2023-11-04T15:15:25.876 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-04T15:15:25.877 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2023-11-04_14:52:48-smoke-reef-release-distro-default-smithi/7447748 --description smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap s3tests-branch supported-random-distro$/{centos_latest} tasks/{0-install test/libcephfs_interface_tests}} --name yuriw-2023-11-04_14:52:48-smoke-reef-release-distro-default-smithi --verbose --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2023-11-04_14:52:48-smoke-reef-release-distro-default-smithi/7447748/orig.config.yaml 2023-11-04T15:15:25.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T15:15:25.995 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-11-04_14:52:48-smoke-reef-release-distro-default-smithi/7447748 branch: reef-release description: smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap s3tests-branch supported-random-distro$/{centos_latest} tasks/{0-install test/libcephfs_interface_tests}} email: yweinste@redhat.com first_in_suite: false job_id: '7447748' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-11-04_14:52:48-smoke-reef-release-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 2 size: 10 - machine: cpus: 1 disk: 40 ram: 8000 volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: reef-release ceph: conf: client: debug client: 20 debug ms: 1 mds: debug mds: 20 debug ms: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: f7e9f9af51acf98e0ccc3037487018e4ae40caa5 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: f7e9f9af51acf98e0ccc3037487018e4ae40caa5 s3tests: force-branch: ceph-reef thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef-release sha1: f7e9f9af51acf98e0ccc3037487018e4ae40caa5 owner: scheduled_yuriw@teuthology priority: 71 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mds.a - mgr.x - osd.0 - osd.1 - - mon.b - mds.b - mon.c - mgr.y - osd.2 - osd.3 - - client.0 seed: 1380 sha1: f7e9f9af51acf98e0ccc3037487018e4ae40caa5 sleep_before_teardown: 0 subset: 111/120000 suite: smoke suite_branch: reef-release suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_f7e9f9af51acf98e0ccc3037487018e4ae40caa5/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: f7e9f9af51acf98e0ccc3037487018e4ae40caa5 targets: smithi019.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDUF6GhI9UdAVsAuoE7taXLXG9X55/PpxG0EzdDfjrGV973BZVbJQjP7zdZwIRFQ1Kc60DvJydDHIr7yoMRXOxY= smithi096.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK5l3tDH2VVqynCSWKBpotIfAusQCpStCcRal/vwmwL8eKhohkIs8Xg0Ebt25Q8nPiv3D8BGGaNX6ki/mdyWg+s= smithi130.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBUw1R0UBohkkCAXVi0fUzIBoX9wBq68kEPkBOfBr2PKB2ER0yAJSAO7f2znVl7GMLRro6CEtxtEJ3rgN7i2RLg= tasks: - install: cleanup: true - ceph: null - ceph-fuse: null - workunit: clients: client.0: - libcephfs/test.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 6899cd26fceddb2fec83dc1a1349394b28c8998e timestamp: 2023-11-04_14:52:48 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3084822 2023-11-04T15:15:25.995 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_f7e9f9af51acf98e0ccc3037487018e4ae40caa5/qa; will attempt to use it 2023-11-04T15:15:25.996 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_f7e9f9af51acf98e0ccc3037487018e4ae40caa5/qa/tasks 2023-11-04T15:15:25.997 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-04T15:15:25.998 INFO:teuthology.task.internal:Checking packages... 2023-11-04T15:15:26.022 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'f7e9f9af51acf98e0ccc3037487018e4ae40caa5' 2023-11-04T15:15:26.023 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-04T15:15:26.023 INFO:teuthology.packaging:ref: None 2023-11-04T15:15:26.024 INFO:teuthology.packaging:tag: None 2023-11-04T15:15:26.024 INFO:teuthology.packaging:branch: reef-release 2023-11-04T15:15:26.024 INFO:teuthology.packaging:sha1: f7e9f9af51acf98e0ccc3037487018e4ae40caa5 2023-11-04T15:15:26.024 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef-release 2023-11-04T15:15:26.245 INFO:teuthology.task.internal:Found packages for ceph version 18.2.0-1181.gf7e9f9af 2023-11-04T15:15:26.246 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-04T15:15:26.253 INFO:teuthology.task.internal:no buildpackages task found 2023-11-04T15:15:26.253 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-04T15:15:26.259 INFO:teuthology.task.internal:Saving configuration 2023-11-04T15:15:26.272 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-04T15:15:26.278 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-04T15:15:26.304 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi019.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-04_14:52:48-smoke-reef-release-distro-default-smithi/7447748', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 15:10:17.739057', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDUF6GhI9UdAVsAuoE7taXLXG9X55/PpxG0EzdDfjrGV973BZVbJQjP7zdZwIRFQ1Kc60DvJydDHIr7yoMRXOxY='} 2023-11-04T15:15:26.328 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi096.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-04_14:52:48-smoke-reef-release-distro-default-smithi/7447748', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 15:10:17.736686', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK5l3tDH2VVqynCSWKBpotIfAusQCpStCcRal/vwmwL8eKhohkIs8Xg0Ebt25Q8nPiv3D8BGGaNX6ki/mdyWg+s='} 2023-11-04T15:15:26.347 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi130.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-04_14:52:48-smoke-reef-release-distro-default-smithi/7447748', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 15:10:17.734917', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBUw1R0UBohkkCAXVi0fUzIBoX9wBq68kEPkBOfBr2PKB2ER0yAJSAO7f2znVl7GMLRro6CEtxtEJ3rgN7i2RLg='} 2023-11-04T15:15:26.347 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-04T15:15:26.354 INFO:teuthology.task.internal:roles: ubuntu@smithi019.front.sepia.ceph.com - ['mon.a', 'mds.a', 'mgr.x', 'osd.0', 'osd.1'] 2023-11-04T15:15:26.354 INFO:teuthology.task.internal:roles: ubuntu@smithi096.front.sepia.ceph.com - ['mon.b', 'mds.b', 'mon.c', 'mgr.y', 'osd.2', 'osd.3'] 2023-11-04T15:15:26.355 INFO:teuthology.task.internal:roles: ubuntu@smithi130.front.sepia.ceph.com - ['client.0'] 2023-11-04T15:15:26.355 INFO:teuthology.run_tasks:Running task console_log... 2023-11-04T15:15:26.491 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbeb4f0a9d0>, signals=[15]) 2023-11-04T15:15:26.492 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-04T15:15:26.499 INFO:teuthology.task.internal:Opening connections... 2023-11-04T15:15:26.499 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi019.front.sepia.ceph.com 2023-11-04T15:15:26.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T15:15:26.600 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi096.front.sepia.ceph.com 2023-11-04T15:15:26.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T15:15:26.686 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi130.front.sepia.ceph.com 2023-11-04T15:15:26.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T15:15:26.772 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-04T15:15:26.779 DEBUG:teuthology.orchestra.run.smithi019:> uname -m 2023-11-04T15:15:26.798 INFO:teuthology.orchestra.run.smithi019.stdout:x86_64 2023-11-04T15:15:26.798 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release 2023-11-04T15:15:26.856 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream" 2023-11-04T15:15:26.857 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="9" 2023-11-04T15:15:26.857 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos" 2023-11-04T15:15:26.857 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora" 2023-11-04T15:15:26.857 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="9" 2023-11-04T15:15:26.858 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el9" 2023-11-04T15:15:26.858 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-04T15:15:26.858 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31" 2023-11-04T15:15:26.858 INFO:teuthology.orchestra.run.smithi019.stdout:LOGO="fedora-logo-icon" 2023-11-04T15:15:26.859 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-04T15:15:26.859 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/" 2023-11-04T15:15:26.859 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-04T15:15:26.859 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-04T15:15:26.859 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-04T15:15:26.860 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2023-11-04T15:15:26.889 DEBUG:teuthology.orchestra.run.smithi096:> uname -m 2023-11-04T15:15:26.907 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64 2023-11-04T15:15:26.907 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2023-11-04T15:15:26.964 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="CentOS Stream" 2023-11-04T15:15:26.964 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="9" 2023-11-04T15:15:26.964 INFO:teuthology.orchestra.run.smithi096.stdout:ID="centos" 2023-11-04T15:15:26.965 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE="rhel fedora" 2023-11-04T15:15:26.965 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="9" 2023-11-04T15:15:26.965 INFO:teuthology.orchestra.run.smithi096.stdout:PLATFORM_ID="platform:el9" 2023-11-04T15:15:26.965 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-04T15:15:26.965 INFO:teuthology.orchestra.run.smithi096.stdout:ANSI_COLOR="0;31" 2023-11-04T15:15:26.966 INFO:teuthology.orchestra.run.smithi096.stdout:LOGO="fedora-logo-icon" 2023-11-04T15:15:26.966 INFO:teuthology.orchestra.run.smithi096.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-04T15:15:26.966 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://centos.org/" 2023-11-04T15:15:26.966 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-04T15:15:26.966 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-04T15:15:26.967 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-04T15:15:26.967 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2023-11-04T15:15:26.989 DEBUG:teuthology.orchestra.run.smithi130:> uname -m 2023-11-04T15:15:27.007 INFO:teuthology.orchestra.run.smithi130.stdout:x86_64 2023-11-04T15:15:27.008 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release 2023-11-04T15:15:27.065 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="CentOS Stream" 2023-11-04T15:15:27.065 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="9" 2023-11-04T15:15:27.066 INFO:teuthology.orchestra.run.smithi130.stdout:ID="centos" 2023-11-04T15:15:27.066 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE="rhel fedora" 2023-11-04T15:15:27.066 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="9" 2023-11-04T15:15:27.066 INFO:teuthology.orchestra.run.smithi130.stdout:PLATFORM_ID="platform:el9" 2023-11-04T15:15:27.066 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-04T15:15:27.067 INFO:teuthology.orchestra.run.smithi130.stdout:ANSI_COLOR="0;31" 2023-11-04T15:15:27.067 INFO:teuthology.orchestra.run.smithi130.stdout:LOGO="fedora-logo-icon" 2023-11-04T15:15:27.067 INFO:teuthology.orchestra.run.smithi130.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-04T15:15:27.067 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://centos.org/" 2023-11-04T15:15:27.068 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-04T15:15:27.068 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-04T15:15:27.068 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-04T15:15:27.069 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server 2023-11-04T15:15:27.089 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-04T15:15:27.099 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-04T15:15:27.105 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-04T15:15:27.105 DEBUG:teuthology.orchestra.run.smithi019:> test '!' -e /home/ubuntu/cephtest 2023-11-04T15:15:27.108 DEBUG:teuthology.orchestra.run.smithi096:> test '!' -e /home/ubuntu/cephtest 2023-11-04T15:15:27.110 DEBUG:teuthology.orchestra.run.smithi130:> test '!' -e /home/ubuntu/cephtest 2023-11-04T15:15:27.126 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-04T15:15:27.132 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-04T15:15:27.134 DEBUG:teuthology.orchestra.run.smithi019:> test -z $(ls -A /var/lib/ceph) 2023-11-04T15:15:27.166 DEBUG:teuthology.orchestra.run.smithi096:> test -z $(ls -A /var/lib/ceph) 2023-11-04T15:15:27.169 DEBUG:teuthology.orchestra.run.smithi130:> test -z $(ls -A /var/lib/ceph) 2023-11-04T15:15:27.254 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-04T15:15:27.330 INFO:teuthology.run_tasks:Running task kernel... 2023-11-04T15:15:27.344 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-11-04T15:15:27.345 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-11-04T15:15:27.345 DEBUG:teuthology.orchestra.run.smithi019:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-04T15:15:27.346 DEBUG:teuthology.orchestra.run.smithi096:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-04T15:15:27.347 DEBUG:teuthology.orchestra.run.smithi130:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-04T15:15:27.365 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T15:15:27.366 DEBUG:teuthology.orchestra.run.smithi096:> uname -r 2023-11-04T15:15:27.368 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T15:15:27.368 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T15:15:27.369 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2023-11-04T15:15:27.369 DEBUG:teuthology.orchestra.run.smithi130:> uname -r 2023-11-04T15:15:27.423 INFO:teuthology.orchestra.run.smithi096.stdout:5.14.0-361.el9.x86_64 2023-11-04T15:15:27.424 INFO:teuthology.task.kernel:Running kernel on smithi096: 5.14.0-361.el9.x86_64 2023-11-04T15:15:27.424 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum install -y kernel 2023-11-04T15:15:27.426 INFO:teuthology.orchestra.run.smithi130.stdout:5.14.0-361.el9.x86_64 2023-11-04T15:15:27.426 INFO:teuthology.task.kernel:Running kernel on smithi130: 5.14.0-361.el9.x86_64 2023-11-04T15:15:27.426 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum install -y kernel 2023-11-04T15:15:27.428 INFO:teuthology.orchestra.run.smithi019.stdout:5.14.0-361.el9.x86_64 2023-11-04T15:15:27.428 INFO:teuthology.task.kernel:Running kernel on smithi019: 5.14.0-361.el9.x86_64 2023-11-04T15:15:27.428 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum install -y kernel 2023-11-04T15:15:29.531 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS-9 - AppStream 13 MB/s | 6.3 MB 00:00 2023-11-04T15:15:29.558 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS-9 - AppStream 14 MB/s | 6.3 MB 00:00 2023-11-04T15:15:29.594 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS-9 - AppStream 11 MB/s | 6.3 MB 00:00 2023-11-04T15:15:30.920 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS-9 - BaseOS 8.1 MB/s | 2.0 MB 00:00 2023-11-04T15:15:30.946 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS-9 - BaseOS 5.2 MB/s | 2.0 MB 00:00 2023-11-04T15:15:31.275 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS-9 - BaseOS 3.0 MB/s | 2.0 MB 00:00 2023-11-04T15:15:31.702 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 7.9 MB 00:00 2023-11-04T15:15:31.878 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 7.9 MB 00:00 2023-11-04T15:15:32.158 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 7.9 MB 00:00 2023-11-04T15:15:33.688 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - AppStream 23 MB/s | 18 MB 00:00 2023-11-04T15:15:34.000 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - AppStream 22 MB/s | 18 MB 00:00 2023-11-04T15:15:34.497 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - AppStream 10 MB/s | 18 MB 00:01 2023-11-04T15:15:37.943 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - CRB 9.4 MB/s | 5.8 MB 00:00 2023-11-04T15:15:39.138 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - CRB 2.7 MB/s | 5.8 MB 00:02 2023-11-04T15:15:39.379 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 5.8 MB 00:01 2023-11-04T15:15:39.861 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 15 kB 00:00 2023-11-04T15:15:40.547 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 15 kB 00:00 2023-11-04T15:15:40.713 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - Extras packages 72 kB/s | 15 kB 00:00 2023-11-04T15:15:40.904 INFO:teuthology.orchestra.run.smithi130.stdout:Extra Packages for Enterprise Linux 21 MB/s | 19 MB 00:00 2023-11-04T15:15:42.017 INFO:teuthology.orchestra.run.smithi096.stdout:Extra Packages for Enterprise Linux 14 MB/s | 19 MB 00:01 2023-11-04T15:15:42.600 INFO:teuthology.orchestra.run.smithi019.stdout:Extra Packages for Enterprise Linux 11 MB/s | 19 MB 00:01 2023-11-04T15:15:45.520 INFO:teuthology.orchestra.run.smithi130.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2023-11-04T15:15:46.690 INFO:teuthology.orchestra.run.smithi096.stdout:lab-extras 11 kB/s | 1.7 kB 00:00 2023-11-04T15:15:47.297 INFO:teuthology.orchestra.run.smithi019.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2023-11-04T15:15:47.560 INFO:teuthology.orchestra.run.smithi130.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-11-04T15:15:47.561 INFO:teuthology.orchestra.run.smithi130.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-11-04T15:15:47.701 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:15:47.708 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:15:47.708 INFO:teuthology.orchestra.run.smithi130.stdout: Package Architecture Version Repository Size 2023-11-04T15:15:47.709 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:15:47.709 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-11-04T15:15:47.709 INFO:teuthology.orchestra.run.smithi130.stdout: kernel x86_64 5.14.0-378.el9 baseos 5.3 M 2023-11-04T15:15:47.710 INFO:teuthology.orchestra.run.smithi130.stdout:Installing dependencies: 2023-11-04T15:15:47.710 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-core x86_64 5.14.0-378.el9 baseos 20 M 2023-11-04T15:15:47.710 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-modules x86_64 5.14.0-378.el9 baseos 38 M 2023-11-04T15:15:47.711 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-modules-core x86_64 5.14.0-378.el9 baseos 32 M 2023-11-04T15:15:47.711 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:15:47.712 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-11-04T15:15:47.712 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:15:47.712 INFO:teuthology.orchestra.run.smithi130.stdout:Install 4 Packages 2023-11-04T15:15:47.713 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:15:47.713 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 95 M 2023-11-04T15:15:47.713 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 120 M 2023-11-04T15:15:47.714 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-11-04T15:15:48.754 INFO:teuthology.orchestra.run.smithi096.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-11-04T15:15:48.754 INFO:teuthology.orchestra.run.smithi096.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-11-04T15:15:48.871 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:15:48.882 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:15:48.882 INFO:teuthology.orchestra.run.smithi096.stdout: Package Architecture Version Repository Size 2023-11-04T15:15:48.882 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:15:48.883 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2023-11-04T15:15:48.883 INFO:teuthology.orchestra.run.smithi096.stdout: kernel x86_64 5.14.0-378.el9 baseos 5.3 M 2023-11-04T15:15:48.883 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2023-11-04T15:15:48.883 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-core x86_64 5.14.0-378.el9 baseos 20 M 2023-11-04T15:15:48.883 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-modules x86_64 5.14.0-378.el9 baseos 38 M 2023-11-04T15:15:48.884 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-modules-core x86_64 5.14.0-378.el9 baseos 32 M 2023-11-04T15:15:48.884 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:15:48.884 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2023-11-04T15:15:48.884 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:15:48.884 INFO:teuthology.orchestra.run.smithi096.stdout:Install 4 Packages 2023-11-04T15:15:48.885 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:15:48.885 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 95 M 2023-11-04T15:15:48.885 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 120 M 2023-11-04T15:15:48.886 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2023-11-04T15:15:49.265 INFO:teuthology.orchestra.run.smithi096.stdout:(1/4): kernel-5.14.0-378.el9.x86_64.rpm 16 MB/s | 5.3 MB 00:00 2023-11-04T15:15:49.437 INFO:teuthology.orchestra.run.smithi019.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-11-04T15:15:49.437 INFO:teuthology.orchestra.run.smithi019.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-11-04T15:15:49.518 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:15:49.524 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:15:49.524 INFO:teuthology.orchestra.run.smithi019.stdout: Package Architecture Version Repository Size 2023-11-04T15:15:49.524 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:15:49.525 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2023-11-04T15:15:49.525 INFO:teuthology.orchestra.run.smithi019.stdout: kernel x86_64 5.14.0-378.el9 baseos 5.3 M 2023-11-04T15:15:49.525 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2023-11-04T15:15:49.525 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-core x86_64 5.14.0-378.el9 baseos 20 M 2023-11-04T15:15:49.525 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules x86_64 5.14.0-378.el9 baseos 38 M 2023-11-04T15:15:49.526 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules-core x86_64 5.14.0-378.el9 baseos 32 M 2023-11-04T15:15:49.526 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:15:49.526 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2023-11-04T15:15:49.526 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:15:49.526 INFO:teuthology.orchestra.run.smithi019.stdout:Install 4 Packages 2023-11-04T15:15:49.527 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:15:49.527 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 95 M 2023-11-04T15:15:49.528 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 120 M 2023-11-04T15:15:49.528 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2023-11-04T15:15:49.597 INFO:teuthology.orchestra.run.smithi130.stdout:(1/4): kernel-5.14.0-378.el9.x86_64.rpm 3.0 MB/s | 5.3 MB 00:01 2023-11-04T15:15:49.732 INFO:teuthology.orchestra.run.smithi096.stdout:(2/4): kernel-core-5.14.0-378.el9.x86_64.rpm 25 MB/s | 20 MB 00:00 2023-11-04T15:15:50.122 INFO:teuthology.orchestra.run.smithi130.stdout:(2/4): kernel-core-5.14.0-378.el9.x86_64.rpm 8.8 MB/s | 20 MB 00:02 2023-11-04T15:15:50.157 INFO:teuthology.orchestra.run.smithi096.stdout:(3/4): kernel-modules-5.14.0-378.el9.x86_64.rpm 31 MB/s | 38 MB 00:01 2023-11-04T15:15:50.600 INFO:teuthology.orchestra.run.smithi096.stdout:(4/4): kernel-modules-core-5.14.0-378.el9.x86_6 24 MB/s | 32 MB 00:01 2023-11-04T15:15:50.600 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:15:50.600 INFO:teuthology.orchestra.run.smithi096.stdout:Total 55 MB/s | 95 MB 00:01 2023-11-04T15:15:50.747 INFO:teuthology.orchestra.run.smithi130.stdout:(3/4): kernel-modules-core-5.14.0-378.el9.x86_6 28 MB/s | 32 MB 00:01 2023-11-04T15:15:50.890 INFO:teuthology.orchestra.run.smithi019.stdout:(1/4): kernel-5.14.0-378.el9.x86_64.rpm 4.1 MB/s | 5.3 MB 00:01 2023-11-04T15:15:51.439 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2023-11-04T15:15:51.522 INFO:teuthology.orchestra.run.smithi130.stdout:(4/4): kernel-modules-5.14.0-378.el9.x86_64.rpm 10 MB/s | 38 MB 00:03 2023-11-04T15:15:51.523 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:15:51.523 INFO:teuthology.orchestra.run.smithi130.stdout:Total 25 MB/s | 95 MB 00:03 2023-11-04T15:15:51.802 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2023-11-04T15:15:51.802 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2023-11-04T15:15:52.299 INFO:teuthology.orchestra.run.smithi019.stdout:(2/4): kernel-core-5.14.0-378.el9.x86_64.rpm 7.4 MB/s | 20 MB 00:02 2023-11-04T15:15:52.363 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-11-04T15:15:52.706 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-11-04T15:15:52.707 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-11-04T15:15:53.110 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2023-11-04T15:15:53.110 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2023-11-04T15:15:53.979 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-11-04T15:15:53.979 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-11-04T15:15:54.440 INFO:teuthology.orchestra.run.smithi019.stdout:(3/4): kernel-modules-5.14.0-378.el9.x86_64.rpm 7.7 MB/s | 38 MB 00:04 2023-11-04T15:15:55.025 INFO:teuthology.orchestra.run.smithi019.stdout:(4/4): kernel-modules-core-5.14.0-378.el9.x86_6 7.8 MB/s | 32 MB 00:04 2023-11-04T15:15:55.026 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:15:55.026 INFO:teuthology.orchestra.run.smithi019.stdout:Total 17 MB/s | 95 MB 00:05 2023-11-04T15:15:55.728 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2023-11-04T15:15:55.908 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2023-11-04T15:15:56.336 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2023-11-04T15:15:56.336 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2023-11-04T15:15:56.342 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : kernel-modules-core-5.14.0-378.el9.x86_64 1/4 2023-11-04T15:15:56.476 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-04T15:15:56.622 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-11-04T15:15:57.256 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : kernel-modules-core-5.14.0-378.el9.x86_64 1/4 2023-11-04T15:15:57.390 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-04T15:15:57.703 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2023-11-04T15:15:57.704 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2023-11-04T15:15:59.236 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-04T15:15:59.418 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-04T15:16:00.127 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-04T15:16:00.318 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-04T15:16:00.469 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2023-11-04T15:16:01.124 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-modules-core-5.14.0-378.el9.x86_64 1/4 2023-11-04T15:16:01.259 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-04T15:16:04.018 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-04T15:16:04.149 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : kernel-5.14.0-378.el9.x86_64 4/4 2023-11-04T15:16:04.158 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-04T15:16:04.326 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-04T15:16:04.941 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-04T15:16:05.060 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : kernel-5.14.0-378.el9.x86_64 4/4 2023-11-04T15:16:08.788 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-11-04T15:16:09.279 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-04T15:16:09.401 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-5.14.0-378.el9.x86_64 4/4 2023-11-04T15:16:09.666 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-11-04T15:16:14.388 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-11-04T15:16:37.802 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 4/4 2023-11-04T15:16:37.844 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 4/4 2023-11-04T15:16:38.266 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: kernel-5.14.0-378.el9.x86_64 4/4 2023-11-04T15:16:38.267 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : kernel-5.14.0-378.el9.x86_64 1/4 2023-11-04T15:16:38.267 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-04T15:16:38.267 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-04T15:16:38.483 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 4/4 2023-11-04T15:16:38.525 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 4/4 2023-11-04T15:16:38.681 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-11-04T15:16:38.681 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:16:38.681 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2023-11-04T15:16:38.682 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-5.14.0-378.el9.x86_64 2023-11-04T15:16:38.682 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-core-5.14.0-378.el9.x86_64 2023-11-04T15:16:38.682 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-modules-5.14.0-378.el9.x86_64 2023-11-04T15:16:38.682 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-modules-core-5.14.0-378.el9.x86_64 2023-11-04T15:16:38.683 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:16:38.683 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:16:38.961 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: kernel-5.14.0-378.el9.x86_64 4/4 2023-11-04T15:16:38.961 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : kernel-5.14.0-378.el9.x86_64 1/4 2023-11-04T15:16:38.961 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-04T15:16:38.962 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-04T15:16:39.149 DEBUG:teuthology.orchestra.run.smithi096:> rpm -q kernel | sort -rV | head -n 1 2023-11-04T15:16:39.290 INFO:teuthology.orchestra.run.smithi096.stdout:kernel-5.14.0-378.el9.x86_64 2023-11-04T15:16:39.290 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-11-04T15:16:39.290 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-378.el9.x86_64 2023-11-04T15:16:39.291 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-04T15:16:39.291 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-04T15:16:39.291 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-11-04T15:16:39.291 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi096.front.sepia.ceph.com, path=None, version=distro) 2023-11-04T15:16:39.292 DEBUG:teuthology.orchestra.run.smithi096:> rpm -q kernel | sort -rV | head -n 1 2023-11-04T15:16:39.386 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-11-04T15:16:39.387 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:16:39.387 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-11-04T15:16:39.387 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-5.14.0-378.el9.x86_64 2023-11-04T15:16:39.387 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-core-5.14.0-378.el9.x86_64 2023-11-04T15:16:39.387 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-modules-5.14.0-378.el9.x86_64 2023-11-04T15:16:39.388 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-modules-core-5.14.0-378.el9.x86_64 2023-11-04T15:16:39.388 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:16:39.388 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:16:39.408 INFO:teuthology.orchestra.run.smithi096.stdout:kernel-5.14.0-378.el9.x86_64 2023-11-04T15:16:39.408 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-11-04T15:16:39.409 DEBUG:teuthology.orchestra.run.smithi096:> sudo rpm -qi grub2-tools 2023-11-04T15:16:39.442 INFO:teuthology.orchestra.run.smithi096.stdout:Name : grub2-tools 2023-11-04T15:16:39.442 INFO:teuthology.orchestra.run.smithi096.stdout:Epoch : 1 2023-11-04T15:16:39.443 INFO:teuthology.orchestra.run.smithi096.stdout:Version : 2.06 2023-11-04T15:16:39.443 INFO:teuthology.orchestra.run.smithi096.stdout:Release : 68.el9 2023-11-04T15:16:39.443 INFO:teuthology.orchestra.run.smithi096.stdout:Architecture: x86_64 2023-11-04T15:16:39.443 INFO:teuthology.orchestra.run.smithi096.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-04T15:16:39.444 INFO:teuthology.orchestra.run.smithi096.stdout:Group : Unspecified 2023-11-04T15:16:39.444 INFO:teuthology.orchestra.run.smithi096.stdout:Size : 8264254 2023-11-04T15:16:39.444 INFO:teuthology.orchestra.run.smithi096.stdout:License : GPLv3+ 2023-11-04T15:16:39.444 INFO:teuthology.orchestra.run.smithi096.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-04T15:16:39.444 INFO:teuthology.orchestra.run.smithi096.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-04T15:16:39.445 INFO:teuthology.orchestra.run.smithi096.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-04T15:16:39.445 INFO:teuthology.orchestra.run.smithi096.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-04T15:16:39.445 INFO:teuthology.orchestra.run.smithi096.stdout:Packager : builder@centos.org 2023-11-04T15:16:39.445 INFO:teuthology.orchestra.run.smithi096.stdout:Vendor : CentOS 2023-11-04T15:16:39.445 INFO:teuthology.orchestra.run.smithi096.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-04T15:16:39.446 INFO:teuthology.orchestra.run.smithi096.stdout:Summary : Support tools for GRUB. 2023-11-04T15:16:39.446 INFO:teuthology.orchestra.run.smithi096.stdout:Description : 2023-11-04T15:16:39.446 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:16:39.446 INFO:teuthology.orchestra.run.smithi096.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-04T15:16:39.446 INFO:teuthology.orchestra.run.smithi096.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-04T15:16:39.447 INFO:teuthology.orchestra.run.smithi096.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-04T15:16:39.447 INFO:teuthology.orchestra.run.smithi096.stdout:hardware devices. 2023-11-04T15:16:39.447 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:16:39.447 INFO:teuthology.orchestra.run.smithi096.stdout:This subpackage provides tools for support of all platforms. 2023-11-04T15:16:39.448 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-04T15:16:39.448 INFO:teuthology.task.kernel:Updating grub on smithi096 to boot 5.14.0-378.el9.x86_64 2023-11-04T15:16:39.449 DEBUG:teuthology.orchestra.run.smithi096:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-04T15:16:39.883 DEBUG:teuthology.orchestra.run.smithi130:> rpm -q kernel | sort -rV | head -n 1 2023-11-04T15:16:40.068 INFO:teuthology.orchestra.run.smithi130.stdout:kernel-5.14.0-378.el9.x86_64 2023-11-04T15:16:40.069 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-11-04T15:16:40.069 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-378.el9.x86_64 2023-11-04T15:16:40.069 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-04T15:16:40.069 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-04T15:16:40.069 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-11-04T15:16:40.070 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi130.front.sepia.ceph.com, path=None, version=distro) 2023-11-04T15:16:40.070 DEBUG:teuthology.orchestra.run.smithi130:> rpm -q kernel | sort -rV | head -n 1 2023-11-04T15:16:40.096 INFO:teuthology.orchestra.run.smithi096.stderr:Generating grub configuration file ... 2023-11-04T15:16:40.186 INFO:teuthology.orchestra.run.smithi130.stdout:kernel-5.14.0-378.el9.x86_64 2023-11-04T15:16:40.187 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-11-04T15:16:40.187 DEBUG:teuthology.orchestra.run.smithi130:> sudo rpm -qi grub2-tools 2023-11-04T15:16:40.227 INFO:teuthology.orchestra.run.smithi130.stdout:Name : grub2-tools 2023-11-04T15:16:40.227 INFO:teuthology.orchestra.run.smithi130.stdout:Epoch : 1 2023-11-04T15:16:40.227 INFO:teuthology.orchestra.run.smithi130.stdout:Version : 2.06 2023-11-04T15:16:40.228 INFO:teuthology.orchestra.run.smithi130.stdout:Release : 68.el9 2023-11-04T15:16:40.228 INFO:teuthology.orchestra.run.smithi130.stdout:Architecture: x86_64 2023-11-04T15:16:40.228 INFO:teuthology.orchestra.run.smithi130.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-04T15:16:40.228 INFO:teuthology.orchestra.run.smithi130.stdout:Group : Unspecified 2023-11-04T15:16:40.228 INFO:teuthology.orchestra.run.smithi130.stdout:Size : 8264254 2023-11-04T15:16:40.229 INFO:teuthology.orchestra.run.smithi130.stdout:License : GPLv3+ 2023-11-04T15:16:40.229 INFO:teuthology.orchestra.run.smithi130.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-04T15:16:40.229 INFO:teuthology.orchestra.run.smithi130.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-04T15:16:40.229 INFO:teuthology.orchestra.run.smithi130.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-04T15:16:40.230 INFO:teuthology.orchestra.run.smithi130.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-04T15:16:40.230 INFO:teuthology.orchestra.run.smithi130.stdout:Packager : builder@centos.org 2023-11-04T15:16:40.230 INFO:teuthology.orchestra.run.smithi130.stdout:Vendor : CentOS 2023-11-04T15:16:40.230 INFO:teuthology.orchestra.run.smithi130.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-04T15:16:40.230 INFO:teuthology.orchestra.run.smithi130.stdout:Summary : Support tools for GRUB. 2023-11-04T15:16:40.231 INFO:teuthology.orchestra.run.smithi130.stdout:Description : 2023-11-04T15:16:40.231 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:16:40.231 INFO:teuthology.orchestra.run.smithi130.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-04T15:16:40.231 INFO:teuthology.orchestra.run.smithi130.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-04T15:16:40.232 INFO:teuthology.orchestra.run.smithi130.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-04T15:16:40.232 INFO:teuthology.orchestra.run.smithi130.stdout:hardware devices. 2023-11-04T15:16:40.232 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:16:40.232 INFO:teuthology.orchestra.run.smithi130.stdout:This subpackage provides tools for support of all platforms. 2023-11-04T15:16:40.233 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-04T15:16:40.233 INFO:teuthology.task.kernel:Updating grub on smithi130 to boot 5.14.0-378.el9.x86_64 2023-11-04T15:16:40.234 DEBUG:teuthology.orchestra.run.smithi130:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-04T15:16:40.898 INFO:teuthology.orchestra.run.smithi130.stderr:Generating grub configuration file ... 2023-11-04T15:16:41.478 INFO:teuthology.orchestra.run.smithi096.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-04T15:16:41.526 INFO:teuthology.orchestra.run.smithi096.stderr:done 2023-11-04T15:16:41.529 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2023-11-04T15:16:41.545 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.od6FnwVzcz 2023-11-04T15:16:41.546 DEBUG:teuthology.orchestra.run.smithi096:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.od6FnwVzcz 2023-11-04T15:16:41.614 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.od6FnwVzcz 2023-11-04T15:16:41.750 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.od6FnwVzcz is 6KB 2023-11-04T15:16:41.799 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.od6FnwVzcz 2023-11-04T15:16:41.813 DEBUG:teuthology.orchestra.run.smithi096:> sudo /bin/ls /boot/loader/entries || true 2023-11-04T15:16:41.878 INFO:teuthology.orchestra.run.smithi096.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-04T15:16:41.878 INFO:teuthology.orchestra.run.smithi096.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-04T15:16:41.879 INFO:teuthology.orchestra.run.smithi096.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-04T15:16:41.879 INFO:teuthology.orchestra.run.smithi096.stdout:15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64.conf 2023-11-04T15:16:41.882 DEBUG:teuthology.orchestra.run.smithi096:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64 2023-11-04T15:16:42.037 DEBUG:teuthology.orchestra.run.smithi096:> sudo shutdown -r now 2023-11-04T15:16:42.281 INFO:teuthology.orchestra.run.smithi130.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-04T15:16:42.336 INFO:teuthology.orchestra.run.smithi130.stderr:done 2023-11-04T15:16:42.339 DEBUG:teuthology.orchestra.run.smithi130:> mktemp 2023-11-04T15:16:42.354 INFO:teuthology.orchestra.run.smithi130.stdout:/tmp/tmp.BrkPSyrmN6 2023-11-04T15:16:42.355 DEBUG:teuthology.orchestra.run.smithi130:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.BrkPSyrmN6 2023-11-04T15:16:42.423 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0666 /tmp/tmp.BrkPSyrmN6 2023-11-04T15:16:42.569 DEBUG:teuthology.orchestra.remote:smithi130:/tmp/tmp.BrkPSyrmN6 is 6KB 2023-11-04T15:16:42.619 DEBUG:teuthology.orchestra.run.smithi130:> rm -fr /tmp/tmp.BrkPSyrmN6 2023-11-04T15:16:42.633 DEBUG:teuthology.orchestra.run.smithi130:> sudo /bin/ls /boot/loader/entries || true 2023-11-04T15:16:42.698 INFO:teuthology.orchestra.run.smithi130.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-04T15:16:42.699 INFO:teuthology.orchestra.run.smithi130.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-04T15:16:42.699 INFO:teuthology.orchestra.run.smithi130.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-04T15:16:42.699 INFO:teuthology.orchestra.run.smithi130.stdout:15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64.conf 2023-11-04T15:16:42.700 DEBUG:teuthology.orchestra.run.smithi130:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64 2023-11-04T15:16:42.853 DEBUG:teuthology.orchestra.run.smithi130:> sudo shutdown -r now 2023-11-04T15:16:44.720 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-core-5.14.0-378.el9.x86_64 4/4 2023-11-04T15:16:44.766 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-modules-5.14.0-378.el9.x86_64 4/4 2023-11-04T15:16:45.167 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-5.14.0-378.el9.x86_64 4/4 2023-11-04T15:16:45.168 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-5.14.0-378.el9.x86_64 1/4 2023-11-04T15:16:45.168 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-core-5.14.0-378.el9.x86_64 2/4 2023-11-04T15:16:45.168 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-modules-5.14.0-378.el9.x86_64 3/4 2023-11-04T15:16:45.576 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-modules-core-5.14.0-378.el9.x86_64 4/4 2023-11-04T15:16:45.576 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:16:45.576 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2023-11-04T15:16:45.577 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-5.14.0-378.el9.x86_64 2023-11-04T15:16:45.577 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-core-5.14.0-378.el9.x86_64 2023-11-04T15:16:45.577 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules-5.14.0-378.el9.x86_64 2023-11-04T15:16:45.578 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules-core-5.14.0-378.el9.x86_64 2023-11-04T15:16:45.578 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:16:45.578 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:16:46.089 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q kernel | sort -rV | head -n 1 2023-11-04T15:16:46.234 INFO:teuthology.orchestra.run.smithi019.stdout:kernel-5.14.0-378.el9.x86_64 2023-11-04T15:16:46.235 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-11-04T15:16:46.235 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-378.el9.x86_64 2023-11-04T15:16:46.236 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-04T15:16:46.236 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-04T15:16:46.236 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-11-04T15:16:46.237 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi019.front.sepia.ceph.com, path=None, version=distro) 2023-11-04T15:16:46.237 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q kernel | sort -rV | head -n 1 2023-11-04T15:16:46.359 INFO:teuthology.orchestra.run.smithi019.stdout:kernel-5.14.0-378.el9.x86_64 2023-11-04T15:16:46.360 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-378.el9.x86_64 2023-11-04T15:16:46.360 DEBUG:teuthology.orchestra.run.smithi019:> sudo rpm -qi grub2-tools 2023-11-04T15:16:46.402 INFO:teuthology.orchestra.run.smithi019.stdout:Name : grub2-tools 2023-11-04T15:16:46.403 INFO:teuthology.orchestra.run.smithi019.stdout:Epoch : 1 2023-11-04T15:16:46.403 INFO:teuthology.orchestra.run.smithi019.stdout:Version : 2.06 2023-11-04T15:16:46.403 INFO:teuthology.orchestra.run.smithi019.stdout:Release : 68.el9 2023-11-04T15:16:46.404 INFO:teuthology.orchestra.run.smithi019.stdout:Architecture: x86_64 2023-11-04T15:16:46.404 INFO:teuthology.orchestra.run.smithi019.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-04T15:16:46.404 INFO:teuthology.orchestra.run.smithi019.stdout:Group : Unspecified 2023-11-04T15:16:46.405 INFO:teuthology.orchestra.run.smithi019.stdout:Size : 8264254 2023-11-04T15:16:46.405 INFO:teuthology.orchestra.run.smithi019.stdout:License : GPLv3+ 2023-11-04T15:16:46.405 INFO:teuthology.orchestra.run.smithi019.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-04T15:16:46.406 INFO:teuthology.orchestra.run.smithi019.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-04T15:16:46.406 INFO:teuthology.orchestra.run.smithi019.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-04T15:16:46.407 INFO:teuthology.orchestra.run.smithi019.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-04T15:16:46.407 INFO:teuthology.orchestra.run.smithi019.stdout:Packager : builder@centos.org 2023-11-04T15:16:46.407 INFO:teuthology.orchestra.run.smithi019.stdout:Vendor : CentOS 2023-11-04T15:16:46.408 INFO:teuthology.orchestra.run.smithi019.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-04T15:16:46.408 INFO:teuthology.orchestra.run.smithi019.stdout:Summary : Support tools for GRUB. 2023-11-04T15:16:46.409 INFO:teuthology.orchestra.run.smithi019.stdout:Description : 2023-11-04T15:16:46.409 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:16:46.409 INFO:teuthology.orchestra.run.smithi019.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-04T15:16:46.410 INFO:teuthology.orchestra.run.smithi019.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-04T15:16:46.410 INFO:teuthology.orchestra.run.smithi019.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-04T15:16:46.410 INFO:teuthology.orchestra.run.smithi019.stdout:hardware devices. 2023-11-04T15:16:46.411 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:16:46.411 INFO:teuthology.orchestra.run.smithi019.stdout:This subpackage provides tools for support of all platforms. 2023-11-04T15:16:46.412 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-04T15:16:46.413 INFO:teuthology.task.kernel:Updating grub on smithi019 to boot 5.14.0-378.el9.x86_64 2023-11-04T15:16:46.413 DEBUG:teuthology.orchestra.run.smithi019:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-04T15:16:47.156 INFO:teuthology.orchestra.run.smithi019.stderr:Generating grub configuration file ... 2023-11-04T15:16:48.538 INFO:teuthology.orchestra.run.smithi019.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-04T15:16:48.585 INFO:teuthology.orchestra.run.smithi019.stderr:done 2023-11-04T15:16:48.587 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2023-11-04T15:16:48.603 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.PPVaSUgRiK 2023-11-04T15:16:48.603 DEBUG:teuthology.orchestra.run.smithi019:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.PPVaSUgRiK 2023-11-04T15:16:48.688 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.PPVaSUgRiK 2023-11-04T15:16:48.806 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.PPVaSUgRiK is 6KB 2023-11-04T15:16:48.854 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.PPVaSUgRiK 2023-11-04T15:16:48.869 DEBUG:teuthology.orchestra.run.smithi019:> sudo /bin/ls /boot/loader/entries || true 2023-11-04T15:16:48.938 INFO:teuthology.orchestra.run.smithi019.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-04T15:16:48.938 INFO:teuthology.orchestra.run.smithi019.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-04T15:16:48.938 INFO:teuthology.orchestra.run.smithi019.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-04T15:16:48.939 INFO:teuthology.orchestra.run.smithi019.stdout:15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64.conf 2023-11-04T15:16:48.940 DEBUG:teuthology.orchestra.run.smithi019:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-378.el9.x86_64 2023-11-04T15:16:49.081 DEBUG:teuthology.orchestra.run.smithi019:> sudo shutdown -r now 2023-11-04T15:17:12.062 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-11-04T15:17:12.063 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2023-11-04T15:17:12.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T15:17:12.856 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-11-04T15:17:12.857 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-11-04T15:17:12.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T15:17:19.088 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-11-04T15:17:19.088 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2023-11-04T15:17:19.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T15:17:30.618 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2023-11-04T15:17:31.390 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.130 2023-11-04T15:17:37.530 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.19 2023-11-04T15:17:39.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2023-11-04T15:17:39.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T15:17:40.392 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-11-04T15:17:40.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T15:17:42.682 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2023-11-04T15:17:43.454 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.130 2023-11-04T15:17:46.534 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2023-11-04T15:17:46.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T15:17:54.690 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2023-11-04T15:17:54.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T15:17:55.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-11-04T15:17:55.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T15:18:13.883 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.130 2023-11-04T15:18:26.453 DEBUG:teuthology.orchestra.run.smithi096:> true 2023-11-04T15:18:26.812 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2023-11-04T15:18:26.812 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-378.el9.x86_64"... 2023-11-04T15:18:26.812 DEBUG:teuthology.orchestra.run.smithi096:> uname -r 2023-11-04T15:18:26.827 INFO:teuthology.orchestra.run.smithi096.stdout:5.14.0-378.el9.x86_64 2023-11-04T15:18:26.828 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-378.el9.x86_64 vs 5.14.0-378.el9.x86_64 2023-11-04T15:18:26.828 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-04T15:18:26.829 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-04T15:18:27.830 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-11-04T15:18:27.831 DEBUG:teuthology.orchestra.run.smithi096:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-04T15:18:27.917 INFO:teuthology.orchestra.run.smithi096.stdout:ttyS1 2023-11-04T15:18:27.955 DEBUG:teuthology.parallel:result is None 2023-11-04T15:18:28.884 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-11-04T15:18:28.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T15:18:29.226 DEBUG:teuthology.orchestra.run.smithi130:> true 2023-11-04T15:18:29.606 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-11-04T15:18:29.606 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-378.el9.x86_64"... 2023-11-04T15:18:29.607 DEBUG:teuthology.orchestra.run.smithi130:> uname -r 2023-11-04T15:18:29.621 INFO:teuthology.orchestra.run.smithi130.stdout:5.14.0-378.el9.x86_64 2023-11-04T15:18:29.621 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-378.el9.x86_64 vs 5.14.0-378.el9.x86_64 2023-11-04T15:18:29.622 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-04T15:18:29.622 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-04T15:18:30.623 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2023-11-04T15:18:30.623 DEBUG:teuthology.orchestra.run.smithi130:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-04T15:18:30.690 INFO:teuthology.orchestra.run.smithi130.stdout:ttyS1 2023-11-04T15:18:30.734 DEBUG:teuthology.parallel:result is None 2023-11-04T15:18:46.537 DEBUG:teuthology.orchestra.remote:timed out 2023-11-04T15:18:58.539 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2023-11-04T15:18:58.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T15:18:58.898 DEBUG:teuthology.orchestra.run.smithi019:> true 2023-11-04T15:18:59.273 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2023-11-04T15:18:59.273 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-378.el9.x86_64"... 2023-11-04T15:18:59.273 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2023-11-04T15:18:59.288 INFO:teuthology.orchestra.run.smithi019.stdout:5.14.0-378.el9.x86_64 2023-11-04T15:18:59.289 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-378.el9.x86_64 vs 5.14.0-378.el9.x86_64 2023-11-04T15:18:59.289 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-04T15:18:59.289 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-04T15:19:00.290 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-04T15:19:00.291 DEBUG:teuthology.orchestra.run.smithi019:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-04T15:19:00.347 INFO:teuthology.orchestra.run.smithi019.stdout:ttyS1 2023-11-04T15:19:00.384 DEBUG:teuthology.parallel:result is None 2023-11-04T15:19:00.385 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-04T15:19:00.393 INFO:teuthology.task.internal:Creating test directory... 2023-11-04T15:19:00.394 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-04T15:19:00.396 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-04T15:19:00.399 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-04T15:19:00.418 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-04T15:19:00.425 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-04T15:19:00.463 INFO:teuthology.task.internal:Creating archive directory... 2023-11-04T15:19:00.464 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-04T15:19:00.467 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-04T15:19:00.469 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-04T15:19:00.500 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-04T15:19:00.507 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-04T15:19:00.507 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-04T15:19:00.534 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-04T15:19:00.538 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-04T15:19:00.568 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T15:19:00.575 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T15:19:00.581 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T15:19:00.585 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T15:19:00.589 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T15:19:00.595 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T15:19:00.597 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-04T15:19:00.604 INFO:teuthology.task.internal:Configuring sudo... 2023-11-04T15:19:00.604 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-04T15:19:00.632 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-04T15:19:00.635 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-04T15:19:00.665 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-04T15:19:00.677 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-04T15:19:00.677 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-04T15:19:00.705 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-04T15:19:00.708 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-04T15:19:00.723 DEBUG:teuthology.orchestra.run.smithi019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-04T15:19:00.804 DEBUG:teuthology.orchestra.run.smithi019:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-04T15:19:00.857 DEBUG:teuthology.orchestra.run.smithi019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-04T15:19:00.940 DEBUG:teuthology.orchestra.run.smithi019:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-04T15:19:00.987 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-04T15:19:00.987 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-04T15:19:01.059 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-04T15:19:01.104 DEBUG:teuthology.orchestra.run.smithi096:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-04T15:19:01.170 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-04T15:19:01.214 DEBUG:teuthology.orchestra.run.smithi096:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-04T15:19:01.256 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-11-04T15:19:01.257 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-04T15:19:01.324 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-04T15:19:01.369 DEBUG:teuthology.orchestra.run.smithi130:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-04T15:19:01.426 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-04T15:19:01.511 DEBUG:teuthology.orchestra.run.smithi130:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-04T15:19:01.555 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-11-04T15:19:01.555 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-04T15:19:01.624 DEBUG:teuthology.orchestra.run.smithi019:> sudo service rsyslog restart 2023-11-04T15:19:01.627 DEBUG:teuthology.orchestra.run.smithi096:> sudo service rsyslog restart 2023-11-04T15:19:01.629 DEBUG:teuthology.orchestra.run.smithi130:> sudo service rsyslog restart 2023-11-04T15:19:01.676 INFO:teuthology.orchestra.run.smithi019.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-04T15:19:01.678 INFO:teuthology.orchestra.run.smithi096.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-04T15:19:01.715 INFO:teuthology.orchestra.run.smithi130.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-04T15:19:02.176 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-04T15:19:02.186 INFO:teuthology.task.internal:Starting timer... 2023-11-04T15:19:02.187 INFO:teuthology.run_tasks:Running task pcp... 2023-11-04T15:19:02.199 INFO:teuthology.run_tasks:Running task selinux... 2023-11-04T15:19:02.211 DEBUG:teuthology.orchestra.run.smithi019:> sudo service auditd rotate 2023-11-04T15:19:02.270 INFO:teuthology.orchestra.run.smithi019.stdout:Rotating logs: 2023-11-04T15:19:02.272 DEBUG:teuthology.orchestra.run.smithi096:> sudo service auditd rotate 2023-11-04T15:19:02.364 INFO:teuthology.orchestra.run.smithi096.stdout:Rotating logs: 2023-11-04T15:19:02.367 DEBUG:teuthology.orchestra.run.smithi130:> sudo service auditd rotate 2023-11-04T15:19:02.430 INFO:teuthology.orchestra.run.smithi130.stdout:Rotating logs: 2023-11-04T15:19:02.432 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-04T15:19:02.433 DEBUG:teuthology.orchestra.run.smithi019:> /usr/sbin/getenforce 2023-11-04T15:19:02.451 INFO:teuthology.orchestra.run.smithi019.stdout:Permissive 2023-11-04T15:19:02.451 DEBUG:teuthology.orchestra.run.smithi096:> /usr/sbin/getenforce 2023-11-04T15:19:02.486 INFO:teuthology.orchestra.run.smithi096.stdout:Permissive 2023-11-04T15:19:02.486 DEBUG:teuthology.orchestra.run.smithi130:> /usr/sbin/getenforce 2023-11-04T15:19:02.506 INFO:teuthology.orchestra.run.smithi130.stdout:Permissive 2023-11-04T15:19:02.506 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi019.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi096.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi130.front.sepia.ceph.com': 'permissive'} 2023-11-04T15:19:02.506 DEBUG:teuthology.orchestra.run.smithi019:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-04T15:19:02.538 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T15:19:02.540 DEBUG:teuthology.orchestra.run.smithi096:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-04T15:19:02.571 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T15:19:02.572 DEBUG:teuthology.orchestra.run.smithi130:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-04T15:19:02.600 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T15:19:02.600 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-04T15:19:02.601 DEBUG:teuthology.orchestra.run.smithi019:> sudo /usr/sbin/setenforce permissive 2023-11-04T15:19:02.637 DEBUG:teuthology.orchestra.run.smithi096:> sudo /usr/sbin/setenforce permissive 2023-11-04T15:19:02.679 DEBUG:teuthology.orchestra.run.smithi130:> sudo /usr/sbin/setenforce permissive 2023-11-04T15:19:02.716 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-04T15:19:02.726 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-04T15:19:02.726 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-04T15:19:02.745 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-04T15:19:02.747 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi019.front.sepia.ceph.com,smithi096.front.sepia.ceph.com,smithi130.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-04T15:24:34.140 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi019.front.sepia.ceph.com'), Remote(name='ubuntu@smithi096.front.sepia.ceph.com'), Remote(name='ubuntu@smithi130.front.sepia.ceph.com')] 2023-11-04T15:24:34.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2023-11-04T15:24:34.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T15:24:34.239 DEBUG:teuthology.orchestra.run.smithi019:> true 2023-11-04T15:24:34.313 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2023-11-04T15:24:34.314 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2023-11-04T15:24:34.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T15:24:34.399 DEBUG:teuthology.orchestra.run.smithi096:> true 2023-11-04T15:24:34.471 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2023-11-04T15:24:34.472 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-11-04T15:24:34.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T15:24:34.557 DEBUG:teuthology.orchestra.run.smithi130:> true 2023-11-04T15:24:34.627 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-11-04T15:24:34.627 INFO:teuthology.run_tasks:Running task clock... 2023-11-04T15:24:34.638 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-04T15:24:34.638 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-04T15:24:34.639 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-04T15:24:34.642 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-04T15:24:34.642 DEBUG:teuthology.orchestra.run.smithi096:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-04T15:24:34.645 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-04T15:24:34.645 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-04T15:24:34.674 INFO:teuthology.orchestra.run.smithi096.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-04T15:24:34.678 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-04T15:24:34.691 INFO:teuthology.orchestra.run.smithi096.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-04T15:24:34.699 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-04T15:24:34.701 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-04T15:24:34.718 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-04T15:24:34.721 INFO:teuthology.orchestra.run.smithi096.stderr:sudo: ntpd: command not found 2023-11-04T15:24:34.734 INFO:teuthology.orchestra.run.smithi096.stdout:506 Cannot talk to daemon 2023-11-04T15:24:34.736 INFO:teuthology.orchestra.run.smithi019.stderr:sudo: ntpd: command not found 2023-11-04T15:24:34.748 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: ntpd: command not found 2023-11-04T15:24:34.751 INFO:teuthology.orchestra.run.smithi096.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-04T15:24:34.754 INFO:teuthology.orchestra.run.smithi019.stdout:506 Cannot talk to daemon 2023-11-04T15:24:34.762 INFO:teuthology.orchestra.run.smithi130.stdout:506 Cannot talk to daemon 2023-11-04T15:24:34.767 INFO:teuthology.orchestra.run.smithi096.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-04T15:24:34.774 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-04T15:24:34.779 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-04T15:24:34.794 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-04T15:24:34.795 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-04T15:24:34.810 INFO:teuthology.orchestra.run.smithi096.stderr:bash: line 1: ntpq: command not found 2023-11-04T15:24:34.814 INFO:teuthology.orchestra.run.smithi096.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-04T15:24:34.814 INFO:teuthology.orchestra.run.smithi096.stdout:=============================================================================== 2023-11-04T15:24:34.814 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T15:24:34.814 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T15:24:34.815 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T15:24:34.815 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T15:24:34.838 INFO:teuthology.orchestra.run.smithi130.stderr:bash: line 1: ntpq: command not found 2023-11-04T15:24:34.841 INFO:teuthology.orchestra.run.smithi130.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-04T15:24:34.841 INFO:teuthology.orchestra.run.smithi130.stdout:=============================================================================== 2023-11-04T15:24:34.841 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T15:24:34.841 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T15:24:34.841 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T15:24:34.842 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T15:24:34.842 INFO:teuthology.orchestra.run.smithi019.stderr:bash: line 1: ntpq: command not found 2023-11-04T15:24:34.845 INFO:teuthology.orchestra.run.smithi019.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-04T15:24:34.845 INFO:teuthology.orchestra.run.smithi019.stdout:=============================================================================== 2023-11-04T15:24:34.846 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T15:24:34.846 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T15:24:34.846 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T15:24:34.846 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T15:24:34.847 INFO:teuthology.run_tasks:Running task install... 2023-11-04T15:24:34.855 DEBUG:teuthology.task.install:project ceph 2023-11-04T15:24:34.856 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f7e9f9af51acf98e0ccc3037487018e4ae40caa5'}} 2023-11-04T15:24:34.856 DEBUG:teuthology.task.install:config {'cleanup': True, 'flavor': 'default', 'sha1': 'f7e9f9af51acf98e0ccc3037487018e4ae40caa5'} 2023-11-04T15:24:34.856 INFO:teuthology.task.install:Using flavor: default 2023-11-04T15:24:34.862 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-04T15:24:34.863 INFO:teuthology.task.install:extra packages: [] 2023-11-04T15:24:34.863 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': True, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f7e9f9af51acf98e0ccc3037487018e4ae40caa5', 'tag': None, 'wait_for_package': False} 2023-11-04T15:24:34.865 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f7e9f9af51acf98e0ccc3037487018e4ae40caa5 2023-11-04T15:24:34.867 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': True, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f7e9f9af51acf98e0ccc3037487018e4ae40caa5', 'tag': None, 'wait_for_package': False} 2023-11-04T15:24:34.867 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f7e9f9af51acf98e0ccc3037487018e4ae40caa5 2023-11-04T15:24:34.869 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': True, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f7e9f9af51acf98e0ccc3037487018e4ae40caa5', 'tag': None, 'wait_for_package': False} 2023-11-04T15:24:34.869 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f7e9f9af51acf98e0ccc3037487018e4ae40caa5 2023-11-04T15:24:35.012 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/reef-release/f7e9f9af51acf98e0ccc3037487018e4ae40caa5/centos/9/flavors/default/ 2023-11-04T15:24:35.012 INFO:teuthology.task.install.rpm:Package version is 18.2.0-1181.gf7e9f9af 2023-11-04T15:24:35.083 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/reef-release/f7e9f9af51acf98e0ccc3037487018e4ae40caa5/centos/9/flavors/default/ 2023-11-04T15:24:35.084 INFO:teuthology.task.install.rpm:Package version is 18.2.0-1181.gf7e9f9af 2023-11-04T15:24:35.088 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/reef-release/f7e9f9af51acf98e0ccc3037487018e4ae40caa5/centos/9/flavors/default/ 2023-11-04T15:24:35.088 INFO:teuthology.task.install.rpm:Package version is 18.2.0-1181.gf7e9f9af 2023-11-04T15:24:35.180 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/reef-release/f7e9f9af51acf98e0ccc3037487018e4ae40caa5/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/reef-release/f7e9f9af51acf98e0ccc3037487018e4ae40caa5/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/reef-release/f7e9f9af51acf98e0ccc3037487018e4ae40caa5/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-04T15:24:35.180 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-11-04T15:24:35.181 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-04T15:24:35.188 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/reef-release/f7e9f9af51acf98e0ccc3037487018e4ae40caa5/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/reef-release/f7e9f9af51acf98e0ccc3037487018e4ae40caa5/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/reef-release/f7e9f9af51acf98e0ccc3037487018e4ae40caa5/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-04T15:24:35.188 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-04T15:24:35.189 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-04T15:24:35.208 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-11-04T15:24:35.208 DEBUG:teuthology.orchestra.run.smithi096:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f7e9f9af51acf98e0ccc3037487018e4ae40caa5/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-04T15:24:35.222 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-11-04T15:24:35.222 DEBUG:teuthology.orchestra.run.smithi019:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f7e9f9af51acf98e0ccc3037487018e4ae40caa5/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-04T15:24:35.259 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/reef-release/f7e9f9af51acf98e0ccc3037487018e4ae40caa5/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/reef-release/f7e9f9af51acf98e0ccc3037487018e4ae40caa5/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/reef-release/f7e9f9af51acf98e0ccc3037487018e4ae40caa5/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-04T15:24:35.260 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-11-04T15:24:35.260 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-04T15:24:35.276 DEBUG:teuthology.orchestra.run.smithi096:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-04T15:24:35.288 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-11-04T15:24:35.288 DEBUG:teuthology.orchestra.run.smithi130:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f7e9f9af51acf98e0ccc3037487018e4ae40caa5/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-04T15:24:35.294 DEBUG:teuthology.orchestra.run.smithi019:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-04T15:24:35.355 DEBUG:teuthology.orchestra.run.smithi096:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-04T15:24:35.356 DEBUG:teuthology.orchestra.run.smithi130:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-04T15:24:35.383 DEBUG:teuthology.orchestra.run.smithi019:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-04T15:24:35.413 INFO:teuthology.orchestra.run.smithi019.stdout:check_obsoletes = 1 2023-11-04T15:24:35.415 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum clean all 2023-11-04T15:24:35.421 INFO:teuthology.orchestra.run.smithi096.stdout:check_obsoletes = 1 2023-11-04T15:24:35.423 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum clean all 2023-11-04T15:24:35.436 DEBUG:teuthology.orchestra.run.smithi130:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-04T15:24:35.502 INFO:teuthology.orchestra.run.smithi130.stdout:check_obsoletes = 1 2023-11-04T15:24:35.504 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum clean all 2023-11-04T15:24:35.656 INFO:teuthology.orchestra.run.smithi096.stdout:72 files removed 2023-11-04T15:24:35.669 INFO:teuthology.orchestra.run.smithi019.stdout:72 files removed 2023-11-04T15:24:35.683 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-radosgw 2023-11-04T15:24:35.696 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install ceph-radosgw 2023-11-04T15:24:35.738 INFO:teuthology.orchestra.run.smithi130.stdout:72 files removed 2023-11-04T15:24:35.765 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install ceph-radosgw 2023-11-04T15:24:36.411 INFO:teuthology.orchestra.run.smithi096.stdout:ceph packages for x86_64 186 kB/s | 77 kB 00:00 2023-11-04T15:24:36.497 INFO:teuthology.orchestra.run.smithi019.stdout:ceph packages for x86_64 165 kB/s | 77 kB 00:00 2023-11-04T15:24:36.544 INFO:teuthology.orchestra.run.smithi130.stdout:ceph packages for x86_64 167 kB/s | 77 kB 00:00 2023-11-04T15:24:36.745 INFO:teuthology.orchestra.run.smithi096.stdout:ceph noarch packages 33 kB/s | 9.4 kB 00:00 2023-11-04T15:24:36.887 INFO:teuthology.orchestra.run.smithi130.stdout:ceph noarch packages 32 kB/s | 9.4 kB 00:00 2023-11-04T15:24:36.889 INFO:teuthology.orchestra.run.smithi019.stdout:ceph noarch packages 28 kB/s | 9.4 kB 00:00 2023-11-04T15:24:37.129 INFO:teuthology.orchestra.run.smithi096.stdout:ceph source packages 5.4 kB/s | 1.9 kB 00:00 2023-11-04T15:24:37.215 INFO:teuthology.orchestra.run.smithi019.stdout:ceph source packages 6.5 kB/s | 1.9 kB 00:00 2023-11-04T15:24:37.237 INFO:teuthology.orchestra.run.smithi130.stdout:ceph source packages 6.0 kB/s | 1.9 kB 00:00 2023-11-04T15:24:37.659 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS-9 - AppStream 16 MB/s | 6.3 MB 00:00 2023-11-04T15:24:37.664 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS-9 - AppStream 13 MB/s | 6.3 MB 00:00 2023-11-04T15:24:37.673 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS-9 - AppStream 16 MB/s | 6.3 MB 00:00 2023-11-04T15:24:39.098 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS-9 - BaseOS 5.3 MB/s | 2.0 MB 00:00 2023-11-04T15:24:39.114 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS-9 - BaseOS 5.1 MB/s | 2.0 MB 00:00 2023-11-04T15:24:39.134 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS-9 - BaseOS 5.0 MB/s | 2.0 MB 00:00 2023-11-04T15:24:40.000 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 7.9 MB 00:00 2023-11-04T15:24:40.222 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 7.9 MB 00:00 2023-11-04T15:24:41.314 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - BaseOS 4.2 MB/s | 7.9 MB 00:01 2023-11-04T15:24:45.539 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - AppStream 4.2 MB/s | 18 MB 00:04 2023-11-04T15:24:45.841 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - AppStream 5.3 MB/s | 18 MB 00:03 2023-11-04T15:24:49.356 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - CRB 11 MB/s | 5.8 MB 00:00 2023-11-04T15:24:50.624 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - Extras packages 86 kB/s | 15 kB 00:00 2023-11-04T15:24:51.058 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 5.8 MB 00:01 2023-11-04T15:24:51.833 INFO:teuthology.orchestra.run.smithi096.stdout:Extra Packages for Enterprise Linux 18 MB/s | 19 MB 00:01 2023-11-04T15:24:52.534 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 15 kB 00:00 2023-11-04T15:24:53.744 INFO:teuthology.orchestra.run.smithi130.stdout:Extra Packages for Enterprise Linux 18 MB/s | 19 MB 00:01 2023-11-04T15:24:56.143 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 18 MB 00:15 2023-11-04T15:24:56.425 INFO:teuthology.orchestra.run.smithi096.stdout:lab-extras 11 kB/s | 1.7 kB 00:00 2023-11-04T15:24:58.152 INFO:teuthology.orchestra.run.smithi130.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2023-11-04T15:24:58.822 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:24:58.836 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:24:58.836 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2023-11-04T15:24:58.836 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:24:58.837 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2023-11-04T15:24:58.837 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-radosgw x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 7.7 M 2023-11-04T15:24:58.837 INFO:teuthology.orchestra.run.smithi096.stdout:Upgrading: 2023-11-04T15:24:58.837 INFO:teuthology.orchestra.run.smithi096.stdout: librados2 x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 3.3 M 2023-11-04T15:24:58.837 INFO:teuthology.orchestra.run.smithi096.stdout: librbd1 x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 3.0 M 2023-11-04T15:24:58.838 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2023-11-04T15:24:58.838 INFO:teuthology.orchestra.run.smithi096.stdout: boost-program-options 2023-11-04T15:24:58.838 INFO:teuthology.orchestra.run.smithi096.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-04T15:24:58.838 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-base x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 5.2 M 2023-11-04T15:24:58.838 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-common x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 18 M 2023-11-04T15:24:58.839 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-selinux x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 24 k 2023-11-04T15:24:58.839 INFO:teuthology.orchestra.run.smithi096.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-11-04T15:24:58.839 INFO:teuthology.orchestra.run.smithi096.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-04T15:24:58.839 INFO:teuthology.orchestra.run.smithi096.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-04T15:24:58.839 INFO:teuthology.orchestra.run.smithi096.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-04T15:24:58.840 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs2 x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 658 k 2023-11-04T15:24:58.840 INFO:teuthology.orchestra.run.smithi096.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-04T15:24:58.840 INFO:teuthology.orchestra.run.smithi096.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-04T15:24:58.840 INFO:teuthology.orchestra.run.smithi096.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-11-04T15:24:58.840 INFO:teuthology.orchestra.run.smithi096.stdout: libradosstriper1 x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 475 k 2023-11-04T15:24:58.841 INFO:teuthology.orchestra.run.smithi096.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-04T15:24:58.841 INFO:teuthology.orchestra.run.smithi096.stdout: librgw2 x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 4.5 M 2023-11-04T15:24:58.841 INFO:teuthology.orchestra.run.smithi096.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-04T15:24:58.841 INFO:teuthology.orchestra.run.smithi096.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-04T15:24:58.842 INFO:teuthology.orchestra.run.smithi096.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-04T15:24:58.842 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-argparse 2023-11-04T15:24:58.842 INFO:teuthology.orchestra.run.smithi096.stdout: x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 45 k 2023-11-04T15:24:58.842 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-common x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 124 k 2023-11-04T15:24:58.842 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cephfs x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 162 k 2023-11-04T15:24:58.843 INFO:teuthology.orchestra.run.smithi096.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-04T15:24:58.843 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rados x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 320 k 2023-11-04T15:24:58.843 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rbd x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 298 k 2023-11-04T15:24:58.843 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rgw x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 99 k 2023-11-04T15:24:58.843 INFO:teuthology.orchestra.run.smithi096.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-04T15:24:58.843 INFO:teuthology.orchestra.run.smithi096.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-04T15:24:58.844 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:24:58.844 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2023-11-04T15:24:58.844 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:24:58.844 INFO:teuthology.orchestra.run.smithi096.stdout:Install 28 Packages 2023-11-04T15:24:58.844 INFO:teuthology.orchestra.run.smithi096.stdout:Upgrade 2 Packages 2023-11-04T15:24:58.844 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:24:58.845 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 53 M 2023-11-04T15:24:58.845 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2023-11-04T15:24:59.767 INFO:teuthology.orchestra.run.smithi096.stdout:(1/30): ceph-base-18.2.0-1181.gf7e9f9af.el9.x86 7.4 MB/s | 5.2 MB 00:00 2023-11-04T15:24:59.817 INFO:teuthology.orchestra.run.smithi096.stdout:(2/30): ceph-selinux-18.2.0-1181.gf7e9f9af.el9. 483 kB/s | 24 kB 00:00 2023-11-04T15:24:59.926 INFO:teuthology.orchestra.run.smithi096.stdout:(3/30): libcephfs2-18.2.0-1181.gf7e9f9af.el9.x8 5.9 MB/s | 658 kB 00:00 2023-11-04T15:25:00.051 INFO:teuthology.orchestra.run.smithi096.stdout:(4/30): ceph-radosgw-18.2.0-1181.gf7e9f9af.el9. 7.8 MB/s | 7.7 MB 00:00 2023-11-04T15:25:00.076 INFO:teuthology.orchestra.run.smithi096.stdout:(5/30): libradosstriper1-18.2.0-1181.gf7e9f9af. 3.1 MB/s | 475 kB 00:00 2023-11-04T15:25:00.118 INFO:teuthology.orchestra.run.smithi096.stdout:(6/30): python3-ceph-argparse-18.2.0-1181.gf7e9 1.1 MB/s | 45 kB 00:00 2023-11-04T15:25:00.177 INFO:teuthology.orchestra.run.smithi096.stdout:(7/30): python3-ceph-common-18.2.0-1181.gf7e9f9 2.1 MB/s | 124 kB 00:00 2023-11-04T15:25:00.244 INFO:teuthology.orchestra.run.smithi096.stdout:(8/30): python3-cephfs-18.2.0-1181.gf7e9f9af.el 2.4 MB/s | 162 kB 00:00 2023-11-04T15:25:00.319 INFO:teuthology.orchestra.run.smithi096.stdout:(9/30): python3-rados-18.2.0-1181.gf7e9f9af.el9 4.2 MB/s | 320 kB 00:00 2023-11-04T15:25:00.403 INFO:teuthology.orchestra.run.smithi096.stdout:(10/30): librgw2-18.2.0-1181.gf7e9f9af.el9.x86_ 13 MB/s | 4.5 MB 00:00 2023-11-04T15:25:00.428 INFO:teuthology.orchestra.run.smithi096.stdout:(11/30): python3-rbd-18.2.0-1181.gf7e9f9af.el9. 2.7 MB/s | 298 kB 00:00 2023-11-04T15:25:00.453 INFO:teuthology.orchestra.run.smithi096.stdout:(12/30): python3-rgw-18.2.0-1181.gf7e9f9af.el9. 1.9 MB/s | 99 kB 00:00 2023-11-04T15:25:00.476 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - CRB 6.5 MB/s | 5.8 MB 00:00 2023-11-04T15:25:00.562 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:25:00.563 INFO:teuthology.orchestra.run.smithi096.stdout:(13/30): boost-program-options-1.75.0-8.el9.x86 793 kB/s | 106 kB 00:00 2023-11-04T15:25:00.572 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:25:00.572 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2023-11-04T15:25:00.572 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:25:00.572 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-11-04T15:25:00.573 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-radosgw x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 7.7 M 2023-11-04T15:25:00.573 INFO:teuthology.orchestra.run.smithi130.stdout:Upgrading: 2023-11-04T15:25:00.573 INFO:teuthology.orchestra.run.smithi130.stdout: librados2 x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 3.3 M 2023-11-04T15:25:00.573 INFO:teuthology.orchestra.run.smithi130.stdout: librbd1 x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 3.0 M 2023-11-04T15:25:00.574 INFO:teuthology.orchestra.run.smithi130.stdout:Installing dependencies: 2023-11-04T15:25:00.574 INFO:teuthology.orchestra.run.smithi130.stdout: boost-program-options 2023-11-04T15:25:00.574 INFO:teuthology.orchestra.run.smithi130.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-04T15:25:00.574 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-base x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 5.2 M 2023-11-04T15:25:00.575 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-common x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 18 M 2023-11-04T15:25:00.575 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-selinux x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 24 k 2023-11-04T15:25:00.575 INFO:teuthology.orchestra.run.smithi130.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-11-04T15:25:00.575 INFO:teuthology.orchestra.run.smithi130.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-04T15:25:00.575 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-04T15:25:00.576 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-04T15:25:00.576 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs2 x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 658 k 2023-11-04T15:25:00.576 INFO:teuthology.orchestra.run.smithi130.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-04T15:25:00.576 INFO:teuthology.orchestra.run.smithi130.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-04T15:25:00.577 INFO:teuthology.orchestra.run.smithi130.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-11-04T15:25:00.577 INFO:teuthology.orchestra.run.smithi130.stdout: libradosstriper1 x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 475 k 2023-11-04T15:25:00.577 INFO:teuthology.orchestra.run.smithi130.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-04T15:25:00.577 INFO:teuthology.orchestra.run.smithi130.stdout: librgw2 x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 4.5 M 2023-11-04T15:25:00.578 INFO:teuthology.orchestra.run.smithi130.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-04T15:25:00.578 INFO:teuthology.orchestra.run.smithi130.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-04T15:25:00.578 INFO:teuthology.orchestra.run.smithi130.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-04T15:25:00.578 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-argparse 2023-11-04T15:25:00.579 INFO:teuthology.orchestra.run.smithi130.stdout: x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 45 k 2023-11-04T15:25:00.579 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-common x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 124 k 2023-11-04T15:25:00.579 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cephfs x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 162 k 2023-11-04T15:25:00.579 INFO:teuthology.orchestra.run.smithi130.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-04T15:25:00.579 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rados x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 320 k 2023-11-04T15:25:00.580 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rbd x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 298 k 2023-11-04T15:25:00.580 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rgw x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 99 k 2023-11-04T15:25:00.580 INFO:teuthology.orchestra.run.smithi130.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-04T15:25:00.580 INFO:teuthology.orchestra.run.smithi130.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-04T15:25:00.580 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:25:00.581 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-11-04T15:25:00.581 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:25:00.581 INFO:teuthology.orchestra.run.smithi130.stdout:Install 28 Packages 2023-11-04T15:25:00.581 INFO:teuthology.orchestra.run.smithi130.stdout:Upgrade 2 Packages 2023-11-04T15:25:00.582 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:25:00.582 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 53 M 2023-11-04T15:25:00.583 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-11-04T15:25:00.587 INFO:teuthology.orchestra.run.smithi096.stdout:(14/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 159 kB 00:00 2023-11-04T15:25:00.621 INFO:teuthology.orchestra.run.smithi096.stdout:(15/30): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2023-11-04T15:25:00.646 INFO:teuthology.orchestra.run.smithi096.stdout:(16/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.7 MB/s | 282 kB 00:00 2023-11-04T15:25:00.671 INFO:teuthology.orchestra.run.smithi096.stdout:(17/30): python3-prettytable-0.7.2-27.el9.noarc 827 kB/s | 41 kB 00:00 2023-11-04T15:25:00.855 INFO:teuthology.orchestra.run.smithi096.stdout:(18/30): fmt-8.1.1-5.el9.x86_64.rpm 605 kB/s | 111 kB 00:00 2023-11-04T15:25:00.930 INFO:teuthology.orchestra.run.smithi096.stdout:(19/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 4.0 MB/s | 309 kB 00:00 2023-11-04T15:25:01.166 INFO:teuthology.orchestra.run.smithi096.stdout:(20/30): ceph-common-18.2.0-1181.gf7e9f9af.el9. 8.7 MB/s | 18 MB 00:02 2023-11-04T15:25:01.231 INFO:teuthology.orchestra.run.smithi096.stdout:(21/30): libarrow-9.0.0-9.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2023-11-04T15:25:01.256 INFO:teuthology.orchestra.run.smithi096.stdout:(22/30): libarrow-doc-9.0.0-9.el9.noarch.rpm 279 kB/s | 24 kB 00:00 2023-11-04T15:25:01.281 INFO:teuthology.orchestra.run.smithi096.stdout:(23/30): liboath-2.6.7-2.el9.x86_64.rpm 971 kB/s | 49 kB 00:00 2023-11-04T15:25:01.306 INFO:teuthology.orchestra.run.smithi096.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2023-11-04T15:25:01.348 INFO:teuthology.orchestra.run.smithi096.stdout:(25/30): parquet-libs-9.0.0-9.el9.x86_64.rpm 12 MB/s | 837 kB 00:00 2023-11-04T15:25:01.374 INFO:teuthology.orchestra.run.smithi096.stdout:(26/30): re2-20211101-3.el9.x86_64.rpm 2.8 MB/s | 192 kB 00:00 2023-11-04T15:25:01.391 INFO:teuthology.orchestra.run.smithi096.stdout:(27/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 61 kB/s | 45 kB 00:00 2023-11-04T15:25:01.424 INFO:teuthology.orchestra.run.smithi096.stdout:(28/30): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2023-11-04T15:25:01.658 INFO:teuthology.orchestra.run.smithi096.stdout:(29/30): librbd1-18.2.0-1181.gf7e9f9af.el9.x86_ 11 MB/s | 3.0 MB 00:00 2023-11-04T15:25:01.775 INFO:teuthology.orchestra.run.smithi096.stdout:(30/30): librados2-18.2.0-1181.gf7e9f9af.el9.x8 8.2 MB/s | 3.3 MB 00:00 2023-11-04T15:25:01.780 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:25:01.781 INFO:teuthology.orchestra.run.smithi096.stdout:Total 18 MB/s | 53 MB 00:02 2023-11-04T15:25:01.792 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2023-11-04T15:25:01.802 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - Extras packages 75 kB/s | 15 kB 00:00 2023-11-04T15:25:01.826 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2023-11-04T15:25:01.826 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2023-11-04T15:25:02.095 INFO:teuthology.orchestra.run.smithi130.stdout:(1/30): ceph-base-18.2.0-1181.gf7e9f9af.el9.x86 5.0 MB/s | 5.2 MB 00:01 2023-11-04T15:25:02.145 INFO:teuthology.orchestra.run.smithi130.stdout:(2/30): ceph-selinux-18.2.0-1181.gf7e9f9af.el9. 482 kB/s | 24 kB 00:00 2023-11-04T15:25:02.237 INFO:teuthology.orchestra.run.smithi130.stdout:(3/30): libcephfs2-18.2.0-1181.gf7e9f9af.el9.x8 7.0 MB/s | 658 kB 00:00 2023-11-04T15:25:02.290 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2023-11-04T15:25:02.291 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2023-11-04T15:25:02.379 INFO:teuthology.orchestra.run.smithi130.stdout:(4/30): ceph-radosgw-18.2.0-1181.gf7e9f9af.el9. 5.8 MB/s | 7.7 MB 00:01 2023-11-04T15:25:02.404 INFO:teuthology.orchestra.run.smithi130.stdout:(5/30): libradosstriper1-18.2.0-1181.gf7e9f9af. 2.8 MB/s | 475 kB 00:00 2023-11-04T15:25:02.446 INFO:teuthology.orchestra.run.smithi130.stdout:(6/30): python3-ceph-argparse-18.2.0-1181.gf7e9 1.1 MB/s | 45 kB 00:00 2023-11-04T15:25:02.496 INFO:teuthology.orchestra.run.smithi130.stdout:(7/30): python3-ceph-common-18.2.0-1181.gf7e9f9 2.4 MB/s | 124 kB 00:00 2023-11-04T15:25:02.555 INFO:teuthology.orchestra.run.smithi130.stdout:(8/30): python3-cephfs-18.2.0-1181.gf7e9f9af.el 2.7 MB/s | 162 kB 00:00 2023-11-04T15:25:02.563 INFO:teuthology.orchestra.run.smithi019.stdout:Extra Packages for Enterprise Linux 30 MB/s | 19 MB 00:00 2023-11-04T15:25:02.639 INFO:teuthology.orchestra.run.smithi130.stdout:(9/30): python3-rados-18.2.0-1181.gf7e9f9af.el9 3.7 MB/s | 320 kB 00:00 2023-11-04T15:25:02.722 INFO:teuthology.orchestra.run.smithi130.stdout:(10/30): librgw2-18.2.0-1181.gf7e9f9af.el9.x86_ 13 MB/s | 4.5 MB 00:00 2023-11-04T15:25:02.764 INFO:teuthology.orchestra.run.smithi130.stdout:(11/30): python3-rbd-18.2.0-1181.gf7e9f9af.el9. 2.3 MB/s | 298 kB 00:00 2023-11-04T15:25:02.789 INFO:teuthology.orchestra.run.smithi130.stdout:(12/30): python3-rgw-18.2.0-1181.gf7e9f9af.el9. 1.5 MB/s | 99 kB 00:00 2023-11-04T15:25:02.898 INFO:teuthology.orchestra.run.smithi130.stdout:(13/30): boost-program-options-1.75.0-8.el9.x86 792 kB/s | 106 kB 00:00 2023-11-04T15:25:02.932 INFO:teuthology.orchestra.run.smithi130.stdout:(14/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 159 kB 00:00 2023-11-04T15:25:02.965 INFO:teuthology.orchestra.run.smithi130.stdout:(15/30): librdkafka-1.6.1-102.el9.x86_64.rpm 9.6 MB/s | 661 kB 00:00 2023-11-04T15:25:02.991 INFO:teuthology.orchestra.run.smithi130.stdout:(16/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.7 MB/s | 282 kB 00:00 2023-11-04T15:25:03.016 INFO:teuthology.orchestra.run.smithi130.stdout:(17/30): python3-prettytable-0.7.2-27.el9.noarc 824 kB/s | 41 kB 00:00 2023-11-04T15:25:03.425 INFO:teuthology.orchestra.run.smithi130.stdout:(18/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 104 kB/s | 45 kB 00:00 2023-11-04T15:25:03.542 INFO:teuthology.orchestra.run.smithi130.stdout:(19/30): fmt-8.1.1-5.el9.x86_64.rpm 211 kB/s | 111 kB 00:00 2023-11-04T15:25:03.692 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2023-11-04T15:25:03.745 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2023-11-04T15:25:03.788 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/32 2023-11-04T15:25:03.846 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/32 2023-11-04T15:25:03.884 INFO:teuthology.orchestra.run.smithi130.stdout:(20/30): ceph-common-18.2.0-1181.gf7e9f9af.el9. 6.5 MB/s | 18 MB 00:02 2023-11-04T15:25:03.915 INFO:teuthology.orchestra.run.smithi130.stdout:(21/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 631 kB/s | 309 kB 00:00 2023-11-04T15:25:04.173 INFO:teuthology.orchestra.run.smithi130.stdout:(22/30): libarrow-doc-9.0.0-9.el9.noarch.rpm 85 kB/s | 24 kB 00:00 2023-11-04T15:25:04.196 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2023-11-04T15:25:04.198 INFO:teuthology.orchestra.run.smithi130.stdout:(23/30): liboath-2.6.7-2.el9.x86_64.rpm 171 kB/s | 49 kB 00:00 2023-11-04T15:25:04.237 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : librados2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 5/32 2023-11-04T15:25:04.274 INFO:teuthology.orchestra.run.smithi130.stdout:(24/30): libarrow-9.0.0-9.el9.x86_64.rpm 6.0 MB/s | 4.4 MB 00:00 2023-11-04T15:25:04.299 INFO:teuthology.orchestra.run.smithi130.stdout:(25/30): libunwind-1.6.2-1.el9.x86_64.rpm 535 kB/s | 67 kB 00:00 2023-11-04T15:25:04.319 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librados2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 5/32 2023-11-04T15:25:04.333 INFO:teuthology.orchestra.run.smithi130.stdout:(26/30): parquet-libs-9.0.0-9.el9.x86_64.rpm 6.2 MB/s | 837 kB 00:00 2023-11-04T15:25:04.400 INFO:teuthology.orchestra.run.smithi130.stdout:(27/30): re2-20211101-3.el9.x86_64.rpm 1.5 MB/s | 192 kB 00:00 2023-11-04T15:25:04.417 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rados-2:18.2.0-1181.gf7e9f9af.el9.x86_64 6/32 2023-11-04T15:25:04.447 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libcephfs2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 7/32 2023-11-04T15:25:04.459 INFO:teuthology.orchestra.run.smithi130.stdout:(28/30): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2023-11-04T15:25:04.509 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libcephfs2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 7/32 2023-11-04T15:25:04.538 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2023-11-04T15:25:04.581 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-ceph-argparse-2:18.2.0-1181.gf7e9f9af.el9. 9/32 2023-11-04T15:25:04.647 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cephfs-2:18.2.0-1181.gf7e9f9af.el9.x86_64 10/32 2023-11-04T15:25:04.674 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libradosstriper1-2:18.2.0-1181.gf7e9f9af.el9.x86_6 11/32 2023-11-04T15:25:04.722 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libradosstriper1-2:18.2.0-1181.gf7e9f9af.el9.x86_6 11/32 2023-11-04T15:25:04.734 INFO:teuthology.orchestra.run.smithi130.stdout:(29/30): librbd1-18.2.0-1181.gf7e9f9af.el9.x86_ 9.0 MB/s | 3.0 MB 00:00 2023-11-04T15:25:04.784 INFO:teuthology.orchestra.run.smithi130.stdout:(30/30): librados2-18.2.0-1181.gf7e9f9af.el9.x8 7.3 MB/s | 3.3 MB 00:00 2023-11-04T15:25:04.789 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:25:04.790 INFO:teuthology.orchestra.run.smithi130.stdout:Total 13 MB/s | 53 MB 00:04 2023-11-04T15:25:04.800 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-11-04T15:25:04.828 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2023-11-04T15:25:04.834 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-11-04T15:25:04.834 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-11-04T15:25:04.856 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 13/32 2023-11-04T15:25:04.896 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2023-11-04T15:25:04.929 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2023-11-04T15:25:04.956 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 16/32 2023-11-04T15:25:04.995 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2023-11-04T15:25:05.028 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2023-11-04T15:25:05.301 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-11-04T15:25:05.302 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-11-04T15:25:05.329 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2023-11-04T15:25:05.366 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : librbd1-2:18.2.0-1181.gf7e9f9af.el9.x86_64 20/32 2023-11-04T15:25:05.455 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librbd1-2:18.2.0-1181.gf7e9f9af.el9.x86_64 20/32 2023-11-04T15:25:05.479 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 21/32 2023-11-04T15:25:05.515 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2023-11-04T15:25:05.917 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 23/32 2023-11-04T15:25:05.943 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librgw2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 24/32 2023-11-04T15:25:06.015 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librgw2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 24/32 2023-11-04T15:25:06.112 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 25/32 2023-11-04T15:25:06.146 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x8 26/32 2023-11-04T15:25:06.702 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-11-04T15:25:06.771 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2023-11-04T15:25:06.823 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/32 2023-11-04T15:25:06.889 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/32 2023-11-04T15:25:07.171 INFO:teuthology.orchestra.run.smithi019.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2023-11-04T15:25:07.258 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2023-11-04T15:25:07.288 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : librados2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 5/32 2023-11-04T15:25:07.381 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librados2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 5/32 2023-11-04T15:25:07.467 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rados-2:18.2.0-1181.gf7e9f9af.el9.x86_64 6/32 2023-11-04T15:25:07.498 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcephfs2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 7/32 2023-11-04T15:25:07.544 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libcephfs2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 7/32 2023-11-04T15:25:07.581 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2023-11-04T15:25:07.624 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-ceph-argparse-2:18.2.0-1181.gf7e9f9af.el9. 9/32 2023-11-04T15:25:07.690 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cephfs-2:18.2.0-1181.gf7e9f9af.el9.x86_64 10/32 2023-11-04T15:25:07.717 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libradosstriper1-2:18.2.0-1181.gf7e9f9af.el9.x86_6 11/32 2023-11-04T15:25:07.766 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libradosstriper1-2:18.2.0-1181.gf7e9f9af.el9.x86_6 11/32 2023-11-04T15:25:07.871 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2023-11-04T15:25:07.900 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 13/32 2023-11-04T15:25:07.940 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2023-11-04T15:25:07.981 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2023-11-04T15:25:08.008 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 16/32 2023-11-04T15:25:08.045 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2023-11-04T15:25:08.078 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2023-11-04T15:25:08.264 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x86_64 27/32 2023-11-04T15:25:08.367 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x86_64 27/32 2023-11-04T15:25:08.378 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2023-11-04T15:25:08.408 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : librbd1-2:18.2.0-1181.gf7e9f9af.el9.x86_64 20/32 2023-11-04T15:25:08.498 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librbd1-2:18.2.0-1181.gf7e9f9af.el9.x86_64 20/32 2023-11-04T15:25:08.530 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 21/32 2023-11-04T15:25:08.565 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2023-11-04T15:25:08.923 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x86_64 27/32 2023-11-04T15:25:08.965 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-base-2:18.2.0-1181.gf7e9f9af.el9.x86_64 28/32 2023-11-04T15:25:08.976 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 23/32 2023-11-04T15:25:09.011 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librgw2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 24/32 2023-11-04T15:25:09.034 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-base-2:18.2.0-1181.gf7e9f9af.el9.x86_64 28/32 2023-11-04T15:25:09.035 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-04T15:25:09.035 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-04T15:25:09.035 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:25:09.066 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-selinux-2:18.2.0-1181.gf7e9f9af.el9.x86_64 29/32 2023-11-04T15:25:09.082 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librgw2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 24/32 2023-11-04T15:25:09.166 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 25/32 2023-11-04T15:25:09.205 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x8 26/32 2023-11-04T15:25:09.739 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:25:09.750 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:25:09.751 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2023-11-04T15:25:09.751 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:25:09.751 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2023-11-04T15:25:09.751 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-radosgw x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 7.7 M 2023-11-04T15:25:09.751 INFO:teuthology.orchestra.run.smithi019.stdout:Upgrading: 2023-11-04T15:25:09.752 INFO:teuthology.orchestra.run.smithi019.stdout: librados2 x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 3.3 M 2023-11-04T15:25:09.752 INFO:teuthology.orchestra.run.smithi019.stdout: librbd1 x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 3.0 M 2023-11-04T15:25:09.752 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2023-11-04T15:25:09.752 INFO:teuthology.orchestra.run.smithi019.stdout: boost-program-options 2023-11-04T15:25:09.752 INFO:teuthology.orchestra.run.smithi019.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-04T15:25:09.753 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-base x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 5.2 M 2023-11-04T15:25:09.753 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-common x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 18 M 2023-11-04T15:25:09.753 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-selinux x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 24 k 2023-11-04T15:25:09.753 INFO:teuthology.orchestra.run.smithi019.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-11-04T15:25:09.753 INFO:teuthology.orchestra.run.smithi019.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-04T15:25:09.754 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-04T15:25:09.754 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-04T15:25:09.754 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs2 x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 658 k 2023-11-04T15:25:09.754 INFO:teuthology.orchestra.run.smithi019.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-04T15:25:09.754 INFO:teuthology.orchestra.run.smithi019.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-04T15:25:09.754 INFO:teuthology.orchestra.run.smithi019.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-11-04T15:25:09.755 INFO:teuthology.orchestra.run.smithi019.stdout: libradosstriper1 x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 475 k 2023-11-04T15:25:09.755 INFO:teuthology.orchestra.run.smithi019.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-04T15:25:09.755 INFO:teuthology.orchestra.run.smithi019.stdout: librgw2 x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 4.5 M 2023-11-04T15:25:09.755 INFO:teuthology.orchestra.run.smithi019.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-04T15:25:09.755 INFO:teuthology.orchestra.run.smithi019.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-04T15:25:09.756 INFO:teuthology.orchestra.run.smithi019.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-04T15:25:09.756 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-argparse 2023-11-04T15:25:09.756 INFO:teuthology.orchestra.run.smithi019.stdout: x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 45 k 2023-11-04T15:25:09.756 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-common x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 124 k 2023-11-04T15:25:09.756 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cephfs x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 162 k 2023-11-04T15:25:09.757 INFO:teuthology.orchestra.run.smithi019.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-04T15:25:09.757 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rados x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 320 k 2023-11-04T15:25:09.757 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rbd x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 298 k 2023-11-04T15:25:09.757 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rgw x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 99 k 2023-11-04T15:25:09.757 INFO:teuthology.orchestra.run.smithi019.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-04T15:25:09.757 INFO:teuthology.orchestra.run.smithi019.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-04T15:25:09.758 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:25:09.758 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2023-11-04T15:25:09.758 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:25:09.758 INFO:teuthology.orchestra.run.smithi019.stdout:Install 28 Packages 2023-11-04T15:25:09.758 INFO:teuthology.orchestra.run.smithi019.stdout:Upgrade 2 Packages 2023-11-04T15:25:09.759 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:25:09.759 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 53 M 2023-11-04T15:25:09.759 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2023-11-04T15:25:10.739 INFO:teuthology.orchestra.run.smithi019.stdout:(1/30): ceph-base-18.2.0-1181.gf7e9f9af.el9.x86 7.9 MB/s | 5.2 MB 00:00 2023-11-04T15:25:10.847 INFO:teuthology.orchestra.run.smithi019.stdout:(2/30): ceph-radosgw-18.2.0-1181.gf7e9f9af.el9. 10 MB/s | 7.7 MB 00:00 2023-11-04T15:25:10.864 INFO:teuthology.orchestra.run.smithi019.stdout:(3/30): ceph-selinux-18.2.0-1181.gf7e9f9af.el9. 192 kB/s | 24 kB 00:00 2023-11-04T15:25:10.906 INFO:teuthology.orchestra.run.smithi019.stdout:(4/30): libcephfs2-18.2.0-1181.gf7e9f9af.el9.x8 11 MB/s | 658 kB 00:00 2023-11-04T15:25:10.952 INFO:teuthology.orchestra.run.smithi019.stdout:(5/30): libradosstriper1-18.2.0-1181.gf7e9f9af. 5.3 MB/s | 475 kB 00:00 2023-11-04T15:25:11.023 INFO:teuthology.orchestra.run.smithi019.stdout:(6/30): python3-ceph-argparse-18.2.0-1181.gf7e9 633 kB/s | 45 kB 00:00 2023-11-04T15:25:11.099 INFO:teuthology.orchestra.run.smithi019.stdout:(7/30): python3-ceph-common-18.2.0-1181.gf7e9f9 1.6 MB/s | 124 kB 00:00 2023-11-04T15:25:11.166 INFO:teuthology.orchestra.run.smithi019.stdout:(8/30): librgw2-18.2.0-1181.gf7e9f9af.el9.x86_6 17 MB/s | 4.5 MB 00:00 2023-11-04T15:25:11.191 INFO:teuthology.orchestra.run.smithi019.stdout:(9/30): python3-cephfs-18.2.0-1181.gf7e9f9af.el 1.7 MB/s | 162 kB 00:00 2023-11-04T15:25:11.216 INFO:teuthology.orchestra.run.smithi019.stdout:(10/30): python3-rados-18.2.0-1181.gf7e9f9af.el 6.2 MB/s | 320 kB 00:00 2023-11-04T15:25:11.242 INFO:teuthology.orchestra.run.smithi019.stdout:(11/30): python3-rbd-18.2.0-1181.gf7e9f9af.el9. 5.8 MB/s | 298 kB 00:00 2023-11-04T15:25:11.267 INFO:teuthology.orchestra.run.smithi019.stdout:(12/30): python3-rgw-18.2.0-1181.gf7e9f9af.el9. 1.9 MB/s | 99 kB 00:00 2023-11-04T15:25:11.288 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x86_64 27/32 2023-11-04T15:25:11.326 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x86_64 27/32 2023-11-04T15:25:11.376 INFO:teuthology.orchestra.run.smithi019.stdout:(13/30): boost-program-options-1.75.0-8.el9.x86 791 kB/s | 106 kB 00:00 2023-11-04T15:25:11.409 INFO:teuthology.orchestra.run.smithi019.stdout:(14/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 159 kB 00:00 2023-11-04T15:25:11.443 INFO:teuthology.orchestra.run.smithi019.stdout:(15/30): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 661 kB 00:00 2023-11-04T15:25:11.476 INFO:teuthology.orchestra.run.smithi019.stdout:(16/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.2 MB/s | 282 kB 00:00 2023-11-04T15:25:11.494 INFO:teuthology.orchestra.run.smithi019.stdout:(17/30): python3-prettytable-0.7.2-27.el9.noarc 829 kB/s | 41 kB 00:00 2023-11-04T15:25:11.843 INFO:teuthology.orchestra.run.smithi019.stdout:(18/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 123 kB/s | 45 kB 00:00 2023-11-04T15:25:11.871 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x86_64 27/32 2023-11-04T15:25:11.930 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-base-2:18.2.0-1181.gf7e9f9af.el9.x86_64 28/32 2023-11-04T15:25:12.028 INFO:teuthology.orchestra.run.smithi019.stdout:(19/30): fmt-8.1.1-5.el9.x86_64.rpm 207 kB/s | 111 kB 00:00 2023-11-04T15:25:12.029 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-base-2:18.2.0-1181.gf7e9f9af.el9.x86_64 28/32 2023-11-04T15:25:12.029 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-04T15:25:12.029 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-04T15:25:12.029 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:25:12.073 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-selinux-2:18.2.0-1181.gf7e9f9af.el9.x86_64 29/32 2023-11-04T15:25:12.469 INFO:teuthology.orchestra.run.smithi019.stdout:(20/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 494 kB/s | 309 kB 00:00 2023-11-04T15:25:12.570 INFO:teuthology.orchestra.run.smithi019.stdout:(21/30): libarrow-doc-9.0.0-9.el9.noarch.rpm 243 kB/s | 24 kB 00:00 2023-11-04T15:25:12.629 INFO:teuthology.orchestra.run.smithi019.stdout:(22/30): libarrow-9.0.0-9.el9.x86_64.rpm 7.4 MB/s | 4.4 MB 00:00 2023-11-04T15:25:12.679 INFO:teuthology.orchestra.run.smithi019.stdout:(23/30): liboath-2.6.7-2.el9.x86_64.rpm 447 kB/s | 49 kB 00:00 2023-11-04T15:25:12.737 INFO:teuthology.orchestra.run.smithi019.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 622 kB/s | 67 kB 00:00 2023-11-04T15:25:12.979 INFO:teuthology.orchestra.run.smithi019.stdout:(25/30): ceph-common-18.2.0-1181.gf7e9f9af.el9. 6.3 MB/s | 18 MB 00:02 2023-11-04T15:25:13.004 INFO:teuthology.orchestra.run.smithi019.stdout:(26/30): re2-20211101-3.el9.x86_64.rpm 717 kB/s | 192 kB 00:00 2023-11-04T15:25:13.038 INFO:teuthology.orchestra.run.smithi019.stdout:(27/30): parquet-libs-9.0.0-9.el9.x86_64.rpm 2.3 MB/s | 837 kB 00:00 2023-11-04T15:25:13.330 INFO:teuthology.orchestra.run.smithi019.stdout:(28/30): librbd1-18.2.0-1181.gf7e9f9af.el9.x86_ 10 MB/s | 3.0 MB 00:00 2023-11-04T15:25:13.380 INFO:teuthology.orchestra.run.smithi019.stdout:(29/30): librados2-18.2.0-1181.gf7e9f9af.el9.x8 8.7 MB/s | 3.3 MB 00:00 2023-11-04T15:25:13.806 INFO:teuthology.orchestra.run.smithi019.stdout:(30/30): thrift-0.15.0-2.el9.x86_64.rpm 1.9 MB/s | 1.6 MB 00:00 2023-11-04T15:25:13.812 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:25:13.812 INFO:teuthology.orchestra.run.smithi019.stdout:Total 13 MB/s | 53 MB 00:04 2023-11-04T15:25:13.825 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2023-11-04T15:25:13.868 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2023-11-04T15:25:13.869 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2023-11-04T15:25:14.360 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2023-11-04T15:25:14.360 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2023-11-04T15:25:15.916 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2023-11-04T15:25:15.976 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2023-11-04T15:25:16.032 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/32 2023-11-04T15:25:16.103 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/32 2023-11-04T15:25:16.437 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2023-11-04T15:25:16.501 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : librados2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 5/32 2023-11-04T15:25:16.585 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librados2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 5/32 2023-11-04T15:25:16.676 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rados-2:18.2.0-1181.gf7e9f9af.el9.x86_64 6/32 2023-11-04T15:25:16.703 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephfs2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 7/32 2023-11-04T15:25:16.749 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libcephfs2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 7/32 2023-11-04T15:25:16.778 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2023-11-04T15:25:16.822 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ceph-argparse-2:18.2.0-1181.gf7e9f9af.el9. 9/32 2023-11-04T15:25:16.889 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cephfs-2:18.2.0-1181.gf7e9f9af.el9.x86_64 10/32 2023-11-04T15:25:16.914 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libradosstriper1-2:18.2.0-1181.gf7e9f9af.el9.x86_6 11/32 2023-11-04T15:25:16.980 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libradosstriper1-2:18.2.0-1181.gf7e9f9af.el9.x86_6 11/32 2023-11-04T15:25:17.098 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2023-11-04T15:25:17.129 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 13/32 2023-11-04T15:25:17.191 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2023-11-04T15:25:17.228 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2023-11-04T15:25:17.255 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 16/32 2023-11-04T15:25:17.291 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2023-11-04T15:25:17.324 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2023-11-04T15:25:17.639 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2023-11-04T15:25:17.669 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : librbd1-2:18.2.0-1181.gf7e9f9af.el9.x86_64 20/32 2023-11-04T15:25:17.761 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librbd1-2:18.2.0-1181.gf7e9f9af.el9.x86_64 20/32 2023-11-04T15:25:17.791 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 21/32 2023-11-04T15:25:17.828 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2023-11-04T15:25:18.250 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 23/32 2023-11-04T15:25:18.280 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librgw2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 24/32 2023-11-04T15:25:18.352 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librgw2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 24/32 2023-11-04T15:25:18.430 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 25/32 2023-11-04T15:25:18.466 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x8 26/32 2023-11-04T15:25:18.638 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-selinux-2:18.2.0-1181.gf7e9f9af.el9.x86_64 29/32 2023-11-04T15:25:18.638 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /sys 2023-11-04T15:25:18.639 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /proc 2023-11-04T15:25:18.639 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /mnt 2023-11-04T15:25:18.639 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /var/tmp 2023-11-04T15:25:18.639 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /home 2023-11-04T15:25:18.640 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /root 2023-11-04T15:25:18.640 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /tmp 2023-11-04T15:25:18.640 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:25:19.391 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-radosgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 30/32 2023-11-04T15:25:19.415 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 30/32 2023-11-04T15:25:19.415 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:25:19.416 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-04T15:25:19.416 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-04T15:25:19.416 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-04T15:25:19.416 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:25:19.418 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2023-11-04T15:25:19.494 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2023-11-04T15:25:19.494 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2023-11-04T15:25:20.636 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2023-11-04T15:25:20.636 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-base-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/32 2023-11-04T15:25:20.637 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/32 2023-11-04T15:25:20.637 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-radosgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 3/32 2023-11-04T15:25:20.637 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-selinux-2:18.2.0-1181.gf7e9f9af.el9.x86_64 4/32 2023-11-04T15:25:20.637 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libcephfs2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 5/32 2023-11-04T15:25:20.637 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libradosstriper1-2:18.2.0-1181.gf7e9f9af.el9.x86_6 6/32 2023-11-04T15:25:20.638 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librgw2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 7/32 2023-11-04T15:25:20.638 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-ceph-argparse-2:18.2.0-1181.gf7e9f9af.el9. 8/32 2023-11-04T15:25:20.638 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x8 9/32 2023-11-04T15:25:20.638 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cephfs-2:18.2.0-1181.gf7e9f9af.el9.x86_64 10/32 2023-11-04T15:25:20.638 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rados-2:18.2.0-1181.gf7e9f9af.el9.x86_64 11/32 2023-11-04T15:25:20.639 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 12/32 2023-11-04T15:25:20.639 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 13/32 2023-11-04T15:25:20.639 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2023-11-04T15:25:20.639 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2023-11-04T15:25:20.639 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/32 2023-11-04T15:25:20.640 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/32 2023-11-04T15:25:20.640 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/32 2023-11-04T15:25:20.640 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/32 2023-11-04T15:25:20.640 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2023-11-04T15:25:20.640 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2023-11-04T15:25:20.641 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 22/32 2023-11-04T15:25:20.641 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 23/32 2023-11-04T15:25:20.641 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2023-11-04T15:25:20.641 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2023-11-04T15:25:20.641 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 26/32 2023-11-04T15:25:20.641 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2023-11-04T15:25:20.642 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2023-11-04T15:25:20.642 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librados2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 29/32 2023-11-04T15:25:20.642 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2023-11-04T15:25:20.642 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librbd1-2:18.2.0-1181.gf7e9f9af.el9.x86_64 31/32 2023-11-04T15:25:20.743 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x86_64 27/32 2023-11-04T15:25:20.774 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x86_64 27/32 2023-11-04T15:25:21.382 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x86_64 27/32 2023-11-04T15:25:21.419 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-base-2:18.2.0-1181.gf7e9f9af.el9.x86_64 28/32 2023-11-04T15:25:21.500 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-base-2:18.2.0-1181.gf7e9f9af.el9.x86_64 28/32 2023-11-04T15:25:21.501 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-04T15:25:21.501 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-04T15:25:21.501 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:25:21.529 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-selinux-2:18.2.0-1181.gf7e9f9af.el9.x86_64 29/32 2023-11-04T15:25:21.571 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-selinux-2:18.2.0-1181.gf7e9f9af.el9.x86_64 29/32 2023-11-04T15:25:21.571 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /sys 2023-11-04T15:25:21.571 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /proc 2023-11-04T15:25:21.571 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /mnt 2023-11-04T15:25:21.572 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /var/tmp 2023-11-04T15:25:21.572 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /home 2023-11-04T15:25:21.572 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /root 2023-11-04T15:25:21.572 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /tmp 2023-11-04T15:25:21.572 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:25:21.801 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2023-11-04T15:25:21.802 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:25:21.802 INFO:teuthology.orchestra.run.smithi096.stdout:Upgraded: 2023-11-04T15:25:21.802 INFO:teuthology.orchestra.run.smithi096.stdout: librados2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:21.802 INFO:teuthology.orchestra.run.smithi096.stdout: librbd1-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:21.802 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2023-11-04T15:25:21.803 INFO:teuthology.orchestra.run.smithi096.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-04T15:25:21.803 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-base-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:21.803 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:21.803 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-radosgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:21.803 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-selinux-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:21.804 INFO:teuthology.orchestra.run.smithi096.stdout: fmt-8.1.1-5.el9.x86_64 2023-11-04T15:25:21.804 INFO:teuthology.orchestra.run.smithi096.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-04T15:25:21.804 INFO:teuthology.orchestra.run.smithi096.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-04T15:25:21.804 INFO:teuthology.orchestra.run.smithi096.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-04T15:25:21.804 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:21.805 INFO:teuthology.orchestra.run.smithi096.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-04T15:25:21.805 INFO:teuthology.orchestra.run.smithi096.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-04T15:25:21.805 INFO:teuthology.orchestra.run.smithi096.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-04T15:25:21.805 INFO:teuthology.orchestra.run.smithi096.stdout: libradosstriper1-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:21.805 INFO:teuthology.orchestra.run.smithi096.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-04T15:25:21.806 INFO:teuthology.orchestra.run.smithi096.stdout: librgw2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:21.806 INFO:teuthology.orchestra.run.smithi096.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-04T15:25:21.806 INFO:teuthology.orchestra.run.smithi096.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-04T15:25:21.806 INFO:teuthology.orchestra.run.smithi096.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-04T15:25:21.807 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-argparse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:21.807 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:21.807 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cephfs-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:21.807 INFO:teuthology.orchestra.run.smithi096.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-04T15:25:21.808 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rados-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:21.808 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:21.808 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:21.808 INFO:teuthology.orchestra.run.smithi096.stdout: re2-1:20211101-3.el9.x86_64 2023-11-04T15:25:21.808 INFO:teuthology.orchestra.run.smithi096.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-04T15:25:21.808 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:25:21.809 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:25:22.107 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-test 2023-11-04T15:25:22.314 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-radosgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 30/32 2023-11-04T15:25:22.338 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 30/32 2023-11-04T15:25:22.338 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:25:22.339 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-04T15:25:22.339 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-04T15:25:22.339 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-04T15:25:22.339 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:25:22.340 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2023-11-04T15:25:22.408 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2023-11-04T15:25:22.408 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2023-11-04T15:25:22.647 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:00:26 ago on Sat 04 Nov 2023 03:24:56 PM UTC. 2023-11-04T15:25:22.788 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:25:22.789 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:25:22.789 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2023-11-04T15:25:22.789 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:25:22.790 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2023-11-04T15:25:22.790 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-test x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 40 M 2023-11-04T15:25:22.790 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2023-11-04T15:25:22.790 INFO:teuthology.orchestra.run.smithi096.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-11-04T15:25:22.790 INFO:teuthology.orchestra.run.smithi096.stdout: libcephsqlite x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 165 k 2023-11-04T15:25:22.791 INFO:teuthology.orchestra.run.smithi096.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-04T15:25:22.791 INFO:teuthology.orchestra.run.smithi096.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-04T15:25:22.791 INFO:teuthology.orchestra.run.smithi096.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-04T15:25:22.791 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:25:22.791 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2023-11-04T15:25:22.792 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:25:22.792 INFO:teuthology.orchestra.run.smithi096.stdout:Install 6 Packages 2023-11-04T15:25:22.792 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:25:22.793 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 41 M 2023-11-04T15:25:22.793 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 167 M 2023-11-04T15:25:22.793 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2023-11-04T15:25:23.074 INFO:teuthology.orchestra.run.smithi096.stdout:(1/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.4 MB/s | 217 kB 00:00 2023-11-04T15:25:23.116 INFO:teuthology.orchestra.run.smithi096.stdout:(2/6): socat-1.7.4.1-5.el9.x86_64.rpm 7.2 MB/s | 300 kB 00:00 2023-11-04T15:25:23.150 INFO:teuthology.orchestra.run.smithi096.stdout:(3/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.9 MB/s | 63 kB 00:00 2023-11-04T15:25:23.283 INFO:teuthology.orchestra.run.smithi096.stdout:(4/6): jq-1.6-15.el9.x86_64.rpm 1.4 MB/s | 187 kB 00:00 2023-11-04T15:25:23.510 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2023-11-04T15:25:23.510 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-base-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/32 2023-11-04T15:25:23.510 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/32 2023-11-04T15:25:23.510 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-radosgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 3/32 2023-11-04T15:25:23.511 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-selinux-2:18.2.0-1181.gf7e9f9af.el9.x86_64 4/32 2023-11-04T15:25:23.511 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephfs2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 5/32 2023-11-04T15:25:23.511 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libradosstriper1-2:18.2.0-1181.gf7e9f9af.el9.x86_6 6/32 2023-11-04T15:25:23.511 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librgw2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 7/32 2023-11-04T15:25:23.511 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-ceph-argparse-2:18.2.0-1181.gf7e9f9af.el9. 8/32 2023-11-04T15:25:23.512 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x8 9/32 2023-11-04T15:25:23.512 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cephfs-2:18.2.0-1181.gf7e9f9af.el9.x86_64 10/32 2023-11-04T15:25:23.512 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rados-2:18.2.0-1181.gf7e9f9af.el9.x86_64 11/32 2023-11-04T15:25:23.512 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 12/32 2023-11-04T15:25:23.512 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 13/32 2023-11-04T15:25:23.513 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2023-11-04T15:25:23.513 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2023-11-04T15:25:23.513 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/32 2023-11-04T15:25:23.513 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/32 2023-11-04T15:25:23.514 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/32 2023-11-04T15:25:23.514 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/32 2023-11-04T15:25:23.514 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2023-11-04T15:25:23.514 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2023-11-04T15:25:23.514 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 22/32 2023-11-04T15:25:23.515 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 23/32 2023-11-04T15:25:23.515 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2023-11-04T15:25:23.515 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2023-11-04T15:25:23.515 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 26/32 2023-11-04T15:25:23.515 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2023-11-04T15:25:23.516 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2023-11-04T15:25:23.516 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 29/32 2023-11-04T15:25:23.517 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2023-11-04T15:25:23.517 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librbd1-2:18.2.0-1181.gf7e9f9af.el9.x86_64 31/32 2023-11-04T15:25:23.550 INFO:teuthology.orchestra.run.smithi096.stdout:(5/6): libcephsqlite-18.2.0-1181.gf7e9f9af.el9. 262 kB/s | 165 kB 00:00 2023-11-04T15:25:24.423 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2023-11-04T15:25:24.423 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:25:24.423 INFO:teuthology.orchestra.run.smithi130.stdout:Upgraded: 2023-11-04T15:25:24.423 INFO:teuthology.orchestra.run.smithi130.stdout: librados2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:24.424 INFO:teuthology.orchestra.run.smithi130.stdout: librbd1-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:24.424 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-11-04T15:25:24.424 INFO:teuthology.orchestra.run.smithi130.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-04T15:25:24.424 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-base-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:24.424 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:24.425 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-radosgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:24.425 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-selinux-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:24.425 INFO:teuthology.orchestra.run.smithi130.stdout: fmt-8.1.1-5.el9.x86_64 2023-11-04T15:25:24.425 INFO:teuthology.orchestra.run.smithi130.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-04T15:25:24.425 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-04T15:25:24.426 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-04T15:25:24.426 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:24.426 INFO:teuthology.orchestra.run.smithi130.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-04T15:25:24.426 INFO:teuthology.orchestra.run.smithi130.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-04T15:25:24.426 INFO:teuthology.orchestra.run.smithi130.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-04T15:25:24.427 INFO:teuthology.orchestra.run.smithi130.stdout: libradosstriper1-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:24.427 INFO:teuthology.orchestra.run.smithi130.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-04T15:25:24.427 INFO:teuthology.orchestra.run.smithi130.stdout: librgw2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:24.427 INFO:teuthology.orchestra.run.smithi130.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-04T15:25:24.427 INFO:teuthology.orchestra.run.smithi130.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-04T15:25:24.428 INFO:teuthology.orchestra.run.smithi130.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-04T15:25:24.428 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-argparse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:24.428 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:24.428 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cephfs-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:24.428 INFO:teuthology.orchestra.run.smithi130.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-04T15:25:24.429 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rados-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:24.429 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:24.429 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:24.429 INFO:teuthology.orchestra.run.smithi130.stdout: re2-1:20211101-3.el9.x86_64 2023-11-04T15:25:24.429 INFO:teuthology.orchestra.run.smithi130.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-04T15:25:24.430 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:25:24.430 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:25:24.805 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install ceph-test 2023-11-04T15:25:25.356 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:00:27 ago on Sat 04 Nov 2023 03:24:58 PM UTC. 2023-11-04T15:25:25.497 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:25:25.497 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:25:25.498 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2023-11-04T15:25:25.498 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:25:25.498 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-11-04T15:25:25.498 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-test x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 40 M 2023-11-04T15:25:25.498 INFO:teuthology.orchestra.run.smithi130.stdout:Installing dependencies: 2023-11-04T15:25:25.499 INFO:teuthology.orchestra.run.smithi130.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-11-04T15:25:25.499 INFO:teuthology.orchestra.run.smithi130.stdout: libcephsqlite x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 165 k 2023-11-04T15:25:25.499 INFO:teuthology.orchestra.run.smithi130.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-04T15:25:25.499 INFO:teuthology.orchestra.run.smithi130.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-04T15:25:25.499 INFO:teuthology.orchestra.run.smithi130.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-04T15:25:25.500 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:25:25.500 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-11-04T15:25:25.500 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:25:25.500 INFO:teuthology.orchestra.run.smithi130.stdout:Install 6 Packages 2023-11-04T15:25:25.500 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:25:25.501 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 41 M 2023-11-04T15:25:25.501 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 167 M 2023-11-04T15:25:25.501 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-11-04T15:25:25.937 INFO:teuthology.orchestra.run.smithi130.stdout:(1/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.3 MB/s | 217 kB 00:00 2023-11-04T15:25:25.987 INFO:teuthology.orchestra.run.smithi130.stdout:(2/6): socat-1.7.4.1-5.el9.x86_64.rpm 6.1 MB/s | 300 kB 00:00 2023-11-04T15:25:26.020 INFO:teuthology.orchestra.run.smithi130.stdout:(3/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2023-11-04T15:25:26.121 INFO:teuthology.orchestra.run.smithi130.stdout:(4/6): libcephsqlite-18.2.0-1181.gf7e9f9af.el9. 478 kB/s | 165 kB 00:00 2023-11-04T15:25:26.187 INFO:teuthology.orchestra.run.smithi130.stdout:(5/6): jq-1.6-15.el9.x86_64.rpm 1.1 MB/s | 187 kB 00:00 2023-11-04T15:25:26.267 INFO:teuthology.orchestra.run.smithi096.stdout:(6/6): ceph-test-18.2.0-1181.gf7e9f9af.el9.x86_ 12 MB/s | 40 MB 00:03 2023-11-04T15:25:26.270 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:25:26.270 INFO:teuthology.orchestra.run.smithi096.stdout:Total 12 MB/s | 41 MB 00:03 2023-11-04T15:25:26.284 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2023-11-04T15:25:26.304 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2023-11-04T15:25:26.304 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2023-11-04T15:25:26.641 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2023-11-04T15:25:26.641 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2023-11-04T15:25:27.158 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2023-11-04T15:25:27.245 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2023-11-04T15:25:27.301 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2023-11-04T15:25:27.334 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2023-11-04T15:25:27.375 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : jq-1.6-15.el9.x86_64 4/6 2023-11-04T15:25:27.403 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libcephsqlite-2:18.2.0-1181.gf7e9f9af.el9.x86_64 5/6 2023-11-04T15:25:28.080 INFO:teuthology.orchestra.run.smithi130.stdout:(6/6): ceph-test-18.2.0-1181.gf7e9f9af.el9.x86_ 17 MB/s | 40 MB 00:02 2023-11-04T15:25:28.083 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:25:28.083 INFO:teuthology.orchestra.run.smithi130.stdout:Total 16 MB/s | 41 MB 00:02 2023-11-04T15:25:28.098 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-11-04T15:25:28.118 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-11-04T15:25:28.119 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-11-04T15:25:28.455 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-11-04T15:25:28.455 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-11-04T15:25:28.993 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-11-04T15:25:29.082 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2023-11-04T15:25:29.123 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2023-11-04T15:25:29.154 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2023-11-04T15:25:29.197 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : jq-1.6-15.el9.x86_64 4/6 2023-11-04T15:25:29.232 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcephsqlite-2:18.2.0-1181.gf7e9f9af.el9.x86_64 5/6 2023-11-04T15:25:31.314 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libcephsqlite-2:18.2.0-1181.gf7e9f9af.el9.x86_64 5/6 2023-11-04T15:25:31.385 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-test-2:18.2.0-1181.gf7e9f9af.el9.x86_64 6/6 2023-11-04T15:25:31.634 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-selinux-2:18.2.0-1181.gf7e9f9af.el9.x86_64 29/32 2023-11-04T15:25:31.634 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /sys 2023-11-04T15:25:31.634 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /proc 2023-11-04T15:25:31.635 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /mnt 2023-11-04T15:25:31.635 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /var/tmp 2023-11-04T15:25:31.635 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /home 2023-11-04T15:25:31.635 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /root 2023-11-04T15:25:31.635 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /tmp 2023-11-04T15:25:31.636 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:25:32.402 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-radosgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 30/32 2023-11-04T15:25:32.433 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 30/32 2023-11-04T15:25:32.434 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:25:32.434 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-04T15:25:32.434 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-04T15:25:32.435 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-04T15:25:32.435 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:25:32.435 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2023-11-04T15:25:32.505 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2023-11-04T15:25:32.505 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2023-11-04T15:25:32.966 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libcephsqlite-2:18.2.0-1181.gf7e9f9af.el9.x86_64 5/6 2023-11-04T15:25:33.056 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-test-2:18.2.0-1181.gf7e9f9af.el9.x86_64 6/6 2023-11-04T15:25:33.434 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-test-2:18.2.0-1181.gf7e9f9af.el9.x86_64 6/6 2023-11-04T15:25:33.435 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-test-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/6 2023-11-04T15:25:33.435 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libcephsqlite-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/6 2023-11-04T15:25:33.435 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2023-11-04T15:25:33.435 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2023-11-04T15:25:33.435 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2023-11-04T15:25:33.648 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2023-11-04T15:25:33.648 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-base-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/32 2023-11-04T15:25:33.648 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/32 2023-11-04T15:25:33.649 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-radosgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 3/32 2023-11-04T15:25:33.649 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-selinux-2:18.2.0-1181.gf7e9f9af.el9.x86_64 4/32 2023-11-04T15:25:33.649 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephfs2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 5/32 2023-11-04T15:25:33.649 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libradosstriper1-2:18.2.0-1181.gf7e9f9af.el9.x86_6 6/32 2023-11-04T15:25:33.650 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librgw2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 7/32 2023-11-04T15:25:33.650 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ceph-argparse-2:18.2.0-1181.gf7e9f9af.el9. 8/32 2023-11-04T15:25:33.650 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x8 9/32 2023-11-04T15:25:33.650 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cephfs-2:18.2.0-1181.gf7e9f9af.el9.x86_64 10/32 2023-11-04T15:25:33.650 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rados-2:18.2.0-1181.gf7e9f9af.el9.x86_64 11/32 2023-11-04T15:25:33.651 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 12/32 2023-11-04T15:25:33.651 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 13/32 2023-11-04T15:25:33.651 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2023-11-04T15:25:33.651 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2023-11-04T15:25:33.651 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/32 2023-11-04T15:25:33.651 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/32 2023-11-04T15:25:33.652 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/32 2023-11-04T15:25:33.652 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/32 2023-11-04T15:25:33.652 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2023-11-04T15:25:33.652 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2023-11-04T15:25:33.652 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 22/32 2023-11-04T15:25:33.653 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 23/32 2023-11-04T15:25:33.653 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2023-11-04T15:25:33.653 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2023-11-04T15:25:33.653 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 26/32 2023-11-04T15:25:33.653 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2023-11-04T15:25:33.654 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2023-11-04T15:25:33.654 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 29/32 2023-11-04T15:25:33.654 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2023-11-04T15:25:33.654 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librbd1-2:18.2.0-1181.gf7e9f9af.el9.x86_64 31/32 2023-11-04T15:25:33.798 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : jq-1.6-15.el9.x86_64 6/6 2023-11-04T15:25:33.799 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:25:33.799 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2023-11-04T15:25:33.799 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-test-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:33.799 INFO:teuthology.orchestra.run.smithi096.stdout: jq-1.6-15.el9.x86_64 2023-11-04T15:25:33.799 INFO:teuthology.orchestra.run.smithi096.stdout: libcephsqlite-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:33.800 INFO:teuthology.orchestra.run.smithi096.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-04T15:25:33.800 INFO:teuthology.orchestra.run.smithi096.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-04T15:25:33.800 INFO:teuthology.orchestra.run.smithi096.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-04T15:25:33.800 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:25:33.800 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:25:34.100 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph 2023-11-04T15:25:34.650 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:00:38 ago on Sat 04 Nov 2023 03:24:56 PM UTC. 2023-11-04T15:25:34.793 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:25:34.795 INFO:teuthology.orchestra.run.smithi096.stdout:========================================================================================= 2023-11-04T15:25:34.795 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2023-11-04T15:25:34.795 INFO:teuthology.orchestra.run.smithi096.stdout:========================================================================================= 2023-11-04T15:25:34.796 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2023-11-04T15:25:34.796 INFO:teuthology.orchestra.run.smithi096.stdout: ceph x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 6.5 k 2023-11-04T15:25:34.796 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2023-11-04T15:25:34.796 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mds x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 2.1 M 2023-11-04T15:25:34.796 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 1.4 M 2023-11-04T15:25:34.797 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-modules-core noarch 2:18.2.0-1181.gf7e9f9af.el9 ceph-noarch 242 k 2023-11-04T15:25:34.797 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mon x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 4.4 M 2023-11-04T15:25:34.797 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-osd x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 18 M 2023-11-04T15:25:34.797 INFO:teuthology.orchestra.run.smithi096.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-04T15:25:34.797 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-04T15:25:34.798 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-04T15:25:34.798 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-04T15:25:34.798 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-11-04T15:25:34.798 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-04T15:25:34.798 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-04T15:25:34.799 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-04T15:25:34.799 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-04T15:25:34.799 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-04T15:25:34.799 INFO:teuthology.orchestra.run.smithi096.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-04T15:25:34.799 INFO:teuthology.orchestra.run.smithi096.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-04T15:25:34.799 INFO:teuthology.orchestra.run.smithi096.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-04T15:25:34.800 INFO:teuthology.orchestra.run.smithi096.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-04T15:25:34.800 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-04T15:25:34.800 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-04T15:25:34.800 INFO:teuthology.orchestra.run.smithi096.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-04T15:25:34.800 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-04T15:25:34.801 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-04T15:25:34.801 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-11-04T15:25:34.801 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-04T15:25:34.801 INFO:teuthology.orchestra.run.smithi096.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-04T15:25:34.801 INFO:teuthology.orchestra.run.smithi096.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-04T15:25:34.802 INFO:teuthology.orchestra.run.smithi096.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-04T15:25:34.802 INFO:teuthology.orchestra.run.smithi096.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-04T15:25:34.802 INFO:teuthology.orchestra.run.smithi096.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-04T15:25:34.802 INFO:teuthology.orchestra.run.smithi096.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-04T15:25:34.802 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:25:34.803 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2023-11-04T15:25:34.803 INFO:teuthology.orchestra.run.smithi096.stdout:========================================================================================= 2023-11-04T15:25:34.803 INFO:teuthology.orchestra.run.smithi096.stdout:Install 33 Packages 2023-11-04T15:25:34.803 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:25:34.804 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 30 M 2023-11-04T15:25:34.804 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 109 M 2023-11-04T15:25:34.804 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2023-11-04T15:25:35.005 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2023-11-04T15:25:35.005 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:25:35.006 INFO:teuthology.orchestra.run.smithi019.stdout:Upgraded: 2023-11-04T15:25:35.006 INFO:teuthology.orchestra.run.smithi019.stdout: librados2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:35.006 INFO:teuthology.orchestra.run.smithi019.stdout: librbd1-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:35.006 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2023-11-04T15:25:35.007 INFO:teuthology.orchestra.run.smithi019.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-04T15:25:35.007 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-base-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:35.007 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:35.007 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-radosgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:35.007 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-selinux-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:35.007 INFO:teuthology.orchestra.run.smithi019.stdout: fmt-8.1.1-5.el9.x86_64 2023-11-04T15:25:35.008 INFO:teuthology.orchestra.run.smithi019.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-04T15:25:35.008 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-04T15:25:35.008 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-04T15:25:35.009 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:35.009 INFO:teuthology.orchestra.run.smithi019.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-04T15:25:35.009 INFO:teuthology.orchestra.run.smithi019.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-04T15:25:35.010 INFO:teuthology.orchestra.run.smithi019.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-04T15:25:35.010 INFO:teuthology.orchestra.run.smithi019.stdout: libradosstriper1-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:35.010 INFO:teuthology.orchestra.run.smithi019.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-04T15:25:35.011 INFO:teuthology.orchestra.run.smithi019.stdout: librgw2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:35.011 INFO:teuthology.orchestra.run.smithi019.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-04T15:25:35.011 INFO:teuthology.orchestra.run.smithi019.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-04T15:25:35.011 INFO:teuthology.orchestra.run.smithi019.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-04T15:25:35.012 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-argparse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:35.012 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:35.012 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cephfs-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:35.013 INFO:teuthology.orchestra.run.smithi019.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-04T15:25:35.013 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rados-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:35.013 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:35.014 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:35.014 INFO:teuthology.orchestra.run.smithi019.stdout: re2-1:20211101-3.el9.x86_64 2023-11-04T15:25:35.014 INFO:teuthology.orchestra.run.smithi019.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-04T15:25:35.014 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:25:35.014 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:25:35.177 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-test-2:18.2.0-1181.gf7e9f9af.el9.x86_64 6/6 2023-11-04T15:25:35.177 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-test-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/6 2023-11-04T15:25:35.177 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephsqlite-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/6 2023-11-04T15:25:35.178 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2023-11-04T15:25:35.178 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2023-11-04T15:25:35.178 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2023-11-04T15:25:35.211 INFO:teuthology.orchestra.run.smithi096.stdout:(1/33): ceph-18.2.0-1181.gf7e9f9af.el9.x86_64.r 31 kB/s | 6.5 kB 00:00 2023-11-04T15:25:35.286 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install ceph-test 2023-11-04T15:25:35.345 INFO:teuthology.orchestra.run.smithi096.stdout:(2/33): ceph-mgr-18.2.0-1181.gf7e9f9af.el9.x86_ 4.2 MB/s | 1.4 MB 00:00 2023-11-04T15:25:35.549 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : jq-1.6-15.el9.x86_64 6/6 2023-11-04T15:25:35.550 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:25:35.550 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-11-04T15:25:35.550 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-test-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:35.550 INFO:teuthology.orchestra.run.smithi130.stdout: jq-1.6-15.el9.x86_64 2023-11-04T15:25:35.551 INFO:teuthology.orchestra.run.smithi130.stdout: libcephsqlite-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:35.551 INFO:teuthology.orchestra.run.smithi130.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-04T15:25:35.551 INFO:teuthology.orchestra.run.smithi130.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-04T15:25:35.551 INFO:teuthology.orchestra.run.smithi130.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-04T15:25:35.551 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:25:35.552 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:25:35.778 INFO:teuthology.orchestra.run.smithi096.stdout:(3/33): ceph-mds-18.2.0-1181.gf7e9f9af.el9.x86_ 2.7 MB/s | 2.1 MB 00:00 2023-11-04T15:25:35.861 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install ceph 2023-11-04T15:25:35.862 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:00:28 ago on Sat 04 Nov 2023 03:25:07 PM UTC. 2023-11-04T15:25:35.870 INFO:teuthology.orchestra.run.smithi096.stdout:(4/33): ceph-mgr-modules-core-18.2.0-1181.gf7e9 2.6 MB/s | 242 kB 00:00 2023-11-04T15:25:35.979 INFO:teuthology.orchestra.run.smithi096.stdout:(5/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 144 kB 00:00 2023-11-04T15:25:36.004 INFO:teuthology.orchestra.run.smithi096.stdout:(6/33): python3-markupsafe-1.1.1-12.el9.x86_64. 1.2 MB/s | 32 kB 00:00 2023-11-04T15:25:36.013 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:25:36.014 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:25:36.014 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2023-11-04T15:25:36.014 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:25:36.015 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2023-11-04T15:25:36.015 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-test x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 40 M 2023-11-04T15:25:36.015 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2023-11-04T15:25:36.016 INFO:teuthology.orchestra.run.smithi019.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-11-04T15:25:36.016 INFO:teuthology.orchestra.run.smithi019.stdout: libcephsqlite x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 165 k 2023-11-04T15:25:36.017 INFO:teuthology.orchestra.run.smithi019.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-04T15:25:36.017 INFO:teuthology.orchestra.run.smithi019.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-04T15:25:36.017 INFO:teuthology.orchestra.run.smithi019.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-04T15:25:36.018 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:25:36.018 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2023-11-04T15:25:36.018 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:25:36.019 INFO:teuthology.orchestra.run.smithi019.stdout:Install 6 Packages 2023-11-04T15:25:36.019 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:25:36.020 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 41 M 2023-11-04T15:25:36.021 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 167 M 2023-11-04T15:25:36.021 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2023-11-04T15:25:36.029 INFO:teuthology.orchestra.run.smithi096.stdout:(7/33): python3-toml-0.10.2-6.el9.noarch.rpm 1.5 MB/s | 39 kB 00:00 2023-11-04T15:25:36.071 INFO:teuthology.orchestra.run.smithi096.stdout:(8/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.6 MB/s | 241 kB 00:00 2023-11-04T15:25:36.105 INFO:teuthology.orchestra.run.smithi096.stdout:(9/33): python3-ply-3.11-14.el9.noarch.rpm 3.0 MB/s | 103 kB 00:00 2023-11-04T15:25:36.139 INFO:teuthology.orchestra.run.smithi096.stdout:(10/33): python3-pycparser-2.20-6.el9.noarch.rp 3.7 MB/s | 124 kB 00:00 2023-11-04T15:25:36.206 INFO:teuthology.orchestra.run.smithi096.stdout:(11/33): ceph-mon-18.2.0-1181.gf7e9f9af.el9.x86 4.4 MB/s | 4.4 MB 00:00 2023-11-04T15:25:36.209 INFO:teuthology.orchestra.run.smithi019.stdout:(1/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.4 MB/s | 217 kB 00:00 2023-11-04T15:25:36.231 INFO:teuthology.orchestra.run.smithi096.stdout:(12/33): python3-requests-2.25.1-7.el9.noarch.r 1.2 MB/s | 113 kB 00:00 2023-11-04T15:25:36.256 INFO:teuthology.orchestra.run.smithi096.stdout:(13/33): python3-urllib3-1.26.5-4.el9.noarch.rp 3.7 MB/s | 187 kB 00:00 2023-11-04T15:25:36.260 INFO:teuthology.orchestra.run.smithi019.stdout:(2/6): socat-1.7.4.1-5.el9.x86_64.rpm 6.0 MB/s | 300 kB 00:00 2023-11-04T15:25:36.293 INFO:teuthology.orchestra.run.smithi019.stdout:(3/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2023-11-04T15:25:36.365 INFO:teuthology.orchestra.run.smithi096.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 471 kB/s | 51 kB 00:00 2023-11-04T15:25:36.413 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:00:38 ago on Sat 04 Nov 2023 03:24:58 PM UTC. 2023-11-04T15:25:36.427 INFO:teuthology.orchestra.run.smithi019.stdout:(4/6): jq-1.6-15.el9.x86_64.rpm 1.4 MB/s | 187 kB 00:00 2023-11-04T15:25:36.457 INFO:teuthology.orchestra.run.smithi096.stdout:(15/33): python3-cryptography-36.0.1-4.el9.x86_ 5.4 MB/s | 1.2 MB 00:00 2023-11-04T15:25:36.460 INFO:teuthology.orchestra.run.smithi019.stdout:(5/6): libcephsqlite-18.2.0-1181.gf7e9f9af.el9. 411 kB/s | 165 kB 00:00 2023-11-04T15:25:36.482 INFO:teuthology.orchestra.run.smithi096.stdout:(16/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 371 kB/s | 43 kB 00:00 2023-11-04T15:25:36.554 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:25:36.557 INFO:teuthology.orchestra.run.smithi130.stdout:========================================================================================= 2023-11-04T15:25:36.557 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2023-11-04T15:25:36.557 INFO:teuthology.orchestra.run.smithi130.stdout:========================================================================================= 2023-11-04T15:25:36.557 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-11-04T15:25:36.558 INFO:teuthology.orchestra.run.smithi130.stdout: ceph x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 6.5 k 2023-11-04T15:25:36.558 INFO:teuthology.orchestra.run.smithi130.stdout:Installing dependencies: 2023-11-04T15:25:36.558 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mds x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 2.1 M 2023-11-04T15:25:36.558 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 1.4 M 2023-11-04T15:25:36.558 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-modules-core noarch 2:18.2.0-1181.gf7e9f9af.el9 ceph-noarch 242 k 2023-11-04T15:25:36.559 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mon x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 4.4 M 2023-11-04T15:25:36.559 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-osd x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 18 M 2023-11-04T15:25:36.559 INFO:teuthology.orchestra.run.smithi130.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-04T15:25:36.559 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-04T15:25:36.559 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-04T15:25:36.560 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-04T15:25:36.560 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-11-04T15:25:36.560 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-04T15:25:36.560 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-04T15:25:36.561 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-04T15:25:36.561 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-04T15:25:36.561 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-04T15:25:36.561 INFO:teuthology.orchestra.run.smithi130.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-04T15:25:36.561 INFO:teuthology.orchestra.run.smithi130.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-04T15:25:36.561 INFO:teuthology.orchestra.run.smithi130.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-04T15:25:36.562 INFO:teuthology.orchestra.run.smithi130.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-04T15:25:36.562 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-04T15:25:36.562 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-04T15:25:36.562 INFO:teuthology.orchestra.run.smithi130.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-04T15:25:36.562 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-04T15:25:36.563 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-04T15:25:36.563 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-11-04T15:25:36.563 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-04T15:25:36.563 INFO:teuthology.orchestra.run.smithi130.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-04T15:25:36.563 INFO:teuthology.orchestra.run.smithi130.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-04T15:25:36.564 INFO:teuthology.orchestra.run.smithi130.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-04T15:25:36.564 INFO:teuthology.orchestra.run.smithi130.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-04T15:25:36.564 INFO:teuthology.orchestra.run.smithi130.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-04T15:25:36.564 INFO:teuthology.orchestra.run.smithi130.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-04T15:25:36.564 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:25:36.564 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-11-04T15:25:36.565 INFO:teuthology.orchestra.run.smithi130.stdout:========================================================================================= 2023-11-04T15:25:36.565 INFO:teuthology.orchestra.run.smithi130.stdout:Install 33 Packages 2023-11-04T15:25:36.565 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:25:36.566 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 30 M 2023-11-04T15:25:36.566 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 109 M 2023-11-04T15:25:36.566 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-11-04T15:25:36.649 INFO:teuthology.orchestra.run.smithi096.stdout:(17/33): ceph-osd-18.2.0-1181.gf7e9f9af.el9.x86 13 MB/s | 18 MB 00:01 2023-11-04T15:25:36.708 INFO:teuthology.orchestra.run.smithi096.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 184 kB/s | 11 kB 00:00 2023-11-04T15:25:36.741 INFO:teuthology.orchestra.run.smithi096.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 605 kB/s | 172 kB 00:00 2023-11-04T15:25:36.767 INFO:teuthology.orchestra.run.smithi096.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 302 kB/s | 18 kB 00:00 2023-11-04T15:25:36.792 INFO:teuthology.orchestra.run.smithi096.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 460 kB/s | 23 kB 00:00 2023-11-04T15:25:36.817 INFO:teuthology.orchestra.run.smithi096.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 388 kB/s | 19 kB 00:00 2023-11-04T15:25:36.843 INFO:teuthology.orchestra.run.smithi096.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2023-11-04T15:25:36.868 INFO:teuthology.orchestra.run.smithi096.stdout:(24/33): python3-cherrypy-18.6.1-2.el9.noarch.r 931 kB/s | 358 kB 00:00 2023-11-04T15:25:36.893 INFO:teuthology.orchestra.run.smithi096.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 612 kB/s | 46 kB 00:00 2023-11-04T15:25:36.905 INFO:teuthology.orchestra.run.smithi130.stdout:(1/33): ceph-18.2.0-1181.gf7e9f9af.el9.x86_64.r 36 kB/s | 6.5 kB 00:00 2023-11-04T15:25:36.918 INFO:teuthology.orchestra.run.smithi096.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2023-11-04T15:25:36.943 INFO:teuthology.orchestra.run.smithi096.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 327 kB/s | 16 kB 00:00 2023-11-04T15:25:36.985 INFO:teuthology.orchestra.run.smithi096.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.3 MB/s | 90 kB 00:00 2023-11-04T15:25:37.002 INFO:teuthology.orchestra.run.smithi096.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 610 kB/s | 36 kB 00:00 2023-11-04T15:25:37.028 INFO:teuthology.orchestra.run.smithi096.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2023-11-04T15:25:37.078 INFO:teuthology.orchestra.run.smithi096.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 401 kB/s | 20 kB 00:00 2023-11-04T15:25:37.103 INFO:teuthology.orchestra.run.smithi096.stdout:(32/33): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2023-11-04T15:25:37.137 INFO:teuthology.orchestra.run.smithi096.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.1 MB/s | 427 kB 00:00 2023-11-04T15:25:37.140 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:25:37.140 INFO:teuthology.orchestra.run.smithi096.stdout:Total 13 MB/s | 30 MB 00:02 2023-11-04T15:25:37.173 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2023-11-04T15:25:37.213 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2023-11-04T15:25:37.214 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2023-11-04T15:25:37.594 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2023-11-04T15:25:37.595 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2023-11-04T15:25:38.205 INFO:teuthology.orchestra.run.smithi130.stdout:(2/33): ceph-mgr-18.2.0-1181.gf7e9f9af.el9.x86_ 1.0 MB/s | 1.4 MB 00:01 2023-11-04T15:25:38.289 INFO:teuthology.orchestra.run.smithi130.stdout:(3/33): ceph-mds-18.2.0-1181.gf7e9f9af.el9.x86_ 1.3 MB/s | 2.1 MB 00:01 2023-11-04T15:25:38.389 INFO:teuthology.orchestra.run.smithi130.stdout:(4/33): ceph-mgr-modules-core-18.2.0-1181.gf7e9 2.4 MB/s | 242 kB 00:00 2023-11-04T15:25:38.394 INFO:teuthology.orchestra.run.smithi019.stdout:(6/6): ceph-test-18.2.0-1181.gf7e9f9af.el9.x86_ 17 MB/s | 40 MB 00:02 2023-11-04T15:25:38.397 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:25:38.397 INFO:teuthology.orchestra.run.smithi019.stdout:Total 17 MB/s | 41 MB 00:02 2023-11-04T15:25:38.412 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2023-11-04T15:25:38.435 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2023-11-04T15:25:38.435 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2023-11-04T15:25:38.456 INFO:teuthology.orchestra.run.smithi130.stdout:(5/33): ceph-mon-18.2.0-1181.gf7e9f9af.el9.x86_ 2.8 MB/s | 4.4 MB 00:01 2023-11-04T15:25:38.557 INFO:teuthology.orchestra.run.smithi130.stdout:(6/33): python3-markupsafe-1.1.1-12.el9.x86_64. 316 kB/s | 32 kB 00:00 2023-11-04T15:25:38.582 INFO:teuthology.orchestra.run.smithi130.stdout:(7/33): python3-mako-1.1.4-6.el9.noarch.rpm 751 kB/s | 144 kB 00:00 2023-11-04T15:25:38.598 INFO:teuthology.orchestra.run.smithi130.stdout:(8/33): python3-toml-0.10.2-6.el9.noarch.rpm 927 kB/s | 39 kB 00:00 2023-11-04T15:25:38.632 INFO:teuthology.orchestra.run.smithi130.stdout:(9/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2023-11-04T15:25:38.657 INFO:teuthology.orchestra.run.smithi130.stdout:(10/33): python3-ply-3.11-14.el9.noarch.rpm 1.7 MB/s | 103 kB 00:00 2023-11-04T15:25:38.683 INFO:teuthology.orchestra.run.smithi130.stdout:(11/33): python3-pycparser-2.20-6.el9.noarch.rp 2.4 MB/s | 124 kB 00:00 2023-11-04T15:25:38.708 INFO:teuthology.orchestra.run.smithi130.stdout:(12/33): python3-requests-2.25.1-7.el9.noarch.r 2.2 MB/s | 113 kB 00:00 2023-11-04T15:25:38.733 INFO:teuthology.orchestra.run.smithi130.stdout:(13/33): python3-urllib3-1.26.5-4.el9.noarch.rp 3.7 MB/s | 187 kB 00:00 2023-11-04T15:25:38.793 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2023-11-04T15:25:38.793 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2023-11-04T15:25:38.804 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2023-11-04T15:25:38.881 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2023-11-04T15:25:38.913 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2023-11-04T15:25:38.925 INFO:teuthology.orchestra.run.smithi130.stdout:(14/33): python3-cryptography-36.0.1-4.el9.x86_ 5.7 MB/s | 1.2 MB 00:00 2023-11-04T15:25:38.946 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2023-11-04T15:25:39.029 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2023-11-04T15:25:39.100 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2023-11-04T15:25:39.141 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2023-11-04T15:25:39.179 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2023-11-04T15:25:39.234 INFO:teuthology.orchestra.run.smithi130.stdout:(15/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 141 kB/s | 43 kB 00:00 2023-11-04T15:25:39.246 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 8/33 2023-11-04T15:25:39.300 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 9/33 2023-11-04T15:25:39.330 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2023-11-04T15:25:39.339 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 10/33 2023-11-04T15:25:39.388 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-ply-3.11-14.el9.noarch 11/33 2023-11-04T15:25:39.413 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2023-11-04T15:25:39.442 INFO:teuthology.orchestra.run.smithi130.stdout:(16/33): python3-pytz-2021.1-5.el9.noarch.rpm 72 kB/s | 51 kB 00:00 2023-11-04T15:25:39.443 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 12/33 2023-11-04T15:25:39.467 INFO:teuthology.orchestra.run.smithi130.stdout:(17/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 736 kB/s | 172 kB 00:00 2023-11-04T15:25:39.471 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2023-11-04T15:25:39.503 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2023-11-04T15:25:39.559 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : jq-1.6-15.el9.x86_64 4/6 2023-11-04T15:25:39.565 INFO:teuthology.orchestra.run.smithi130.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 110 kB/s | 11 kB 00:00 2023-11-04T15:25:39.589 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephsqlite-2:18.2.0-1181.gf7e9f9af.el9.x86_64 5/6 2023-11-04T15:25:39.598 INFO:teuthology.orchestra.run.smithi130.stdout:(19/33): python3-cherrypy-18.6.1-2.el9.noarch.r 2.3 MB/s | 358 kB 00:00 2023-11-04T15:25:39.629 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 13/33 2023-11-04T15:25:39.640 INFO:teuthology.orchestra.run.smithi130.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 235 kB/s | 18 kB 00:00 2023-11-04T15:25:39.674 INFO:teuthology.orchestra.run.smithi130.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 308 kB/s | 23 kB 00:00 2023-11-04T15:25:39.677 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 14/33 2023-11-04T15:25:39.707 INFO:teuthology.orchestra.run.smithi130.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 291 kB/s | 19 kB 00:00 2023-11-04T15:25:39.720 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 15/33 2023-11-04T15:25:39.755 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 16/33 2023-11-04T15:25:39.785 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 17/33 2023-11-04T15:25:39.799 INFO:teuthology.orchestra.run.smithi130.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 157 kB/s | 20 kB 00:00 2023-11-04T15:25:39.816 INFO:teuthology.orchestra.run.smithi130.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 427 kB/s | 46 kB 00:00 2023-11-04T15:25:39.861 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 18/33 2023-11-04T15:25:39.883 INFO:teuthology.orchestra.run.smithi130.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 946 kB/s | 79 kB 00:00 2023-11-04T15:25:39.895 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 19/33 2023-11-04T15:25:39.928 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 20/33 2023-11-04T15:25:39.967 INFO:teuthology.orchestra.run.smithi130.stdout:(26/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2023-11-04T15:25:39.970 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 21/33 2023-11-04T15:25:39.984 INFO:teuthology.orchestra.run.smithi130.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 164 kB/s | 16 kB 00:00 2023-11-04T15:25:40.004 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2023-11-04T15:25:40.051 INFO:teuthology.orchestra.run.smithi130.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.1 MB/s | 90 kB 00:00 2023-11-04T15:25:40.068 INFO:teuthology.orchestra.run.smithi130.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 428 kB/s | 36 kB 00:00 2023-11-04T15:25:40.094 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2023-11-04T15:25:40.143 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2023-11-04T15:25:40.176 INFO:teuthology.orchestra.run.smithi130.stdout:(30/33): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2023-11-04T15:25:40.217 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2023-11-04T15:25:40.293 INFO:teuthology.orchestra.run.smithi130.stdout:(31/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.9 MB/s | 427 kB 00:00 2023-11-04T15:25:40.310 INFO:teuthology.orchestra.run.smithi130.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 150 kB/s | 20 kB 00:00 2023-11-04T15:25:40.352 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2023-11-04T15:25:40.485 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2023-11-04T15:25:40.648 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-1181.gf7e9f9af.el9. 28/33 2023-11-04T15:25:40.674 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-2:18.2.0-1181.gf7e9f9af.el9.x86_64 29/33 2023-11-04T15:25:40.699 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-2:18.2.0-1181.gf7e9f9af.el9.x86_64 29/33 2023-11-04T15:25:40.699 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:25:40.699 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-04T15:25:40.699 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-04T15:25:40.700 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-04T15:25:40.700 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:25:42.250 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-osd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 30/33 2023-11-04T15:25:42.278 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-osd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 30/33 2023-11-04T15:25:42.279 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:25:42.279 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-04T15:25:42.279 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-04T15:25:42.279 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-04T15:25:42.280 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:25:42.743 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mon-2:18.2.0-1181.gf7e9f9af.el9.x86_64 31/33 2023-11-04T15:25:42.766 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mon-2:18.2.0-1181.gf7e9f9af.el9.x86_64 31/33 2023-11-04T15:25:42.767 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:25:42.767 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-04T15:25:42.767 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-04T15:25:42.767 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-04T15:25:42.767 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:25:42.977 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mds-2:18.2.0-1181.gf7e9f9af.el9.x86_64 32/33 2023-11-04T15:25:43.000 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mds-2:18.2.0-1181.gf7e9f9af.el9.x86_64 32/33 2023-11-04T15:25:43.000 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:25:43.001 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-04T15:25:43.001 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-04T15:25:43.001 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-04T15:25:43.001 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:25:43.058 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-2:18.2.0-1181.gf7e9f9af.el9.x86_64 33/33 2023-11-04T15:25:43.541 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libcephsqlite-2:18.2.0-1181.gf7e9f9af.el9.x86_64 5/6 2023-11-04T15:25:43.624 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-test-2:18.2.0-1181.gf7e9f9af.el9.x86_64 6/6 2023-11-04T15:25:44.692 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-2:18.2.0-1181.gf7e9f9af.el9.x86_64 33/33 2023-11-04T15:25:44.693 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/33 2023-11-04T15:25:44.693 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mds-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/33 2023-11-04T15:25:44.693 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-2:18.2.0-1181.gf7e9f9af.el9.x86_64 3/33 2023-11-04T15:25:44.693 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mon-2:18.2.0-1181.gf7e9f9af.el9.x86_64 4/33 2023-11-04T15:25:44.694 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-osd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 5/33 2023-11-04T15:25:44.694 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-1181.gf7e9f9af.el9. 6/33 2023-11-04T15:25:44.694 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2023-11-04T15:25:44.694 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2023-11-04T15:25:44.695 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 9/33 2023-11-04T15:25:44.695 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 10/33 2023-11-04T15:25:44.695 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-ply-3.11-14.el9.noarch 11/33 2023-11-04T15:25:44.695 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 12/33 2023-11-04T15:25:44.696 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 13/33 2023-11-04T15:25:44.696 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 14/33 2023-11-04T15:25:44.696 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 15/33 2023-11-04T15:25:44.696 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/33 2023-11-04T15:25:44.697 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2023-11-04T15:25:44.697 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2023-11-04T15:25:44.697 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2023-11-04T15:25:44.697 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2023-11-04T15:25:44.697 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2023-11-04T15:25:44.698 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2023-11-04T15:25:44.698 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2023-11-04T15:25:44.698 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2023-11-04T15:25:44.698 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2023-11-04T15:25:44.699 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2023-11-04T15:25:44.699 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2023-11-04T15:25:44.699 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2023-11-04T15:25:44.699 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2023-11-04T15:25:44.699 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2023-11-04T15:25:44.700 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2023-11-04T15:25:44.700 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2023-11-04T15:25:45.085 INFO:teuthology.orchestra.run.smithi130.stdout:(33/33): ceph-osd-18.2.0-1181.gf7e9f9af.el9.x86 2.6 MB/s | 18 MB 00:06 2023-11-04T15:25:45.090 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:25:45.090 INFO:teuthology.orchestra.run.smithi130.stdout:Total 3.5 MB/s | 30 MB 00:08 2023-11-04T15:25:45.123 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-11-04T15:25:45.163 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-11-04T15:25:45.164 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-11-04T15:25:45.519 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-11-04T15:25:45.519 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-11-04T15:25:45.635 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2023-11-04T15:25:45.636 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:25:45.636 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2023-11-04T15:25:45.636 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:45.636 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mds-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:45.637 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:45.637 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-modules-core-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:25:45.637 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mon-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:45.637 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-osd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:45.637 INFO:teuthology.orchestra.run.smithi096.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-04T15:25:45.638 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-04T15:25:45.638 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-04T15:25:45.638 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-04T15:25:45.638 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-04T15:25:45.638 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-04T15:25:45.639 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-04T15:25:45.639 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-04T15:25:45.639 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-04T15:25:45.639 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-04T15:25:45.639 INFO:teuthology.orchestra.run.smithi096.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-04T15:25:45.640 INFO:teuthology.orchestra.run.smithi096.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-04T15:25:45.640 INFO:teuthology.orchestra.run.smithi096.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-04T15:25:45.640 INFO:teuthology.orchestra.run.smithi096.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-04T15:25:45.640 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-04T15:25:45.640 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ply-3.11-14.el9.noarch 2023-11-04T15:25:45.641 INFO:teuthology.orchestra.run.smithi096.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-04T15:25:45.641 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-04T15:25:45.641 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-04T15:25:45.641 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-04T15:25:45.641 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-04T15:25:45.642 INFO:teuthology.orchestra.run.smithi096.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-04T15:25:45.642 INFO:teuthology.orchestra.run.smithi096.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-04T15:25:45.642 INFO:teuthology.orchestra.run.smithi096.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-04T15:25:45.642 INFO:teuthology.orchestra.run.smithi096.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-04T15:25:45.642 INFO:teuthology.orchestra.run.smithi096.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-04T15:25:45.643 INFO:teuthology.orchestra.run.smithi096.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-04T15:25:45.643 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:25:45.643 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:25:45.647 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-test-2:18.2.0-1181.gf7e9f9af.el9.x86_64 6/6 2023-11-04T15:25:45.648 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-test-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/6 2023-11-04T15:25:45.648 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephsqlite-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/6 2023-11-04T15:25:45.648 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2023-11-04T15:25:45.648 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2023-11-04T15:25:45.648 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2023-11-04T15:25:45.999 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-base 2023-11-04T15:25:46.050 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : jq-1.6-15.el9.x86_64 6/6 2023-11-04T15:25:46.051 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:25:46.051 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2023-11-04T15:25:46.051 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-test-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:46.052 INFO:teuthology.orchestra.run.smithi019.stdout: jq-1.6-15.el9.x86_64 2023-11-04T15:25:46.052 INFO:teuthology.orchestra.run.smithi019.stdout: libcephsqlite-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:46.052 INFO:teuthology.orchestra.run.smithi019.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-04T15:25:46.052 INFO:teuthology.orchestra.run.smithi019.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-04T15:25:46.053 INFO:teuthology.orchestra.run.smithi019.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-04T15:25:46.053 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:25:46.053 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:25:46.339 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install ceph 2023-11-04T15:25:46.539 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:00:50 ago on Sat 04 Nov 2023 03:24:56 PM UTC. 2023-11-04T15:25:46.630 INFO:teuthology.orchestra.run.smithi096.stdout:Package ceph-base-2:18.2.0-1181.gf7e9f9af.el9.x86_64 is already installed. 2023-11-04T15:25:46.679 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:25:46.680 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2023-11-04T15:25:46.680 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:25:46.737 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install cephadm 2023-11-04T15:25:46.766 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-11-04T15:25:46.821 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2023-11-04T15:25:46.852 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2023-11-04T15:25:46.886 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2023-11-04T15:25:46.912 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:00:39 ago on Sat 04 Nov 2023 03:25:07 PM UTC. 2023-11-04T15:25:46.977 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2023-11-04T15:25:47.055 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2023-11-04T15:25:47.064 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:25:47.066 INFO:teuthology.orchestra.run.smithi019.stdout:========================================================================================= 2023-11-04T15:25:47.066 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2023-11-04T15:25:47.067 INFO:teuthology.orchestra.run.smithi019.stdout:========================================================================================= 2023-11-04T15:25:47.067 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2023-11-04T15:25:47.067 INFO:teuthology.orchestra.run.smithi019.stdout: ceph x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 6.5 k 2023-11-04T15:25:47.067 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2023-11-04T15:25:47.068 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mds x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 2.1 M 2023-11-04T15:25:47.068 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 1.4 M 2023-11-04T15:25:47.068 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-modules-core noarch 2:18.2.0-1181.gf7e9f9af.el9 ceph-noarch 242 k 2023-11-04T15:25:47.068 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mon x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 4.4 M 2023-11-04T15:25:47.068 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-osd x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 18 M 2023-11-04T15:25:47.069 INFO:teuthology.orchestra.run.smithi019.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-04T15:25:47.069 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-04T15:25:47.069 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-04T15:25:47.069 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-04T15:25:47.069 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-11-04T15:25:47.069 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-04T15:25:47.070 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-04T15:25:47.070 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-04T15:25:47.070 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-04T15:25:47.070 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-04T15:25:47.070 INFO:teuthology.orchestra.run.smithi019.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-04T15:25:47.071 INFO:teuthology.orchestra.run.smithi019.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-04T15:25:47.071 INFO:teuthology.orchestra.run.smithi019.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-04T15:25:47.071 INFO:teuthology.orchestra.run.smithi019.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-04T15:25:47.071 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-04T15:25:47.071 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-04T15:25:47.072 INFO:teuthology.orchestra.run.smithi019.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-04T15:25:47.072 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-04T15:25:47.072 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-04T15:25:47.072 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-11-04T15:25:47.072 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-04T15:25:47.073 INFO:teuthology.orchestra.run.smithi019.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-04T15:25:47.073 INFO:teuthology.orchestra.run.smithi019.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-04T15:25:47.073 INFO:teuthology.orchestra.run.smithi019.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-04T15:25:47.073 INFO:teuthology.orchestra.run.smithi019.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-04T15:25:47.073 INFO:teuthology.orchestra.run.smithi019.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-04T15:25:47.073 INFO:teuthology.orchestra.run.smithi019.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-04T15:25:47.074 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:25:47.074 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2023-11-04T15:25:47.074 INFO:teuthology.orchestra.run.smithi019.stdout:========================================================================================= 2023-11-04T15:25:47.074 INFO:teuthology.orchestra.run.smithi019.stdout:Install 33 Packages 2023-11-04T15:25:47.074 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:25:47.075 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 30 M 2023-11-04T15:25:47.075 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 109 M 2023-11-04T15:25:47.076 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2023-11-04T15:25:47.097 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2023-11-04T15:25:47.134 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2023-11-04T15:25:47.202 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 8/33 2023-11-04T15:25:47.256 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 9/33 2023-11-04T15:25:47.271 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:00:51 ago on Sat 04 Nov 2023 03:24:56 PM UTC. 2023-11-04T15:25:47.294 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 10/33 2023-11-04T15:25:47.343 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-ply-3.11-14.el9.noarch 11/33 2023-11-04T15:25:47.398 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 12/33 2023-11-04T15:25:47.413 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:25:47.413 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:25:47.414 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2023-11-04T15:25:47.414 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:25:47.414 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2023-11-04T15:25:47.414 INFO:teuthology.orchestra.run.smithi096.stdout: cephadm noarch 2:18.2.0-1181.gf7e9f9af.el9 ceph-noarch 221 k 2023-11-04T15:25:47.415 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:25:47.415 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2023-11-04T15:25:47.415 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:25:47.415 INFO:teuthology.orchestra.run.smithi096.stdout:Install 1 Package 2023-11-04T15:25:47.416 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:25:47.416 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 221 k 2023-11-04T15:25:47.416 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 213 k 2023-11-04T15:25:47.416 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2023-11-04T15:25:47.592 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 13/33 2023-11-04T15:25:47.640 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 14/33 2023-11-04T15:25:47.679 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 15/33 2023-11-04T15:25:47.712 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 16/33 2023-11-04T15:25:47.743 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 17/33 2023-11-04T15:25:47.760 INFO:teuthology.orchestra.run.smithi096.stdout:cephadm-18.2.0-1181.gf7e9f9af.el9.noarch.rpm 641 kB/s | 221 kB 00:00 2023-11-04T15:25:47.761 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:25:47.761 INFO:teuthology.orchestra.run.smithi096.stdout:Total 638 kB/s | 221 kB 00:00 2023-11-04T15:25:47.761 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2023-11-04T15:25:47.766 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2023-11-04T15:25:47.767 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2023-11-04T15:25:47.769 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2023-11-04T15:25:47.769 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2023-11-04T15:25:47.779 INFO:teuthology.orchestra.run.smithi019.stdout:(1/33): ceph-18.2.0-1181.gf7e9f9af.el9.x86_64.r 28 kB/s | 6.5 kB 00:00 2023-11-04T15:25:47.820 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 18/33 2023-11-04T15:25:47.842 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2023-11-04T15:25:47.861 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 19/33 2023-11-04T15:25:47.903 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 20/33 2023-11-04T15:25:47.929 INFO:teuthology.orchestra.run.smithi019.stdout:(2/33): ceph-mds-18.2.0-1181.gf7e9f9af.el9.x86_ 5.5 MB/s | 2.1 MB 00:00 2023-11-04T15:25:47.944 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 21/33 2023-11-04T15:25:47.963 INFO:teuthology.orchestra.run.smithi019.stdout:(3/33): ceph-mgr-18.2.0-1181.gf7e9f9af.el9.x86_ 3.5 MB/s | 1.4 MB 00:00 2023-11-04T15:25:47.979 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2023-11-04T15:25:48.047 INFO:teuthology.orchestra.run.smithi019.stdout:(4/33): ceph-mgr-modules-core-18.2.0-1181.gf7e9 2.8 MB/s | 242 kB 00:00 2023-11-04T15:25:48.068 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2023-11-04T15:25:48.105 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2023-11-04T15:25:48.139 INFO:teuthology.orchestra.run.smithi019.stdout:(5/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.5 MB/s | 144 kB 00:00 2023-11-04T15:25:48.172 INFO:teuthology.orchestra.run.smithi019.stdout:(6/33): python3-markupsafe-1.1.1-12.el9.x86_64. 954 kB/s | 32 kB 00:00 2023-11-04T15:25:48.182 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2023-11-04T15:25:48.205 INFO:teuthology.orchestra.run.smithi019.stdout:(7/33): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2023-11-04T15:25:48.248 INFO:teuthology.orchestra.run.smithi019.stdout:(8/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.6 MB/s | 241 kB 00:00 2023-11-04T15:25:48.262 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/1 2023-11-04T15:25:48.281 INFO:teuthology.orchestra.run.smithi019.stdout:(9/33): python3-ply-3.11-14.el9.noarch.rpm 3.0 MB/s | 103 kB 00:00 2023-11-04T15:25:48.318 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2023-11-04T15:25:48.323 INFO:teuthology.orchestra.run.smithi019.stdout:(10/33): python3-pycparser-2.20-6.el9.noarch.rp 2.9 MB/s | 124 kB 00:00 2023-11-04T15:25:48.357 INFO:teuthology.orchestra.run.smithi019.stdout:(11/33): python3-requests-2.25.1-7.el9.noarch.r 3.3 MB/s | 113 kB 00:00 2023-11-04T15:25:48.357 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/1 2023-11-04T15:25:48.390 INFO:teuthology.orchestra.run.smithi019.stdout:(12/33): python3-urllib3-1.26.5-4.el9.noarch.rp 5.5 MB/s | 187 kB 00:00 2023-11-04T15:25:48.442 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2023-11-04T15:25:48.605 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-1181.gf7e9f9af.el9. 28/33 2023-11-04T15:25:48.631 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-2:18.2.0-1181.gf7e9f9af.el9.x86_64 29/33 2023-11-04T15:25:48.655 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-2:18.2.0-1181.gf7e9f9af.el9.x86_64 29/33 2023-11-04T15:25:48.655 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:25:48.656 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-04T15:25:48.656 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-04T15:25:48.656 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-04T15:25:48.656 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:25:48.736 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/1 2023-11-04T15:25:48.791 INFO:teuthology.orchestra.run.smithi019.stdout:(13/33): ceph-osd-18.2.0-1181.gf7e9f9af.el9.x86 20 MB/s | 18 MB 00:00 2023-11-04T15:25:48.833 INFO:teuthology.orchestra.run.smithi019.stdout:(14/33): python3-cryptography-36.0.1-4.el9.x86_ 2.8 MB/s | 1.2 MB 00:00 2023-11-04T15:25:48.916 INFO:teuthology.orchestra.run.smithi019.stdout:(15/33): python3-pytz-2021.1-5.el9.noarch.rpm 408 kB/s | 51 kB 00:00 2023-11-04T15:25:49.000 INFO:teuthology.orchestra.run.smithi019.stdout:(16/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 260 kB/s | 43 kB 00:00 2023-11-04T15:25:49.058 INFO:teuthology.orchestra.run.smithi019.stdout:(17/33): ceph-mon-18.2.0-1181.gf7e9f9af.el9.x86 3.4 MB/s | 4.4 MB 00:01 2023-11-04T15:25:49.064 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/1 2023-11-04T15:25:49.064 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:25:49.065 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2023-11-04T15:25:49.065 INFO:teuthology.orchestra.run.smithi096.stdout: cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:25:49.065 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:25:49.065 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:25:49.150 INFO:teuthology.orchestra.run.smithi019.stdout:(18/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 734 kB/s | 172 kB 00:00 2023-11-04T15:25:49.176 INFO:teuthology.orchestra.run.smithi019.stdout:(19/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 91 kB/s | 11 kB 00:00 2023-11-04T15:25:49.201 INFO:teuthology.orchestra.run.smithi019.stdout:(20/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.7 MB/s | 358 kB 00:00 2023-11-04T15:25:49.229 INFO:teuthology.orchestra.run.smithi019.stdout:(21/33): python3-jaraco-classes-3.2.1-5.el9.noa 234 kB/s | 18 kB 00:00 2023-11-04T15:25:49.251 INFO:teuthology.orchestra.run.smithi019.stdout:(22/33): python3-jaraco-collections-3.0.0-8.el9 307 kB/s | 23 kB 00:00 2023-11-04T15:25:49.266 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-immutable-object-cache 2023-11-04T15:25:49.277 INFO:teuthology.orchestra.run.smithi019.stdout:(23/33): python3-jaraco-functools-3.5.0-2.el9.n 258 kB/s | 19 kB 00:00 2023-11-04T15:25:49.302 INFO:teuthology.orchestra.run.smithi019.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 261 kB/s | 20 kB 00:00 2023-11-04T15:25:49.344 INFO:teuthology.orchestra.run.smithi019.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 503 kB/s | 46 kB 00:00 2023-11-04T15:25:49.369 INFO:teuthology.orchestra.run.smithi019.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 855 kB/s | 79 kB 00:00 2023-11-04T15:25:49.411 INFO:teuthology.orchestra.run.smithi019.stdout:(27/33): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2023-11-04T15:25:49.428 INFO:teuthology.orchestra.run.smithi019.stdout:(28/33): python3-portend-3.1.0-2.el9.noarch.rpm 196 kB/s | 16 kB 00:00 2023-11-04T15:25:49.453 INFO:teuthology.orchestra.run.smithi019.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.0 MB/s | 90 kB 00:00 2023-11-04T15:25:49.470 INFO:teuthology.orchestra.run.smithi019.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 610 kB/s | 36 kB 00:00 2023-11-04T15:25:49.521 INFO:teuthology.orchestra.run.smithi019.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 399 kB/s | 20 kB 00:00 2023-11-04T15:25:49.546 INFO:teuthology.orchestra.run.smithi019.stdout:(32/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.5 MB/s | 427 kB 00:00 2023-11-04T15:25:49.588 INFO:teuthology.orchestra.run.smithi019.stdout:(33/33): python3-webob-1.8.7-6.el9.noarch.rpm 1.4 MB/s | 230 kB 00:00 2023-11-04T15:25:49.590 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:25:49.590 INFO:teuthology.orchestra.run.smithi019.stdout:Total 12 MB/s | 30 MB 00:02 2023-11-04T15:25:49.624 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2023-11-04T15:25:49.668 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2023-11-04T15:25:49.668 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2023-11-04T15:25:49.825 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:00:53 ago on Sat 04 Nov 2023 03:24:56 PM UTC. 2023-11-04T15:25:49.966 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:25:49.967 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:25:49.967 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repo Size 2023-11-04T15:25:49.968 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:25:49.968 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2023-11-04T15:25:49.968 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 142 k 2023-11-04T15:25:49.968 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:25:49.968 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2023-11-04T15:25:49.969 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:25:49.969 INFO:teuthology.orchestra.run.smithi096.stdout:Install 1 Package 2023-11-04T15:25:49.969 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:25:49.969 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 142 k 2023-11-04T15:25:49.969 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 400 k 2023-11-04T15:25:49.970 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2023-11-04T15:25:50.088 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2023-11-04T15:25:50.214 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2023-11-04T15:25:50.224 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-osd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 30/33 2023-11-04T15:25:50.254 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-osd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 30/33 2023-11-04T15:25:50.254 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:25:50.255 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-04T15:25:50.255 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-04T15:25:50.256 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-04T15:25:50.256 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:25:50.284 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-immutable-object-cache-18.2.0-1181.gf7e9f9 451 kB/s | 142 kB 00:00 2023-11-04T15:25:50.284 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:25:50.285 INFO:teuthology.orchestra.run.smithi096.stdout:Total 450 kB/s | 142 kB 00:00 2023-11-04T15:25:50.285 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2023-11-04T15:25:50.292 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2023-11-04T15:25:50.293 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2023-11-04T15:25:50.345 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2023-11-04T15:25:50.345 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2023-11-04T15:25:50.484 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2023-11-04T15:25:50.543 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-1181.gf7e9f9af. 1/1 2023-11-04T15:25:50.567 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-1181.gf7e9f9af. 1/1 2023-11-04T15:25:50.568 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:25:50.568 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-04T15:25:50.568 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:25:50.708 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mon-2:18.2.0-1181.gf7e9f9af.el9.x86_64 31/33 2023-11-04T15:25:50.731 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mon-2:18.2.0-1181.gf7e9f9af.el9.x86_64 31/33 2023-11-04T15:25:50.732 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:25:50.732 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-04T15:25:50.732 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-04T15:25:50.732 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-04T15:25:50.733 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:25:50.934 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mds-2:18.2.0-1181.gf7e9f9af.el9.x86_64 32/33 2023-11-04T15:25:50.956 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mds-2:18.2.0-1181.gf7e9f9af.el9.x86_64 32/33 2023-11-04T15:25:50.957 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:25:50.957 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-04T15:25:50.957 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-04T15:25:50.957 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-04T15:25:50.957 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:25:51.022 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-2:18.2.0-1181.gf7e9f9af.el9.x86_64 33/33 2023-11-04T15:25:51.348 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2023-11-04T15:25:51.399 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2023-11-04T15:25:51.432 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2023-11-04T15:25:51.481 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2023-11-04T15:25:51.567 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-1181.gf7e9f9af. 1/1 2023-11-04T15:25:51.567 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:25:51.568 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2023-11-04T15:25:51.568 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-immutable-object-cache-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:51.568 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:25:51.568 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:25:51.577 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2023-11-04T15:25:51.654 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2023-11-04T15:25:51.701 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2023-11-04T15:25:51.748 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2023-11-04T15:25:51.824 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-mgr 2023-11-04T15:25:51.829 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 8/33 2023-11-04T15:25:51.878 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 9/33 2023-11-04T15:25:51.916 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 10/33 2023-11-04T15:25:51.965 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ply-3.11-14.el9.noarch 11/33 2023-11-04T15:25:52.021 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 12/33 2023-11-04T15:25:52.222 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 13/33 2023-11-04T15:25:52.270 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 14/33 2023-11-04T15:25:52.309 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 15/33 2023-11-04T15:25:52.343 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 16/33 2023-11-04T15:25:52.373 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 17/33 2023-11-04T15:25:52.374 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:00:56 ago on Sat 04 Nov 2023 03:24:56 PM UTC. 2023-11-04T15:25:52.452 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 18/33 2023-11-04T15:25:52.472 INFO:teuthology.orchestra.run.smithi096.stdout:Package ceph-mgr-2:18.2.0-1181.gf7e9f9af.el9.x86_64 is already installed. 2023-11-04T15:25:52.492 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 19/33 2023-11-04T15:25:52.521 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:25:52.521 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2023-11-04T15:25:52.522 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:25:52.525 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 20/33 2023-11-04T15:25:52.567 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 21/33 2023-11-04T15:25:52.601 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2023-11-04T15:25:52.603 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-mgr-dashboard 2023-11-04T15:25:52.693 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2023-11-04T15:25:52.736 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2023-11-04T15:25:52.776 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-2:18.2.0-1181.gf7e9f9af.el9.x86_64 33/33 2023-11-04T15:25:52.776 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/33 2023-11-04T15:25:52.776 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mds-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/33 2023-11-04T15:25:52.777 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-2:18.2.0-1181.gf7e9f9af.el9.x86_64 3/33 2023-11-04T15:25:52.777 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mon-2:18.2.0-1181.gf7e9f9af.el9.x86_64 4/33 2023-11-04T15:25:52.777 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-osd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 5/33 2023-11-04T15:25:52.777 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-1181.gf7e9f9af.el9. 6/33 2023-11-04T15:25:52.778 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2023-11-04T15:25:52.778 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2023-11-04T15:25:52.778 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 9/33 2023-11-04T15:25:52.778 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 10/33 2023-11-04T15:25:52.778 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-ply-3.11-14.el9.noarch 11/33 2023-11-04T15:25:52.779 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 12/33 2023-11-04T15:25:52.779 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 13/33 2023-11-04T15:25:52.779 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 14/33 2023-11-04T15:25:52.779 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 15/33 2023-11-04T15:25:52.779 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/33 2023-11-04T15:25:52.780 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2023-11-04T15:25:52.780 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2023-11-04T15:25:52.780 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2023-11-04T15:25:52.780 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2023-11-04T15:25:52.780 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2023-11-04T15:25:52.780 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2023-11-04T15:25:52.781 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2023-11-04T15:25:52.781 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2023-11-04T15:25:52.781 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2023-11-04T15:25:52.781 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2023-11-04T15:25:52.781 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2023-11-04T15:25:52.782 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2023-11-04T15:25:52.783 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2023-11-04T15:25:52.783 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2023-11-04T15:25:52.783 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2023-11-04T15:25:52.784 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2023-11-04T15:25:52.814 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2023-11-04T15:25:52.955 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2023-11-04T15:25:53.087 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2023-11-04T15:25:53.145 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:00:57 ago on Sat 04 Nov 2023 03:24:56 PM UTC. 2023-11-04T15:25:53.252 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-1181.gf7e9f9af.el9. 28/33 2023-11-04T15:25:53.286 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-2:18.2.0-1181.gf7e9f9af.el9.x86_64 29/33 2023-11-04T15:25:53.287 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:25:53.288 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:25:53.288 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2023-11-04T15:25:53.288 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:25:53.288 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2023-11-04T15:25:53.289 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-dashboard noarch 2:18.2.0-1181.gf7e9f9af.el9 ceph-noarch 1.8 M 2023-11-04T15:25:53.289 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2023-11-04T15:25:53.289 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-grafana-dashboards noarch 2:18.2.0-1181.gf7e9f9af.el9 ceph-noarch 23 k 2023-11-04T15:25:53.289 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-prometheus-alerts noarch 2:18.2.0-1181.gf7e9f9af.el9 ceph-noarch 15 k 2023-11-04T15:25:53.290 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-04T15:25:53.290 INFO:teuthology.orchestra.run.smithi096.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-04T15:25:53.290 INFO:teuthology.orchestra.run.smithi096.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-04T15:25:53.290 INFO:teuthology.orchestra.run.smithi096.stdout:Installing weak dependencies: 2023-11-04T15:25:53.290 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-04T15:25:53.291 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:25:53.291 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2023-11-04T15:25:53.291 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:25:53.291 INFO:teuthology.orchestra.run.smithi096.stdout:Install 7 Packages 2023-11-04T15:25:53.291 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:25:53.292 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 2.1 M 2023-11-04T15:25:53.292 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 8.5 M 2023-11-04T15:25:53.293 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2023-11-04T15:25:53.312 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-2:18.2.0-1181.gf7e9f9af.el9.x86_64 29/33 2023-11-04T15:25:53.313 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:25:53.313 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-04T15:25:53.313 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-04T15:25:53.313 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-04T15:25:53.314 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:25:53.553 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2023-11-04T15:25:53.554 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:25:53.554 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-11-04T15:25:53.554 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:53.554 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mds-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:53.555 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:53.555 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-modules-core-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:25:53.555 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mon-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:53.555 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-osd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:53.555 INFO:teuthology.orchestra.run.smithi130.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-04T15:25:53.556 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-04T15:25:53.556 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-04T15:25:53.556 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-04T15:25:53.556 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-04T15:25:53.556 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-04T15:25:53.557 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-04T15:25:53.557 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-04T15:25:53.557 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-04T15:25:53.557 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-04T15:25:53.557 INFO:teuthology.orchestra.run.smithi130.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-04T15:25:53.558 INFO:teuthology.orchestra.run.smithi130.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-04T15:25:53.558 INFO:teuthology.orchestra.run.smithi130.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-04T15:25:53.558 INFO:teuthology.orchestra.run.smithi130.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-04T15:25:53.558 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-04T15:25:53.558 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ply-3.11-14.el9.noarch 2023-11-04T15:25:53.559 INFO:teuthology.orchestra.run.smithi130.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-04T15:25:53.559 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-04T15:25:53.559 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-04T15:25:53.559 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-04T15:25:53.559 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-04T15:25:53.560 INFO:teuthology.orchestra.run.smithi130.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-04T15:25:53.560 INFO:teuthology.orchestra.run.smithi130.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-04T15:25:53.560 INFO:teuthology.orchestra.run.smithi130.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-04T15:25:53.560 INFO:teuthology.orchestra.run.smithi130.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-04T15:25:53.561 INFO:teuthology.orchestra.run.smithi130.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-04T15:25:53.561 INFO:teuthology.orchestra.run.smithi130.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-04T15:25:53.561 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:25:53.561 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:25:53.655 INFO:teuthology.orchestra.run.smithi096.stdout:(1/7): ceph-grafana-dashboards-18.2.0-1181.gf7e 74 kB/s | 23 kB 00:00 2023-11-04T15:25:53.721 INFO:teuthology.orchestra.run.smithi096.stdout:(2/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 136 kB/s | 9.0 kB 00:00 2023-11-04T15:25:53.756 INFO:teuthology.orchestra.run.smithi096.stdout:(3/7): ceph-prometheus-alerts-18.2.0-1181.gf7e9 35 kB/s | 15 kB 00:00 2023-11-04T15:25:53.814 INFO:teuthology.orchestra.run.smithi096.stdout:(4/7): python3-jwt-2.4.0-1.el9.noarch.rpm 442 kB/s | 41 kB 00:00 2023-11-04T15:25:53.840 INFO:teuthology.orchestra.run.smithi096.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 366 kB/s | 31 kB 00:00 2023-11-04T15:25:53.896 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install ceph-base 2023-11-04T15:25:53.914 INFO:teuthology.orchestra.run.smithi096.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 1.8 MB/s | 188 kB 00:00 2023-11-04T15:25:53.981 INFO:teuthology.orchestra.run.smithi096.stdout:(7/7): ceph-mgr-dashboard-18.2.0-1181.gf7e9f9af 2.7 MB/s | 1.8 MB 00:00 2023-11-04T15:25:53.983 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:25:53.984 INFO:teuthology.orchestra.run.smithi096.stdout:Total 3.0 MB/s | 2.1 MB 00:00 2023-11-04T15:25:53.984 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2023-11-04T15:25:53.992 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2023-11-04T15:25:53.992 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2023-11-04T15:25:54.055 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2023-11-04T15:25:54.056 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2023-11-04T15:25:54.355 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2023-11-04T15:25:54.424 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2023-11-04T15:25:54.443 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:00:56 ago on Sat 04 Nov 2023 03:24:58 PM UTC. 2023-11-04T15:25:54.458 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2023-11-04T15:25:54.505 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2023-11-04T15:25:54.535 INFO:teuthology.orchestra.run.smithi130.stdout:Package ceph-base-2:18.2.0-1181.gf7e9f9af.el9.x86_64 is already installed. 2023-11-04T15:25:54.537 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2023-11-04T15:25:54.566 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-1181.gf7e9f9af.el9.n 5/7 2023-11-04T15:25:54.585 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:25:54.586 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2023-11-04T15:25:54.586 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:25:54.648 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install cephadm 2023-11-04T15:25:54.799 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-1181.gf7e9f9af.el9. 6/7 2023-11-04T15:25:54.835 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-1181.gf7e9f9af.el9.noarc 7/7 2023-11-04T15:25:54.929 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-osd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 30/33 2023-11-04T15:25:54.957 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-osd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 30/33 2023-11-04T15:25:54.957 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:25:54.958 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-04T15:25:54.958 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-04T15:25:54.958 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-04T15:25:54.958 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:25:55.191 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:00:57 ago on Sat 04 Nov 2023 03:24:58 PM UTC. 2023-11-04T15:25:55.334 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:25:55.335 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:25:55.336 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2023-11-04T15:25:55.336 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:25:55.336 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-11-04T15:25:55.336 INFO:teuthology.orchestra.run.smithi130.stdout: cephadm noarch 2:18.2.0-1181.gf7e9f9af.el9 ceph-noarch 221 k 2023-11-04T15:25:55.336 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:25:55.337 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-11-04T15:25:55.337 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:25:55.337 INFO:teuthology.orchestra.run.smithi130.stdout:Install 1 Package 2023-11-04T15:25:55.337 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:25:55.337 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 221 k 2023-11-04T15:25:55.338 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 213 k 2023-11-04T15:25:55.338 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-11-04T15:25:55.370 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-1181.gf7e9f9af.el9.noarc 7/7 2023-11-04T15:25:55.370 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-1181.gf7e9f9af.el9. 1/7 2023-11-04T15:25:55.370 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-1181.gf7e9f9af.el9.noarc 2/7 2023-11-04T15:25:55.370 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-1181.gf7e9f9af.el9.n 3/7 2023-11-04T15:25:55.371 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2023-11-04T15:25:55.371 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2023-11-04T15:25:55.371 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2023-11-04T15:25:55.438 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mon-2:18.2.0-1181.gf7e9f9af.el9.x86_64 31/33 2023-11-04T15:25:55.463 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mon-2:18.2.0-1181.gf7e9f9af.el9.x86_64 31/33 2023-11-04T15:25:55.463 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:25:55.463 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-04T15:25:55.463 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-04T15:25:55.464 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-04T15:25:55.464 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:25:55.672 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mds-2:18.2.0-1181.gf7e9f9af.el9.x86_64 32/33 2023-11-04T15:25:55.676 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2023-11-04T15:25:55.676 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:25:55.676 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2023-11-04T15:25:55.677 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-grafana-dashboards-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:25:55.677 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-dashboard-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:25:55.677 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-prometheus-alerts-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:25:55.677 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-04T15:25:55.677 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-04T15:25:55.678 INFO:teuthology.orchestra.run.smithi096.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-04T15:25:55.678 INFO:teuthology.orchestra.run.smithi096.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-04T15:25:55.678 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:25:55.678 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:25:55.696 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mds-2:18.2.0-1181.gf7e9f9af.el9.x86_64 32/33 2023-11-04T15:25:55.696 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:25:55.696 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-04T15:25:55.697 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-04T15:25:55.697 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-04T15:25:55.697 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:25:55.754 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-2:18.2.0-1181.gf7e9f9af.el9.x86_64 33/33 2023-11-04T15:25:55.806 INFO:teuthology.orchestra.run.smithi130.stdout:cephadm-18.2.0-1181.gf7e9f9af.el9.noarch.rpm 472 kB/s | 221 kB 00:00 2023-11-04T15:25:55.806 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:25:55.807 INFO:teuthology.orchestra.run.smithi130.stdout:Total 470 kB/s | 221 kB 00:00 2023-11-04T15:25:55.807 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-11-04T15:25:55.811 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-11-04T15:25:55.812 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-11-04T15:25:55.814 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-11-04T15:25:55.815 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-11-04T15:25:55.880 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-11-04T15:25:55.915 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-mgr-diskprediction-local 2023-11-04T15:25:56.365 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/1 2023-11-04T15:25:56.452 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:00 ago on Sat 04 Nov 2023 03:24:56 PM UTC. 2023-11-04T15:25:56.460 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/1 2023-11-04T15:25:56.593 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:25:56.595 INFO:teuthology.orchestra.run.smithi096.stdout:============================================================================================ 2023-11-04T15:25:56.595 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2023-11-04T15:25:56.595 INFO:teuthology.orchestra.run.smithi096.stdout:============================================================================================ 2023-11-04T15:25:56.596 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2023-11-04T15:25:56.596 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-1181.gf7e9f9af.el9 ceph-noarch 7.4 M 2023-11-04T15:25:56.596 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2023-11-04T15:25:56.597 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-04T15:25:56.597 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-04T15:25:56.597 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-04T15:25:56.597 INFO:teuthology.orchestra.run.smithi096.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-04T15:25:56.598 INFO:teuthology.orchestra.run.smithi096.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-04T15:25:56.598 INFO:teuthology.orchestra.run.smithi096.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-04T15:25:56.598 INFO:teuthology.orchestra.run.smithi096.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-04T15:25:56.599 INFO:teuthology.orchestra.run.smithi096.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-11-04T15:25:56.599 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-04T15:25:56.600 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-04T15:25:56.600 INFO:teuthology.orchestra.run.smithi096.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-04T15:25:56.600 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:25:56.601 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2023-11-04T15:25:56.601 INFO:teuthology.orchestra.run.smithi096.stdout:============================================================================================ 2023-11-04T15:25:56.601 INFO:teuthology.orchestra.run.smithi096.stdout:Install 12 Packages 2023-11-04T15:25:56.602 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:25:56.604 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 37 M 2023-11-04T15:25:56.604 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 209 M 2023-11-04T15:25:56.604 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2023-11-04T15:25:56.730 INFO:teuthology.orchestra.run.smithi096.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 238 kB/s | 32 kB 00:00 2023-11-04T15:25:56.764 INFO:teuthology.orchestra.run.smithi096.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 529 kB/s | 17 kB 00:00 2023-11-04T15:25:56.798 INFO:teuthology.orchestra.run.smithi096.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2023-11-04T15:25:56.860 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/1 2023-11-04T15:25:56.864 INFO:teuthology.orchestra.run.smithi096.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 11 MB/s | 3.0 MB 00:00 2023-11-04T15:25:56.923 INFO:teuthology.orchestra.run.smithi096.stdout:(5/12): python3-devel-3.9.17-2.el9.x86_64.rpm 3.5 MB/s | 205 kB 00:00 2023-11-04T15:25:56.990 INFO:teuthology.orchestra.run.smithi096.stdout:(6/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 25 MB/s | 4.7 MB 00:00 2023-11-04T15:25:57.065 INFO:teuthology.orchestra.run.smithi096.stdout:(7/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 4.8 MB 00:00 2023-11-04T15:25:57.091 INFO:teuthology.orchestra.run.smithi096.stdout:(8/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.2 MB/s | 217 kB 00:00 2023-11-04T15:25:57.158 INFO:teuthology.orchestra.run.smithi096.stdout:(9/12): libgfortran-11.4.1-2.3.el9.x86_64.rpm 12 MB/s | 803 kB 00:00 2023-11-04T15:25:57.182 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/1 2023-11-04T15:25:57.182 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:25:57.182 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-11-04T15:25:57.183 INFO:teuthology.orchestra.run.smithi130.stdout: cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:25:57.183 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:25:57.183 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:25:57.333 INFO:teuthology.orchestra.run.smithi096.stdout:(10/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 59 MB/s | 16 MB 00:00 2023-11-04T15:25:57.358 INFO:teuthology.orchestra.run.smithi096.stdout:(11/12): libquadmath-11.4.1-2.3.el9.x86_64.rpm 985 kB/s | 195 kB 00:00 2023-11-04T15:25:57.383 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install ceph-immutable-object-cache 2023-11-04T15:25:57.448 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-2:18.2.0-1181.gf7e9f9af.el9.x86_64 33/33 2023-11-04T15:25:57.449 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/33 2023-11-04T15:25:57.449 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mds-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/33 2023-11-04T15:25:57.449 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-2:18.2.0-1181.gf7e9f9af.el9.x86_64 3/33 2023-11-04T15:25:57.449 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mon-2:18.2.0-1181.gf7e9f9af.el9.x86_64 4/33 2023-11-04T15:25:57.450 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-osd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 5/33 2023-11-04T15:25:57.450 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-1181.gf7e9f9af.el9. 6/33 2023-11-04T15:25:57.450 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2023-11-04T15:25:57.450 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2023-11-04T15:25:57.450 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 9/33 2023-11-04T15:25:57.451 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 10/33 2023-11-04T15:25:57.451 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ply-3.11-14.el9.noarch 11/33 2023-11-04T15:25:57.451 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 12/33 2023-11-04T15:25:57.451 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 13/33 2023-11-04T15:25:57.451 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 14/33 2023-11-04T15:25:57.452 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 15/33 2023-11-04T15:25:57.452 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/33 2023-11-04T15:25:57.452 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2023-11-04T15:25:57.452 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2023-11-04T15:25:57.452 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2023-11-04T15:25:57.453 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2023-11-04T15:25:57.453 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2023-11-04T15:25:57.453 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2023-11-04T15:25:57.453 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2023-11-04T15:25:57.453 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2023-11-04T15:25:57.454 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2023-11-04T15:25:57.454 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2023-11-04T15:25:57.454 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2023-11-04T15:25:57.454 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2023-11-04T15:25:57.455 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2023-11-04T15:25:57.455 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2023-11-04T15:25:57.455 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2023-11-04T15:25:57.455 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2023-11-04T15:25:57.875 INFO:teuthology.orchestra.run.smithi096.stdout:(12/12): ceph-mgr-diskprediction-local-18.2.0-1 5.8 MB/s | 7.4 MB 00:01 2023-11-04T15:25:57.878 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:25:57.878 INFO:teuthology.orchestra.run.smithi096.stdout:Total 29 MB/s | 37 MB 00:01 2023-11-04T15:25:57.878 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2023-11-04T15:25:57.901 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2023-11-04T15:25:57.901 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2023-11-04T15:25:57.949 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:00:59 ago on Sat 04 Nov 2023 03:24:58 PM UTC. 2023-11-04T15:25:58.090 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:25:58.091 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:25:58.092 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repo Size 2023-11-04T15:25:58.092 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:25:58.092 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-11-04T15:25:58.092 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 142 k 2023-11-04T15:25:58.093 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:25:58.093 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-11-04T15:25:58.093 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:25:58.093 INFO:teuthology.orchestra.run.smithi130.stdout:Install 1 Package 2023-11-04T15:25:58.093 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:25:58.094 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 142 k 2023-11-04T15:25:58.094 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 400 k 2023-11-04T15:25:58.094 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-11-04T15:25:58.285 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-immutable-object-cache-18.2.0-1181.gf7e9f9 738 kB/s | 142 kB 00:00 2023-11-04T15:25:58.286 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:25:58.286 INFO:teuthology.orchestra.run.smithi130.stdout:Total 734 kB/s | 142 kB 00:00 2023-11-04T15:25:58.287 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-11-04T15:25:58.293 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-11-04T15:25:58.294 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-11-04T15:25:58.347 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-11-04T15:25:58.347 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-11-04T15:25:58.351 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2023-11-04T15:25:58.351 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2023-11-04T15:25:58.490 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-11-04T15:25:58.539 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2023-11-04T15:25:58.539 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:25:58.540 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2023-11-04T15:25:58.540 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:58.540 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mds-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:58.540 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:58.540 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-modules-core-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:25:58.541 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mon-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:58.541 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-osd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:58.541 INFO:teuthology.orchestra.run.smithi019.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-04T15:25:58.541 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-04T15:25:58.541 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-04T15:25:58.542 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-04T15:25:58.542 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-04T15:25:58.542 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-04T15:25:58.542 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-04T15:25:58.542 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-04T15:25:58.543 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-04T15:25:58.543 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-04T15:25:58.543 INFO:teuthology.orchestra.run.smithi019.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-04T15:25:58.543 INFO:teuthology.orchestra.run.smithi019.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-04T15:25:58.543 INFO:teuthology.orchestra.run.smithi019.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-04T15:25:58.544 INFO:teuthology.orchestra.run.smithi019.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-04T15:25:58.544 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-04T15:25:58.544 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ply-3.11-14.el9.noarch 2023-11-04T15:25:58.544 INFO:teuthology.orchestra.run.smithi019.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-04T15:25:58.544 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-04T15:25:58.545 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-04T15:25:58.545 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-04T15:25:58.545 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-04T15:25:58.545 INFO:teuthology.orchestra.run.smithi019.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-04T15:25:58.545 INFO:teuthology.orchestra.run.smithi019.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-04T15:25:58.546 INFO:teuthology.orchestra.run.smithi019.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-04T15:25:58.546 INFO:teuthology.orchestra.run.smithi019.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-04T15:25:58.546 INFO:teuthology.orchestra.run.smithi019.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-04T15:25:58.546 INFO:teuthology.orchestra.run.smithi019.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-04T15:25:58.546 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:25:58.547 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:25:58.561 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-1181.gf7e9f9af. 1/1 2023-11-04T15:25:58.586 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-1181.gf7e9f9af. 1/1 2023-11-04T15:25:58.586 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:25:58.586 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-04T15:25:58.586 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:25:58.910 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install ceph-base 2023-11-04T15:25:59.044 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2023-11-04T15:25:59.130 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 1/12 2023-11-04T15:25:59.162 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 2/12 2023-11-04T15:25:59.254 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2023-11-04T15:25:59.290 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2023-11-04T15:25:59.466 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2023-11-04T15:25:59.490 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-11-04T15:25:59.505 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:00:52 ago on Sat 04 Nov 2023 03:25:07 PM UTC. 2023-11-04T15:25:59.573 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2023-11-04T15:25:59.597 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-1181.gf7e9f9af. 1/1 2023-11-04T15:25:59.598 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:25:59.598 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-11-04T15:25:59.598 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-immutable-object-cache-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:25:59.598 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:25:59.599 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:25:59.600 INFO:teuthology.orchestra.run.smithi019.stdout:Package ceph-base-2:18.2.0-1181.gf7e9f9af.el9.x86_64 is already installed. 2023-11-04T15:25:59.652 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:25:59.653 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do. 2023-11-04T15:25:59.653 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:25:59.714 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install cephadm 2023-11-04T15:25:59.838 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install ceph-mgr 2023-11-04T15:26:00.244 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2023-11-04T15:26:00.286 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:00:53 ago on Sat 04 Nov 2023 03:25:07 PM UTC. 2023-11-04T15:26:00.351 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2023-11-04T15:26:00.398 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:01:02 ago on Sat 04 Nov 2023 03:24:58 PM UTC. 2023-11-04T15:26:00.434 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:26:00.435 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:26:00.435 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2023-11-04T15:26:00.435 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:26:00.435 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2023-11-04T15:26:00.436 INFO:teuthology.orchestra.run.smithi019.stdout: cephadm noarch 2:18.2.0-1181.gf7e9f9af.el9 ceph-noarch 221 k 2023-11-04T15:26:00.436 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:00.436 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2023-11-04T15:26:00.436 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:26:00.436 INFO:teuthology.orchestra.run.smithi019.stdout:Install 1 Package 2023-11-04T15:26:00.437 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:00.437 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 221 k 2023-11-04T15:26:00.437 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 213 k 2023-11-04T15:26:00.437 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2023-11-04T15:26:00.493 INFO:teuthology.orchestra.run.smithi130.stdout:Package ceph-mgr-2:18.2.0-1181.gf7e9f9af.el9.x86_64 is already installed. 2023-11-04T15:26:00.542 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:26:00.543 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2023-11-04T15:26:00.543 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:26:00.607 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install ceph-mgr-dashboard 2023-11-04T15:26:00.670 INFO:teuthology.orchestra.run.smithi019.stdout:cephadm-18.2.0-1181.gf7e9f9af.el9.noarch.rpm 946 kB/s | 221 kB 00:00 2023-11-04T15:26:00.671 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:26:00.671 INFO:teuthology.orchestra.run.smithi019.stdout:Total 938 kB/s | 221 kB 00:00 2023-11-04T15:26:00.671 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2023-11-04T15:26:00.677 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2023-11-04T15:26:00.677 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2023-11-04T15:26:00.680 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2023-11-04T15:26:00.680 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2023-11-04T15:26:00.752 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2023-11-04T15:26:01.155 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:01:03 ago on Sat 04 Nov 2023 03:24:58 PM UTC. 2023-11-04T15:26:01.156 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/1 2023-11-04T15:26:01.260 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/1 2023-11-04T15:26:01.296 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:26:01.297 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:26:01.297 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2023-11-04T15:26:01.298 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:26:01.298 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-11-04T15:26:01.298 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-dashboard noarch 2:18.2.0-1181.gf7e9f9af.el9 ceph-noarch 1.8 M 2023-11-04T15:26:01.298 INFO:teuthology.orchestra.run.smithi130.stdout:Installing dependencies: 2023-11-04T15:26:01.298 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-grafana-dashboards noarch 2:18.2.0-1181.gf7e9f9af.el9 ceph-noarch 23 k 2023-11-04T15:26:01.299 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-prometheus-alerts noarch 2:18.2.0-1181.gf7e9f9af.el9 ceph-noarch 15 k 2023-11-04T15:26:01.299 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-04T15:26:01.299 INFO:teuthology.orchestra.run.smithi130.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-04T15:26:01.299 INFO:teuthology.orchestra.run.smithi130.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-04T15:26:01.299 INFO:teuthology.orchestra.run.smithi130.stdout:Installing weak dependencies: 2023-11-04T15:26:01.300 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-04T15:26:01.300 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:01.300 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-11-04T15:26:01.300 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:26:01.300 INFO:teuthology.orchestra.run.smithi130.stdout:Install 7 Packages 2023-11-04T15:26:01.301 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:01.301 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 2.1 M 2023-11-04T15:26:01.302 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 8.5 M 2023-11-04T15:26:01.302 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-11-04T15:26:01.597 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2023-11-04T15:26:01.613 INFO:teuthology.orchestra.run.smithi130.stdout:(1/7): ceph-prometheus-alerts-18.2.0-1181.gf7e9 56 kB/s | 15 kB 00:00 2023-11-04T15:26:01.631 INFO:teuthology.orchestra.run.smithi130.stdout:(2/7): ceph-grafana-dashboards-18.2.0-1181.gf7e 83 kB/s | 23 kB 00:00 2023-11-04T15:26:01.672 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/1 2023-11-04T15:26:01.747 INFO:teuthology.orchestra.run.smithi130.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 68 kB/s | 9.0 kB 00:00 2023-11-04T15:26:01.789 INFO:teuthology.orchestra.run.smithi130.stdout:(4/7): ceph-mgr-dashboard-18.2.0-1181.gf7e9f9af 4.0 MB/s | 1.8 MB 00:00 2023-11-04T15:26:01.806 INFO:teuthology.orchestra.run.smithi130.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 233 kB/s | 41 kB 00:00 2023-11-04T15:26:01.823 INFO:teuthology.orchestra.run.smithi130.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 408 kB/s | 31 kB 00:00 2023-11-04T15:26:01.923 INFO:teuthology.orchestra.run.smithi130.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 1.4 MB/s | 188 kB 00:00 2023-11-04T15:26:01.925 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:26:01.926 INFO:teuthology.orchestra.run.smithi130.stdout:Total 3.3 MB/s | 2.1 MB 00:00 2023-11-04T15:26:01.926 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-11-04T15:26:01.934 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-11-04T15:26:01.934 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-11-04T15:26:01.985 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/1 2023-11-04T15:26:01.985 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:01.985 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2023-11-04T15:26:01.986 INFO:teuthology.orchestra.run.smithi019.stdout: cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:26:01.986 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:01.986 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:26:01.998 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-11-04T15:26:01.998 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-11-04T15:26:02.157 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install ceph-immutable-object-cache 2023-11-04T15:26:02.301 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-11-04T15:26:02.358 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2023-11-04T15:26:02.392 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2023-11-04T15:26:02.438 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2023-11-04T15:26:02.478 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2023-11-04T15:26:02.507 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-1181.gf7e9f9af.el9.n 5/7 2023-11-04T15:26:02.618 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2023-11-04T15:26:02.649 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-1181.gf7e9f 12/12 2023-11-04T15:26:02.737 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:00:55 ago on Sat 04 Nov 2023 03:25:07 PM UTC. 2023-11-04T15:26:02.742 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-1181.gf7e9f9af.el9. 6/7 2023-11-04T15:26:02.777 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-1181.gf7e9f9af.el9.noarc 7/7 2023-11-04T15:26:02.888 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:26:02.889 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:26:02.889 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repo Size 2023-11-04T15:26:02.889 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:26:02.889 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2023-11-04T15:26:02.890 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 142 k 2023-11-04T15:26:02.890 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:02.890 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2023-11-04T15:26:02.890 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:26:02.891 INFO:teuthology.orchestra.run.smithi019.stdout:Install 1 Package 2023-11-04T15:26:02.891 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:02.891 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 142 k 2023-11-04T15:26:02.891 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 400 k 2023-11-04T15:26:02.891 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2023-11-04T15:26:03.200 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-immutable-object-cache-18.2.0-1181.gf7e9f9 458 kB/s | 142 kB 00:00 2023-11-04T15:26:03.201 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:26:03.202 INFO:teuthology.orchestra.run.smithi019.stdout:Total 456 kB/s | 142 kB 00:00 2023-11-04T15:26:03.202 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2023-11-04T15:26:03.209 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2023-11-04T15:26:03.210 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2023-11-04T15:26:03.264 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2023-11-04T15:26:03.265 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2023-11-04T15:26:03.331 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-1181.gf7e9f9af.el9.noarc 7/7 2023-11-04T15:26:03.332 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-1181.gf7e9f9af.el9. 1/7 2023-11-04T15:26:03.332 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-1181.gf7e9f9af.el9.noarc 2/7 2023-11-04T15:26:03.332 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-1181.gf7e9f9af.el9.n 3/7 2023-11-04T15:26:03.332 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2023-11-04T15:26:03.333 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2023-11-04T15:26:03.333 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2023-11-04T15:26:03.405 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2023-11-04T15:26:03.468 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-1181.gf7e9f9af. 1/1 2023-11-04T15:26:03.494 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-1181.gf7e9f9af. 1/1 2023-11-04T15:26:03.494 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:26:03.494 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-04T15:26:03.495 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:03.644 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2023-11-04T15:26:03.644 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:03.644 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-11-04T15:26:03.645 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-grafana-dashboards-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:26:03.645 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-dashboard-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:26:03.645 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-prometheus-alerts-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:26:03.645 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-04T15:26:03.645 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-04T15:26:03.646 INFO:teuthology.orchestra.run.smithi130.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-04T15:26:03.646 INFO:teuthology.orchestra.run.smithi130.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-04T15:26:03.646 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:03.646 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:26:03.866 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install ceph-mgr-diskprediction-local 2023-11-04T15:26:04.411 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:01:06 ago on Sat 04 Nov 2023 03:24:58 PM UTC. 2023-11-04T15:26:04.482 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-1181.gf7e9f9af. 1/1 2023-11-04T15:26:04.482 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:04.483 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2023-11-04T15:26:04.483 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-immutable-object-cache-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:26:04.483 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:04.483 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:26:04.554 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:26:04.555 INFO:teuthology.orchestra.run.smithi130.stdout:============================================================================================ 2023-11-04T15:26:04.556 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2023-11-04T15:26:04.556 INFO:teuthology.orchestra.run.smithi130.stdout:============================================================================================ 2023-11-04T15:26:04.556 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-11-04T15:26:04.556 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-1181.gf7e9f9af.el9 ceph-noarch 7.4 M 2023-11-04T15:26:04.557 INFO:teuthology.orchestra.run.smithi130.stdout:Installing dependencies: 2023-11-04T15:26:04.557 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-04T15:26:04.557 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-04T15:26:04.557 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-04T15:26:04.557 INFO:teuthology.orchestra.run.smithi130.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-04T15:26:04.558 INFO:teuthology.orchestra.run.smithi130.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-04T15:26:04.558 INFO:teuthology.orchestra.run.smithi130.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-04T15:26:04.558 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-04T15:26:04.558 INFO:teuthology.orchestra.run.smithi130.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-11-04T15:26:04.558 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-04T15:26:04.559 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-04T15:26:04.559 INFO:teuthology.orchestra.run.smithi130.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-04T15:26:04.559 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:04.559 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-11-04T15:26:04.559 INFO:teuthology.orchestra.run.smithi130.stdout:============================================================================================ 2023-11-04T15:26:04.560 INFO:teuthology.orchestra.run.smithi130.stdout:Install 12 Packages 2023-11-04T15:26:04.560 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:04.561 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 37 M 2023-11-04T15:26:04.561 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 209 M 2023-11-04T15:26:04.562 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-11-04T15:26:04.688 INFO:teuthology.orchestra.run.smithi130.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 244 kB/s | 32 kB 00:00 2023-11-04T15:26:04.722 INFO:teuthology.orchestra.run.smithi130.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 532 kB/s | 17 kB 00:00 2023-11-04T15:26:04.747 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install ceph-mgr 2023-11-04T15:26:04.755 INFO:teuthology.orchestra.run.smithi130.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2023-11-04T15:26:04.806 INFO:teuthology.orchestra.run.smithi130.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 12 MB/s | 3.0 MB 00:00 2023-11-04T15:26:04.872 INFO:teuthology.orchestra.run.smithi130.stdout:(5/12): python3-devel-3.9.17-2.el9.x86_64.rpm 3.1 MB/s | 205 kB 00:00 2023-11-04T15:26:04.939 INFO:teuthology.orchestra.run.smithi130.stdout:(6/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 26 MB/s | 4.7 MB 00:00 2023-11-04T15:26:05.015 INFO:teuthology.orchestra.run.smithi130.stdout:(7/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 4.8 MB 00:00 2023-11-04T15:26:05.040 INFO:teuthology.orchestra.run.smithi130.stdout:(8/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.2 MB/s | 217 kB 00:00 2023-11-04T15:26:05.073 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-1181.gf7e9f 12/12 2023-11-04T15:26:05.073 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-1181.gf7e9f 1/12 2023-11-04T15:26:05.073 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2023-11-04T15:26:05.073 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2023-11-04T15:26:05.074 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2023-11-04T15:26:05.074 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2023-11-04T15:26:05.074 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-11-04T15:26:05.074 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 7/12 2023-11-04T15:26:05.074 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 8/12 2023-11-04T15:26:05.075 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 9/12 2023-11-04T15:26:05.075 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 10/12 2023-11-04T15:26:05.075 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 11/12 2023-11-04T15:26:05.165 INFO:teuthology.orchestra.run.smithi130.stdout:(9/12): libgfortran-11.4.1-2.3.el9.x86_64.rpm 6.4 MB/s | 803 kB 00:00 2023-11-04T15:26:05.316 INFO:teuthology.orchestra.run.smithi130.stdout:(10/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 52 MB/s | 16 MB 00:00 2023-11-04T15:26:05.321 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:00:58 ago on Sat 04 Nov 2023 03:25:07 PM UTC. 2023-11-04T15:26:05.341 INFO:teuthology.orchestra.run.smithi130.stdout:(11/12): libquadmath-11.4.1-2.3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2023-11-04T15:26:05.416 INFO:teuthology.orchestra.run.smithi019.stdout:Package ceph-mgr-2:18.2.0-1181.gf7e9f9af.el9.x86_64 is already installed. 2023-11-04T15:26:05.468 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:26:05.469 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do. 2023-11-04T15:26:05.469 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:26:05.499 INFO:teuthology.orchestra.run.smithi130.stdout:(12/12): ceph-mgr-diskprediction-local-18.2.0-1 7.9 MB/s | 7.4 MB 00:00 2023-11-04T15:26:05.501 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:26:05.502 INFO:teuthology.orchestra.run.smithi130.stdout:Total 39 MB/s | 37 MB 00:00 2023-11-04T15:26:05.502 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-11-04T15:26:05.523 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-11-04T15:26:05.524 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-11-04T15:26:05.525 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install ceph-mgr-dashboard 2023-11-04T15:26:05.537 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 12/12 2023-11-04T15:26:05.538 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:05.538 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2023-11-04T15:26:05.538 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-diskprediction-local-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:26:05.538 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-04T15:26:05.541 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-04T15:26:05.541 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-04T15:26:05.541 INFO:teuthology.orchestra.run.smithi096.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-04T15:26:05.541 INFO:teuthology.orchestra.run.smithi096.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-04T15:26:05.541 INFO:teuthology.orchestra.run.smithi096.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-04T15:26:05.542 INFO:teuthology.orchestra.run.smithi096.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-04T15:26:05.542 INFO:teuthology.orchestra.run.smithi096.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-04T15:26:05.542 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-04T15:26:05.542 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-04T15:26:05.543 INFO:teuthology.orchestra.run.smithi096.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-04T15:26:05.543 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:05.543 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:26:05.865 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-mgr-rook 2023-11-04T15:26:05.947 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-11-04T15:26:05.947 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-11-04T15:26:06.099 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:00:59 ago on Sat 04 Nov 2023 03:25:07 PM UTC. 2023-11-04T15:26:06.246 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:26:06.247 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:26:06.247 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2023-11-04T15:26:06.247 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:26:06.248 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2023-11-04T15:26:06.248 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-dashboard noarch 2:18.2.0-1181.gf7e9f9af.el9 ceph-noarch 1.8 M 2023-11-04T15:26:06.248 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2023-11-04T15:26:06.248 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-grafana-dashboards noarch 2:18.2.0-1181.gf7e9f9af.el9 ceph-noarch 23 k 2023-11-04T15:26:06.248 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-prometheus-alerts noarch 2:18.2.0-1181.gf7e9f9af.el9 ceph-noarch 15 k 2023-11-04T15:26:06.249 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-04T15:26:06.249 INFO:teuthology.orchestra.run.smithi019.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-04T15:26:06.249 INFO:teuthology.orchestra.run.smithi019.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-04T15:26:06.249 INFO:teuthology.orchestra.run.smithi019.stdout:Installing weak dependencies: 2023-11-04T15:26:06.249 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-04T15:26:06.250 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:06.250 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2023-11-04T15:26:06.250 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:26:06.250 INFO:teuthology.orchestra.run.smithi019.stdout:Install 7 Packages 2023-11-04T15:26:06.250 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:06.251 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 2.1 M 2023-11-04T15:26:06.252 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 8.5 M 2023-11-04T15:26:06.252 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2023-11-04T15:26:06.419 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:10 ago on Sat 04 Nov 2023 03:24:56 PM UTC. 2023-11-04T15:26:06.562 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:26:06.563 INFO:teuthology.orchestra.run.smithi096.stdout:======================================================================================== 2023-11-04T15:26:06.563 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2023-11-04T15:26:06.563 INFO:teuthology.orchestra.run.smithi096.stdout:======================================================================================== 2023-11-04T15:26:06.564 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2023-11-04T15:26:06.564 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-rook noarch 2:18.2.0-1181.gf7e9f9af.el9 ceph-noarch 47 k 2023-11-04T15:26:06.564 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2023-11-04T15:26:06.564 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-04T15:26:06.564 INFO:teuthology.orchestra.run.smithi096.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-04T15:26:06.565 INFO:teuthology.orchestra.run.smithi096.stdout: python3-google-auth noarch 1:2.23.3-1.el9 epel 197 k 2023-11-04T15:26:06.565 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-04T15:26:06.565 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-04T15:26:06.565 INFO:teuthology.orchestra.run.smithi096.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-04T15:26:06.566 INFO:teuthology.orchestra.run.smithi096.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-04T15:26:06.566 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-04T15:26:06.566 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-04T15:26:06.566 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-04T15:26:06.566 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-04T15:26:06.567 INFO:teuthology.orchestra.run.smithi096.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-04T15:26:06.567 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:06.567 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2023-11-04T15:26:06.567 INFO:teuthology.orchestra.run.smithi096.stdout:======================================================================================== 2023-11-04T15:26:06.567 INFO:teuthology.orchestra.run.smithi096.stdout:Install 13 Packages 2023-11-04T15:26:06.567 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:06.568 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 2.0 M 2023-11-04T15:26:06.568 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 26 M 2023-11-04T15:26:06.569 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2023-11-04T15:26:06.659 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-11-04T15:26:06.662 INFO:teuthology.orchestra.run.smithi019.stdout:(1/7): ceph-prometheus-alerts-18.2.0-1181.gf7e9 44 kB/s | 15 kB 00:00 2023-11-04T15:26:06.688 INFO:teuthology.orchestra.run.smithi019.stdout:(2/7): ceph-grafana-dashboards-18.2.0-1181.gf7e 65 kB/s | 23 kB 00:00 2023-11-04T15:26:06.722 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 1/12 2023-11-04T15:26:06.762 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 2/12 2023-11-04T15:26:06.804 INFO:teuthology.orchestra.run.smithi019.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 64 kB/s | 9.0 kB 00:00 2023-11-04T15:26:06.853 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2023-11-04T15:26:06.871 INFO:teuthology.orchestra.run.smithi019.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 470 kB/s | 31 kB 00:00 2023-11-04T15:26:06.897 INFO:teuthology.orchestra.run.smithi019.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 196 kB/s | 41 kB 00:00 2023-11-04T15:26:06.898 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2023-11-04T15:26:06.955 INFO:teuthology.orchestra.run.smithi019.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 2.2 MB/s | 188 kB 00:00 2023-11-04T15:26:07.009 INFO:teuthology.orchestra.run.smithi096.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 179 kB/s | 18 kB 00:00 2023-11-04T15:26:07.059 INFO:teuthology.orchestra.run.smithi096.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 161 kB/s | 24 kB 00:00 2023-11-04T15:26:07.078 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2023-11-04T15:26:07.101 INFO:teuthology.orchestra.run.smithi096.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.5 MB/s | 174 kB 00:00 2023-11-04T15:26:07.114 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-11-04T15:26:07.126 INFO:teuthology.orchestra.run.smithi096.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 132 kB 00:00 2023-11-04T15:26:07.152 INFO:teuthology.orchestra.run.smithi096.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2023-11-04T15:26:07.177 INFO:teuthology.orchestra.run.smithi096.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 872 kB/s | 43 kB 00:00 2023-11-04T15:26:07.199 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2023-11-04T15:26:07.412 INFO:teuthology.orchestra.run.smithi096.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 124 kB/s | 32 kB 00:00 2023-11-04T15:26:07.427 INFO:teuthology.orchestra.run.smithi096.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 60 kB/s | 15 kB 00:00 2023-11-04T15:26:07.486 INFO:teuthology.orchestra.run.smithi096.stdout:(9/13): ceph-mgr-rook-18.2.0-1181.gf7e9f9af.el9 82 kB/s | 47 kB 00:00 2023-11-04T15:26:07.555 INFO:teuthology.orchestra.run.smithi019.stdout:(7/7): ceph-mgr-dashboard-18.2.0-1181.gf7e9f9af 1.4 MB/s | 1.8 MB 00:01 2023-11-04T15:26:07.559 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:26:07.559 INFO:teuthology.orchestra.run.smithi019.stdout:Total 1.6 MB/s | 2.1 MB 00:01 2023-11-04T15:26:07.559 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2023-11-04T15:26:07.569 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2023-11-04T15:26:07.569 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2023-11-04T15:26:07.643 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2023-11-04T15:26:07.644 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2023-11-04T15:26:07.661 INFO:teuthology.orchestra.run.smithi096.stdout:(10/13): python3-google-auth-2.23.3-1.el9.noarc 786 kB/s | 197 kB 00:00 2023-11-04T15:26:07.762 INFO:teuthology.orchestra.run.smithi096.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 897 kB/s | 90 kB 00:00 2023-11-04T15:26:07.787 INFO:teuthology.orchestra.run.smithi096.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 197 kB/s | 59 kB 00:00 2023-11-04T15:26:07.867 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2023-11-04T15:26:07.920 INFO:teuthology.orchestra.run.smithi096.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 2.1 MB/s | 1.0 MB 00:00 2023-11-04T15:26:07.922 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:26:07.922 INFO:teuthology.orchestra.run.smithi096.stdout:Total 1.5 MB/s | 2.0 MB 00:01 2023-11-04T15:26:07.922 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2023-11-04T15:26:07.936 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2023-11-04T15:26:07.936 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2023-11-04T15:26:07.954 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2023-11-04T15:26:07.992 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2023-11-04T15:26:08.023 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2023-11-04T15:26:08.032 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2023-11-04T15:26:08.032 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2023-11-04T15:26:08.058 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2023-11-04T15:26:08.105 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2023-11-04T15:26:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2023-11-04T15:26:08.173 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-1181.gf7e9f9af.el9.n 5/7 2023-11-04T15:26:08.422 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-1181.gf7e9f9af.el9. 6/7 2023-11-04T15:26:08.450 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-1181.gf7e9f9af.el9.noarc 7/7 2023-11-04T15:26:08.555 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2023-11-04T15:26:08.724 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2023-11-04T15:26:08.788 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2023-11-04T15:26:08.852 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2023-11-04T15:26:08.890 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2023-11-04T15:26:08.930 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2023-11-04T15:26:09.013 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-1181.gf7e9f9af.el9.noarc 7/7 2023-11-04T15:26:09.013 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-1181.gf7e9f9af.el9. 1/7 2023-11-04T15:26:09.013 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-1181.gf7e9f9af.el9.noarc 2/7 2023-11-04T15:26:09.013 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-1181.gf7e9f9af.el9.n 3/7 2023-11-04T15:26:09.014 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2023-11-04T15:26:09.014 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2023-11-04T15:26:09.014 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2023-11-04T15:26:09.022 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2023-11-04T15:26:09.133 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-google-auth-1:2.23.3-1.el9.noarch 7/13 2023-11-04T15:26:09.199 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2023-11-04T15:26:09.227 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2023-11-04T15:26:09.345 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2023-11-04T15:26:09.345 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:09.346 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2023-11-04T15:26:09.346 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-grafana-dashboards-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:26:09.346 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-dashboard-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:26:09.347 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-prometheus-alerts-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:26:09.347 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-04T15:26:09.347 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-04T15:26:09.348 INFO:teuthology.orchestra.run.smithi019.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-04T15:26:09.348 INFO:teuthology.orchestra.run.smithi019.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-04T15:26:09.348 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:09.348 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:26:09.546 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install ceph-mgr-diskprediction-local 2023-11-04T15:26:09.931 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2023-11-04T15:26:09.971 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2023-11-04T15:26:10.005 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2023-11-04T15:26:10.051 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2023-11-04T15:26:10.075 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-rook-2:18.2.0-1181.gf7e9f9af.el9.noarch 13/13 2023-11-04T15:26:10.116 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:01:03 ago on Sat 04 Nov 2023 03:25:07 PM UTC. 2023-11-04T15:26:10.236 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2023-11-04T15:26:10.264 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:26:10.265 INFO:teuthology.orchestra.run.smithi019.stdout:============================================================================================ 2023-11-04T15:26:10.265 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2023-11-04T15:26:10.265 INFO:teuthology.orchestra.run.smithi019.stdout:============================================================================================ 2023-11-04T15:26:10.266 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2023-11-04T15:26:10.266 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-1181.gf7e9f9af.el9 ceph-noarch 7.4 M 2023-11-04T15:26:10.266 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2023-11-04T15:26:10.266 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-04T15:26:10.266 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-04T15:26:10.267 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-04T15:26:10.267 INFO:teuthology.orchestra.run.smithi019.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-04T15:26:10.267 INFO:teuthology.orchestra.run.smithi019.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-04T15:26:10.267 INFO:teuthology.orchestra.run.smithi019.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-04T15:26:10.267 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-04T15:26:10.268 INFO:teuthology.orchestra.run.smithi019.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-11-04T15:26:10.268 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-04T15:26:10.268 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-04T15:26:10.268 INFO:teuthology.orchestra.run.smithi019.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-04T15:26:10.268 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:10.268 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2023-11-04T15:26:10.269 INFO:teuthology.orchestra.run.smithi019.stdout:============================================================================================ 2023-11-04T15:26:10.269 INFO:teuthology.orchestra.run.smithi019.stdout:Install 12 Packages 2023-11-04T15:26:10.269 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:10.270 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 37 M 2023-11-04T15:26:10.270 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 209 M 2023-11-04T15:26:10.270 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2023-11-04T15:26:10.278 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-1181.gf7e9f 12/12 2023-11-04T15:26:10.387 INFO:teuthology.orchestra.run.smithi019.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 265 kB/s | 32 kB 00:00 2023-11-04T15:26:10.421 INFO:teuthology.orchestra.run.smithi019.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 517 kB/s | 17 kB 00:00 2023-11-04T15:26:10.454 INFO:teuthology.orchestra.run.smithi019.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2023-11-04T15:26:10.521 INFO:teuthology.orchestra.run.smithi019.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 12 MB/s | 3.0 MB 00:00 2023-11-04T15:26:10.580 INFO:teuthology.orchestra.run.smithi019.stdout:(5/12): python3-devel-3.9.17-2.el9.x86_64.rpm 3.5 MB/s | 205 kB 00:00 2023-11-04T15:26:10.647 INFO:teuthology.orchestra.run.smithi019.stdout:(6/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 25 MB/s | 4.7 MB 00:00 2023-11-04T15:26:10.722 INFO:teuthology.orchestra.run.smithi019.stdout:(7/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 4.8 MB 00:00 2023-11-04T15:26:10.747 INFO:teuthology.orchestra.run.smithi019.stdout:(8/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.2 MB/s | 217 kB 00:00 2023-11-04T15:26:10.814 INFO:teuthology.orchestra.run.smithi019.stdout:(9/12): libgfortran-11.4.1-2.3.el9.x86_64.rpm 12 MB/s | 803 kB 00:00 2023-11-04T15:26:10.821 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-1181.gf7e9f9af.el9.noarch 13/13 2023-11-04T15:26:10.821 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-rook-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/13 2023-11-04T15:26:10.822 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2023-11-04T15:26:10.822 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2023-11-04T15:26:10.822 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2023-11-04T15:26:10.822 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2023-11-04T15:26:10.822 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2023-11-04T15:26:10.823 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2023-11-04T15:26:10.823 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2023-11-04T15:26:10.823 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2023-11-04T15:26:10.823 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-google-auth-1:2.23.3-1.el9.noarch 10/13 2023-11-04T15:26:10.823 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2023-11-04T15:26:10.824 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2023-11-04T15:26:10.982 INFO:teuthology.orchestra.run.smithi019.stdout:(10/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 61 MB/s | 16 MB 00:00 2023-11-04T15:26:11.006 INFO:teuthology.orchestra.run.smithi019.stdout:(11/12): libquadmath-11.4.1-2.3.el9.x86_64.rpm 1.0 MB/s | 195 kB 00:00 2023-11-04T15:26:11.148 INFO:teuthology.orchestra.run.smithi019.stdout:(12/12): ceph-mgr-diskprediction-local-18.2.0-1 8.4 MB/s | 7.4 MB 00:00 2023-11-04T15:26:11.151 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:26:11.151 INFO:teuthology.orchestra.run.smithi019.stdout:Total 42 MB/s | 37 MB 00:00 2023-11-04T15:26:11.151 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2023-11-04T15:26:11.175 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2023-11-04T15:26:11.175 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2023-11-04T15:26:11.215 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2023-11-04T15:26:11.216 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:11.216 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2023-11-04T15:26:11.216 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-rook-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:26:11.216 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-04T15:26:11.217 INFO:teuthology.orchestra.run.smithi096.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-04T15:26:11.217 INFO:teuthology.orchestra.run.smithi096.stdout: python3-google-auth-1:2.23.3-1.el9.noarch 2023-11-04T15:26:11.217 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-04T15:26:11.217 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-04T15:26:11.217 INFO:teuthology.orchestra.run.smithi096.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-04T15:26:11.218 INFO:teuthology.orchestra.run.smithi096.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-04T15:26:11.218 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-04T15:26:11.218 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-04T15:26:11.218 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-04T15:26:11.218 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-04T15:26:11.219 INFO:teuthology.orchestra.run.smithi096.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-04T15:26:11.219 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:11.219 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:26:11.481 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-mgr-cephadm 2023-11-04T15:26:11.622 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2023-11-04T15:26:11.622 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2023-11-04T15:26:12.027 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:16 ago on Sat 04 Nov 2023 03:24:56 PM UTC. 2023-11-04T15:26:12.177 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:26:12.178 INFO:teuthology.orchestra.run.smithi096.stdout:======================================================================================== 2023-11-04T15:26:12.178 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2023-11-04T15:26:12.178 INFO:teuthology.orchestra.run.smithi096.stdout:======================================================================================== 2023-11-04T15:26:12.178 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2023-11-04T15:26:12.178 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-cephadm noarch 2:18.2.0-1181.gf7e9f9af.el9 ceph-noarch 132 k 2023-11-04T15:26:12.179 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2023-11-04T15:26:12.179 INFO:teuthology.orchestra.run.smithi096.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-04T15:26:12.179 INFO:teuthology.orchestra.run.smithi096.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-04T15:26:12.179 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-04T15:26:12.179 INFO:teuthology.orchestra.run.smithi096.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-04T15:26:12.180 INFO:teuthology.orchestra.run.smithi096.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-04T15:26:12.180 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:12.180 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2023-11-04T15:26:12.180 INFO:teuthology.orchestra.run.smithi096.stdout:======================================================================================== 2023-11-04T15:26:12.180 INFO:teuthology.orchestra.run.smithi096.stdout:Install 6 Packages 2023-11-04T15:26:12.181 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:12.181 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 6.8 M 2023-11-04T15:26:12.182 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 33 M 2023-11-04T15:26:12.182 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2023-11-04T15:26:12.346 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2023-11-04T15:26:12.414 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 1/12 2023-11-04T15:26:12.444 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 2/12 2023-11-04T15:26:12.532 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2023-11-04T15:26:12.573 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2023-11-04T15:26:12.582 INFO:teuthology.orchestra.run.smithi096.stdout:(1/6): python3-jinja2-2.11.3-4.el9.noarch.rpm 1.0 MB/s | 228 kB 00:00 2023-11-04T15:26:12.699 INFO:teuthology.orchestra.run.smithi096.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 5.8 MB 00:00 2023-11-04T15:26:12.766 INFO:teuthology.orchestra.run.smithi096.stdout:(3/6): ceph-mgr-cephadm-18.2.0-1181.gf7e9f9af.e 330 kB/s | 132 kB 00:00 2023-11-04T15:26:12.770 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2023-11-04T15:26:12.797 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-11-04T15:26:12.880 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2023-11-04T15:26:12.975 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-1181.gf7e9f 12/12 2023-11-04T15:26:12.975 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-1181.gf7e9f 1/12 2023-11-04T15:26:12.975 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2023-11-04T15:26:12.976 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2023-11-04T15:26:12.976 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2023-11-04T15:26:12.976 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2023-11-04T15:26:12.976 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-11-04T15:26:12.976 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 7/12 2023-11-04T15:26:12.977 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 8/12 2023-11-04T15:26:12.977 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 9/12 2023-11-04T15:26:12.977 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 10/12 2023-11-04T15:26:12.977 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 11/12 2023-11-04T15:26:13.258 INFO:teuthology.orchestra.run.smithi096.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 108 kB/s | 58 kB 00:00 2023-11-04T15:26:13.300 INFO:teuthology.orchestra.run.smithi096.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 96 kB/s | 51 kB 00:00 2023-11-04T15:26:13.438 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 12/12 2023-11-04T15:26:13.439 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:13.439 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-11-04T15:26:13.439 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-diskprediction-local-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:26:13.439 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-04T15:26:13.439 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-04T15:26:13.440 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-04T15:26:13.440 INFO:teuthology.orchestra.run.smithi130.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-04T15:26:13.440 INFO:teuthology.orchestra.run.smithi130.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-04T15:26:13.440 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-04T15:26:13.440 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-04T15:26:13.441 INFO:teuthology.orchestra.run.smithi130.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-04T15:26:13.441 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-04T15:26:13.441 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-04T15:26:13.441 INFO:teuthology.orchestra.run.smithi130.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-04T15:26:13.441 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:13.442 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:26:13.575 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2023-11-04T15:26:13.687 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2023-11-04T15:26:13.812 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install ceph-mgr-rook 2023-11-04T15:26:13.816 INFO:teuthology.orchestra.run.smithi096.stdout:(6/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 444 kB/s | 548 kB 00:01 2023-11-04T15:26:13.821 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:26:13.821 INFO:teuthology.orchestra.run.smithi096.stdout:Total 4.1 MB/s | 6.8 MB 00:01 2023-11-04T15:26:13.821 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2023-11-04T15:26:13.831 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2023-11-04T15:26:13.831 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2023-11-04T15:26:13.920 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2023-11-04T15:26:13.920 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2023-11-04T15:26:14.217 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2023-11-04T15:26:14.368 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:01:16 ago on Sat 04 Nov 2023 03:24:58 PM UTC. 2023-11-04T15:26:14.397 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2023-11-04T15:26:14.451 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2023-11-04T15:26:14.509 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:26:14.510 INFO:teuthology.orchestra.run.smithi130.stdout:======================================================================================== 2023-11-04T15:26:14.511 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2023-11-04T15:26:14.511 INFO:teuthology.orchestra.run.smithi130.stdout:======================================================================================== 2023-11-04T15:26:14.511 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-11-04T15:26:14.511 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-rook noarch 2:18.2.0-1181.gf7e9f9af.el9 ceph-noarch 47 k 2023-11-04T15:26:14.512 INFO:teuthology.orchestra.run.smithi130.stdout:Installing dependencies: 2023-11-04T15:26:14.512 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-04T15:26:14.512 INFO:teuthology.orchestra.run.smithi130.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-04T15:26:14.512 INFO:teuthology.orchestra.run.smithi130.stdout: python3-google-auth noarch 1:2.23.3-1.el9 epel 197 k 2023-11-04T15:26:14.512 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-04T15:26:14.513 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-04T15:26:14.513 INFO:teuthology.orchestra.run.smithi130.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-04T15:26:14.513 INFO:teuthology.orchestra.run.smithi130.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-04T15:26:14.513 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-04T15:26:14.513 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-04T15:26:14.514 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-04T15:26:14.514 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-04T15:26:14.514 INFO:teuthology.orchestra.run.smithi130.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-04T15:26:14.514 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:14.515 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-11-04T15:26:14.515 INFO:teuthology.orchestra.run.smithi130.stdout:======================================================================================== 2023-11-04T15:26:14.515 INFO:teuthology.orchestra.run.smithi130.stdout:Install 13 Packages 2023-11-04T15:26:14.515 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:14.516 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 2.0 M 2023-11-04T15:26:14.517 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 26 M 2023-11-04T15:26:14.517 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-11-04T15:26:14.685 INFO:teuthology.orchestra.run.smithi130.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 152 kB/s | 18 kB 00:00 2023-11-04T15:26:14.710 INFO:teuthology.orchestra.run.smithi130.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 169 kB/s | 24 kB 00:00 2023-11-04T15:26:14.752 INFO:teuthology.orchestra.run.smithi130.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.6 MB/s | 174 kB 00:00 2023-11-04T15:26:14.778 INFO:teuthology.orchestra.run.smithi130.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 132 kB 00:00 2023-11-04T15:26:14.811 INFO:teuthology.orchestra.run.smithi130.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 3.5 MB/s | 211 kB 00:00 2023-11-04T15:26:14.837 INFO:teuthology.orchestra.run.smithi130.stdout:(6/13): ceph-mgr-rook-18.2.0-1181.gf7e9f9af.el9 175 kB/s | 47 kB 00:00 2023-11-04T15:26:14.862 INFO:teuthology.orchestra.run.smithi130.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 510 kB/s | 43 kB 00:00 2023-11-04T15:26:14.971 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2023-11-04T15:26:15.004 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2023-11-04T15:26:15.054 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2023-11-04T15:26:15.112 INFO:teuthology.orchestra.run.smithi130.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 60 kB/s | 15 kB 00:00 2023-11-04T15:26:15.122 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 5/6 2023-11-04T15:26:15.146 INFO:teuthology.orchestra.run.smithi130.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 96 kB/s | 32 kB 00:00 2023-11-04T15:26:15.147 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 6/6 2023-11-04T15:26:15.321 INFO:teuthology.orchestra.run.smithi130.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 338 kB/s | 59 kB 00:00 2023-11-04T15:26:15.346 INFO:teuthology.orchestra.run.smithi130.stdout:(11/13): python3-google-auth-2.23.3-1.el9.noarc 407 kB/s | 197 kB 00:00 2023-11-04T15:26:15.430 INFO:teuthology.orchestra.run.smithi130.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 826 kB/s | 90 kB 00:00 2023-11-04T15:26:15.580 INFO:teuthology.orchestra.run.smithi130.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 2.2 MB/s | 1.0 MB 00:00 2023-11-04T15:26:15.582 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:26:15.582 INFO:teuthology.orchestra.run.smithi130.stdout:Total 1.9 MB/s | 2.0 MB 00:01 2023-11-04T15:26:15.583 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-11-04T15:26:15.595 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-11-04T15:26:15.596 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-11-04T15:26:15.694 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-11-04T15:26:15.695 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-11-04T15:26:15.971 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 6/6 2023-11-04T15:26:15.971 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/6 2023-11-04T15:26:15.971 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2023-11-04T15:26:15.971 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 3/6 2023-11-04T15:26:15.972 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2023-11-04T15:26:15.972 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2023-11-04T15:26:16.100 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2023-11-04T15:26:16.123 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-1181.gf7e9f 12/12 2023-11-04T15:26:16.220 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-11-04T15:26:16.263 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2023-11-04T15:26:16.264 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:16.264 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2023-11-04T15:26:16.264 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:26:16.264 INFO:teuthology.orchestra.run.smithi096.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-04T15:26:16.265 INFO:teuthology.orchestra.run.smithi096.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-04T15:26:16.265 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-04T15:26:16.265 INFO:teuthology.orchestra.run.smithi096.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-04T15:26:16.265 INFO:teuthology.orchestra.run.smithi096.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-04T15:26:16.265 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:16.266 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:26:16.375 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2023-11-04T15:26:16.430 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2023-11-04T15:26:16.494 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2023-11-04T15:26:16.530 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-fuse 2023-11-04T15:26:16.540 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2023-11-04T15:26:16.581 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2023-11-04T15:26:16.682 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2023-11-04T15:26:16.792 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-google-auth-1:2.23.3-1.el9.noarch 7/13 2023-11-04T15:26:16.841 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2023-11-04T15:26:17.074 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:21 ago on Sat 04 Nov 2023 03:24:56 PM UTC. 2023-11-04T15:26:17.213 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:26:17.214 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:26:17.214 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2023-11-04T15:26:17.215 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:26:17.215 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2023-11-04T15:26:17.215 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-fuse x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 839 k 2023-11-04T15:26:17.215 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2023-11-04T15:26:17.215 INFO:teuthology.orchestra.run.smithi096.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-04T15:26:17.216 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:17.216 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2023-11-04T15:26:17.216 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:26:17.216 INFO:teuthology.orchestra.run.smithi096.stdout:Install 2 Packages 2023-11-04T15:26:17.217 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:17.217 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 918 k 2023-11-04T15:26:17.217 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 2.7 M 2023-11-04T15:26:17.217 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2023-11-04T15:26:17.344 INFO:teuthology.orchestra.run.smithi096.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 612 kB/s | 79 kB 00:00 2023-11-04T15:26:17.551 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2023-11-04T15:26:17.596 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2023-11-04T15:26:17.630 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2023-11-04T15:26:17.675 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2023-11-04T15:26:17.700 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-rook-2:18.2.0-1181.gf7e9f9af.el9.noarch 13/13 2023-11-04T15:26:17.702 INFO:teuthology.orchestra.run.smithi096.stdout:(2/2): ceph-fuse-18.2.0-1181.gf7e9f9af.el9.x86_ 1.7 MB/s | 839 kB 00:00 2023-11-04T15:26:17.703 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:26:17.704 INFO:teuthology.orchestra.run.smithi096.stdout:Total 1.8 MB/s | 918 kB 00:00 2023-11-04T15:26:17.704 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2023-11-04T15:26:17.725 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2023-11-04T15:26:17.725 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2023-11-04T15:26:17.801 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2023-11-04T15:26:17.801 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2023-11-04T15:26:17.985 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2023-11-04T15:26:18.107 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2023-11-04T15:26:18.178 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/2 2023-11-04T15:26:18.467 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-1181.gf7e9f9af.el9.noarch 13/13 2023-11-04T15:26:18.467 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-rook-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/13 2023-11-04T15:26:18.468 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2023-11-04T15:26:18.468 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2023-11-04T15:26:18.468 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2023-11-04T15:26:18.468 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2023-11-04T15:26:18.468 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2023-11-04T15:26:18.469 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2023-11-04T15:26:18.469 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2023-11-04T15:26:18.469 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2023-11-04T15:26:18.469 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-google-auth-1:2.23.3-1.el9.noarch 10/13 2023-11-04T15:26:18.469 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2023-11-04T15:26:18.470 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2023-11-04T15:26:18.600 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-1181.gf7e9f 12/12 2023-11-04T15:26:18.601 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-1181.gf7e9f 1/12 2023-11-04T15:26:18.601 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2023-11-04T15:26:18.601 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2023-11-04T15:26:18.601 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2023-11-04T15:26:18.602 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2023-11-04T15:26:18.602 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-11-04T15:26:18.602 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 7/12 2023-11-04T15:26:18.602 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 8/12 2023-11-04T15:26:18.602 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 9/12 2023-11-04T15:26:18.603 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 10/12 2023-11-04T15:26:18.603 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 11/12 2023-11-04T15:26:18.834 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2023-11-04T15:26:18.835 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:18.835 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-11-04T15:26:18.835 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-rook-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:26:18.835 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-04T15:26:18.836 INFO:teuthology.orchestra.run.smithi130.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-04T15:26:18.836 INFO:teuthology.orchestra.run.smithi130.stdout: python3-google-auth-1:2.23.3-1.el9.noarch 2023-11-04T15:26:18.836 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-04T15:26:18.836 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-04T15:26:18.836 INFO:teuthology.orchestra.run.smithi130.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-04T15:26:18.837 INFO:teuthology.orchestra.run.smithi130.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-04T15:26:18.837 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-04T15:26:18.837 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-04T15:26:18.837 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-04T15:26:18.837 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-04T15:26:18.838 INFO:teuthology.orchestra.run.smithi130.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-04T15:26:18.838 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:18.838 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:26:18.865 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/2 2023-11-04T15:26:18.865 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/2 2023-11-04T15:26:19.030 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 12/12 2023-11-04T15:26:19.031 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:19.031 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2023-11-04T15:26:19.031 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-diskprediction-local-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:26:19.031 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-04T15:26:19.032 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-04T15:26:19.032 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-04T15:26:19.032 INFO:teuthology.orchestra.run.smithi019.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-04T15:26:19.032 INFO:teuthology.orchestra.run.smithi019.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-04T15:26:19.032 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-04T15:26:19.033 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-04T15:26:19.033 INFO:teuthology.orchestra.run.smithi019.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-04T15:26:19.033 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-04T15:26:19.033 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-04T15:26:19.033 INFO:teuthology.orchestra.run.smithi019.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-04T15:26:19.034 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:19.034 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:26:19.075 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install ceph-mgr-cephadm 2023-11-04T15:26:19.175 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2023-11-04T15:26:19.175 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:19.177 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2023-11-04T15:26:19.178 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2023-11-04T15:26:19.178 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:19.178 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:26:19.404 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install ceph-mgr-rook 2023-11-04T15:26:19.430 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-volume 2023-11-04T15:26:19.638 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:01:21 ago on Sat 04 Nov 2023 03:24:58 PM UTC. 2023-11-04T15:26:19.791 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:26:19.791 INFO:teuthology.orchestra.run.smithi130.stdout:======================================================================================== 2023-11-04T15:26:19.792 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2023-11-04T15:26:19.792 INFO:teuthology.orchestra.run.smithi130.stdout:======================================================================================== 2023-11-04T15:26:19.792 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-11-04T15:26:19.792 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-cephadm noarch 2:18.2.0-1181.gf7e9f9af.el9 ceph-noarch 132 k 2023-11-04T15:26:19.792 INFO:teuthology.orchestra.run.smithi130.stdout:Installing dependencies: 2023-11-04T15:26:19.793 INFO:teuthology.orchestra.run.smithi130.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-04T15:26:19.793 INFO:teuthology.orchestra.run.smithi130.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-04T15:26:19.793 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-04T15:26:19.793 INFO:teuthology.orchestra.run.smithi130.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-04T15:26:19.794 INFO:teuthology.orchestra.run.smithi130.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-04T15:26:19.794 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:19.794 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-11-04T15:26:19.794 INFO:teuthology.orchestra.run.smithi130.stdout:======================================================================================== 2023-11-04T15:26:19.794 INFO:teuthology.orchestra.run.smithi130.stdout:Install 6 Packages 2023-11-04T15:26:19.795 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:19.795 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 6.8 M 2023-11-04T15:26:19.796 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 33 M 2023-11-04T15:26:19.796 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-11-04T15:26:19.987 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:01:12 ago on Sat 04 Nov 2023 03:25:07 PM UTC. 2023-11-04T15:26:19.993 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:23 ago on Sat 04 Nov 2023 03:24:56 PM UTC. 2023-11-04T15:26:20.022 INFO:teuthology.orchestra.run.smithi130.stdout:(1/6): python3-jinja2-2.11.3-4.el9.noarch.rpm 1.6 MB/s | 228 kB 00:00 2023-11-04T15:26:20.132 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:26:20.133 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:26:20.133 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2023-11-04T15:26:20.133 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:26:20.133 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2023-11-04T15:26:20.134 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-volume noarch 2:18.2.0-1181.gf7e9f9af.el9 ceph-noarch 262 k 2023-11-04T15:26:20.134 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:20.134 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2023-11-04T15:26:20.134 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:26:20.134 INFO:teuthology.orchestra.run.smithi096.stdout:Install 1 Package 2023-11-04T15:26:20.135 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:20.135 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 262 k 2023-11-04T15:26:20.135 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 1.2 M 2023-11-04T15:26:20.135 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2023-11-04T15:26:20.138 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:26:20.139 INFO:teuthology.orchestra.run.smithi130.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 5.8 MB 00:00 2023-11-04T15:26:20.140 INFO:teuthology.orchestra.run.smithi019.stdout:======================================================================================== 2023-11-04T15:26:20.140 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2023-11-04T15:26:20.140 INFO:teuthology.orchestra.run.smithi019.stdout:======================================================================================== 2023-11-04T15:26:20.140 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2023-11-04T15:26:20.141 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-rook noarch 2:18.2.0-1181.gf7e9f9af.el9 ceph-noarch 47 k 2023-11-04T15:26:20.141 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2023-11-04T15:26:20.141 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-04T15:26:20.141 INFO:teuthology.orchestra.run.smithi019.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-04T15:26:20.142 INFO:teuthology.orchestra.run.smithi019.stdout: python3-google-auth noarch 1:2.23.3-1.el9 epel 197 k 2023-11-04T15:26:20.142 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-04T15:26:20.142 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-04T15:26:20.142 INFO:teuthology.orchestra.run.smithi019.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-04T15:26:20.142 INFO:teuthology.orchestra.run.smithi019.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-04T15:26:20.143 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-04T15:26:20.143 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-04T15:26:20.143 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-04T15:26:20.143 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-04T15:26:20.143 INFO:teuthology.orchestra.run.smithi019.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-04T15:26:20.144 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:20.144 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2023-11-04T15:26:20.144 INFO:teuthology.orchestra.run.smithi019.stdout:======================================================================================== 2023-11-04T15:26:20.144 INFO:teuthology.orchestra.run.smithi019.stdout:Install 13 Packages 2023-11-04T15:26:20.144 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:20.145 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 2.0 M 2023-11-04T15:26:20.145 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 26 M 2023-11-04T15:26:20.145 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2023-11-04T15:26:20.381 INFO:teuthology.orchestra.run.smithi130.stdout:(3/6): ceph-mgr-cephadm-18.2.0-1181.gf7e9f9af.e 263 kB/s | 132 kB 00:00 2023-11-04T15:26:20.489 INFO:teuthology.orchestra.run.smithi019.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 150 kB/s | 18 kB 00:00 2023-11-04T15:26:20.506 INFO:teuthology.orchestra.run.smithi130.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 157 kB/s | 58 kB 00:00 2023-11-04T15:26:20.515 INFO:teuthology.orchestra.run.smithi019.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 168 kB/s | 24 kB 00:00 2023-11-04T15:26:20.557 INFO:teuthology.orchestra.run.smithi019.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.6 MB/s | 174 kB 00:00 2023-11-04T15:26:20.557 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-volume-18.2.0-1181.gf7e9f9af.el9.noarch.rp 619 kB/s | 262 kB 00:00 2023-11-04T15:26:20.557 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:26:20.558 INFO:teuthology.orchestra.run.smithi096.stdout:Total 617 kB/s | 262 kB 00:00 2023-11-04T15:26:20.558 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2023-11-04T15:26:20.566 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2023-11-04T15:26:20.566 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2023-11-04T15:26:20.582 INFO:teuthology.orchestra.run.smithi019.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 132 kB 00:00 2023-11-04T15:26:20.601 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2023-11-04T15:26:20.602 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2023-11-04T15:26:20.607 INFO:teuthology.orchestra.run.smithi019.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2023-11-04T15:26:20.632 INFO:teuthology.orchestra.run.smithi019.stdout:(6/13): ceph-mgr-rook-18.2.0-1181.gf7e9f9af.el9 180 kB/s | 47 kB 00:00 2023-11-04T15:26:20.657 INFO:teuthology.orchestra.run.smithi019.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 569 kB/s | 43 kB 00:00 2023-11-04T15:26:20.665 INFO:teuthology.orchestra.run.smithi130.stdout:(5/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 856 kB/s | 548 kB 00:00 2023-11-04T15:26:20.723 INFO:teuthology.orchestra.run.smithi130.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 149 kB/s | 51 kB 00:00 2023-11-04T15:26:20.725 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:26:20.725 INFO:teuthology.orchestra.run.smithi130.stdout:Total 7.3 MB/s | 6.8 MB 00:00 2023-11-04T15:26:20.726 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-11-04T15:26:20.735 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-11-04T15:26:20.735 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-11-04T15:26:20.813 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2023-11-04T15:26:20.836 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-11-04T15:26:20.837 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-11-04T15:26:20.849 INFO:teuthology.orchestra.run.smithi019.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 78 kB/s | 15 kB 00:00 2023-11-04T15:26:20.875 INFO:teuthology.orchestra.run.smithi019.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 120 kB/s | 32 kB 00:00 2023-11-04T15:26:20.875 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-volume-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/1 2023-11-04T15:26:20.890 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-volume-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/1 2023-11-04T15:26:20.891 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:26:20.891 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-04T15:26:20.892 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:20.900 INFO:teuthology.orchestra.run.smithi019.stdout:(10/13): python3-google-auth-2.23.3-1.el9.noarc 814 kB/s | 197 kB 00:00 2023-11-04T15:26:20.950 INFO:teuthology.orchestra.run.smithi019.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 785 kB/s | 59 kB 00:00 2023-11-04T15:26:20.976 INFO:teuthology.orchestra.run.smithi019.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.2 MB/s | 90 kB 00:00 2023-11-04T15:26:21.034 INFO:teuthology.orchestra.run.smithi019.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 5.5 MB/s | 1.0 MB 00:00 2023-11-04T15:26:21.038 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:26:21.038 INFO:teuthology.orchestra.run.smithi019.stdout:Total 2.3 MB/s | 2.0 MB 00:00 2023-11-04T15:26:21.039 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2023-11-04T15:26:21.052 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2023-11-04T15:26:21.052 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2023-11-04T15:26:21.119 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-11-04T15:26:21.158 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2023-11-04T15:26:21.158 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2023-11-04T15:26:21.278 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2023-11-04T15:26:21.333 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2023-11-04T15:26:21.692 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2023-11-04T15:26:21.842 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2023-11-04T15:26:21.883 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2023-11-04T15:26:21.908 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-volume-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/1 2023-11-04T15:26:21.908 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:21.908 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2023-11-04T15:26:21.908 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-volume-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:26:21.909 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:21.909 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:26:21.926 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2023-11-04T15:26:21.979 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2023-11-04T15:26:21.997 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 5/6 2023-11-04T15:26:22.022 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 6/6 2023-11-04T15:26:22.042 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2023-11-04T15:26:22.079 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2023-11-04T15:26:22.121 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2023-11-04T15:26:22.226 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2023-11-04T15:26:22.253 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install librados-devel 2023-11-04T15:26:22.337 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-google-auth-1:2.23.3-1.el9.noarch 7/13 2023-11-04T15:26:22.397 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2023-11-04T15:26:22.823 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:26 ago on Sat 04 Nov 2023 03:24:56 PM UTC. 2023-11-04T15:26:22.870 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 6/6 2023-11-04T15:26:22.871 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/6 2023-11-04T15:26:22.871 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2023-11-04T15:26:22.871 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 3/6 2023-11-04T15:26:22.872 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2023-11-04T15:26:22.872 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2023-11-04T15:26:22.966 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:26:22.967 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:26:22.967 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repo Size 2023-11-04T15:26:22.967 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:26:22.968 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2023-11-04T15:26:22.968 INFO:teuthology.orchestra.run.smithi096.stdout: librados-devel x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 126 k 2023-11-04T15:26:22.968 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:22.968 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2023-11-04T15:26:22.968 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:26:22.969 INFO:teuthology.orchestra.run.smithi096.stdout:Install 1 Package 2023-11-04T15:26:22.969 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:22.969 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 126 k 2023-11-04T15:26:22.969 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 456 k 2023-11-04T15:26:22.969 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2023-11-04T15:26:23.170 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2023-11-04T15:26:23.183 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2023-11-04T15:26:23.184 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:23.184 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-11-04T15:26:23.184 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:26:23.184 INFO:teuthology.orchestra.run.smithi130.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-04T15:26:23.185 INFO:teuthology.orchestra.run.smithi130.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-04T15:26:23.185 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-04T15:26:23.185 INFO:teuthology.orchestra.run.smithi130.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-04T15:26:23.185 INFO:teuthology.orchestra.run.smithi130.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-04T15:26:23.185 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:23.186 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:26:23.218 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2023-11-04T15:26:23.260 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2023-11-04T15:26:23.279 INFO:teuthology.orchestra.run.smithi096.stdout:librados-devel-18.2.0-1181.gf7e9f9af.el9.x86_64 407 kB/s | 126 kB 00:00 2023-11-04T15:26:23.280 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:26:23.280 INFO:teuthology.orchestra.run.smithi096.stdout:Total 404 kB/s | 126 kB 00:00 2023-11-04T15:26:23.280 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2023-11-04T15:26:23.286 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2023-11-04T15:26:23.286 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2023-11-04T15:26:23.307 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2023-11-04T15:26:23.330 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-rook-2:18.2.0-1181.gf7e9f9af.el9.noarch 13/13 2023-11-04T15:26:23.341 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2023-11-04T15:26:23.342 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2023-11-04T15:26:23.432 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install ceph-fuse 2023-11-04T15:26:23.506 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2023-11-04T15:26:23.601 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librados-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:23.985 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:01:25 ago on Sat 04 Nov 2023 03:24:58 PM UTC. 2023-11-04T15:26:24.053 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librados-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:24.111 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-1181.gf7e9f9af.el9.noarch 13/13 2023-11-04T15:26:24.111 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-rook-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/13 2023-11-04T15:26:24.111 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2023-11-04T15:26:24.111 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2023-11-04T15:26:24.112 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2023-11-04T15:26:24.112 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2023-11-04T15:26:24.112 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2023-11-04T15:26:24.112 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2023-11-04T15:26:24.112 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2023-11-04T15:26:24.113 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2023-11-04T15:26:24.113 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-google-auth-1:2.23.3-1.el9.noarch 10/13 2023-11-04T15:26:24.113 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2023-11-04T15:26:24.113 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2023-11-04T15:26:24.125 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:26:24.126 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:26:24.126 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2023-11-04T15:26:24.126 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:26:24.127 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-11-04T15:26:24.127 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-fuse x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 839 k 2023-11-04T15:26:24.127 INFO:teuthology.orchestra.run.smithi130.stdout:Installing dependencies: 2023-11-04T15:26:24.127 INFO:teuthology.orchestra.run.smithi130.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-04T15:26:24.127 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:24.128 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-11-04T15:26:24.128 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:26:24.128 INFO:teuthology.orchestra.run.smithi130.stdout:Install 2 Packages 2023-11-04T15:26:24.128 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:24.128 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 918 k 2023-11-04T15:26:24.129 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 2.7 M 2023-11-04T15:26:24.129 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-11-04T15:26:24.251 INFO:teuthology.orchestra.run.smithi130.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 634 kB/s | 79 kB 00:00 2023-11-04T15:26:24.394 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librados-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:24.394 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:24.395 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2023-11-04T15:26:24.395 INFO:teuthology.orchestra.run.smithi096.stdout: librados-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:26:24.395 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:24.395 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:26:24.451 INFO:teuthology.orchestra.run.smithi130.stdout:(2/2): ceph-fuse-18.2.0-1181.gf7e9f9af.el9.x86_ 2.5 MB/s | 839 kB 00:00 2023-11-04T15:26:24.452 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:26:24.453 INFO:teuthology.orchestra.run.smithi130.stdout:Total 2.7 MB/s | 918 kB 00:00 2023-11-04T15:26:24.453 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-11-04T15:26:24.473 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-11-04T15:26:24.474 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-11-04T15:26:24.491 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2023-11-04T15:26:24.491 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:24.491 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2023-11-04T15:26:24.492 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-rook-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:26:24.492 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-04T15:26:24.492 INFO:teuthology.orchestra.run.smithi019.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-04T15:26:24.492 INFO:teuthology.orchestra.run.smithi019.stdout: python3-google-auth-1:2.23.3-1.el9.noarch 2023-11-04T15:26:24.493 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-04T15:26:24.493 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-04T15:26:24.493 INFO:teuthology.orchestra.run.smithi019.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-04T15:26:24.493 INFO:teuthology.orchestra.run.smithi019.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-04T15:26:24.493 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-04T15:26:24.494 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-04T15:26:24.494 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-04T15:26:24.494 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-04T15:26:24.494 INFO:teuthology.orchestra.run.smithi019.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-04T15:26:24.494 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:24.495 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:26:24.550 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-11-04T15:26:24.551 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-11-04T15:26:24.638 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install libcephfs2 2023-11-04T15:26:24.723 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install ceph-mgr-cephadm 2023-11-04T15:26:24.744 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-11-04T15:26:24.882 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2023-11-04T15:26:24.952 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/2 2023-11-04T15:26:25.196 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:29 ago on Sat 04 Nov 2023 03:24:56 PM UTC. 2023-11-04T15:26:25.292 INFO:teuthology.orchestra.run.smithi096.stdout:Package libcephfs2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 is already installed. 2023-11-04T15:26:25.296 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:01:18 ago on Sat 04 Nov 2023 03:25:07 PM UTC. 2023-11-04T15:26:25.342 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:26:25.343 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2023-11-04T15:26:25.343 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:26:25.408 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install libcephfs-devel 2023-11-04T15:26:25.446 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:26:25.447 INFO:teuthology.orchestra.run.smithi019.stdout:======================================================================================== 2023-11-04T15:26:25.447 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2023-11-04T15:26:25.447 INFO:teuthology.orchestra.run.smithi019.stdout:======================================================================================== 2023-11-04T15:26:25.447 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2023-11-04T15:26:25.448 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-cephadm noarch 2:18.2.0-1181.gf7e9f9af.el9 ceph-noarch 132 k 2023-11-04T15:26:25.448 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2023-11-04T15:26:25.448 INFO:teuthology.orchestra.run.smithi019.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-04T15:26:25.448 INFO:teuthology.orchestra.run.smithi019.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-04T15:26:25.448 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-04T15:26:25.449 INFO:teuthology.orchestra.run.smithi019.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-04T15:26:25.449 INFO:teuthology.orchestra.run.smithi019.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-04T15:26:25.449 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:25.449 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2023-11-04T15:26:25.449 INFO:teuthology.orchestra.run.smithi019.stdout:======================================================================================== 2023-11-04T15:26:25.450 INFO:teuthology.orchestra.run.smithi019.stdout:Install 6 Packages 2023-11-04T15:26:25.450 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:25.451 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 6.8 M 2023-11-04T15:26:25.451 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 33 M 2023-11-04T15:26:25.452 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2023-11-04T15:26:25.635 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/2 2023-11-04T15:26:25.635 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/2 2023-11-04T15:26:25.944 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2023-11-04T15:26:25.944 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:25.944 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-11-04T15:26:25.944 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2023-11-04T15:26:25.945 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:25.945 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:26:25.946 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:29 ago on Sat 04 Nov 2023 03:24:56 PM UTC. 2023-11-04T15:26:25.971 INFO:teuthology.orchestra.run.smithi019.stdout:(1/6): python3-jinja2-2.11.3-4.el9.noarch.rpm 1.4 MB/s | 228 kB 00:00 2023-11-04T15:26:26.077 INFO:teuthology.orchestra.run.smithi019.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 5.8 MB 00:00 2023-11-04T15:26:26.088 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:26:26.089 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:26:26.089 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repo Size 2023-11-04T15:26:26.089 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:26:26.089 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2023-11-04T15:26:26.090 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs-devel x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 31 k 2023-11-04T15:26:26.090 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:26.090 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2023-11-04T15:26:26.090 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:26:26.090 INFO:teuthology.orchestra.run.smithi096.stdout:Install 1 Package 2023-11-04T15:26:26.091 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:26.091 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 31 k 2023-11-04T15:26:26.092 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 139 k 2023-11-04T15:26:26.092 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2023-11-04T15:26:26.231 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install ceph-volume 2023-11-04T15:26:26.245 INFO:teuthology.orchestra.run.smithi019.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 346 kB/s | 58 kB 00:00 2023-11-04T15:26:26.270 INFO:teuthology.orchestra.run.smithi019.stdout:(4/6): ceph-mgr-cephadm-18.2.0-1181.gf7e9f9af.e 289 kB/s | 132 kB 00:00 2023-11-04T15:26:26.320 INFO:teuthology.orchestra.run.smithi019.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 679 kB/s | 51 kB 00:00 2023-11-04T15:26:26.324 INFO:teuthology.orchestra.run.smithi096.stdout:libcephfs-devel-18.2.0-1181.gf7e9f9af.el9.x86_6 132 kB/s | 31 kB 00:00 2023-11-04T15:26:26.325 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:26:26.326 INFO:teuthology.orchestra.run.smithi096.stdout:Total 131 kB/s | 31 kB 00:00 2023-11-04T15:26:26.326 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2023-11-04T15:26:26.329 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2023-11-04T15:26:26.329 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2023-11-04T15:26:26.345 INFO:teuthology.orchestra.run.smithi019.stdout:(6/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 1.4 MB/s | 548 kB 00:00 2023-11-04T15:26:26.347 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:26:26.348 INFO:teuthology.orchestra.run.smithi019.stdout:Total 7.5 MB/s | 6.8 MB 00:00 2023-11-04T15:26:26.348 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2023-11-04T15:26:26.353 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2023-11-04T15:26:26.353 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2023-11-04T15:26:26.358 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2023-11-04T15:26:26.358 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2023-11-04T15:26:26.440 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2023-11-04T15:26:26.454 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2023-11-04T15:26:26.455 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2023-11-04T15:26:26.547 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libcephfs-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:26.757 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2023-11-04T15:26:26.792 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:01:28 ago on Sat 04 Nov 2023 03:24:58 PM UTC. 2023-11-04T15:26:26.918 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2023-11-04T15:26:26.932 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:26:26.933 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:26:26.933 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2023-11-04T15:26:26.934 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:26:26.934 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-11-04T15:26:26.934 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-volume noarch 2:18.2.0-1181.gf7e9f9af.el9 ceph-noarch 262 k 2023-11-04T15:26:26.934 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:26.934 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-11-04T15:26:26.935 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:26:26.935 INFO:teuthology.orchestra.run.smithi130.stdout:Install 1 Package 2023-11-04T15:26:26.935 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:26.935 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 262 k 2023-11-04T15:26:26.935 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 1.2 M 2023-11-04T15:26:26.936 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-11-04T15:26:26.960 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libcephfs-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:26.973 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2023-11-04T15:26:27.243 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libcephfs-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:27.243 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:27.244 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2023-11-04T15:26:27.244 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:26:27.244 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:27.244 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:26:27.421 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install librados2 2023-11-04T15:26:27.447 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-volume-18.2.0-1181.gf7e9f9af.el9.noarch.rp 511 kB/s | 262 kB 00:00 2023-11-04T15:26:27.448 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:26:27.448 INFO:teuthology.orchestra.run.smithi130.stdout:Total 510 kB/s | 262 kB 00:00 2023-11-04T15:26:27.448 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-11-04T15:26:27.456 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-11-04T15:26:27.456 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-11-04T15:26:27.487 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-11-04T15:26:27.488 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-11-04T15:26:27.532 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2023-11-04T15:26:27.619 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2023-11-04T15:26:27.687 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 5/6 2023-11-04T15:26:27.700 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-11-04T15:26:27.709 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 6/6 2023-11-04T15:26:27.774 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-volume-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/1 2023-11-04T15:26:27.790 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-volume-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/1 2023-11-04T15:26:27.790 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:26:27.790 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-04T15:26:27.790 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:27.964 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:31 ago on Sat 04 Nov 2023 03:24:56 PM UTC. 2023-11-04T15:26:28.057 INFO:teuthology.orchestra.run.smithi096.stdout:Package librados2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 is already installed. 2023-11-04T15:26:28.106 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:26:28.107 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2023-11-04T15:26:28.107 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:26:28.173 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install librbd1 2023-11-04T15:26:28.574 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 6/6 2023-11-04T15:26:28.575 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/6 2023-11-04T15:26:28.575 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2023-11-04T15:26:28.575 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 3/6 2023-11-04T15:26:28.575 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2023-11-04T15:26:28.575 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2023-11-04T15:26:28.720 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:32 ago on Sat 04 Nov 2023 03:24:56 PM UTC. 2023-11-04T15:26:28.803 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-volume-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/1 2023-11-04T15:26:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:28.804 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-11-04T15:26:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-volume-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:26:28.804 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:28.804 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:26:28.810 INFO:teuthology.orchestra.run.smithi096.stdout:Package librbd1-2:18.2.0-1181.gf7e9f9af.el9.x86_64 is already installed. 2023-11-04T15:26:28.859 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:26:28.860 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2023-11-04T15:26:28.860 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:26:28.907 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2023-11-04T15:26:28.908 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:28.908 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2023-11-04T15:26:28.908 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:26:28.908 INFO:teuthology.orchestra.run.smithi019.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-04T15:26:28.909 INFO:teuthology.orchestra.run.smithi019.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-04T15:26:28.909 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-04T15:26:28.909 INFO:teuthology.orchestra.run.smithi019.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-04T15:26:28.909 INFO:teuthology.orchestra.run.smithi019.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-04T15:26:28.909 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:28.910 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:26:28.923 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install python3-rados 2023-11-04T15:26:29.128 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install librados-devel 2023-11-04T15:26:29.143 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install ceph-fuse 2023-11-04T15:26:29.473 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:33 ago on Sat 04 Nov 2023 03:24:56 PM UTC. 2023-11-04T15:26:29.564 INFO:teuthology.orchestra.run.smithi096.stdout:Package python3-rados-2:18.2.0-1181.gf7e9f9af.el9.x86_64 is already installed. 2023-11-04T15:26:29.615 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:26:29.616 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2023-11-04T15:26:29.616 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:26:29.682 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install python3-rgw 2023-11-04T15:26:29.690 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:01:31 ago on Sat 04 Nov 2023 03:24:58 PM UTC. 2023-11-04T15:26:29.715 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:01:22 ago on Sat 04 Nov 2023 03:25:07 PM UTC. 2023-11-04T15:26:29.833 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:26:29.834 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:26:29.834 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repo Size 2023-11-04T15:26:29.835 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:26:29.835 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-11-04T15:26:29.837 INFO:teuthology.orchestra.run.smithi130.stdout: librados-devel x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 126 k 2023-11-04T15:26:29.838 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:29.838 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-11-04T15:26:29.838 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:26:29.838 INFO:teuthology.orchestra.run.smithi130.stdout:Install 1 Package 2023-11-04T15:26:29.838 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:29.839 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 126 k 2023-11-04T15:26:29.839 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 456 k 2023-11-04T15:26:29.839 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-11-04T15:26:29.862 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:26:29.863 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:26:29.863 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2023-11-04T15:26:29.863 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:26:29.864 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2023-11-04T15:26:29.864 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-fuse x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 839 k 2023-11-04T15:26:29.864 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2023-11-04T15:26:29.864 INFO:teuthology.orchestra.run.smithi019.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-04T15:26:29.864 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:29.865 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2023-11-04T15:26:29.865 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:26:29.865 INFO:teuthology.orchestra.run.smithi019.stdout:Install 2 Packages 2023-11-04T15:26:29.865 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:29.866 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 918 k 2023-11-04T15:26:29.866 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 2.7 M 2023-11-04T15:26:29.866 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2023-11-04T15:26:29.980 INFO:teuthology.orchestra.run.smithi019.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 680 kB/s | 79 kB 00:00 2023-11-04T15:26:30.044 INFO:teuthology.orchestra.run.smithi130.stdout:librados-devel-18.2.0-1181.gf7e9f9af.el9.x86_64 608 kB/s | 126 kB 00:00 2023-11-04T15:26:30.045 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:26:30.045 INFO:teuthology.orchestra.run.smithi130.stdout:Total 603 kB/s | 126 kB 00:00 2023-11-04T15:26:30.045 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-11-04T15:26:30.051 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-11-04T15:26:30.051 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-11-04T15:26:30.108 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-11-04T15:26:30.108 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-11-04T15:26:30.180 INFO:teuthology.orchestra.run.smithi019.stdout:(2/2): ceph-fuse-18.2.0-1181.gf7e9f9af.el9.x86_ 2.6 MB/s | 839 kB 00:00 2023-11-04T15:26:30.181 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:26:30.182 INFO:teuthology.orchestra.run.smithi019.stdout:Total 2.8 MB/s | 918 kB 00:00 2023-11-04T15:26:30.182 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2023-11-04T15:26:30.204 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2023-11-04T15:26:30.204 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2023-11-04T15:26:30.230 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:34 ago on Sat 04 Nov 2023 03:24:56 PM UTC. 2023-11-04T15:26:30.262 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-11-04T15:26:30.284 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2023-11-04T15:26:30.284 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2023-11-04T15:26:30.322 INFO:teuthology.orchestra.run.smithi096.stdout:Package python3-rgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 is already installed. 2023-11-04T15:26:30.358 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librados-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:30.371 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:26:30.372 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2023-11-04T15:26:30.373 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:26:30.440 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install python3-cephfs 2023-11-04T15:26:30.472 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2023-11-04T15:26:30.607 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2023-11-04T15:26:30.675 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/2 2023-11-04T15:26:30.879 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librados-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:30.988 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:34 ago on Sat 04 Nov 2023 03:24:56 PM UTC. 2023-11-04T15:26:31.080 INFO:teuthology.orchestra.run.smithi096.stdout:Package python3-cephfs-2:18.2.0-1181.gf7e9f9af.el9.x86_64 is already installed. 2023-11-04T15:26:31.130 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:26:31.131 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2023-11-04T15:26:31.132 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:26:31.197 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install python3-rbd 2023-11-04T15:26:31.200 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:31.201 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:31.201 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-11-04T15:26:31.201 INFO:teuthology.orchestra.run.smithi130.stdout: librados-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:26:31.201 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:31.201 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:26:31.366 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/2 2023-11-04T15:26:31.366 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/2 2023-11-04T15:26:31.465 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install libcephfs2 2023-11-04T15:26:31.674 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2023-11-04T15:26:31.674 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:31.674 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2023-11-04T15:26:31.675 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2023-11-04T15:26:31.675 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:31.675 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:26:31.748 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:35 ago on Sat 04 Nov 2023 03:24:56 PM UTC. 2023-11-04T15:26:31.839 INFO:teuthology.orchestra.run.smithi096.stdout:Package python3-rbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 is already installed. 2023-11-04T15:26:31.888 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:26:31.889 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2023-11-04T15:26:31.889 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:26:31.929 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install ceph-volume 2023-11-04T15:26:31.956 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install rbd-fuse 2023-11-04T15:26:32.028 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:01:34 ago on Sat 04 Nov 2023 03:24:58 PM UTC. 2023-11-04T15:26:32.123 INFO:teuthology.orchestra.run.smithi130.stdout:Package libcephfs2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 is already installed. 2023-11-04T15:26:32.172 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:26:32.172 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2023-11-04T15:26:32.173 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:26:32.234 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install libcephfs-devel 2023-11-04T15:26:32.503 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:36 ago on Sat 04 Nov 2023 03:24:56 PM UTC. 2023-11-04T15:26:32.506 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:01:25 ago on Sat 04 Nov 2023 03:25:07 PM UTC. 2023-11-04T15:26:32.646 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:26:32.647 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:26:32.647 INFO:teuthology.orchestra.run.smithi096.stdout: Package Architecture Version Repository Size 2023-11-04T15:26:32.647 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:26:32.648 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2023-11-04T15:26:32.648 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-fuse x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 86 k 2023-11-04T15:26:32.648 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:32.648 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2023-11-04T15:26:32.649 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:26:32.649 INFO:teuthology.orchestra.run.smithi096.stdout:Install 1 Package 2023-11-04T15:26:32.649 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:32.649 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 86 k 2023-11-04T15:26:32.649 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 231 k 2023-11-04T15:26:32.649 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2023-11-04T15:26:32.654 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:26:32.654 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:26:32.655 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2023-11-04T15:26:32.655 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:26:32.655 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2023-11-04T15:26:32.655 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-volume noarch 2:18.2.0-1181.gf7e9f9af.el9 ceph-noarch 262 k 2023-11-04T15:26:32.655 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:32.656 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2023-11-04T15:26:32.656 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:26:32.656 INFO:teuthology.orchestra.run.smithi019.stdout:Install 1 Package 2023-11-04T15:26:32.656 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:32.656 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 262 k 2023-11-04T15:26:32.657 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 1.2 M 2023-11-04T15:26:32.657 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2023-11-04T15:26:32.786 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:01:34 ago on Sat 04 Nov 2023 03:24:58 PM UTC. 2023-11-04T15:26:32.835 INFO:teuthology.orchestra.run.smithi096.stdout:rbd-fuse-18.2.0-1181.gf7e9f9af.el9.x86_64.rpm 460 kB/s | 86 kB 00:00 2023-11-04T15:26:32.836 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:26:32.836 INFO:teuthology.orchestra.run.smithi096.stdout:Total 457 kB/s | 86 kB 00:00 2023-11-04T15:26:32.837 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2023-11-04T15:26:32.843 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2023-11-04T15:26:32.843 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2023-11-04T15:26:32.898 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2023-11-04T15:26:32.899 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2023-11-04T15:26:32.928 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:26:32.929 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:26:32.929 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repo Size 2023-11-04T15:26:32.930 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:26:32.930 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-11-04T15:26:32.930 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs-devel x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 31 k 2023-11-04T15:26:32.930 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:32.931 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-11-04T15:26:32.931 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:26:32.931 INFO:teuthology.orchestra.run.smithi130.stdout:Install 1 Package 2023-11-04T15:26:32.931 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:32.932 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 31 k 2023-11-04T15:26:32.932 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 139 k 2023-11-04T15:26:32.932 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-11-04T15:26:33.001 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-volume-18.2.0-1181.gf7e9f9af.el9.noarch.rp 759 kB/s | 262 kB 00:00 2023-11-04T15:26:33.002 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:26:33.003 INFO:teuthology.orchestra.run.smithi019.stdout:Total 755 kB/s | 262 kB 00:00 2023-11-04T15:26:33.003 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2023-11-04T15:26:33.011 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2023-11-04T15:26:33.011 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2023-11-04T15:26:33.041 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2023-11-04T15:26:33.050 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2023-11-04T15:26:33.050 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2023-11-04T15:26:33.158 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : rbd-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:33.171 INFO:teuthology.orchestra.run.smithi130.stdout:libcephfs-devel-18.2.0-1181.gf7e9f9af.el9.x86_6 128 kB/s | 31 kB 00:00 2023-11-04T15:26:33.172 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:26:33.172 INFO:teuthology.orchestra.run.smithi130.stdout:Total 128 kB/s | 31 kB 00:00 2023-11-04T15:26:33.173 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-11-04T15:26:33.176 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-11-04T15:26:33.176 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-11-04T15:26:33.198 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-11-04T15:26:33.199 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-11-04T15:26:33.275 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2023-11-04T15:26:33.289 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-11-04T15:26:33.337 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-volume-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/1 2023-11-04T15:26:33.353 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-volume-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/1 2023-11-04T15:26:33.353 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:26:33.353 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-04T15:26:33.354 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:33.395 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcephfs-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:33.558 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: rbd-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:33.844 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : rbd-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:33.844 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:33.844 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2023-11-04T15:26:33.845 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:26:33.845 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:33.845 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:26:33.847 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libcephfs-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:34.098 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install rbd-mirror 2023-11-04T15:26:34.106 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephfs-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:34.106 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:34.107 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-11-04T15:26:34.107 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:26:34.107 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:34.107 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:26:34.288 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install librados2 2023-11-04T15:26:34.370 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-volume-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/1 2023-11-04T15:26:34.370 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:34.371 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2023-11-04T15:26:34.371 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-volume-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:26:34.371 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:34.371 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:26:34.656 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:38 ago on Sat 04 Nov 2023 03:24:56 PM UTC. 2023-11-04T15:26:34.704 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install librados-devel 2023-11-04T15:26:34.804 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:26:34.805 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:26:34.806 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repo Size 2023-11-04T15:26:34.806 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:26:34.806 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2023-11-04T15:26:34.806 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-mirror x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 3.0 M 2023-11-04T15:26:34.806 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:34.807 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2023-11-04T15:26:34.807 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:26:34.807 INFO:teuthology.orchestra.run.smithi096.stdout:Install 1 Package 2023-11-04T15:26:34.807 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:34.807 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 3.0 M 2023-11-04T15:26:34.808 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 12 M 2023-11-04T15:26:34.808 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2023-11-04T15:26:34.840 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:01:36 ago on Sat 04 Nov 2023 03:24:58 PM UTC. 2023-11-04T15:26:34.933 INFO:teuthology.orchestra.run.smithi130.stdout:Package librados2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 is already installed. 2023-11-04T15:26:34.982 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:26:34.983 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2023-11-04T15:26:34.983 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:26:35.054 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install librbd1 2023-11-04T15:26:35.282 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:01:28 ago on Sat 04 Nov 2023 03:25:07 PM UTC. 2023-11-04T15:26:35.430 INFO:teuthology.orchestra.run.smithi096.stdout:rbd-mirror-18.2.0-1181.gf7e9f9af.el9.x86_64.rpm 4.8 MB/s | 3.0 MB 00:00 2023-11-04T15:26:35.431 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:26:35.431 INFO:teuthology.orchestra.run.smithi096.stdout:Total 4.8 MB/s | 3.0 MB 00:00 2023-11-04T15:26:35.432 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2023-11-04T15:26:35.433 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:26:35.433 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:26:35.433 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repo Size 2023-11-04T15:26:35.433 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:26:35.434 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2023-11-04T15:26:35.434 INFO:teuthology.orchestra.run.smithi019.stdout: librados-devel x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 126 k 2023-11-04T15:26:35.434 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:35.434 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2023-11-04T15:26:35.434 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:26:35.435 INFO:teuthology.orchestra.run.smithi019.stdout:Install 1 Package 2023-11-04T15:26:35.435 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:35.435 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 126 k 2023-11-04T15:26:35.435 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 456 k 2023-11-04T15:26:35.436 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2023-11-04T15:26:35.440 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2023-11-04T15:26:35.441 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2023-11-04T15:26:35.512 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2023-11-04T15:26:35.512 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2023-11-04T15:26:35.597 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:01:37 ago on Sat 04 Nov 2023 03:24:58 PM UTC. 2023-11-04T15:26:35.681 INFO:teuthology.orchestra.run.smithi019.stdout:librados-devel-18.2.0-1181.gf7e9f9af.el9.x86_64 511 kB/s | 126 kB 00:00 2023-11-04T15:26:35.682 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:26:35.682 INFO:teuthology.orchestra.run.smithi019.stdout:Total 508 kB/s | 126 kB 00:00 2023-11-04T15:26:35.683 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2023-11-04T15:26:35.688 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2023-11-04T15:26:35.688 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2023-11-04T15:26:35.689 INFO:teuthology.orchestra.run.smithi130.stdout:Package librbd1-2:18.2.0-1181.gf7e9f9af.el9.x86_64 is already installed. 2023-11-04T15:26:35.738 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:26:35.738 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2023-11-04T15:26:35.739 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:26:35.746 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2023-11-04T15:26:35.747 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2023-11-04T15:26:35.803 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install python3-rados 2023-11-04T15:26:35.911 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2023-11-04T15:26:35.929 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2023-11-04T15:26:35.989 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : rbd-mirror-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:36.008 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librados-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:36.013 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: rbd-mirror-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:36.013 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:26:36.013 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-04T15:26:36.013 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-04T15:26:36.013 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-04T15:26:36.014 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:36.355 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:01:38 ago on Sat 04 Nov 2023 03:24:58 PM UTC. 2023-11-04T15:26:36.446 INFO:teuthology.orchestra.run.smithi130.stdout:Package python3-rados-2:18.2.0-1181.gf7e9f9af.el9.x86_64 is already installed. 2023-11-04T15:26:36.472 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librados-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:36.495 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:26:36.496 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2023-11-04T15:26:36.496 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:26:36.560 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install python3-rgw 2023-11-04T15:26:36.794 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:36.797 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:36.797 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2023-11-04T15:26:36.798 INFO:teuthology.orchestra.run.smithi019.stdout: librados-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:26:36.798 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:36.798 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:26:37.035 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install libcephfs2 2023-11-04T15:26:37.111 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:01:39 ago on Sat 04 Nov 2023 03:24:58 PM UTC. 2023-11-04T15:26:37.146 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : rbd-mirror-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:37.146 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:37.147 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2023-11-04T15:26:37.147 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-mirror-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:26:37.147 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:37.147 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:26:37.202 INFO:teuthology.orchestra.run.smithi130.stdout:Package python3-rgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 is already installed. 2023-11-04T15:26:37.251 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:26:37.252 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2023-11-04T15:26:37.252 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:26:37.317 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install python3-cephfs 2023-11-04T15:26:37.409 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install rbd-nbd 2023-11-04T15:26:37.619 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:01:30 ago on Sat 04 Nov 2023 03:25:07 PM UTC. 2023-11-04T15:26:37.714 INFO:teuthology.orchestra.run.smithi019.stdout:Package libcephfs2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 is already installed. 2023-11-04T15:26:37.766 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:26:37.767 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do. 2023-11-04T15:26:37.767 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:26:37.830 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install libcephfs-devel 2023-11-04T15:26:37.861 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:01:39 ago on Sat 04 Nov 2023 03:24:58 PM UTC. 2023-11-04T15:26:37.953 INFO:teuthology.orchestra.run.smithi130.stdout:Package python3-cephfs-2:18.2.0-1181.gf7e9f9af.el9.x86_64 is already installed. 2023-11-04T15:26:37.968 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:41 ago on Sat 04 Nov 2023 03:24:56 PM UTC. 2023-11-04T15:26:38.003 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:26:38.004 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2023-11-04T15:26:38.004 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:26:38.069 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install python3-rbd 2023-11-04T15:26:38.109 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:26:38.110 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:26:38.110 INFO:teuthology.orchestra.run.smithi096.stdout: Package Architecture Version Repository Size 2023-11-04T15:26:38.110 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:26:38.110 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2023-11-04T15:26:38.111 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-nbd x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 171 k 2023-11-04T15:26:38.111 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:38.111 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2023-11-04T15:26:38.111 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:26:38.111 INFO:teuthology.orchestra.run.smithi096.stdout:Install 1 Package 2023-11-04T15:26:38.112 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:38.112 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 171 k 2023-11-04T15:26:38.112 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 494 k 2023-11-04T15:26:38.112 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2023-11-04T15:26:38.309 INFO:teuthology.orchestra.run.smithi096.stdout:rbd-nbd-18.2.0-1181.gf7e9f9af.el9.x86_64.rpm 864 kB/s | 171 kB 00:00 2023-11-04T15:26:38.310 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:26:38.310 INFO:teuthology.orchestra.run.smithi096.stdout:Total 857 kB/s | 171 kB 00:00 2023-11-04T15:26:38.310 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2023-11-04T15:26:38.318 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2023-11-04T15:26:38.318 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2023-11-04T15:26:38.374 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2023-11-04T15:26:38.374 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2023-11-04T15:26:38.408 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:01:31 ago on Sat 04 Nov 2023 03:25:07 PM UTC. 2023-11-04T15:26:38.526 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2023-11-04T15:26:38.557 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:26:38.558 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:26:38.558 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repo Size 2023-11-04T15:26:38.558 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:26:38.559 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2023-11-04T15:26:38.559 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs-devel x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 31 k 2023-11-04T15:26:38.559 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:38.559 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2023-11-04T15:26:38.560 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:26:38.560 INFO:teuthology.orchestra.run.smithi019.stdout:Install 1 Package 2023-11-04T15:26:38.560 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:38.560 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 31 k 2023-11-04T15:26:38.560 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 139 k 2023-11-04T15:26:38.560 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2023-11-04T15:26:38.618 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:01:40 ago on Sat 04 Nov 2023 03:24:58 PM UTC. 2023-11-04T15:26:38.650 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : rbd-nbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:38.709 INFO:teuthology.orchestra.run.smithi130.stdout:Package python3-rbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 is already installed. 2023-11-04T15:26:38.759 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:26:38.760 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2023-11-04T15:26:38.760 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:26:38.801 INFO:teuthology.orchestra.run.smithi019.stdout:libcephfs-devel-18.2.0-1181.gf7e9f9af.el9.x86_6 128 kB/s | 31 kB 00:00 2023-11-04T15:26:38.802 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:26:38.802 INFO:teuthology.orchestra.run.smithi019.stdout:Total 127 kB/s | 31 kB 00:00 2023-11-04T15:26:38.803 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2023-11-04T15:26:38.806 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2023-11-04T15:26:38.806 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2023-11-04T15:26:38.824 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install rbd-fuse 2023-11-04T15:26:38.843 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2023-11-04T15:26:38.844 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2023-11-04T15:26:38.954 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2023-11-04T15:26:39.094 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephfs-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:39.128 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: rbd-nbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:39.368 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:01:41 ago on Sat 04 Nov 2023 03:24:58 PM UTC. 2023-11-04T15:26:39.429 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : rbd-nbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:39.429 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:39.430 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2023-11-04T15:26:39.430 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-nbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:26:39.430 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:39.430 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:26:39.509 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:26:39.510 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libcephfs-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:39.511 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:26:39.511 INFO:teuthology.orchestra.run.smithi130.stdout: Package Architecture Version Repository Size 2023-11-04T15:26:39.511 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:26:39.511 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-11-04T15:26:39.512 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-fuse x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 86 k 2023-11-04T15:26:39.512 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:39.512 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-11-04T15:26:39.512 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:26:39.512 INFO:teuthology.orchestra.run.smithi130.stdout:Install 1 Package 2023-11-04T15:26:39.513 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:39.513 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 86 k 2023-11-04T15:26:39.513 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 231 k 2023-11-04T15:26:39.513 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-11-04T15:26:39.659 DEBUG:teuthology.parallel:result is None 2023-11-04T15:26:39.715 INFO:teuthology.orchestra.run.smithi130.stdout:rbd-fuse-18.2.0-1181.gf7e9f9af.el9.x86_64.rpm 422 kB/s | 86 kB 00:00 2023-11-04T15:26:39.716 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:26:39.717 INFO:teuthology.orchestra.run.smithi130.stdout:Total 419 kB/s | 86 kB 00:00 2023-11-04T15:26:39.717 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-11-04T15:26:39.723 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-11-04T15:26:39.724 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-11-04T15:26:39.778 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-11-04T15:26:39.779 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-11-04T15:26:39.796 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephfs-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:39.796 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:39.797 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2023-11-04T15:26:39.797 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:26:39.797 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:39.797 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:26:39.914 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-11-04T15:26:39.987 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install librados2 2023-11-04T15:26:40.021 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rbd-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:40.444 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: rbd-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:40.560 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:01:33 ago on Sat 04 Nov 2023 03:25:07 PM UTC. 2023-11-04T15:26:40.655 INFO:teuthology.orchestra.run.smithi019.stdout:Package librados2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 is already installed. 2023-11-04T15:26:40.709 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:26:40.709 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do. 2023-11-04T15:26:40.710 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:26:40.733 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:40.733 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:40.733 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-11-04T15:26:40.733 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:26:40.734 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:40.734 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:26:40.763 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install librbd1 2023-11-04T15:26:40.965 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install rbd-mirror 2023-11-04T15:26:41.335 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:01:34 ago on Sat 04 Nov 2023 03:25:07 PM UTC. 2023-11-04T15:26:41.430 INFO:teuthology.orchestra.run.smithi019.stdout:Package librbd1-2:18.2.0-1181.gf7e9f9af.el9.x86_64 is already installed. 2023-11-04T15:26:41.483 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:26:41.484 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do. 2023-11-04T15:26:41.485 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:26:41.522 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:01:43 ago on Sat 04 Nov 2023 03:24:58 PM UTC. 2023-11-04T15:26:41.549 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install python3-rados 2023-11-04T15:26:41.670 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:26:41.670 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:26:41.671 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repo Size 2023-11-04T15:26:41.671 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:26:41.671 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-11-04T15:26:41.671 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-mirror x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 3.0 M 2023-11-04T15:26:41.672 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:41.672 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-11-04T15:26:41.672 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:26:41.672 INFO:teuthology.orchestra.run.smithi130.stdout:Install 1 Package 2023-11-04T15:26:41.672 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:41.673 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 3.0 M 2023-11-04T15:26:41.673 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 12 M 2023-11-04T15:26:41.673 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-11-04T15:26:42.130 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:01:35 ago on Sat 04 Nov 2023 03:25:07 PM UTC. 2023-11-04T15:26:42.193 INFO:teuthology.orchestra.run.smithi130.stdout:rbd-mirror-18.2.0-1181.gf7e9f9af.el9.x86_64.rpm 5.7 MB/s | 3.0 MB 00:00 2023-11-04T15:26:42.194 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:26:42.194 INFO:teuthology.orchestra.run.smithi130.stdout:Total 5.7 MB/s | 3.0 MB 00:00 2023-11-04T15:26:42.194 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-11-04T15:26:42.203 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-11-04T15:26:42.203 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-11-04T15:26:42.222 INFO:teuthology.orchestra.run.smithi019.stdout:Package python3-rados-2:18.2.0-1181.gf7e9f9af.el9.x86_64 is already installed. 2023-11-04T15:26:42.274 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-11-04T15:26:42.274 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-11-04T15:26:42.275 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:26:42.276 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do. 2023-11-04T15:26:42.276 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:26:42.338 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install python3-rgw 2023-11-04T15:26:42.686 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-11-04T15:26:42.752 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rbd-mirror-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:42.776 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: rbd-mirror-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:42.776 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:26:42.777 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-04T15:26:42.777 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-04T15:26:42.777 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-04T15:26:42.777 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:42.913 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:01:35 ago on Sat 04 Nov 2023 03:25:07 PM UTC. 2023-11-04T15:26:43.008 INFO:teuthology.orchestra.run.smithi019.stdout:Package python3-rgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 is already installed. 2023-11-04T15:26:43.063 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:26:43.064 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do. 2023-11-04T15:26:43.064 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:26:43.128 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install python3-cephfs 2023-11-04T15:26:43.703 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:01:36 ago on Sat 04 Nov 2023 03:25:07 PM UTC. 2023-11-04T15:26:43.798 INFO:teuthology.orchestra.run.smithi019.stdout:Package python3-cephfs-2:18.2.0-1181.gf7e9f9af.el9.x86_64 is already installed. 2023-11-04T15:26:43.852 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:26:43.853 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do. 2023-11-04T15:26:43.853 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:26:43.905 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install python3-rbd 2023-11-04T15:26:43.938 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-mirror-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:43.938 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:43.939 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-11-04T15:26:43.939 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-mirror-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:26:43.939 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:43.939 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:26:44.187 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install rbd-nbd 2023-11-04T15:26:44.484 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:01:37 ago on Sat 04 Nov 2023 03:25:07 PM UTC. 2023-11-04T15:26:44.578 INFO:teuthology.orchestra.run.smithi019.stdout:Package python3-rbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 is already installed. 2023-11-04T15:26:44.630 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:26:44.631 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do. 2023-11-04T15:26:44.631 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:26:44.691 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install rbd-fuse 2023-11-04T15:26:44.743 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:01:46 ago on Sat 04 Nov 2023 03:24:58 PM UTC. 2023-11-04T15:26:44.883 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:26:44.884 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:26:44.884 INFO:teuthology.orchestra.run.smithi130.stdout: Package Architecture Version Repository Size 2023-11-04T15:26:44.885 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:26:44.885 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-11-04T15:26:44.885 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-nbd x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 171 k 2023-11-04T15:26:44.885 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:44.885 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-11-04T15:26:44.885 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:26:44.886 INFO:teuthology.orchestra.run.smithi130.stdout:Install 1 Package 2023-11-04T15:26:44.886 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:44.886 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 171 k 2023-11-04T15:26:44.886 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 494 k 2023-11-04T15:26:44.886 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-11-04T15:26:45.088 INFO:teuthology.orchestra.run.smithi130.stdout:rbd-nbd-18.2.0-1181.gf7e9f9af.el9.x86_64.rpm 845 kB/s | 171 kB 00:00 2023-11-04T15:26:45.089 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:26:45.089 INFO:teuthology.orchestra.run.smithi130.stdout:Total 839 kB/s | 171 kB 00:00 2023-11-04T15:26:45.089 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-11-04T15:26:45.096 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-11-04T15:26:45.096 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-11-04T15:26:45.151 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-11-04T15:26:45.152 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-11-04T15:26:45.265 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:01:38 ago on Sat 04 Nov 2023 03:25:07 PM UTC. 2023-11-04T15:26:45.297 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-11-04T15:26:45.411 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rbd-nbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:45.413 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:26:45.414 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:26:45.414 INFO:teuthology.orchestra.run.smithi019.stdout: Package Architecture Version Repository Size 2023-11-04T15:26:45.414 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:26:45.414 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2023-11-04T15:26:45.415 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-fuse x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 86 k 2023-11-04T15:26:45.415 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:45.415 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2023-11-04T15:26:45.415 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:26:45.415 INFO:teuthology.orchestra.run.smithi019.stdout:Install 1 Package 2023-11-04T15:26:45.416 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:45.416 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 86 k 2023-11-04T15:26:45.416 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 231 k 2023-11-04T15:26:45.417 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2023-11-04T15:26:45.621 INFO:teuthology.orchestra.run.smithi019.stdout:rbd-fuse-18.2.0-1181.gf7e9f9af.el9.x86_64.rpm 419 kB/s | 86 kB 00:00 2023-11-04T15:26:45.622 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:26:45.623 INFO:teuthology.orchestra.run.smithi019.stdout:Total 416 kB/s | 86 kB 00:00 2023-11-04T15:26:45.623 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2023-11-04T15:26:45.630 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2023-11-04T15:26:45.630 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2023-11-04T15:26:45.689 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2023-11-04T15:26:45.689 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2023-11-04T15:26:45.834 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2023-11-04T15:26:45.847 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: rbd-nbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:45.930 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:46.138 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-nbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:46.139 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:46.139 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-11-04T15:26:46.139 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-nbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:26:46.139 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:46.140 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:26:46.337 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: rbd-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:46.389 DEBUG:teuthology.parallel:result is None 2023-11-04T15:26:46.770 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:46.770 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:46.770 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2023-11-04T15:26:46.770 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:26:46.771 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:46.771 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:26:47.007 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install rbd-mirror 2023-11-04T15:26:47.592 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:01:40 ago on Sat 04 Nov 2023 03:25:07 PM UTC. 2023-11-04T15:26:47.739 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:26:47.740 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:26:47.740 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repo Size 2023-11-04T15:26:47.740 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:26:47.740 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2023-11-04T15:26:47.741 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-mirror x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 3.0 M 2023-11-04T15:26:47.741 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:47.741 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2023-11-04T15:26:47.741 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:26:47.741 INFO:teuthology.orchestra.run.smithi019.stdout:Install 1 Package 2023-11-04T15:26:47.742 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:47.742 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 3.0 M 2023-11-04T15:26:47.742 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 12 M 2023-11-04T15:26:47.742 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2023-11-04T15:26:48.100 INFO:teuthology.orchestra.run.smithi019.stdout:rbd-mirror-18.2.0-1181.gf7e9f9af.el9.x86_64.rpm 8.3 MB/s | 3.0 MB 00:00 2023-11-04T15:26:48.100 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:26:48.101 INFO:teuthology.orchestra.run.smithi019.stdout:Total 8.3 MB/s | 3.0 MB 00:00 2023-11-04T15:26:48.101 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2023-11-04T15:26:48.111 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2023-11-04T15:26:48.111 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2023-11-04T15:26:48.188 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2023-11-04T15:26:48.189 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2023-11-04T15:26:48.622 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2023-11-04T15:26:48.692 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-mirror-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:48.717 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: rbd-mirror-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:48.718 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:26:48.718 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-04T15:26:48.718 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-04T15:26:48.718 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-04T15:26:48.718 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:49.851 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-mirror-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:49.851 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:49.851 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2023-11-04T15:26:49.852 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-mirror-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:26:49.852 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:49.852 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:26:50.086 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install rbd-nbd 2023-11-04T15:26:50.678 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:01:43 ago on Sat 04 Nov 2023 03:25:07 PM UTC. 2023-11-04T15:26:50.828 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:26:50.829 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:26:50.829 INFO:teuthology.orchestra.run.smithi019.stdout: Package Architecture Version Repository Size 2023-11-04T15:26:50.829 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:26:50.830 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2023-11-04T15:26:50.830 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-nbd x86_64 2:18.2.0-1181.gf7e9f9af.el9 ceph 171 k 2023-11-04T15:26:50.830 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:50.830 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2023-11-04T15:26:50.830 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:26:50.831 INFO:teuthology.orchestra.run.smithi019.stdout:Install 1 Package 2023-11-04T15:26:50.831 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:50.831 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 171 k 2023-11-04T15:26:50.831 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 494 k 2023-11-04T15:26:50.831 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2023-11-04T15:26:51.145 INFO:teuthology.orchestra.run.smithi019.stdout:rbd-nbd-18.2.0-1181.gf7e9f9af.el9.x86_64.rpm 544 kB/s | 171 kB 00:00 2023-11-04T15:26:51.146 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2023-11-04T15:26:51.146 INFO:teuthology.orchestra.run.smithi019.stdout:Total 541 kB/s | 171 kB 00:00 2023-11-04T15:26:51.146 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2023-11-04T15:26:51.154 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2023-11-04T15:26:51.155 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2023-11-04T15:26:51.213 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2023-11-04T15:26:51.214 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2023-11-04T15:26:51.360 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2023-11-04T15:26:51.462 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-nbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:51.912 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: rbd-nbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:52.253 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-nbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:26:52.253 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:52.253 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2023-11-04T15:26:52.254 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-nbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:26:52.254 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:52.254 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:26:52.438 DEBUG:teuthology.parallel:result is None 2023-11-04T15:26:52.438 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f7e9f9af51acf98e0ccc3037487018e4ae40caa5 2023-11-04T15:26:52.592 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-04T15:26:52.614 INFO:teuthology.orchestra.run.smithi019.stdout:18.2.0-1181.gf7e9f9af.el9 2023-11-04T15:26:52.614 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-1181.gf7e9f9af.el9 2023-11-04T15:26:52.615 INFO:teuthology.task.install:The correct ceph version 18.2.0-1181.gf7e9f9af is installed. 2023-11-04T15:26:52.615 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f7e9f9af51acf98e0ccc3037487018e4ae40caa5 2023-11-04T15:26:52.828 DEBUG:teuthology.orchestra.run.smithi096:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-04T15:26:52.854 INFO:teuthology.orchestra.run.smithi096.stdout:18.2.0-1181.gf7e9f9af.el9 2023-11-04T15:26:52.854 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-1181.gf7e9f9af.el9 2023-11-04T15:26:52.854 INFO:teuthology.task.install:The correct ceph version 18.2.0-1181.gf7e9f9af is installed. 2023-11-04T15:26:52.855 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f7e9f9af51acf98e0ccc3037487018e4ae40caa5 2023-11-04T15:26:52.999 DEBUG:teuthology.orchestra.run.smithi130:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-04T15:26:53.024 INFO:teuthology.orchestra.run.smithi130.stdout:18.2.0-1181.gf7e9f9af.el9 2023-11-04T15:26:53.025 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-1181.gf7e9f9af.el9 2023-11-04T15:26:53.025 INFO:teuthology.task.install:The correct ceph version 18.2.0-1181.gf7e9f9af is installed. 2023-11-04T15:26:53.026 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-04T15:26:53.027 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-04T15:26:53.028 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-04T15:26:53.064 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-11-04T15:26:53.064 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-04T15:26:53.099 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-11-04T15:26:53.099 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-04T15:26:53.131 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-04T15:26:53.132 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-04T15:26:53.132 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/daemon-helper 2023-11-04T15:26:53.164 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-04T15:26:53.236 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-11-04T15:26:53.237 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/daemon-helper 2023-11-04T15:26:53.269 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-04T15:26:53.338 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-11-04T15:26:53.338 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/daemon-helper 2023-11-04T15:26:53.370 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-04T15:26:53.439 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-04T15:26:53.440 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-04T15:26:53.440 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-04T15:26:53.473 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-04T15:26:53.546 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-11-04T15:26:53.546 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-04T15:26:53.574 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-04T15:26:53.641 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-11-04T15:26:53.642 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-04T15:26:53.669 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-04T15:26:53.736 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-04T15:26:53.737 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-04T15:26:53.737 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/stdin-killer 2023-11-04T15:26:53.770 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-04T15:26:53.845 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-11-04T15:26:53.845 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/stdin-killer 2023-11-04T15:26:53.872 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-04T15:26:53.939 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-11-04T15:26:53.939 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/stdin-killer 2023-11-04T15:26:53.966 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-04T15:26:54.034 INFO:teuthology.run_tasks:Running task ceph... 2023-11-04T15:26:54.097 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-04T15:26:54.098 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 777 /var/log/ceph 2023-11-04T15:26:54.101 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 777 /var/log/ceph 2023-11-04T15:26:54.103 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 777 /var/log/ceph 2023-11-04T15:26:54.132 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-04T15:26:54.132 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-04T15:26:54.174 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-04T15:26:54.177 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-04T15:26:54.204 INFO:tasks.ceph:Creating extra log directories... 2023-11-04T15:26:54.204 DEBUG:teuthology.orchestra.run.smithi019:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-04T15:26:54.247 DEBUG:teuthology.orchestra.run.smithi096:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-04T15:26:54.250 DEBUG:teuthology.orchestra.run.smithi130:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-04T15:26:54.282 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-04T15:26:54.283 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-04T15:26:54.283 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-04T15:26:54.283 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-04T15:26:54.284 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-04T15:26:54.334 DEBUG:teuthology.orchestra.run.smithi019:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-04T15:26:54.466 DEBUG:teuthology.orchestra.run.smithi019:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-04T15:26:54.497 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-11-04T15:26:54.498 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-04T15:26:54.513 DEBUG:teuthology.orchestra.run.smithi096:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-04T15:26:54.631 DEBUG:teuthology.orchestra.run.smithi096:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-04T15:26:54.658 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-11-04T15:26:54.659 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-04T15:26:54.673 DEBUG:teuthology.orchestra.run.smithi130:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-04T15:26:54.792 DEBUG:teuthology.orchestra.run.smithi130:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-04T15:26:54.824 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-04T15:26:54.824 INFO:tasks.ceph:config {'conf': {'client': {'debug client': 20, 'debug ms': 1}, 'mds': {'debug mds': 20, 'debug ms': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-04T15:26:54.824 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-11-04_14:52:48-smoke-reef-release-distro-default-smithi/7447748', 'branch': 'reef-release', 'description': 'smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap s3tests-branch supported-random-distro$/{centos_latest} tasks/{0-install test/libcephfs_interface_tests}}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7447748', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-11-04_14:52:48-smoke-reef-release-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 2, 'size': 10}}, {'machine': {'cpus': 1, 'disk': 40, 'ram': 8000}, 'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'reef-release'}, 'ceph': {'conf': {'client': {'debug client': 20, 'debug ms': 1}, 'mds': {'debug mds': 20, 'debug ms': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'f7e9f9af51acf98e0ccc3037487018e4ae40caa5'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'f7e9f9af51acf98e0ccc3037487018e4ae40caa5'}}, 's3tests': {'force-branch': 'ceph-reef'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef-release', 'sha1': 'f7e9f9af51acf98e0ccc3037487018e4ae40caa5'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 71, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mds.a', 'mgr.x', 'osd.0', 'osd.1'], ['mon.b', 'mds.b', 'mon.c', 'mgr.y', 'osd.2', 'osd.3'], ['client.0']], 'seed': 1380, 'sha1': 'f7e9f9af51acf98e0ccc3037487018e4ae40caa5', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'smoke', 'suite_branch': 'reef-release', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_f7e9f9af51acf98e0ccc3037487018e4ae40caa5/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'f7e9f9af51acf98e0ccc3037487018e4ae40caa5', 'targets': {'smithi019.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDUF6GhI9UdAVsAuoE7taXLXG9X55/PpxG0EzdDfjrGV973BZVbJQjP7zdZwIRFQ1Kc60DvJydDHIr7yoMRXOxY=', 'smithi096.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK5l3tDH2VVqynCSWKBpotIfAusQCpStCcRal/vwmwL8eKhohkIs8Xg0Ebt25Q8nPiv3D8BGGaNX6ki/mdyWg+s=', 'smithi130.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBUw1R0UBohkkCAXVi0fUzIBoX9wBq68kEPkBOfBr2PKB2ER0yAJSAO7f2znVl7GMLRro6CEtxtEJ3rgN7i2RLg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'cleanup': True, 'flavor': 'default', 'sha1': 'f7e9f9af51acf98e0ccc3037487018e4ae40caa5'}}, {'ceph': None}, {'ceph-fuse': None}, {'workunit': {'clients': {'client.0': ['libcephfs/test.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '6899cd26fceddb2fec83dc1a1349394b28c8998e', 'timestamp': '2023-11-04_14:52:48', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3084822'} 2023-11-04T15:26:54.825 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-04T15:26:54.828 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-04T15:26:54.830 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-04T15:26:54.874 DEBUG:teuthology.orchestra.run.smithi019:> sudo install -d -m0777 -- /var/run/ceph 2023-11-04T15:26:54.884 DEBUG:teuthology.orchestra.run.smithi096:> sudo install -d -m0777 -- /var/run/ceph 2023-11-04T15:26:54.886 DEBUG:teuthology.orchestra.run.smithi130:> sudo install -d -m0777 -- /var/run/ceph 2023-11-04T15:26:54.941 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-04T15:26:54.941 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/scratch_devs of=/dev/stdout 2023-11-04T15:26:54.972 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-04T15:26:54.972 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_1 2023-11-04T15:26:55.028 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-04T15:26:55.029 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T15:26:55.029 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 663 Links: 1 2023-11-04T15:26:55.029 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T15:26:55.029 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T15:26:55.030 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2023-11-04 15:26:48.960672507 +0000 2023-11-04T15:26:55.030 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2023-11-04 15:24:10.322523213 +0000 2023-11-04T15:26:55.030 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2023-11-04 15:24:10.322523213 +0000 2023-11-04T15:26:55.030 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2023-11-04 15:24:10.322523213 +0000 2023-11-04T15:26:55.031 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-04T15:26:55.101 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2023-11-04T15:26:55.101 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2023-11-04T15:26:55.101 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000209666 s, 2.4 MB/s 2023-11-04T15:26:55.102 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-04T15:26:55.160 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_2 2023-11-04T15:26:55.216 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-04T15:26:55.217 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T15:26:55.217 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 682 Links: 1 2023-11-04T15:26:55.217 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T15:26:55.217 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T15:26:55.218 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2023-11-04 15:26:48.960672507 +0000 2023-11-04T15:26:55.218 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2023-11-04 15:24:10.843518316 +0000 2023-11-04T15:26:55.218 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2023-11-04 15:24:10.843518316 +0000 2023-11-04T15:26:55.219 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2023-11-04 15:24:10.843518316 +0000 2023-11-04T15:26:55.219 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-04T15:26:55.288 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2023-11-04T15:26:55.288 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2023-11-04T15:26:55.288 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000204931 s, 2.5 MB/s 2023-11-04T15:26:55.289 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-04T15:26:55.347 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_3 2023-11-04T15:26:55.404 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-04T15:26:55.404 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T15:26:55.404 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 702 Links: 1 2023-11-04T15:26:55.405 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T15:26:55.405 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T15:26:55.405 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2023-11-04 15:26:48.961672498 +0000 2023-11-04T15:26:55.405 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2023-11-04 15:24:11.355513504 +0000 2023-11-04T15:26:55.405 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2023-11-04 15:24:11.355513504 +0000 2023-11-04T15:26:55.406 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2023-11-04 15:24:11.355513504 +0000 2023-11-04T15:26:55.406 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-04T15:26:55.474 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2023-11-04T15:26:55.475 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2023-11-04T15:26:55.475 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000201679 s, 2.5 MB/s 2023-11-04T15:26:55.476 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-04T15:26:55.533 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_4 2023-11-04T15:26:55.590 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-04T15:26:55.590 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T15:26:55.590 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 719 Links: 1 2023-11-04T15:26:55.591 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T15:26:55.591 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T15:26:55.591 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2023-11-04 15:26:48.961672498 +0000 2023-11-04T15:26:55.591 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2023-11-04 15:24:11.853508823 +0000 2023-11-04T15:26:55.591 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2023-11-04 15:24:11.853508823 +0000 2023-11-04T15:26:55.592 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2023-11-04 15:24:11.853508823 +0000 2023-11-04T15:26:55.592 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-04T15:26:55.661 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2023-11-04T15:26:55.662 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2023-11-04T15:26:55.662 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.00020089 s, 2.5 MB/s 2023-11-04T15:26:55.663 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-04T15:26:55.721 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2023-11-04T15:26:55.721 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-11-04T15:26:55.722 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/scratch_devs of=/dev/stdout 2023-11-04T15:26:55.740 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-04T15:26:55.741 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_1 2023-11-04T15:26:55.796 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-04T15:26:55.797 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T15:26:55.797 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 662 Links: 1 2023-11-04T15:26:55.797 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T15:26:55.797 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T15:26:55.798 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2023-11-04 15:26:36.236469485 +0000 2023-11-04T15:26:55.798 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2023-11-04 15:24:06.382182420 +0000 2023-11-04T15:26:55.798 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2023-11-04 15:24:06.382182420 +0000 2023-11-04T15:26:55.798 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: 2023-11-04 15:24:06.382182420 +0000 2023-11-04T15:26:55.799 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-04T15:26:55.867 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2023-11-04T15:26:55.867 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2023-11-04T15:26:55.867 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000272506 s, 1.9 MB/s 2023-11-04T15:26:55.867 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-04T15:26:55.924 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_2 2023-11-04T15:26:55.980 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-04T15:26:55.980 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T15:26:55.981 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 682 Links: 1 2023-11-04T15:26:55.981 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T15:26:55.981 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T15:26:55.981 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2023-11-04 15:26:36.237469460 +0000 2023-11-04T15:26:55.982 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2023-11-04 15:24:06.875170240 +0000 2023-11-04T15:26:55.982 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2023-11-04 15:24:06.875170240 +0000 2023-11-04T15:26:55.982 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: 2023-11-04 15:24:06.875170240 +0000 2023-11-04T15:26:55.982 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-04T15:26:56.047 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2023-11-04T15:26:56.047 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2023-11-04T15:26:56.048 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.00017587 s, 2.9 MB/s 2023-11-04T15:26:56.049 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-04T15:26:56.105 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_3 2023-11-04T15:26:56.161 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-04T15:26:56.161 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T15:26:56.161 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 703 Links: 1 2023-11-04T15:26:56.161 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T15:26:56.162 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T15:26:56.162 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2023-11-04 15:26:36.237469460 +0000 2023-11-04T15:26:56.162 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2023-11-04 15:24:07.362158209 +0000 2023-11-04T15:26:56.162 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2023-11-04 15:24:07.362158209 +0000 2023-11-04T15:26:56.163 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: 2023-11-04 15:24:07.362158209 +0000 2023-11-04T15:26:56.163 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-04T15:26:56.227 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2023-11-04T15:26:56.227 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2023-11-04T15:26:56.227 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000197359 s, 2.6 MB/s 2023-11-04T15:26:56.228 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-04T15:26:56.284 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_4 2023-11-04T15:26:56.339 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-04T15:26:56.340 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T15:26:56.340 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 722 Links: 1 2023-11-04T15:26:56.340 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T15:26:56.340 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:device_t:s0 2023-11-04T15:26:56.340 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2023-11-04 15:26:36.237469460 +0000 2023-11-04T15:26:56.341 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2023-11-04 15:24:07.860145906 +0000 2023-11-04T15:26:56.341 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2023-11-04 15:24:07.860145906 +0000 2023-11-04T15:26:56.341 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: 2023-11-04 15:24:07.860145906 +0000 2023-11-04T15:26:56.341 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-04T15:26:56.405 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2023-11-04T15:26:56.406 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2023-11-04T15:26:56.406 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000191696 s, 2.7 MB/s 2023-11-04T15:26:56.407 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-04T15:26:56.463 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2023-11-04T15:26:56.463 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi019.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi096.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2023-11-04T15:26:56.464 INFO:tasks.ceph:Generating config... 2023-11-04T15:26:56.465 INFO:tasks.ceph:[client] debug client = 20 2023-11-04T15:26:56.465 INFO:tasks.ceph:[client] debug ms = 1 2023-11-04T15:26:56.465 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-04T15:26:56.466 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-04T15:26:56.466 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-04T15:26:56.466 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-04T15:26:56.466 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-04T15:26:56.467 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-04T15:26:56.467 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-04T15:26:56.467 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-04T15:26:56.467 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-04T15:26:56.468 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-04T15:26:56.468 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-04T15:26:56.468 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-04T15:26:56.469 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-11-04T15:26:56.469 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-11-04T15:26:56.469 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-04T15:26:56.469 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-04T15:26:56.470 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-11-04T15:26:56.470 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-04T15:26:56.470 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-04T15:26:56.470 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-04T15:26:56.471 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-04T15:26:56.471 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-04T15:26:56.471 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-11-04T15:26:56.471 INFO:tasks.ceph:Setting up mon.a... 2023-11-04T15:26:56.472 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-04T15:26:56.537 INFO:teuthology.orchestra.run.smithi019.stdout:creating /etc/ceph/ceph.keyring 2023-11-04T15:26:56.540 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-04T15:26:56.591 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-04T15:26:56.623 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.19'), ('mon.b', '172.21.15.96'), ('mon.c', '[v2:172.21.15.96:3301,v1:172.21.15.96:6790]')] 2023-11-04T15:26:56.624 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.19,172.21.15.96,[v2:172.21.15.96:3301,v1:172.21.15.96:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug client': 20, 'debug ms': 1}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug ms': 1}} 2023-11-04T15:26:56.624 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-04T15:26:56.625 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-04T15:26:56.678 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.19 --add b 172.21.15.96 --addv c '[v2:172.21.15.96:3301,v1:172.21.15.96:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-04T15:26:56.764 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-04T15:26:56.764 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: generated fsid e87311d5-496a-4b07-9654-358fe5bbf950 2023-11-04T15:26:56.765 INFO:teuthology.orchestra.run.smithi019.stdout:setting min_mon_release = pacific 2023-11-04T15:26:56.765 INFO:teuthology.orchestra.run.smithi019.stdout:epoch 0 2023-11-04T15:26:56.765 INFO:teuthology.orchestra.run.smithi019.stdout:fsid e87311d5-496a-4b07-9654-358fe5bbf950 2023-11-04T15:26:56.765 INFO:teuthology.orchestra.run.smithi019.stdout:last_changed 2023-11-04T15:26:56.763680+0000 2023-11-04T15:26:56.765 INFO:teuthology.orchestra.run.smithi019.stdout:created 2023-11-04T15:26:56.763680+0000 2023-11-04T15:26:56.766 INFO:teuthology.orchestra.run.smithi019.stdout:min_mon_release 16 (pacific) 2023-11-04T15:26:56.766 INFO:teuthology.orchestra.run.smithi019.stdout:election_strategy: 1 2023-11-04T15:26:56.766 INFO:teuthology.orchestra.run.smithi019.stdout:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2023-11-04T15:26:56.766 INFO:teuthology.orchestra.run.smithi019.stdout:1: [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] mon.b 2023-11-04T15:26:56.766 INFO:teuthology.orchestra.run.smithi019.stdout:2: [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] mon.c 2023-11-04T15:26:56.767 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-04T15:26:56.768 DEBUG:teuthology.orchestra.run.smithi019:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-04T15:26:56.783 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e87311d5-496a-4b07-9654-358fe5bbf950... 2023-11-04T15:26:56.784 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-04T15:26:56.826 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-04T15:26:56.829 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-04T15:26:56.880 INFO:teuthology.orchestra.run.smithi096.stdout:[global] 2023-11-04T15:26:56.880 INFO:teuthology.orchestra.run.smithi096.stdout: chdir = "" 2023-11-04T15:26:56.880 INFO:teuthology.orchestra.run.smithi096.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-04T15:26:56.881 INFO:teuthology.orchestra.run.smithi096.stdout: auth supported = cephx 2023-11-04T15:26:56.881 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:56.881 INFO:teuthology.orchestra.run.smithi096.stdout: filestore xattr use omap = true 2023-11-04T15:26:56.881 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:56.882 INFO:teuthology.orchestra.run.smithi096.stdout: mon clock drift allowed = 1.000 2023-11-04T15:26:56.882 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:56.882 INFO:teuthology.orchestra.run.smithi096.stdout: osd crush chooseleaf type = 0 2023-11-04T15:26:56.882 INFO:teuthology.orchestra.run.smithi096.stdout: auth debug = true 2023-11-04T15:26:56.882 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:56.883 INFO:teuthology.orchestra.run.smithi096.stdout: ms die on old message = true 2023-11-04T15:26:56.883 INFO:teuthology.orchestra.run.smithi096.stdout: ms die on bug = true 2023-11-04T15:26:56.883 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:56.883 INFO:teuthology.orchestra.run.smithi096.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-04T15:26:56.883 INFO:teuthology.orchestra.run.smithi096.stdout: mon pg warn max object skew = 0 2023-11-04T15:26:56.884 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:56.884 INFO:teuthology.orchestra.run.smithi096.stdout: # disable pg_autoscaler by default for new pools 2023-11-04T15:26:56.884 INFO:teuthology.orchestra.run.smithi096.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-04T15:26:56.884 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:56.884 INFO:teuthology.orchestra.run.smithi096.stdout: osd pool default size = 2 2023-11-04T15:26:56.885 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:56.885 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd allow primary affinity = true 2023-11-04T15:26:56.885 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd allow pg remap = true 2023-11-04T15:26:56.885 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on legacy crush tunables = false 2023-11-04T15:26:56.886 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on crush straw calc version zero = false 2023-11-04T15:26:56.887 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on no sortbitwise = false 2023-11-04T15:26:56.887 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on osd down out interval zero = false 2023-11-04T15:26:56.887 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on too few osds = false 2023-11-04T15:26:56.887 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-04T15:26:56.888 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-04T15:26:56.888 INFO:teuthology.orchestra.run.smithi096.stdout: mon_allow_pool_size_one = true 2023-11-04T15:26:56.889 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:56.890 INFO:teuthology.orchestra.run.smithi096.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-04T15:26:56.890 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:56.890 INFO:teuthology.orchestra.run.smithi096.stdout: osd default data pool replay window = 5 2023-11-04T15:26:56.890 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:56.891 INFO:teuthology.orchestra.run.smithi096.stdout: mon allow pool delete = true 2023-11-04T15:26:56.891 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:56.891 INFO:teuthology.orchestra.run.smithi096.stdout: mon cluster log file level = debug 2023-11-04T15:26:56.891 INFO:teuthology.orchestra.run.smithi096.stdout: debug asserts on shutdown = true 2023-11-04T15:26:56.891 INFO:teuthology.orchestra.run.smithi096.stdout: mon health detail to clog = false 2023-11-04T15:26:56.892 INFO:teuthology.orchestra.run.smithi096.stdout: mon host = "172.21.15.19,172.21.15.96,[v2:172.21.15.96:3301,v1:172.21.15.96:6790]" 2023-11-04T15:26:56.893 INFO:teuthology.orchestra.run.smithi096.stdout: fsid = e87311d5-496a-4b07-9654-358fe5bbf950 2023-11-04T15:26:56.894 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:56.894 INFO:teuthology.orchestra.run.smithi096.stdout:[osd] 2023-11-04T15:26:56.894 INFO:teuthology.orchestra.run.smithi096.stdout: osd journal size = 100 2023-11-04T15:26:56.894 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:56.894 INFO:teuthology.orchestra.run.smithi096.stdout: osd scrub load threshold = 5.0 2023-11-04T15:26:56.895 INFO:teuthology.orchestra.run.smithi096.stdout: osd scrub max interval = 600 2023-11-04T15:26:56.895 INFO:teuthology.orchestra.run.smithi096.stdout: osd mclock profile = high_recovery_ops 2023-11-04T15:26:56.895 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:56.895 INFO:teuthology.orchestra.run.smithi096.stdout: osd recover clone overlap = true 2023-11-04T15:26:56.895 INFO:teuthology.orchestra.run.smithi096.stdout: osd recovery max chunk = 1048576 2023-11-04T15:26:56.896 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:56.896 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug shutdown = true 2023-11-04T15:26:56.896 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug op order = true 2023-11-04T15:26:56.896 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug verify stray on activate = true 2023-11-04T15:26:56.896 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:56.897 INFO:teuthology.orchestra.run.smithi096.stdout: osd open classes on start = true 2023-11-04T15:26:56.897 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug pg log writeout = true 2023-11-04T15:26:56.897 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:56.897 INFO:teuthology.orchestra.run.smithi096.stdout: osd deep scrub update digest min age = 30 2023-11-04T15:26:56.897 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:56.898 INFO:teuthology.orchestra.run.smithi096.stdout: osd map max advance = 10 2023-11-04T15:26:56.898 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:56.898 INFO:teuthology.orchestra.run.smithi096.stdout: journal zero on create = true 2023-11-04T15:26:56.898 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:56.898 INFO:teuthology.orchestra.run.smithi096.stdout: filestore ondisk finisher threads = 3 2023-11-04T15:26:56.898 INFO:teuthology.orchestra.run.smithi096.stdout: filestore apply finisher threads = 3 2023-11-04T15:26:56.899 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:56.899 INFO:teuthology.orchestra.run.smithi096.stdout: bdev debug aio = true 2023-11-04T15:26:56.899 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug misdirected ops = true 2023-11-04T15:26:56.899 INFO:teuthology.orchestra.run.smithi096.stdout: bdev async discard = True 2023-11-04T15:26:56.900 INFO:teuthology.orchestra.run.smithi096.stdout: bdev enable discard = True 2023-11-04T15:26:56.900 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore allocator = bitmap 2023-11-04T15:26:56.900 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore block size = 96636764160 2023-11-04T15:26:56.900 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore fsck on mount = True 2023-11-04T15:26:56.900 INFO:teuthology.orchestra.run.smithi096.stdout: debug bluefs = 20 2023-11-04T15:26:56.901 INFO:teuthology.orchestra.run.smithi096.stdout: debug bluestore = 20 2023-11-04T15:26:56.901 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2023-11-04T15:26:56.901 INFO:teuthology.orchestra.run.smithi096.stdout: debug osd = 20 2023-11-04T15:26:56.901 INFO:teuthology.orchestra.run.smithi096.stdout: debug rocksdb = 10 2023-11-04T15:26:56.901 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd backfillfull_ratio = 0.85 2023-11-04T15:26:56.902 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd full ratio = 0.9 2023-11-04T15:26:56.902 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd nearfull ratio = 0.8 2023-11-04T15:26:56.902 INFO:teuthology.orchestra.run.smithi096.stdout: osd failsafe full ratio = 0.95 2023-11-04T15:26:56.902 INFO:teuthology.orchestra.run.smithi096.stdout: osd objectstore = bluestore 2023-11-04T15:26:56.902 INFO:teuthology.orchestra.run.smithi096.stdout: osd shutdown pgref assert = True 2023-11-04T15:26:56.903 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:56.903 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr] 2023-11-04T15:26:56.903 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2023-11-04T15:26:56.903 INFO:teuthology.orchestra.run.smithi096.stdout: debug mgr = 20 2023-11-04T15:26:56.903 INFO:teuthology.orchestra.run.smithi096.stdout: debug mon = 20 2023-11-04T15:26:56.904 INFO:teuthology.orchestra.run.smithi096.stdout: debug auth = 20 2023-11-04T15:26:56.904 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min pgs per osd = 4 2023-11-04T15:26:56.904 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min bytes per osd = 10 2023-11-04T15:26:56.904 INFO:teuthology.orchestra.run.smithi096.stdout: mgr/telemetry/nag = false 2023-11-04T15:26:56.904 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:56.904 INFO:teuthology.orchestra.run.smithi096.stdout:[mon] 2023-11-04T15:26:56.905 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2023-11-04T15:26:56.905 INFO:teuthology.orchestra.run.smithi096.stdout: debug mon = 20 2023-11-04T15:26:56.905 INFO:teuthology.orchestra.run.smithi096.stdout: debug paxos = 20 2023-11-04T15:26:56.905 INFO:teuthology.orchestra.run.smithi096.stdout: debug auth = 20 2023-11-04T15:26:56.906 INFO:teuthology.orchestra.run.smithi096.stdout: mon data avail warn = 5 2023-11-04T15:26:56.906 INFO:teuthology.orchestra.run.smithi096.stdout: mon mgr mkfs grace = 240 2023-11-04T15:26:56.906 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min pgs per osd = 4 2023-11-04T15:26:56.906 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd reporter subtree level = osd 2023-11-04T15:26:56.906 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd prime pg temp = true 2023-11-04T15:26:56.907 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min bytes per osd = 10 2023-11-04T15:26:56.907 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:56.907 INFO:teuthology.orchestra.run.smithi096.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-04T15:26:56.907 INFO:teuthology.orchestra.run.smithi096.stdout: auth mon ticket ttl = 660 # 11m 2023-11-04T15:26:56.907 INFO:teuthology.orchestra.run.smithi096.stdout: auth service ticket ttl = 240 # 4m 2023-11-04T15:26:56.908 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:56.908 INFO:teuthology.orchestra.run.smithi096.stdout: # don't complain about insecure global_id in the test suite 2023-11-04T15:26:56.908 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-04T15:26:56.908 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-04T15:26:56.908 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:56.909 INFO:teuthology.orchestra.run.smithi096.stdout: # 1m isn't quite enough 2023-11-04T15:26:56.909 INFO:teuthology.orchestra.run.smithi096.stdout: mon_down_mkfs_grace = 2m 2023-11-04T15:26:56.909 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:56.909 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_filestore_osds = false 2023-11-04T15:26:56.909 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:26:56.909 INFO:teuthology.orchestra.run.smithi096.stdout:[client] 2023-11-04T15:26:56.910 INFO:teuthology.orchestra.run.smithi096.stdout: rgw cache enabled = true 2023-11-04T15:26:56.910 INFO:teuthology.orchestra.run.smithi096.stdout: rgw enable ops log = true 2023-11-04T15:26:56.910 INFO:teuthology.orchestra.run.smithi096.stdout: rgw enable usage log = true 2023-11-04T15:26:56.910 INFO:teuthology.orchestra.run.smithi096.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-04T15:26:56.910 INFO:teuthology.orchestra.run.smithi096.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-04T15:26:56.911 INFO:teuthology.orchestra.run.smithi096.stdout: debug client = 20 2023-11-04T15:26:56.911 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2023-11-04T15:26:56.911 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.a] 2023-11-04T15:26:56.911 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.b] 2023-11-04T15:26:56.911 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.c] 2023-11-04T15:26:56.912 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.a] 2023-11-04T15:26:56.912 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.b] 2023-11-04T15:26:56.912 INFO:teuthology.orchestra.run.smithi096.stdout:[mds] 2023-11-04T15:26:56.912 INFO:teuthology.orchestra.run.smithi096.stdout: debug mds = 20 2023-11-04T15:26:56.912 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2023-11-04T15:26:56.915 INFO:teuthology.orchestra.run.smithi130.stdout:[global] 2023-11-04T15:26:56.915 INFO:teuthology.orchestra.run.smithi130.stdout: chdir = "" 2023-11-04T15:26:56.915 INFO:teuthology.orchestra.run.smithi130.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-04T15:26:56.915 INFO:teuthology.orchestra.run.smithi130.stdout: auth supported = cephx 2023-11-04T15:26:56.916 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:56.916 INFO:teuthology.orchestra.run.smithi130.stdout: filestore xattr use omap = true 2023-11-04T15:26:56.916 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:56.916 INFO:teuthology.orchestra.run.smithi130.stdout: mon clock drift allowed = 1.000 2023-11-04T15:26:56.916 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:56.916 INFO:teuthology.orchestra.run.smithi130.stdout: osd crush chooseleaf type = 0 2023-11-04T15:26:56.917 INFO:teuthology.orchestra.run.smithi130.stdout: auth debug = true 2023-11-04T15:26:56.917 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:56.917 INFO:teuthology.orchestra.run.smithi130.stdout: ms die on old message = true 2023-11-04T15:26:56.917 INFO:teuthology.orchestra.run.smithi130.stdout: ms die on bug = true 2023-11-04T15:26:56.917 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:56.918 INFO:teuthology.orchestra.run.smithi130.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-04T15:26:56.918 INFO:teuthology.orchestra.run.smithi130.stdout: mon pg warn max object skew = 0 2023-11-04T15:26:56.918 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:56.918 INFO:teuthology.orchestra.run.smithi130.stdout: # disable pg_autoscaler by default for new pools 2023-11-04T15:26:56.919 INFO:teuthology.orchestra.run.smithi130.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-04T15:26:56.919 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:56.919 INFO:teuthology.orchestra.run.smithi130.stdout: osd pool default size = 2 2023-11-04T15:26:56.919 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:56.919 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd allow primary affinity = true 2023-11-04T15:26:56.919 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd allow pg remap = true 2023-11-04T15:26:56.920 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on legacy crush tunables = false 2023-11-04T15:26:56.920 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on crush straw calc version zero = false 2023-11-04T15:26:56.920 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on no sortbitwise = false 2023-11-04T15:26:56.920 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on osd down out interval zero = false 2023-11-04T15:26:56.920 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on too few osds = false 2023-11-04T15:26:56.921 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-04T15:26:56.921 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-04T15:26:56.921 INFO:teuthology.orchestra.run.smithi130.stdout: mon_allow_pool_size_one = true 2023-11-04T15:26:56.921 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:56.921 INFO:teuthology.orchestra.run.smithi130.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-04T15:26:56.921 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:56.922 INFO:teuthology.orchestra.run.smithi130.stdout: osd default data pool replay window = 5 2023-11-04T15:26:56.922 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:56.922 INFO:teuthology.orchestra.run.smithi130.stdout: mon allow pool delete = true 2023-11-04T15:26:56.922 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:56.923 INFO:teuthology.orchestra.run.smithi130.stdout: mon cluster log file level = debug 2023-11-04T15:26:56.923 INFO:teuthology.orchestra.run.smithi130.stdout: debug asserts on shutdown = true 2023-11-04T15:26:56.923 INFO:teuthology.orchestra.run.smithi130.stdout: mon health detail to clog = false 2023-11-04T15:26:56.923 INFO:teuthology.orchestra.run.smithi130.stdout: mon host = "172.21.15.19,172.21.15.96,[v2:172.21.15.96:3301,v1:172.21.15.96:6790]" 2023-11-04T15:26:56.923 INFO:teuthology.orchestra.run.smithi130.stdout: fsid = e87311d5-496a-4b07-9654-358fe5bbf950 2023-11-04T15:26:56.923 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:56.924 INFO:teuthology.orchestra.run.smithi130.stdout:[osd] 2023-11-04T15:26:56.924 INFO:teuthology.orchestra.run.smithi130.stdout: osd journal size = 100 2023-11-04T15:26:56.924 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:56.924 INFO:teuthology.orchestra.run.smithi130.stdout: osd scrub load threshold = 5.0 2023-11-04T15:26:56.924 INFO:teuthology.orchestra.run.smithi130.stdout: osd scrub max interval = 600 2023-11-04T15:26:56.925 INFO:teuthology.orchestra.run.smithi130.stdout: osd mclock profile = high_recovery_ops 2023-11-04T15:26:56.925 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:56.925 INFO:teuthology.orchestra.run.smithi130.stdout: osd recover clone overlap = true 2023-11-04T15:26:56.925 INFO:teuthology.orchestra.run.smithi130.stdout: osd recovery max chunk = 1048576 2023-11-04T15:26:56.925 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:56.926 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug shutdown = true 2023-11-04T15:26:56.926 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug op order = true 2023-11-04T15:26:56.926 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug verify stray on activate = true 2023-11-04T15:26:56.926 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:56.926 INFO:teuthology.orchestra.run.smithi130.stdout: osd open classes on start = true 2023-11-04T15:26:56.927 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug pg log writeout = true 2023-11-04T15:26:56.927 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:56.927 INFO:teuthology.orchestra.run.smithi130.stdout: osd deep scrub update digest min age = 30 2023-11-04T15:26:56.927 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:56.927 INFO:teuthology.orchestra.run.smithi130.stdout: osd map max advance = 10 2023-11-04T15:26:56.927 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:56.928 INFO:teuthology.orchestra.run.smithi130.stdout: journal zero on create = true 2023-11-04T15:26:56.928 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:56.928 INFO:teuthology.orchestra.run.smithi130.stdout: filestore ondisk finisher threads = 3 2023-11-04T15:26:56.928 INFO:teuthology.orchestra.run.smithi130.stdout: filestore apply finisher threads = 3 2023-11-04T15:26:56.928 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:56.929 INFO:teuthology.orchestra.run.smithi130.stdout: bdev debug aio = true 2023-11-04T15:26:56.929 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug misdirected ops = true 2023-11-04T15:26:56.929 INFO:teuthology.orchestra.run.smithi130.stdout: bdev async discard = True 2023-11-04T15:26:56.929 INFO:teuthology.orchestra.run.smithi130.stdout: bdev enable discard = True 2023-11-04T15:26:56.929 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore allocator = bitmap 2023-11-04T15:26:56.930 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore block size = 96636764160 2023-11-04T15:26:56.930 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore fsck on mount = True 2023-11-04T15:26:56.930 INFO:teuthology.orchestra.run.smithi130.stdout: debug bluefs = 20 2023-11-04T15:26:56.930 INFO:teuthology.orchestra.run.smithi130.stdout: debug bluestore = 20 2023-11-04T15:26:56.930 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2023-11-04T15:26:56.930 INFO:teuthology.orchestra.run.smithi130.stdout: debug osd = 20 2023-11-04T15:26:56.931 INFO:teuthology.orchestra.run.smithi130.stdout: debug rocksdb = 10 2023-11-04T15:26:56.931 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd backfillfull_ratio = 0.85 2023-11-04T15:26:56.931 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd full ratio = 0.9 2023-11-04T15:26:56.931 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd nearfull ratio = 0.8 2023-11-04T15:26:56.931 INFO:teuthology.orchestra.run.smithi130.stdout: osd failsafe full ratio = 0.95 2023-11-04T15:26:56.932 INFO:teuthology.orchestra.run.smithi130.stdout: osd objectstore = bluestore 2023-11-04T15:26:56.932 INFO:teuthology.orchestra.run.smithi130.stdout: osd shutdown pgref assert = True 2023-11-04T15:26:56.932 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:56.932 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr] 2023-11-04T15:26:56.932 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2023-11-04T15:26:56.932 INFO:teuthology.orchestra.run.smithi130.stdout: debug mgr = 20 2023-11-04T15:26:56.933 INFO:teuthology.orchestra.run.smithi130.stdout: debug mon = 20 2023-11-04T15:26:56.933 INFO:teuthology.orchestra.run.smithi130.stdout: debug auth = 20 2023-11-04T15:26:56.933 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min pgs per osd = 4 2023-11-04T15:26:56.933 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min bytes per osd = 10 2023-11-04T15:26:56.933 INFO:teuthology.orchestra.run.smithi130.stdout: mgr/telemetry/nag = false 2023-11-04T15:26:56.934 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:56.934 INFO:teuthology.orchestra.run.smithi130.stdout:[mon] 2023-11-04T15:26:56.934 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2023-11-04T15:26:56.934 INFO:teuthology.orchestra.run.smithi130.stdout: debug mon = 20 2023-11-04T15:26:56.934 INFO:teuthology.orchestra.run.smithi130.stdout: debug paxos = 20 2023-11-04T15:26:56.935 INFO:teuthology.orchestra.run.smithi130.stdout: debug auth = 20 2023-11-04T15:26:56.935 INFO:teuthology.orchestra.run.smithi130.stdout: mon data avail warn = 5 2023-11-04T15:26:56.935 INFO:teuthology.orchestra.run.smithi130.stdout: mon mgr mkfs grace = 240 2023-11-04T15:26:56.935 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min pgs per osd = 4 2023-11-04T15:26:56.935 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd reporter subtree level = osd 2023-11-04T15:26:56.936 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd prime pg temp = true 2023-11-04T15:26:56.936 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min bytes per osd = 10 2023-11-04T15:26:56.936 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:56.936 INFO:teuthology.orchestra.run.smithi130.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-04T15:26:56.936 INFO:teuthology.orchestra.run.smithi130.stdout: auth mon ticket ttl = 660 # 11m 2023-11-04T15:26:56.937 INFO:teuthology.orchestra.run.smithi130.stdout: auth service ticket ttl = 240 # 4m 2023-11-04T15:26:56.937 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:56.937 INFO:teuthology.orchestra.run.smithi130.stdout: # don't complain about insecure global_id in the test suite 2023-11-04T15:26:56.937 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-04T15:26:56.937 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-04T15:26:56.938 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:56.938 INFO:teuthology.orchestra.run.smithi130.stdout: # 1m isn't quite enough 2023-11-04T15:26:56.938 INFO:teuthology.orchestra.run.smithi130.stdout: mon_down_mkfs_grace = 2m 2023-11-04T15:26:56.938 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:56.938 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_filestore_osds = false 2023-11-04T15:26:56.939 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:26:56.939 INFO:teuthology.orchestra.run.smithi130.stdout:[client] 2023-11-04T15:26:56.939 INFO:teuthology.orchestra.run.smithi130.stdout: rgw cache enabled = true 2023-11-04T15:26:56.939 INFO:teuthology.orchestra.run.smithi130.stdout: rgw enable ops log = true 2023-11-04T15:26:56.939 INFO:teuthology.orchestra.run.smithi130.stdout: rgw enable usage log = true 2023-11-04T15:26:56.940 INFO:teuthology.orchestra.run.smithi130.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-04T15:26:56.940 INFO:teuthology.orchestra.run.smithi130.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-04T15:26:56.940 INFO:teuthology.orchestra.run.smithi130.stdout: debug client = 20 2023-11-04T15:26:56.940 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2023-11-04T15:26:56.940 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.a] 2023-11-04T15:26:56.941 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.b] 2023-11-04T15:26:56.941 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.c] 2023-11-04T15:26:56.941 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.a] 2023-11-04T15:26:56.941 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.b] 2023-11-04T15:26:56.941 INFO:teuthology.orchestra.run.smithi130.stdout:[mds] 2023-11-04T15:26:56.942 INFO:teuthology.orchestra.run.smithi130.stdout: debug mds = 20 2023-11-04T15:26:56.942 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2023-11-04T15:26:56.942 INFO:teuthology.orchestra.run.smithi019.stdout:[global] 2023-11-04T15:26:56.942 INFO:teuthology.orchestra.run.smithi019.stdout: chdir = "" 2023-11-04T15:26:56.943 INFO:teuthology.orchestra.run.smithi019.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-04T15:26:56.943 INFO:teuthology.orchestra.run.smithi019.stdout: auth supported = cephx 2023-11-04T15:26:56.943 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:56.943 INFO:teuthology.orchestra.run.smithi019.stdout: filestore xattr use omap = true 2023-11-04T15:26:56.943 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:56.944 INFO:teuthology.orchestra.run.smithi019.stdout: mon clock drift allowed = 1.000 2023-11-04T15:26:56.944 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:56.944 INFO:teuthology.orchestra.run.smithi019.stdout: osd crush chooseleaf type = 0 2023-11-04T15:26:56.944 INFO:teuthology.orchestra.run.smithi019.stdout: auth debug = true 2023-11-04T15:26:56.944 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:56.944 INFO:teuthology.orchestra.run.smithi019.stdout: ms die on old message = true 2023-11-04T15:26:56.945 INFO:teuthology.orchestra.run.smithi019.stdout: ms die on bug = true 2023-11-04T15:26:56.945 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:56.945 INFO:teuthology.orchestra.run.smithi019.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-04T15:26:56.945 INFO:teuthology.orchestra.run.smithi019.stdout: mon pg warn max object skew = 0 2023-11-04T15:26:56.945 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:56.946 INFO:teuthology.orchestra.run.smithi019.stdout: # disable pg_autoscaler by default for new pools 2023-11-04T15:26:56.946 INFO:teuthology.orchestra.run.smithi019.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-04T15:26:56.946 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:56.946 INFO:teuthology.orchestra.run.smithi019.stdout: osd pool default size = 2 2023-11-04T15:26:56.946 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:56.946 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd allow primary affinity = true 2023-11-04T15:26:56.947 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd allow pg remap = true 2023-11-04T15:26:56.947 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on legacy crush tunables = false 2023-11-04T15:26:56.947 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on crush straw calc version zero = false 2023-11-04T15:26:56.947 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on no sortbitwise = false 2023-11-04T15:26:56.947 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on osd down out interval zero = false 2023-11-04T15:26:56.948 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on too few osds = false 2023-11-04T15:26:56.948 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-04T15:26:56.948 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-04T15:26:56.948 INFO:teuthology.orchestra.run.smithi019.stdout: mon_allow_pool_size_one = true 2023-11-04T15:26:56.948 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:56.949 INFO:teuthology.orchestra.run.smithi019.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-04T15:26:56.949 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:56.949 INFO:teuthology.orchestra.run.smithi019.stdout: osd default data pool replay window = 5 2023-11-04T15:26:56.949 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:56.949 INFO:teuthology.orchestra.run.smithi019.stdout: mon allow pool delete = true 2023-11-04T15:26:56.949 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:56.950 INFO:teuthology.orchestra.run.smithi019.stdout: mon cluster log file level = debug 2023-11-04T15:26:56.950 INFO:teuthology.orchestra.run.smithi019.stdout: debug asserts on shutdown = true 2023-11-04T15:26:56.950 INFO:teuthology.orchestra.run.smithi019.stdout: mon health detail to clog = false 2023-11-04T15:26:56.950 INFO:teuthology.orchestra.run.smithi019.stdout: mon host = "172.21.15.19,172.21.15.96,[v2:172.21.15.96:3301,v1:172.21.15.96:6790]" 2023-11-04T15:26:56.950 INFO:teuthology.orchestra.run.smithi019.stdout: fsid = e87311d5-496a-4b07-9654-358fe5bbf950 2023-11-04T15:26:56.951 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:56.951 INFO:teuthology.orchestra.run.smithi019.stdout:[osd] 2023-11-04T15:26:56.951 INFO:teuthology.orchestra.run.smithi019.stdout: osd journal size = 100 2023-11-04T15:26:56.951 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:56.951 INFO:teuthology.orchestra.run.smithi019.stdout: osd scrub load threshold = 5.0 2023-11-04T15:26:56.952 INFO:teuthology.orchestra.run.smithi019.stdout: osd scrub max interval = 600 2023-11-04T15:26:56.952 INFO:teuthology.orchestra.run.smithi019.stdout: osd mclock profile = high_recovery_ops 2023-11-04T15:26:56.952 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:56.952 INFO:teuthology.orchestra.run.smithi019.stdout: osd recover clone overlap = true 2023-11-04T15:26:56.952 INFO:teuthology.orchestra.run.smithi019.stdout: osd recovery max chunk = 1048576 2023-11-04T15:26:56.953 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:56.953 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug shutdown = true 2023-11-04T15:26:56.953 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug op order = true 2023-11-04T15:26:56.953 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug verify stray on activate = true 2023-11-04T15:26:56.953 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:56.954 INFO:teuthology.orchestra.run.smithi019.stdout: osd open classes on start = true 2023-11-04T15:26:56.954 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug pg log writeout = true 2023-11-04T15:26:56.954 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:56.954 INFO:teuthology.orchestra.run.smithi019.stdout: osd deep scrub update digest min age = 30 2023-11-04T15:26:56.955 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:56.955 INFO:teuthology.orchestra.run.smithi019.stdout: osd map max advance = 10 2023-11-04T15:26:56.955 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:56.955 INFO:teuthology.orchestra.run.smithi019.stdout: journal zero on create = true 2023-11-04T15:26:56.955 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:56.956 INFO:teuthology.orchestra.run.smithi019.stdout: filestore ondisk finisher threads = 3 2023-11-04T15:26:56.956 INFO:teuthology.orchestra.run.smithi019.stdout: filestore apply finisher threads = 3 2023-11-04T15:26:56.956 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:56.956 INFO:teuthology.orchestra.run.smithi019.stdout: bdev debug aio = true 2023-11-04T15:26:56.956 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug misdirected ops = true 2023-11-04T15:26:56.957 INFO:teuthology.orchestra.run.smithi019.stdout: bdev async discard = True 2023-11-04T15:26:56.957 INFO:teuthology.orchestra.run.smithi019.stdout: bdev enable discard = True 2023-11-04T15:26:56.957 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore allocator = bitmap 2023-11-04T15:26:56.957 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore block size = 96636764160 2023-11-04T15:26:56.957 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore fsck on mount = True 2023-11-04T15:26:56.957 INFO:teuthology.orchestra.run.smithi019.stdout: debug bluefs = 20 2023-11-04T15:26:56.958 INFO:teuthology.orchestra.run.smithi019.stdout: debug bluestore = 20 2023-11-04T15:26:56.958 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2023-11-04T15:26:56.958 INFO:teuthology.orchestra.run.smithi019.stdout: debug osd = 20 2023-11-04T15:26:56.958 INFO:teuthology.orchestra.run.smithi019.stdout: debug rocksdb = 10 2023-11-04T15:26:56.958 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd backfillfull_ratio = 0.85 2023-11-04T15:26:56.959 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd full ratio = 0.9 2023-11-04T15:26:56.959 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd nearfull ratio = 0.8 2023-11-04T15:26:56.959 INFO:teuthology.orchestra.run.smithi019.stdout: osd failsafe full ratio = 0.95 2023-11-04T15:26:56.959 INFO:teuthology.orchestra.run.smithi019.stdout: osd objectstore = bluestore 2023-11-04T15:26:56.959 INFO:teuthology.orchestra.run.smithi019.stdout: osd shutdown pgref assert = True 2023-11-04T15:26:56.959 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:56.960 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr] 2023-11-04T15:26:56.960 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2023-11-04T15:26:56.960 INFO:teuthology.orchestra.run.smithi019.stdout: debug mgr = 20 2023-11-04T15:26:56.960 INFO:teuthology.orchestra.run.smithi019.stdout: debug mon = 20 2023-11-04T15:26:56.960 INFO:teuthology.orchestra.run.smithi019.stdout: debug auth = 20 2023-11-04T15:26:56.961 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min pgs per osd = 4 2023-11-04T15:26:56.961 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min bytes per osd = 10 2023-11-04T15:26:56.961 INFO:teuthology.orchestra.run.smithi019.stdout: mgr/telemetry/nag = false 2023-11-04T15:26:56.961 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:56.961 INFO:teuthology.orchestra.run.smithi019.stdout:[mon] 2023-11-04T15:26:56.962 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2023-11-04T15:26:56.962 INFO:teuthology.orchestra.run.smithi019.stdout: debug mon = 20 2023-11-04T15:26:56.962 INFO:teuthology.orchestra.run.smithi019.stdout: debug paxos = 20 2023-11-04T15:26:56.962 INFO:teuthology.orchestra.run.smithi019.stdout: debug auth = 20 2023-11-04T15:26:56.962 INFO:teuthology.orchestra.run.smithi019.stdout: mon data avail warn = 5 2023-11-04T15:26:56.963 INFO:teuthology.orchestra.run.smithi019.stdout: mon mgr mkfs grace = 240 2023-11-04T15:26:56.963 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min pgs per osd = 4 2023-11-04T15:26:56.963 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd reporter subtree level = osd 2023-11-04T15:26:56.963 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd prime pg temp = true 2023-11-04T15:26:56.963 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min bytes per osd = 10 2023-11-04T15:26:56.964 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:56.964 INFO:teuthology.orchestra.run.smithi019.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-04T15:26:56.964 INFO:teuthology.orchestra.run.smithi019.stdout: auth mon ticket ttl = 660 # 11m 2023-11-04T15:26:56.964 INFO:teuthology.orchestra.run.smithi019.stdout: auth service ticket ttl = 240 # 4m 2023-11-04T15:26:56.964 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:56.965 INFO:teuthology.orchestra.run.smithi019.stdout: # don't complain about insecure global_id in the test suite 2023-11-04T15:26:56.965 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-04T15:26:56.965 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-04T15:26:56.965 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:56.965 INFO:teuthology.orchestra.run.smithi019.stdout: # 1m isn't quite enough 2023-11-04T15:26:56.965 INFO:teuthology.orchestra.run.smithi019.stdout: mon_down_mkfs_grace = 2m 2023-11-04T15:26:56.966 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:56.966 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_filestore_osds = false 2023-11-04T15:26:56.966 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:26:56.966 INFO:teuthology.orchestra.run.smithi019.stdout:[client] 2023-11-04T15:26:56.966 INFO:teuthology.orchestra.run.smithi019.stdout: rgw cache enabled = true 2023-11-04T15:26:56.967 INFO:teuthology.orchestra.run.smithi019.stdout: rgw enable ops log = true 2023-11-04T15:26:56.967 INFO:teuthology.orchestra.run.smithi019.stdout: rgw enable usage log = true 2023-11-04T15:26:56.967 INFO:teuthology.orchestra.run.smithi019.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-04T15:26:56.967 INFO:teuthology.orchestra.run.smithi019.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-04T15:26:56.967 INFO:teuthology.orchestra.run.smithi019.stdout: debug client = 20 2023-11-04T15:26:56.968 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2023-11-04T15:26:56.968 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.a] 2023-11-04T15:26:56.968 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.b] 2023-11-04T15:26:56.968 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.c] 2023-11-04T15:26:56.968 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.a] 2023-11-04T15:26:56.969 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.b] 2023-11-04T15:26:56.969 INFO:teuthology.orchestra.run.smithi019.stdout:[mds] 2023-11-04T15:26:56.969 INFO:teuthology.orchestra.run.smithi019.stdout: debug mds = 20 2023-11-04T15:26:56.969 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2023-11-04T15:26:56.969 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-04T15:26:56.970 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-04T15:26:57.030 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-04T15:26:57.030 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-04T15:26:57.030 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-04T15:26:57.045 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-04T15:26:57.045 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-04T15:26:57.100 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi019.front.sepia.ceph.com 2023-11-04T15:26:57.101 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-04T15:26:57.101 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-04T15:26:57.102 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-04T15:26:57.187 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-04T15:26:57.188 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-04T15:26:57.243 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi096.front.sepia.ceph.com 2023-11-04T15:26:57.244 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-11-04T15:26:57.244 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-04T15:26:57.245 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-04T15:26:57.287 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-11-04T15:26:57.287 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-04T15:26:57.342 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi130.front.sepia.ceph.com 2023-11-04T15:26:57.343 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-11-04T15:26:57.343 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-04T15:26:57.343 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-04T15:26:57.389 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-11-04T15:26:57.389 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-04T15:26:57.446 INFO:tasks.ceph:Setting up mon nodes... 2023-11-04T15:26:57.446 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-04T15:26:57.447 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-04T15:26:57.510 INFO:teuthology.orchestra.run.smithi019.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-04T15:26:57.513 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-04T15:26:57.581 INFO:teuthology.orchestra.run.smithi096.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-04T15:26:57.584 INFO:tasks.ceph:Setting up mds nodes... 2023-11-04T15:26:57.584 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-04T15:26:57.646 INFO:teuthology.orchestra.run.smithi019.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-04T15:26:57.649 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-04T15:26:57.679 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-04T15:26:57.736 INFO:teuthology.orchestra.run.smithi096.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-04T15:26:57.738 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-04T15:26:57.765 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-04T15:26:57.766 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-04T15:26:57.822 INFO:teuthology.orchestra.run.smithi130.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-04T15:26:57.839 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-04T15:26:57.839 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi019.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi096.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2023-11-04T15:26:57.840 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-04T15:26:57.870 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2023-11-04T15:26:57.871 INFO:tasks.ceph:role: osd.0 2023-11-04T15:26:57.871 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi019.front.sepia.ceph.com 2023-11-04T15:26:57.871 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-04T15:26:57.948 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T15:26:57.948 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T15:26:57.948 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T15:26:57.949 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-04T15:26:57.949 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T15:26:57.949 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2023-11-04T15:26:57.949 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T15:26:57.950 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-04T15:26:57.950 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T15:26:57.950 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T15:26:58.458 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2023-11-04T15:26:58.460 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2023-11-04T15:26:58.461 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-04T15:26:58.606 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-04T15:26:58.645 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-04T15:26:58.716 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2023-11-04T15:26:58.716 INFO:tasks.ceph:role: osd.1 2023-11-04T15:26:58.717 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi019.front.sepia.ceph.com 2023-11-04T15:26:58.717 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-04T15:26:58.795 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T15:26:58.795 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T15:26:58.795 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T15:26:58.796 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-04T15:26:58.796 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T15:26:58.796 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2023-11-04T15:26:58.796 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T15:26:58.796 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-04T15:26:58.797 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T15:26:58.797 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T15:26:59.242 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2023-11-04T15:26:59.244 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2023-11-04T15:26:59.244 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-04T15:26:59.351 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-04T15:26:59.387 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T15:26:59.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:26:59.485+0000 7f4c8102b500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-04T15:26:59.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:26:59.487+0000 7f4c8102b500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-04T15:26:59.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:26:59.487+0000 7f4c8102b500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-04T15:26:59.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:26:59.487+0000 7f4c8102b500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-04T15:26:59.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:26:59.487+0000 7f4c8102b500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-04T15:26:59.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:26:59.488+0000 7f4c8102b500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-04T15:27:02.336 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-04T15:27:02.371 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T15:27:02.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:02.465+0000 7f37a500e500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-04T15:27:02.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:02.465+0000 7f37a500e500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-04T15:27:02.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:02.465+0000 7f37a500e500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-04T15:27:02.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:02.465+0000 7f37a500e500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-04T15:27:02.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:02.465+0000 7f37a500e500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-04T15:27:02.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:02.466+0000 7f37a500e500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-04T15:27:05.325 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-04T15:27:05.362 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-04T15:27:05.394 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2023-11-04T15:27:05.395 INFO:tasks.ceph:role: osd.2 2023-11-04T15:27:05.395 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi096.front.sepia.ceph.com 2023-11-04T15:27:05.396 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-04T15:27:05.471 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T15:27:05.472 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T15:27:05.472 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T15:27:05.473 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-04T15:27:05.473 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T15:27:05.473 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2023-11-04T15:27:05.474 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T15:27:05.474 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-04T15:27:05.474 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T15:27:05.475 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T15:27:05.973 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2023-11-04T15:27:05.975 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2023-11-04T15:27:05.976 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2023-11-04T15:27:06.118 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-04T15:27:06.155 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-04T15:27:06.225 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2023-11-04T15:27:06.225 INFO:tasks.ceph:role: osd.3 2023-11-04T15:27:06.225 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi096.front.sepia.ceph.com 2023-11-04T15:27:06.226 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-04T15:27:06.301 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T15:27:06.301 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T15:27:06.301 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T15:27:06.302 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-04T15:27:06.302 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T15:27:06.302 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2023-11-04T15:27:06.302 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T15:27:06.302 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-04T15:27:06.303 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T15:27:06.303 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T15:27:06.745 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2023-11-04T15:27:06.747 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2023-11-04T15:27:06.747 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2023-11-04T15:27:06.843 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-04T15:27:06.873 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T15:27:06.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:06.963+0000 7f30c6bad500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-04T15:27:06.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:06.964+0000 7f30c6bad500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-04T15:27:06.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:06.964+0000 7f30c6bad500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-04T15:27:06.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:06.964+0000 7f30c6bad500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-04T15:27:06.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:06.964+0000 7f30c6bad500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-04T15:27:06.972 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:06.970+0000 7f30c6bad500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-04T15:27:09.825 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-04T15:27:09.856 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T15:27:09.947 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:09.945+0000 7fc2f432b500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-04T15:27:09.947 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:09.945+0000 7fc2f432b500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-04T15:27:09.947 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:09.945+0000 7fc2f432b500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-04T15:27:09.948 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:09.945+0000 7fc2f432b500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-04T15:27:09.948 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:09.945+0000 7fc2f432b500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-04T15:27:09.948 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:09.946+0000 7fc2f432b500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-04T15:27:12.803 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-04T15:27:12.834 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-04T15:27:12.835 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-04T15:27:12.835 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-04T15:27:12.872 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-04T15:27:12.872 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-04T15:27:12.946 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-04T15:27:12.946 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-04T15:27:13.019 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-04T15:27:13.019 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-04T15:27:13.091 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-11-04T15:27:13.092 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-04T15:27:13.123 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-11-04T15:27:13.124 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-04T15:27:13.195 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-11-04T15:27:13.195 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-04T15:27:13.265 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-11-04T15:27:13.265 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-04T15:27:13.335 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-11-04T15:27:13.335 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-04T15:27:13.355 INFO:tasks.ceph:Adding keys to all mons... 2023-11-04T15:27:13.355 DEBUG:teuthology.orchestra.run.smithi019:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-04T15:27:13.358 DEBUG:teuthology.orchestra.run.smithi096:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-04T15:27:13.387 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr.x] 2023-11-04T15:27:13.387 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDBYkZllG9gHhAAk/JLyOZx1hlhdhoGb8IcGQ== 2023-11-04T15:27:13.387 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.a] 2023-11-04T15:27:13.387 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDBYkZlt7WBJhAApbwt62Roh8mYbB6TYOIvjg== 2023-11-04T15:27:13.388 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.0] 2023-11-04T15:27:13.388 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDDYkZlh4QGHRAA3NaM6lVKbc0lx9NTGqinww== 2023-11-04T15:27:13.388 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.1] 2023-11-04T15:27:13.388 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDGYkZlcLDRGxAAP/wncf9N1lwOzeJyTzn6OA== 2023-11-04T15:27:13.388 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr.y] 2023-11-04T15:27:13.388 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDBYkZlfPmfIhAAkS1CNnPicTAoh5PYxmBUEA== 2023-11-04T15:27:13.389 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.b] 2023-11-04T15:27:13.389 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDBYkZldPPcKxAAZR48LoMiazaBqj/m7whh+Q== 2023-11-04T15:27:13.389 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.2] 2023-11-04T15:27:13.389 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDKYkZl3752ORAACn742W+SifSI3gd+MEM+ug== 2023-11-04T15:27:13.389 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.3] 2023-11-04T15:27:13.390 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDNYkZlRfBnOBAAjKLKf6lp3eUQrSu4D1Pv2Q== 2023-11-04T15:27:13.390 INFO:teuthology.orchestra.run.smithi019.stdout:[client.0] 2023-11-04T15:27:13.390 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDBYkZlE/H6MBAAiW95rm3kyiUiV3LDRpB21A== 2023-11-04T15:27:13.402 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr.x] 2023-11-04T15:27:13.402 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQDBYkZllG9gHhAAk/JLyOZx1hlhdhoGb8IcGQ== 2023-11-04T15:27:13.402 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.a] 2023-11-04T15:27:13.402 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQDBYkZlt7WBJhAApbwt62Roh8mYbB6TYOIvjg== 2023-11-04T15:27:13.403 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.0] 2023-11-04T15:27:13.403 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQDDYkZlh4QGHRAA3NaM6lVKbc0lx9NTGqinww== 2023-11-04T15:27:13.403 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.1] 2023-11-04T15:27:13.403 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQDGYkZlcLDRGxAAP/wncf9N1lwOzeJyTzn6OA== 2023-11-04T15:27:13.403 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr.y] 2023-11-04T15:27:13.404 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQDBYkZlfPmfIhAAkS1CNnPicTAoh5PYxmBUEA== 2023-11-04T15:27:13.404 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.b] 2023-11-04T15:27:13.404 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQDBYkZldPPcKxAAZR48LoMiazaBqj/m7whh+Q== 2023-11-04T15:27:13.404 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.2] 2023-11-04T15:27:13.404 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQDKYkZl3752ORAACn742W+SifSI3gd+MEM+ug== 2023-11-04T15:27:13.405 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.3] 2023-11-04T15:27:13.405 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQDNYkZlRfBnOBAAjKLKf6lp3eUQrSu4D1Pv2Q== 2023-11-04T15:27:13.405 INFO:teuthology.orchestra.run.smithi096.stdout:[client.0] 2023-11-04T15:27:13.405 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQDBYkZlE/H6MBAAiW95rm3kyiUiV3LDRpB21A== 2023-11-04T15:27:13.406 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-04T15:27:13.434 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-04T15:27:13.501 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T15:27:13.503 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T15:27:13.560 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T15:27:13.563 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T15:27:13.616 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T15:27:13.618 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T15:27:13.671 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-04T15:27:13.674 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-04T15:27:13.727 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T15:27:13.729 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T15:27:13.786 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T15:27:13.789 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T15:27:13.841 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T15:27:13.844 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T15:27:13.897 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T15:27:13.899 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T15:27:13.956 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-04T15:27:13.956 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-04T15:27:13.987 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-04T15:27:14.090 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-04T15:27:14.120 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-04T15:27:14.147 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-04T15:27:14.247 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-04T15:27:14.274 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-04T15:27:14.341 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-04T15:27:14.436 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-04T15:27:14.462 DEBUG:teuthology.orchestra.run.smithi019:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-04T15:27:14.465 DEBUG:teuthology.orchestra.run.smithi096:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-04T15:27:14.517 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-04T15:27:14.518 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-04T15:27:14.518 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-04T15:27:14.521 INFO:tasks.ceph.mon.a:Started 2023-11-04T15:27:14.521 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-04T15:27:14.521 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-04T15:27:14.560 INFO:tasks.ceph.mon.b:Started 2023-11-04T15:27:14.560 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-04T15:27:14.561 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-04T15:27:14.563 INFO:tasks.ceph.mon.c:Started 2023-11-04T15:27:14.563 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-04T15:27:14.564 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-04T15:27:14.564 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-04T15:27:14.566 INFO:tasks.ceph.mgr.x:Started 2023-11-04T15:27:14.567 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-04T15:27:14.567 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-04T15:27:14.569 INFO:tasks.ceph.mgr.y:Started 2023-11-04T15:27:14.570 INFO:tasks.ceph:Setting crush tunables to default 2023-11-04T15:27:14.570 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph osd crush tunables default 2023-11-04T15:27:14.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.675+0000 7fc971d2e640 1 Processor -- start 2023-11-04T15:27:14.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.676+0000 7fc971d2e640 1 -- start start 2023-11-04T15:27:14.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.676+0000 7fc971d2e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc96c135030 0x7fc96c135410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:14.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.676+0000 7fc971d2e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc96c071840 con 0x7fc96c138a90 2023-11-04T15:27:14.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.676+0000 7fc971d2e640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc96c135950 con 0x7fc96c137f20 2023-11-04T15:27:14.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.676+0000 7fc971d2e640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc96c0a2060 con 0x7fc96c135030 2023-11-04T15:27:14.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.676+0000 7fc96bfff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc96c138a90 0x7fc96c140260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39866/0 (socket says 172.21.15.19:39866) 2023-11-04T15:27:14.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.676+0000 7fc96bfff640 1 -- 172.21.15.19:0/3235104116 learned_addr learned my addr 172.21.15.19:0/3235104116 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:14.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.676+0000 7fc96b7fe640 1 --2- 172.21.15.19:0/3235104116 >> v2:172.21.15.96:3300/0 conn(0x7fc96c135030 0x7fc96c135410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:14.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.676+0000 7fc96b7fe640 1 -- 172.21.15.19:0/3235104116 >> v2:172.21.15.96:3300/0 conn(0x7fc96c135030 msgr2=0x7fc96c135410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-04T15:27:14.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.676+0000 7fc96b7fe640 1 -- 172.21.15.19:0/3235104116 >> v2:172.21.15.96:3300/0 conn(0x7fc96c135030 msgr2=0x7fc96c135410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T15:27:14.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.676+0000 7fc96b7fe640 1 --2- 172.21.15.19:0/3235104116 >> v2:172.21.15.96:3300/0 conn(0x7fc96c135030 0x7fc96c135410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T15:27:14.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.676+0000 7fc96b7fe640 1 --2- 172.21.15.19:0/3235104116 >> v2:172.21.15.96:3300/0 conn(0x7fc96c135030 0x7fc96c135410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T15:27:14.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.877+0000 7fc96b7fe640 1 --2- 172.21.15.19:0/3235104116 >> v2:172.21.15.96:3300/0 conn(0x7fc96c135030 0x7fc96c135410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:14.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.877+0000 7fc96b7fe640 1 -- 172.21.15.19:0/3235104116 >> v2:172.21.15.96:3300/0 conn(0x7fc96c135030 msgr2=0x7fc96c135410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-04T15:27:14.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.877+0000 7fc96b7fe640 1 -- 172.21.15.19:0/3235104116 >> v2:172.21.15.96:3300/0 conn(0x7fc96c135030 msgr2=0x7fc96c135410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T15:27:14.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.877+0000 7fc96b7fe640 1 --2- 172.21.15.19:0/3235104116 >> v2:172.21.15.96:3300/0 conn(0x7fc96c135030 0x7fc96c135410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T15:27:14.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.877+0000 7fc96b7fe640 1 --2- 172.21.15.19:0/3235104116 >> v2:172.21.15.96:3300/0 conn(0x7fc96c135030 0x7fc96c135410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T15:27:14.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.877+0000 7fc96a7fc640 1 -- 172.21.15.19:0/3235104116 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3169999361 0 0) 0x7fc96c071840 con 0x7fc96c138a90 2023-11-04T15:27:14.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.878+0000 7fc96a7fc640 1 -- 172.21.15.19:0/3235104116 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc954003520 con 0x7fc96c138a90 2023-11-04T15:27:14.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.878+0000 7fc96a7fc640 1 -- 172.21.15.19:0/3235104116 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 627337741 0 0) 0x7fc96c135950 con 0x7fc96c137f20 2023-11-04T15:27:14.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.878+0000 7fc96a7fc640 1 -- 172.21.15.19:0/3235104116 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc96c071840 con 0x7fc96c137f20 2023-11-04T15:27:14.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.878+0000 7fc96a7fc640 1 -- 172.21.15.19:0/3235104116 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 683986128 0 0) 0x7fc954003520 con 0x7fc96c138a90 2023-11-04T15:27:14.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.878+0000 7fc96a7fc640 1 -- 172.21.15.19:0/3235104116 >> v2:172.21.15.96:3300/0 conn(0x7fc96c135030 msgr2=0x7fc96c135410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T15:27:14.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.878+0000 7fc96a7fc640 1 --2- 172.21.15.19:0/3235104116 >> v2:172.21.15.96:3300/0 conn(0x7fc96c135030 0x7fc96c135410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:14.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.878+0000 7fc96a7fc640 1 -- 172.21.15.19:0/3235104116 >> v1:172.21.15.96:6789/0 conn(0x7fc96c137f20 legacy=0x7fc96c138380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:14.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.878+0000 7fc96a7fc640 1 -- 172.21.15.19:0/3235104116 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c0705a0 con 0x7fc96c138a90 2023-11-04T15:27:14.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.878+0000 7fc96a7fc640 1 -- 172.21.15.19:0/3235104116 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3646097784 0 0) 0x7fc9640019f0 con 0x7fc96c138a90 2023-11-04T15:27:14.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.878+0000 7fc96a7fc640 1 -- 172.21.15.19:0/3235104116 >> v1:172.21.15.19:6789/0 conn(0x7fc96c138a90 legacy=0x7fc96c140260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:14.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.878+0000 7fc96a7fc640 1 --2- 172.21.15.19:0/3235104116 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc954003b00 0x7fc954003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:14.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.878+0000 7fc96a7fc640 1 --2- 172.21.15.19:0/3235104116 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9540047c0 0x7fc954004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:14.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.878+0000 7fc96a7fc640 1 --2- 172.21.15.19:0/3235104116 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9540052f0 0x7fc95400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:14.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.878+0000 7fc96a7fc640 1 -- 172.21.15.19:0/3235104116 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c0a2060 con 0x7fc9540052f0 2023-11-04T15:27:14.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.878+0000 7fc96a7fc640 1 -- 172.21.15.19:0/3235104116 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95400c210 con 0x7fc954003b00 2023-11-04T15:27:14.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.878+0000 7fc96a7fc640 1 -- 172.21.15.19:0/3235104116 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc95400c3d0 con 0x7fc9540047c0 2023-11-04T15:27:14.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.878+0000 7fc96b7fe640 1 --2- 172.21.15.19:0/3235104116 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc954003b00 0x7fc954003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:14.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.878+0000 7fc96bfff640 1 --2- 172.21.15.19:0/3235104116 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9540052f0 0x7fc95400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:14.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.879+0000 7fc96affd640 1 --2- 172.21.15.19:0/3235104116 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9540047c0 0x7fc954004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:14.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.879+0000 7fc96b7fe640 1 -- 172.21.15.19:0/3235104116 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9540047c0 msgr2=0x7fc954004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:14.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.879+0000 7fc96b7fe640 1 --2- 172.21.15.19:0/3235104116 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9540047c0 0x7fc954004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:14.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.879+0000 7fc96b7fe640 1 -- 172.21.15.19:0/3235104116 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9540052f0 msgr2=0x7fc95400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:14.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.879+0000 7fc96b7fe640 1 --2- 172.21.15.19:0/3235104116 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9540052f0 0x7fc95400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:14.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.879+0000 7fc96b7fe640 1 -- 172.21.15.19:0/3235104116 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc954003520 con 0x7fc954003b00 2023-11-04T15:27:14.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.879+0000 7fc96bfff640 1 --2- 172.21.15.19:0/3235104116 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9540052f0 0x7fc95400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T15:27:14.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.879+0000 7fc96bfff640 1 -- 172.21.15.19:0/3235104116 reap_dead start 2023-11-04T15:27:14.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.880+0000 7fc96b7fe640 1 --2- 172.21.15.19:0/3235104116 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc954003b00 0x7fc954003f20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc95c00da90 tx=0x7fc9540057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3377f8f5c5149134 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:14.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.880+0000 7fc96a7fc640 1 -- 172.21.15.19:0/3235104116 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c02c810 con 0x7fc954003b00 2023-11-04T15:27:14.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.880+0000 7fc96a7fc640 1 -- 172.21.15.19:0/3235104116 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c030070 con 0x7fc954003b00 2023-11-04T15:27:14.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.880+0000 7fc96a7fc640 1 -- 172.21.15.19:0/3235104116 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c02cbf0 con 0x7fc954003b00 2023-11-04T15:27:14.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.881+0000 7fc971d2e640 1 -- 172.21.15.19:0/3235104116 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc954003b00 msgr2=0x7fc954003f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:14.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.881+0000 7fc971d2e640 1 --2- 172.21.15.19:0/3235104116 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc954003b00 0x7fc954003f20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc95c00da90 tx=0x7fc9540057f0 comp rx=0 tx=0).stop 2023-11-04T15:27:14.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.881+0000 7fc971d2e640 1 -- 172.21.15.19:0/3235104116 shutdown_connections 2023-11-04T15:27:14.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.881+0000 7fc971d2e640 1 --2- 172.21.15.19:0/3235104116 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc954003b00 0x7fc954003f20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:14.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.881+0000 7fc971d2e640 1 -- 172.21.15.19:0/3235104116 >> 172.21.15.19:0/3235104116 conn(0x7fc96c0aa410 msgr2=0x7fc96c0aa820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:14.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.881+0000 7fc971d2e640 1 -- 172.21.15.19:0/3235104116 shutdown_connections 2023-11-04T15:27:14.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.881+0000 7fc971d2e640 1 -- 172.21.15.19:0/3235104116 wait complete. 2023-11-04T15:27:14.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.882+0000 7fc971d2e640 1 Processor -- start 2023-11-04T15:27:14.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.882+0000 7fc971d2e640 1 -- start start 2023-11-04T15:27:14.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.883+0000 7fc971d2e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc954003b00 0x7fc96c12ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:14.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.883+0000 7fc971d2e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc96c12f2c0 0x7fc96c1c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:14.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.883+0000 7fc971d2e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc96c1c76e0 0x7fc96c1c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:14.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.883+0000 7fc971d2e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c1c80d0 con 0x7fc96c12f2c0 2023-11-04T15:27:14.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.883+0000 7fc971d2e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c06ca10 con 0x7fc954003b00 2023-11-04T15:27:14.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.883+0000 7fc971d2e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c06c7b0 con 0x7fc96c1c76e0 2023-11-04T15:27:14.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.883+0000 7fc96affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc96c12f2c0 0x7fc96c1c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:14.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.883+0000 7fc96affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc96c12f2c0 0x7fc96c1c71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46218/0 (socket says 172.21.15.19:46218) 2023-11-04T15:27:14.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.883+0000 7fc96affd640 1 -- 172.21.15.19:0/1321606309 learned_addr learned my addr 172.21.15.19:0/1321606309 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:14.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.883+0000 7fc96bfff640 1 --2- 172.21.15.19:0/1321606309 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc96c1c76e0 0x7fc96c1c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:14.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.883+0000 7fc96b7fe640 1 --2- 172.21.15.19:0/1321606309 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc954003b00 0x7fc96c12ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:14.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.883+0000 7fc96affd640 1 -- 172.21.15.19:0/1321606309 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc96c1c76e0 msgr2=0x7fc96c1c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:14.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.883+0000 7fc96affd640 1 --2- 172.21.15.19:0/1321606309 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc96c1c76e0 0x7fc96c1c7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:14.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.883+0000 7fc96affd640 1 -- 172.21.15.19:0/1321606309 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc954003b00 msgr2=0x7fc96c12ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:14.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.883+0000 7fc96affd640 1 --2- 172.21.15.19:0/1321606309 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc954003b00 0x7fc96c12ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:14.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.883+0000 7fc96affd640 1 -- 172.21.15.19:0/1321606309 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c097ec0 con 0x7fc96c12f2c0 2023-11-04T15:27:14.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.884+0000 7fc96affd640 1 --2- 172.21.15.19:0/1321606309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc96c12f2c0 0x7fc96c1c71a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc9600113e0 tx=0x7fc9600117e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:14.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.884+0000 7fc953fff640 1 -- 172.21.15.19:0/1321606309 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9600050d0 con 0x7fc96c12f2c0 2023-11-04T15:27:14.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.884+0000 7fc953fff640 1 -- 172.21.15.19:0/1321606309 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc960005250 con 0x7fc96c12f2c0 2023-11-04T15:27:14.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.884+0000 7fc971d2e640 1 -- 172.21.15.19:0/1321606309 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc96c0a3f30 con 0x7fc96c12f2c0 2023-11-04T15:27:14.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.884+0000 7fc953fff640 1 -- 172.21.15.19:0/1321606309 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9600035f0 con 0x7fc96c12f2c0 2023-11-04T15:27:14.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.884+0000 7fc971d2e640 1 -- 172.21.15.19:0/1321606309 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc96c098540 con 0x7fc96c12f2c0 2023-11-04T15:27:14.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.884+0000 7fc953fff640 1 -- 172.21.15.19:0/1321606309 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc960003a70 con 0x7fc96c12f2c0 2023-11-04T15:27:14.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.884+0000 7fc953fff640 1 -- 172.21.15.19:0/1321606309 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc960021a50 con 0x7fc96c12f2c0 2023-11-04T15:27:14.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.885+0000 7fc971d2e640 1 -- 172.21.15.19:0/1321606309 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc96c067d60 con 0x7fc96c12f2c0 2023-11-04T15:27:14.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.887+0000 7fc953fff640 1 -- 172.21.15.19:0/1321606309 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fc960021460 con 0x7fc96c12f2c0 2023-11-04T15:27:14.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.955+0000 7fc971d2e640 1 -- 172.21.15.19:0/1321606309 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fc96c06fff0 con 0x7fc96c12f2c0 2023-11-04T15:27:14.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.957+0000 7fc953fff640 1 -- 172.21.15.19:0/1321606309 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fc960021600 con 0x7fc96c12f2c0 2023-11-04T15:27:14.959 INFO:teuthology.orchestra.run.smithi019.stderr:adjusted tunables profile to default 2023-11-04T15:27:14.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.958+0000 7fc971d2e640 1 -- 172.21.15.19:0/1321606309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc96c12f2c0 msgr2=0x7fc96c1c71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:14.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.958+0000 7fc971d2e640 1 --2- 172.21.15.19:0/1321606309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc96c12f2c0 0x7fc96c1c71a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc9600113e0 tx=0x7fc9600117e0 comp rx=0 tx=0).stop 2023-11-04T15:27:14.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.958+0000 7fc971d2e640 1 -- 172.21.15.19:0/1321606309 shutdown_connections 2023-11-04T15:27:14.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.958+0000 7fc971d2e640 1 --2- 172.21.15.19:0/1321606309 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc96c1c76e0 0x7fc96c1c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:14.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.958+0000 7fc971d2e640 1 --2- 172.21.15.19:0/1321606309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc96c12f2c0 0x7fc96c1c71a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:14.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.958+0000 7fc971d2e640 1 --2- 172.21.15.19:0/1321606309 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc954003b00 0x7fc96c12ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:14.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.958+0000 7fc971d2e640 1 -- 172.21.15.19:0/1321606309 >> 172.21.15.19:0/1321606309 conn(0x7fc96c0aa410 msgr2=0x7fc96c0a5120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:14.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.958+0000 7fc971d2e640 1 -- 172.21.15.19:0/1321606309 shutdown_connections 2023-11-04T15:27:14.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:14.958+0000 7fc971d2e640 1 -- 172.21.15.19:0/1321606309 wait complete. 2023-11-04T15:27:14.970 INFO:tasks.ceph:check_enable_crimson: False 2023-11-04T15:27:14.971 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-04T15:27:14.971 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-04T15:27:14.972 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-04T15:27:15.002 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-11-04T15:27:15.003 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-04T15:27:15.073 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-11-04T15:27:15.073 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-04T15:27:15.100 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-11-04T15:27:15.100 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-04T15:27:15.167 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd new 34818469-ebf2-4dd4-8119-af19a0121036 0 2023-11-04T15:27:15.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.304+0000 7fe32205f640 1 Processor -- start 2023-11-04T15:27:15.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.304+0000 7fe32205f640 1 -- start start 2023-11-04T15:27:15.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.305+0000 7fe32205f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe31c140bc0 0x7fe31c142fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:15.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.305+0000 7fe32205f640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe31c0a5740 con 0x7fe31c0a63d0 2023-11-04T15:27:15.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.305+0000 7fe32205f640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe31c0a51a0 con 0x7fe31c136110 2023-11-04T15:27:15.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.305+0000 7fe32205f640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c0a3e60 con 0x7fe31c140bc0 2023-11-04T15:27:15.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.305+0000 7fe31bfff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe31c140bc0 0x7fe31c142fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:15.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.305+0000 7fe31bfff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe31c140bc0 0x7fe31c142fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:40300/0 (socket says 172.21.15.96:40300) 2023-11-04T15:27:15.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.305+0000 7fe31bfff640 1 -- 172.21.15.96:0/2393921187 learned_addr learned my addr 172.21.15.96:0/2393921187 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-11-04T15:27:15.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.305+0000 7fe31bfff640 1 -- 172.21.15.96:0/2393921187 >> v1:172.21.15.96:6789/0 conn(0x7fe31c136110 legacy=0x7fe31c1364f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:15.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.305+0000 7fe31bfff640 1 -- 172.21.15.96:0/2393921187 >> v1:172.21.15.19:6789/0 conn(0x7fe31c0a63d0 legacy=0x7fe31c13f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:15.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.305+0000 7fe31a7fc640 1 -- 172.21.15.96:0/2393921187 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2637456386 0 0) 0x7fe31c0a51a0 con 0x7fe31c136110 2023-11-04T15:27:15.310 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.305+0000 7fe31bfff640 1 -- 172.21.15.96:0/2393921187 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31c0a5460 con 0x7fe31c140bc0 2023-11-04T15:27:15.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.306+0000 7fe31bfff640 1 --2- 172.21.15.96:0/2393921187 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe31c140bc0 0x7fe31c142fb0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe314009e80 tx=0x7fe31402beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74e0fb11e9848956 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:15.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.306+0000 7fe31a7fc640 1 -- 172.21.15.96:0/2393921187 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31402ca50 con 0x7fe31c140bc0 2023-11-04T15:27:15.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.306+0000 7fe31a7fc640 1 -- 172.21.15.96:0/2393921187 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31402cbb0 con 0x7fe31c140bc0 2023-11-04T15:27:15.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.306+0000 7fe31a7fc640 1 -- 172.21.15.96:0/2393921187 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3140343f0 con 0x7fe31c140bc0 2023-11-04T15:27:15.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.307+0000 7fe32205f640 1 -- 172.21.15.96:0/2393921187 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe31c140bc0 msgr2=0x7fe31c142fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:15.314 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.307+0000 7fe32205f640 1 --2- 172.21.15.96:0/2393921187 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe31c140bc0 0x7fe31c142fb0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe314009e80 tx=0x7fe31402beb0 comp rx=0 tx=0).stop 2023-11-04T15:27:15.314 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.307+0000 7fe32205f640 1 -- 172.21.15.96:0/2393921187 shutdown_connections 2023-11-04T15:27:15.314 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.307+0000 7fe32205f640 1 --2- 172.21.15.96:0/2393921187 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe31c140bc0 0x7fe31c142fb0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:15.314 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.307+0000 7fe32205f640 1 -- 172.21.15.96:0/2393921187 >> 172.21.15.96:0/2393921187 conn(0x7fe31c0ac3b0 msgr2=0x7fe31c0ac7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:15.314 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.307+0000 7fe32205f640 1 -- 172.21.15.96:0/2393921187 shutdown_connections 2023-11-04T15:27:15.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.307+0000 7fe32205f640 1 -- 172.21.15.96:0/2393921187 wait complete. 2023-11-04T15:27:15.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.308+0000 7fe32205f640 1 Processor -- start 2023-11-04T15:27:15.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.308+0000 7fe32205f640 1 -- start start 2023-11-04T15:27:15.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.308+0000 7fe32205f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe31c0a63d0 0x7fe31c1cee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:15.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.308+0000 7fe32205f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe31c136110 0x7fe31c1cf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:15.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.308+0000 7fe32205f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe31c140bc0 0x7fe31c1cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:15.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.308+0000 7fe32205f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c0985c0 con 0x7fe31c136110 2023-11-04T15:27:15.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.308+0000 7fe32205f640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c13e4d0 con 0x7fe31c140bc0 2023-11-04T15:27:15.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.308+0000 7fe32205f640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c098360 con 0x7fe31c0a63d0 2023-11-04T15:27:15.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.308+0000 7fe31b7fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe31c0a63d0 0x7fe31c1cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:15.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.308+0000 7fe31bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe31c140bc0 0x7fe31c1cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:15.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.308+0000 7fe31b7fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe31c0a63d0 0x7fe31c1cee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:40314/0 (socket says 172.21.15.96:40314) 2023-11-04T15:27:15.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.308+0000 7fe31b7fe640 1 -- 172.21.15.96:0/4236236400 learned_addr learned my addr 172.21.15.96:0/4236236400 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-11-04T15:27:15.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.308+0000 7fe31affd640 1 --2- 172.21.15.96:0/4236236400 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe31c136110 0x7fe31c1cf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:15.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.309+0000 7fe31bfff640 1 -- 172.21.15.96:0/4236236400 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe31c0a63d0 msgr2=0x7fe31c1cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:15.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.309+0000 7fe31bfff640 1 --2- 172.21.15.96:0/4236236400 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe31c0a63d0 0x7fe31c1cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:15.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.309+0000 7fe31bfff640 1 -- 172.21.15.96:0/4236236400 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe31c136110 msgr2=0x7fe31c1cf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:15.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.309+0000 7fe31bfff640 1 --2- 172.21.15.96:0/4236236400 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe31c136110 0x7fe31c1cf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:15.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.309+0000 7fe31bfff640 1 -- 172.21.15.96:0/4236236400 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe314009b30 con 0x7fe31c140bc0 2023-11-04T15:27:15.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.309+0000 7fe31b7fe640 1 --2- 172.21.15.96:0/4236236400 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe31c0a63d0 0x7fe31c1cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T15:27:15.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.309+0000 7fe31bfff640 1 --2- 172.21.15.96:0/4236236400 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe31c140bc0 0x7fe31c1cf8a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe314032000 tx=0x7fe314004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:15.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.309+0000 7fe303fff640 1 -- 172.21.15.96:0/4236236400 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31403e450 con 0x7fe31c140bc0 2023-11-04T15:27:15.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.309+0000 7fe303fff640 1 -- 172.21.15.96:0/4236236400 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31403e5b0 con 0x7fe31c140bc0 2023-11-04T15:27:15.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.309+0000 7fe303fff640 1 -- 172.21.15.96:0/4236236400 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31403e960 con 0x7fe31c140bc0 2023-11-04T15:27:15.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.309+0000 7fe32205f640 1 -- 172.21.15.96:0/4236236400 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe31c098870 con 0x7fe31c140bc0 2023-11-04T15:27:15.320 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.309+0000 7fe32205f640 1 -- 172.21.15.96:0/4236236400 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe31c098e10 con 0x7fe31c140bc0 2023-11-04T15:27:15.320 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.309+0000 7fe303fff640 1 -- 172.21.15.96:0/4236236400 <== mon.1 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe314048400 con 0x7fe31c140bc0 2023-11-04T15:27:15.320 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.309+0000 7fe303fff640 1 -- 172.21.15.96:0/4236236400 <== mon.1 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe31403edc0 con 0x7fe31c140bc0 2023-11-04T15:27:15.320 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.310+0000 7fe32205f640 1 -- 172.21.15.96:0/4236236400 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe31c067d60 con 0x7fe31c140bc0 2023-11-04T15:27:15.321 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.312+0000 7fe303fff640 1 -- 172.21.15.96:0/4236236400 <== mon.1 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fe314043020 con 0x7fe31c140bc0 2023-11-04T15:27:15.344 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-11-04T15:27:15.342+0000 7efe71842040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-04T15:27:15.346 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-11-04T15:27:15.344+0000 7fa97825c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-04T15:27:15.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.383+0000 7fe32205f640 1 -- 172.21.15.96:0/4236236400 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd new", "uuid": "34818469-ebf2-4dd4-8119-af19a0121036", "id": 0} v 0) v1 -- 0x7fe31c0a3ba0 con 0x7fe31c140bc0 2023-11-04T15:27:15.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.386+0000 7fe303fff640 1 -- 172.21.15.96:0/4236236400 <== mon.1 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "34818469-ebf2-4dd4-8119-af19a0121036", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe3140489b0 con 0x7fe31c140bc0 2023-11-04T15:27:15.388 INFO:teuthology.orchestra.run.smithi096.stdout:0 2023-11-04T15:27:15.390 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.387+0000 7fe32205f640 1 -- 172.21.15.96:0/4236236400 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe31c140bc0 msgr2=0x7fe31c1cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:15.390 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.387+0000 7fe32205f640 1 --2- 172.21.15.96:0/4236236400 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe31c140bc0 0x7fe31c1cf8a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe314032000 tx=0x7fe314004a40 comp rx=0 tx=0).stop 2023-11-04T15:27:15.390 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.387+0000 7fe32205f640 1 -- 172.21.15.96:0/4236236400 shutdown_connections 2023-11-04T15:27:15.390 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.387+0000 7fe32205f640 1 --2- 172.21.15.96:0/4236236400 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe31c140bc0 0x7fe31c1cf8a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:15.391 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.387+0000 7fe32205f640 1 --2- 172.21.15.96:0/4236236400 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe31c136110 0x7fe31c1cf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:15.391 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.387+0000 7fe32205f640 1 --2- 172.21.15.96:0/4236236400 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe31c0a63d0 0x7fe31c1cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:15.391 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.387+0000 7fe32205f640 1 -- 172.21.15.96:0/4236236400 >> 172.21.15.96:0/4236236400 conn(0x7fe31c0ac3b0 msgr2=0x7fe31c0a6c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:15.391 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.387+0000 7fe32205f640 1 -- 172.21.15.96:0/4236236400 shutdown_connections 2023-11-04T15:27:15.391 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.387+0000 7fe32205f640 1 -- 172.21.15.96:0/4236236400 wait complete. 2023-11-04T15:27:15.398 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-11-04T15:27:15.396+0000 7efe71842040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-04T15:27:15.399 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd new 92dab290-7912-4eea-b6f6-c754c2480721 1 2023-11-04T15:27:15.400 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-11-04T15:27:15.398+0000 7fa97825c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-04T15:27:15.498 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.496+0000 7f1a8f718640 1 Processor -- start 2023-11-04T15:27:15.498 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.496+0000 7f1a8f718640 1 -- start start 2023-11-04T15:27:15.504 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.497+0000 7f1a8f718640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1a88134110 0x7f1a880a1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:15.504 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.497+0000 7f1a8f718640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a880a2370 con 0x7f1a881344f0 2023-11-04T15:27:15.504 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.497+0000 7f1a8f718640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a88133a20 con 0x7f1a88137590 2023-11-04T15:27:15.504 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.497+0000 7f1a8f718640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a880a06f0 con 0x7f1a88134110 2023-11-04T15:27:15.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.497+0000 7f1a8dcb5640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f1a88137590 0x7f1a8813f1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:55880/0 (socket says 172.21.15.96:55880) 2023-11-04T15:27:15.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.497+0000 7f1a8dcb5640 1 -- 172.21.15.96:0/623326296 learned_addr learned my addr 172.21.15.96:0/623326296 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-11-04T15:27:15.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.497+0000 7f1a8d4b4640 1 --2- 172.21.15.96:0/623326296 >> v2:172.21.15.19:3300/0 conn(0x7f1a88134110 0x7f1a880a1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:15.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.497+0000 7f1a7ffff640 1 -- 172.21.15.96:0/623326296 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155308873 0 0) 0x7f1a88133a20 con 0x7f1a88137590 2023-11-04T15:27:15.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.497+0000 7f1a7ffff640 1 -- 172.21.15.96:0/623326296 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a74005730 con 0x7f1a88137590 2023-11-04T15:27:15.506 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.497+0000 7f1a7ffff640 1 -- 172.21.15.96:0/623326296 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 766683778 0 0) 0x7f1a880a2370 con 0x7f1a881344f0 2023-11-04T15:27:15.506 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.497+0000 7f1a7ffff640 1 -- 172.21.15.96:0/623326296 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a88133a20 con 0x7f1a881344f0 2023-11-04T15:27:15.506 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.497+0000 7f1a7ffff640 1 -- 172.21.15.96:0/623326296 <== mon.1 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2176024834 0 0) 0x7f1a74005730 con 0x7f1a88137590 2023-11-04T15:27:15.506 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.497+0000 7f1a7ffff640 1 -- 172.21.15.96:0/623326296 >> v2:172.21.15.19:3300/0 conn(0x7f1a88134110 msgr2=0x7f1a880a1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:15.506 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.497+0000 7f1a7ffff640 1 --2- 172.21.15.96:0/623326296 >> v2:172.21.15.19:3300/0 conn(0x7f1a88134110 0x7f1a880a1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:15.507 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.497+0000 7f1a7ffff640 1 -- 172.21.15.96:0/623326296 >> v1:172.21.15.19:6789/0 conn(0x7f1a881344f0 legacy=0x7f1a88136e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:15.507 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.497+0000 7f1a7ffff640 1 -- 172.21.15.96:0/623326296 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a880a31c0 con 0x7f1a88137590 2023-11-04T15:27:15.507 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.497+0000 7f1a7ffff640 1 -- 172.21.15.96:0/623326296 <== mon.1 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3646097784 0 0) 0x7f1a840019f0 con 0x7f1a88137590 2023-11-04T15:27:15.507 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.498+0000 7f1a7ffff640 1 -- 172.21.15.96:0/623326296 >> v1:172.21.15.96:6789/0 conn(0x7f1a88137590 legacy=0x7f1a8813f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:15.508 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.498+0000 7f1a7ffff640 1 --2- 172.21.15.96:0/623326296 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1a74005d10 0x7f1a740060f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:15.508 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.498+0000 7f1a7ffff640 1 --2- 172.21.15.96:0/623326296 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a740069d0 0x7f1a74006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:15.508 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.498+0000 7f1a7ffff640 1 --2- 172.21.15.96:0/623326296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a74007390 0x7f1a7400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:15.508 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.498+0000 7f1a7ffff640 1 -- 172.21.15.96:0/623326296 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a78001230 con 0x7f1a74007390 2023-11-04T15:27:15.508 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.498+0000 7f1a7ffff640 1 -- 172.21.15.96:0/623326296 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a880a06f0 con 0x7f1a740069d0 2023-11-04T15:27:15.509 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.498+0000 7f1a7ffff640 1 -- 172.21.15.96:0/623326296 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7400e360 con 0x7f1a74005d10 2023-11-04T15:27:15.509 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.498+0000 7f1a8d4b4640 1 --2- 172.21.15.96:0/623326296 >> v2:172.21.15.19:3300/0 conn(0x7f1a88134110 0x7f1a880a1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T15:27:15.509 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.498+0000 7f1a8ccb3640 1 --2- 172.21.15.96:0/623326296 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a740069d0 0x7f1a74006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:15.509 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.498+0000 7f1a8d4b4640 1 --2- 172.21.15.96:0/623326296 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1a74005d10 0x7f1a740060f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:15.509 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.498+0000 7f1a8dcb5640 1 --2- 172.21.15.96:0/623326296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a74007390 0x7f1a7400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:15.510 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.498+0000 7f1a8ccb3640 1 -- 172.21.15.96:0/623326296 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1a74005d10 msgr2=0x7f1a740060f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:15.510 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.498+0000 7f1a8ccb3640 1 --2- 172.21.15.96:0/623326296 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1a74005d10 0x7f1a740060f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:15.510 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.498+0000 7f1a8ccb3640 1 -- 172.21.15.96:0/623326296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a74007390 msgr2=0x7f1a7400db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:15.510 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.498+0000 7f1a8ccb3640 1 --2- 172.21.15.96:0/623326296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a74007390 0x7f1a7400db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:15.510 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.498+0000 7f1a8ccb3640 1 -- 172.21.15.96:0/623326296 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a74005730 con 0x7f1a740069d0 2023-11-04T15:27:15.511 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.498+0000 7f1a8dcb5640 1 --2- 172.21.15.96:0/623326296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a74007390 0x7f1a7400db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:27:15.511 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.498+0000 7f1a8dcb5640 1 -- 172.21.15.96:0/623326296 reap_dead start 2023-11-04T15:27:15.511 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.499+0000 7f1a8ccb3640 1 --2- 172.21.15.96:0/623326296 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a740069d0 0x7f1a74006e50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1a78007f00 tx=0x7f1a74007a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e44df07160950ffb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:15.511 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.499+0000 7f1a7ffff640 1 -- 172.21.15.96:0/623326296 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a78005270 con 0x7f1a740069d0 2023-11-04T15:27:15.511 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.499+0000 7f1a7ffff640 1 -- 172.21.15.96:0/623326296 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a780053f0 con 0x7f1a740069d0 2023-11-04T15:27:15.511 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.499+0000 7f1a7ffff640 1 -- 172.21.15.96:0/623326296 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7802c8c0 con 0x7f1a740069d0 2023-11-04T15:27:15.512 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.499+0000 7f1a8f718640 1 -- 172.21.15.96:0/623326296 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a740069d0 msgr2=0x7f1a74006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:15.512 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.499+0000 7f1a8f718640 1 --2- 172.21.15.96:0/623326296 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a740069d0 0x7f1a74006e50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1a78007f00 tx=0x7f1a74007a00 comp rx=0 tx=0).stop 2023-11-04T15:27:15.512 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.499+0000 7f1a8f718640 1 -- 172.21.15.96:0/623326296 shutdown_connections 2023-11-04T15:27:15.512 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.499+0000 7f1a8f718640 1 --2- 172.21.15.96:0/623326296 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a740069d0 0x7f1a74006e50 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:15.512 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.499+0000 7f1a8f718640 1 -- 172.21.15.96:0/623326296 >> 172.21.15.96:0/623326296 conn(0x7f1a880a90b0 msgr2=0x7f1a880a94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:15.513 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.499+0000 7f1a8f718640 1 -- 172.21.15.96:0/623326296 shutdown_connections 2023-11-04T15:27:15.513 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.499+0000 7f1a8f718640 1 -- 172.21.15.96:0/623326296 wait complete. 2023-11-04T15:27:15.513 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.500+0000 7f1a8f718640 1 Processor -- start 2023-11-04T15:27:15.513 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.500+0000 7f1a8f718640 1 -- start start 2023-11-04T15:27:15.513 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.501+0000 7f1a8f718640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a740069d0 0x7f1a881cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:15.514 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.501+0000 7f1a8f718640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a881cb1f0 0x7f1a881c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:15.514 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.501+0000 7f1a8f718640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1a881c77a0 0x7f1a881c7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:15.514 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.501+0000 7f1a8f718640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a88098fa0 con 0x7f1a740069d0 2023-11-04T15:27:15.514 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.501+0000 7f1a8f718640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a88134b00 con 0x7f1a881cb1f0 2023-11-04T15:27:15.514 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.501+0000 7f1a8f718640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a881c8160 con 0x7f1a881c77a0 2023-11-04T15:27:15.515 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.501+0000 7f1a8dcb5640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1a881c77a0 0x7f1a881c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:15.515 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.501+0000 7f1a8ccb3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a881cb1f0 0x7f1a881c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:15.515 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.501+0000 7f1a8dcb5640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1a881c77a0 0x7f1a881c7c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:40326/0 (socket says 172.21.15.96:40326) 2023-11-04T15:27:15.515 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.501+0000 7f1a8dcb5640 1 -- 172.21.15.96:0/2563049284 learned_addr learned my addr 172.21.15.96:0/2563049284 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-11-04T15:27:15.515 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.501+0000 7f1a8d4b4640 1 --2- 172.21.15.96:0/2563049284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a740069d0 0x7f1a881cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:15.516 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.501+0000 7f1a8ccb3640 1 -- 172.21.15.96:0/2563049284 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1a881c77a0 msgr2=0x7f1a881c7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:15.517 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.501+0000 7f1a8ccb3640 1 --2- 172.21.15.96:0/2563049284 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1a881c77a0 0x7f1a881c7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:15.517 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.501+0000 7f1a8ccb3640 1 -- 172.21.15.96:0/2563049284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a740069d0 msgr2=0x7f1a881cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:15.518 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.501+0000 7f1a8ccb3640 1 --2- 172.21.15.96:0/2563049284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a740069d0 0x7f1a881cacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:15.518 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.501+0000 7f1a8ccb3640 1 -- 172.21.15.96:0/2563049284 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a880989b0 con 0x7f1a881cb1f0 2023-11-04T15:27:15.518 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.501+0000 7f1a8ccb3640 1 --2- 172.21.15.96:0/2563049284 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a881cb1f0 0x7f1a881c7260 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400e330 tx=0x7f1a78001750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:15.518 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.501+0000 7f1a7dffb640 1 -- 172.21.15.96:0/2563049284 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7803c070 con 0x7f1a881cb1f0 2023-11-04T15:27:15.518 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.501+0000 7f1a7dffb640 1 -- 172.21.15.96:0/2563049284 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a78005280 con 0x7f1a881cb1f0 2023-11-04T15:27:15.519 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.501+0000 7f1a8f718640 1 -- 172.21.15.96:0/2563049284 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a88098ce0 con 0x7f1a881cb1f0 2023-11-04T15:27:15.519 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.501+0000 7f1a7dffb640 1 -- 172.21.15.96:0/2563049284 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a78003810 con 0x7f1a881cb1f0 2023-11-04T15:27:15.519 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.502+0000 7f1a8f718640 1 -- 172.21.15.96:0/2563049284 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a88099490 con 0x7f1a881cb1f0 2023-11-04T15:27:15.519 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.502+0000 7f1a7dffb640 1 -- 172.21.15.96:0/2563049284 <== mon.1 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1a78032070 con 0x7f1a881cb1f0 2023-11-04T15:27:15.519 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.502+0000 7f1a7dffb640 1 -- 172.21.15.96:0/2563049284 <== mon.1 v2:172.21.15.96:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f1a78035870 con 0x7f1a881cb1f0 2023-11-04T15:27:15.520 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.502+0000 7f1a8f718640 1 -- 172.21.15.96:0/2563049284 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a88067d60 con 0x7f1a881cb1f0 2023-11-04T15:27:15.520 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.504+0000 7f1a7dffb640 1 -- 172.21.15.96:0/2563049284 <== mon.1 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f1a78062b10 con 0x7f1a881cb1f0 2023-11-04T15:27:15.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.576+0000 7f1a8f718640 1 -- 172.21.15.96:0/2563049284 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd new", "uuid": "92dab290-7912-4eea-b6f6-c754c2480721", "id": 1} v 0) v1 -- 0x7f1a880a0ab0 con 0x7f1a881cb1f0 2023-11-04T15:27:15.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.581+0000 7f1a7dffb640 1 -- 172.21.15.96:0/2563049284 <== mon.1 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "92dab290-7912-4eea-b6f6-c754c2480721", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1a78051070 con 0x7f1a881cb1f0 2023-11-04T15:27:15.583 INFO:teuthology.orchestra.run.smithi096.stdout:1 2023-11-04T15:27:15.584 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.582+0000 7f1a8f718640 1 -- 172.21.15.96:0/2563049284 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a881cb1f0 msgr2=0x7f1a881c7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:15.585 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.582+0000 7f1a8f718640 1 --2- 172.21.15.96:0/2563049284 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a881cb1f0 0x7f1a881c7260 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400e330 tx=0x7f1a78001750 comp rx=0 tx=0).stop 2023-11-04T15:27:15.585 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.582+0000 7f1a8f718640 1 -- 172.21.15.96:0/2563049284 shutdown_connections 2023-11-04T15:27:15.585 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.582+0000 7f1a8f718640 1 --2- 172.21.15.96:0/2563049284 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1a881c77a0 0x7f1a881c7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:15.585 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.582+0000 7f1a8f718640 1 --2- 172.21.15.96:0/2563049284 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a881cb1f0 0x7f1a881c7260 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:15.585 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.582+0000 7f1a8f718640 1 --2- 172.21.15.96:0/2563049284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a740069d0 0x7f1a881cacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:15.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.582+0000 7f1a8f718640 1 -- 172.21.15.96:0/2563049284 >> 172.21.15.96:0/2563049284 conn(0x7f1a880a90b0 msgr2=0x7f1a881319f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:15.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.582+0000 7f1a8f718640 1 -- 172.21.15.96:0/2563049284 shutdown_connections 2023-11-04T15:27:15.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.582+0000 7f1a8f718640 1 -- 172.21.15.96:0/2563049284 wait complete. 2023-11-04T15:27:15.594 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd new 1be47db4-6dd1-4ce5-832b-bc6ad30c78c3 2 2023-11-04T15:27:15.693 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.690+0000 7fbd0485f640 1 Processor -- start 2023-11-04T15:27:15.694 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.691+0000 7fbd0485f640 1 -- start start 2023-11-04T15:27:15.694 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.691+0000 7fbd0485f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbd00139720 0x7fbd0006e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:15.694 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.691+0000 7fbd0485f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbd00139b00 0x7fbd00098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:15.694 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.691+0000 7fbd0485f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbd00098f50 0x7fbd000993c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:15.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.691+0000 7fbd0485f640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd0009a4f0 con 0x7fbd00098f50 2023-11-04T15:27:15.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.691+0000 7fbd0485f640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd00139f60 con 0x7fbd00139b00 2023-11-04T15:27:15.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.691+0000 7fbd0485f640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0006e8e0 con 0x7fbd00139720 2023-11-04T15:27:15.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.691+0000 7fbcfdd9b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbd00139b00 0x7fbd00098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:15.696 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.691+0000 7fbcfe59c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbd00139720 0x7fbd0006e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:15.696 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.691+0000 7fbcfdd9b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbd00139b00 0x7fbd00098a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39634/0 (socket says 172.21.15.96:39634) 2023-11-04T15:27:15.696 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.691+0000 7fbcfdd9b640 1 -- 172.21.15.96:0/4170313800 learned_addr learned my addr 172.21.15.96:0/4170313800 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-11-04T15:27:15.696 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.691+0000 7fbcfed9d640 1 --2- 172.21.15.96:0/4170313800 >> v2:172.21.15.19:3300/0 conn(0x7fbd00098f50 0x7fbd000993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:15.696 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.692+0000 7fbcfdd9b640 1 -- 172.21.15.96:0/4170313800 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbd00139720 msgr2=0x7fbd0006e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:15.697 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.692+0000 7fbcfdd9b640 1 --2- 172.21.15.96:0/4170313800 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbd00139720 0x7fbd0006e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:15.697 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.692+0000 7fbcfdd9b640 1 -- 172.21.15.96:0/4170313800 >> v2:172.21.15.19:3300/0 conn(0x7fbd00098f50 msgr2=0x7fbd000993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:15.697 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.692+0000 7fbcfdd9b640 1 --2- 172.21.15.96:0/4170313800 >> v2:172.21.15.19:3300/0 conn(0x7fbd00098f50 0x7fbd000993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:15.697 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.692+0000 7fbcfdd9b640 1 -- 172.21.15.96:0/4170313800 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd00065a00 con 0x7fbd00139b00 2023-11-04T15:27:15.701 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.692+0000 7fbcfdd9b640 1 --2- 172.21.15.96:0/4170313800 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd00139b00 0x7fbd00098a10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbd0009b4a0 tx=0x7fbcf002b7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=904d2ac133317e59 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:15.701 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.692+0000 7fbcfd59a640 1 -- 172.21.15.96:0/4170313800 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0031750 con 0x7fbd00139b00 2023-11-04T15:27:15.701 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.693+0000 7fbcfd59a640 1 -- 172.21.15.96:0/4170313800 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf00318b0 con 0x7fbd00139b00 2023-11-04T15:27:15.701 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.693+0000 7fbcfd59a640 1 -- 172.21.15.96:0/4170313800 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0031c40 con 0x7fbd00139b00 2023-11-04T15:27:15.701 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.693+0000 7fbd0485f640 1 -- 172.21.15.96:0/4170313800 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd00139b00 msgr2=0x7fbd00098a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:15.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.693+0000 7fbd0485f640 1 --2- 172.21.15.96:0/4170313800 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd00139b00 0x7fbd00098a10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbd0009b4a0 tx=0x7fbcf002b7f0 comp rx=0 tx=0).stop 2023-11-04T15:27:15.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.693+0000 7fbd0485f640 1 -- 172.21.15.96:0/4170313800 shutdown_connections 2023-11-04T15:27:15.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.693+0000 7fbd0485f640 1 --2- 172.21.15.96:0/4170313800 >> v2:172.21.15.19:3300/0 conn(0x7fbd00098f50 0x7fbd000993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:15.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.693+0000 7fbd0485f640 1 --2- 172.21.15.96:0/4170313800 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd00139b00 0x7fbd00098a10 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:15.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.693+0000 7fbd0485f640 1 --2- 172.21.15.96:0/4170313800 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbd00139720 0x7fbd0006e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:15.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.693+0000 7fbd0485f640 1 -- 172.21.15.96:0/4170313800 >> 172.21.15.96:0/4170313800 conn(0x7fbd000a8920 msgr2=0x7fbd000a8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:15.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.693+0000 7fbd0485f640 1 -- 172.21.15.96:0/4170313800 shutdown_connections 2023-11-04T15:27:15.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.693+0000 7fbd0485f640 1 -- 172.21.15.96:0/4170313800 wait complete. 2023-11-04T15:27:15.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.694+0000 7fbd0485f640 1 Processor -- start 2023-11-04T15:27:15.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.694+0000 7fbd0485f640 1 -- start start 2023-11-04T15:27:15.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.695+0000 7fbd0485f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd00098f50 0x7fbd001cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:15.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.695+0000 7fbd0485f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbd00139720 0x7fbd001cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:15.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.695+0000 7fbd0485f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd00139b00 0x7fbd001cec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:15.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.695+0000 7fbd0485f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd001cb630 con 0x7fbd00139b00 2023-11-04T15:27:15.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.695+0000 7fbd0485f640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd00135f40 con 0x7fbd00098f50 2023-11-04T15:27:15.705 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.695+0000 7fbd0485f640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd001cb820 con 0x7fbd00139720 2023-11-04T15:27:15.705 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.695+0000 7fbcfdd9b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbd00139720 0x7fbd001cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:15.705 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.695+0000 7fbcfe59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd00098f50 0x7fbd001cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:15.705 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.695+0000 7fbcfdd9b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbd00139720 0x7fbd001cc190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:40332/0 (socket says 172.21.15.96:40332) 2023-11-04T15:27:15.705 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.695+0000 7fbcfdd9b640 1 -- 172.21.15.96:0/2559231040 learned_addr learned my addr 172.21.15.96:0/2559231040 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-11-04T15:27:15.706 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.695+0000 7fbcfe59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd00098f50 0x7fbd001cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39648/0 (socket says 172.21.15.96:39648) 2023-11-04T15:27:15.706 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.695+0000 7fbcfed9d640 1 --2- 172.21.15.96:0/2559231040 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd00139b00 0x7fbd001cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:15.706 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.695+0000 7fbcfe59c640 1 -- 172.21.15.96:0/2559231040 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbd00139720 msgr2=0x7fbd001cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:15.706 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.695+0000 7fbcfe59c640 1 --2- 172.21.15.96:0/2559231040 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbd00139720 0x7fbd001cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:15.706 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.695+0000 7fbcfe59c640 1 -- 172.21.15.96:0/2559231040 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd00139b00 msgr2=0x7fbd001cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:15.707 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.695+0000 7fbcfe59c640 1 --2- 172.21.15.96:0/2559231040 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd00139b00 0x7fbd001cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:15.707 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.695+0000 7fbcfe59c640 1 -- 172.21.15.96:0/2559231040 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf00094d0 con 0x7fbd00098f50 2023-11-04T15:27:15.707 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.695+0000 7fbcfdd9b640 1 --2- 172.21.15.96:0/2559231040 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbd00139720 0x7fbd001cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T15:27:15.707 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.695+0000 7fbcfe59c640 1 --2- 172.21.15.96:0/2559231040 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd00098f50 0x7fbd001cbc50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbcf400e850 tx=0x7fbcf400ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:15.707 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.695+0000 7fbceeffd640 1 -- 172.21.15.96:0/2559231040 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf40095b0 con 0x7fbd00098f50 2023-11-04T15:27:15.707 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.696+0000 7fbceeffd640 1 -- 172.21.15.96:0/2559231040 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf400c940 con 0x7fbd00098f50 2023-11-04T15:27:15.708 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.696+0000 7fbd0485f640 1 -- 172.21.15.96:0/2559231040 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd000a54b0 con 0x7fbd00098f50 2023-11-04T15:27:15.708 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.696+0000 7fbceeffd640 1 -- 172.21.15.96:0/2559231040 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf400ccd0 con 0x7fbd00098f50 2023-11-04T15:27:15.708 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.696+0000 7fbd0485f640 1 -- 172.21.15.96:0/2559231040 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd00120b60 con 0x7fbd00098f50 2023-11-04T15:27:15.708 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.696+0000 7fbceeffd640 1 -- 172.21.15.96:0/2559231040 <== mon.1 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbcf4013770 con 0x7fbd00098f50 2023-11-04T15:27:15.708 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.696+0000 7fbceeffd640 1 -- 172.21.15.96:0/2559231040 <== mon.1 v2:172.21.15.96:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fbcf401cbe0 con 0x7fbd00098f50 2023-11-04T15:27:15.709 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.696+0000 7fbd0485f640 1 -- 172.21.15.96:0/2559231040 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd00067d60 con 0x7fbd00098f50 2023-11-04T15:27:15.709 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.698+0000 7fbceeffd640 1 -- 172.21.15.96:0/2559231040 <== mon.1 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fbcf4021060 con 0x7fbd00098f50 2023-11-04T15:27:15.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.770+0000 7fbd0485f640 1 -- 172.21.15.96:0/2559231040 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1be47db4-6dd1-4ce5-832b-bc6ad30c78c3", "id": 2} v 0) v1 -- 0x7fbd0009a6e0 con 0x7fbd00098f50 2023-11-04T15:27:15.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.778+0000 7fbceeffd640 1 -- 172.21.15.96:0/2559231040 <== mon.1 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1be47db4-6dd1-4ce5-832b-bc6ad30c78c3", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbcf4017070 con 0x7fbd00098f50 2023-11-04T15:27:15.780 INFO:teuthology.orchestra.run.smithi096.stdout:2 2023-11-04T15:27:15.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.779+0000 7fbd0485f640 1 -- 172.21.15.96:0/2559231040 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd00098f50 msgr2=0x7fbd001cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:15.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.779+0000 7fbd0485f640 1 --2- 172.21.15.96:0/2559231040 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd00098f50 0x7fbd001cbc50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbcf400e850 tx=0x7fbcf400ed10 comp rx=0 tx=0).stop 2023-11-04T15:27:15.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.779+0000 7fbd0485f640 1 -- 172.21.15.96:0/2559231040 shutdown_connections 2023-11-04T15:27:15.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.779+0000 7fbd0485f640 1 --2- 172.21.15.96:0/2559231040 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd00139b00 0x7fbd001cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:15.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.779+0000 7fbd0485f640 1 --2- 172.21.15.96:0/2559231040 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbd00139720 0x7fbd001cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:15.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.779+0000 7fbd0485f640 1 --2- 172.21.15.96:0/2559231040 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd00098f50 0x7fbd001cbc50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:15.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.779+0000 7fbd0485f640 1 -- 172.21.15.96:0/2559231040 >> 172.21.15.96:0/2559231040 conn(0x7fbd000a8920 msgr2=0x7fbd0006fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:15.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.779+0000 7fbd0485f640 1 -- 172.21.15.96:0/2559231040 shutdown_connections 2023-11-04T15:27:15.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.779+0000 7fbd0485f640 1 -- 172.21.15.96:0/2559231040 wait complete. 2023-11-04T15:27:15.791 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd new 46505800-d64f-49ef-b811-5b5979f48252 3 2023-11-04T15:27:15.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.889+0000 7f074fc1a640 1 Processor -- start 2023-11-04T15:27:15.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.889+0000 7f074fc1a640 1 -- start start 2023-11-04T15:27:15.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.889+0000 7f074fc1a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0748133ba0 0x7f0748133f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:15.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.889+0000 7f074fc1a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f07481344c0 0x7f0748099b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:15.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.889+0000 7f074fc1a640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0748070b50 con 0x7f074809a060 2023-11-04T15:27:15.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.889+0000 7f074fc1a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f074806f9d0 con 0x7f0748133ba0 2023-11-04T15:27:15.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.889+0000 7f074fc1a640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f074806ff70 con 0x7f07481344c0 2023-11-04T15:27:15.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.890+0000 7f074d1b5640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f07481344c0 0x7f0748099b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:15.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.890+0000 7f074d1b5640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f07481344c0 0x7f0748099b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39662/0 (socket says 172.21.15.96:39662) 2023-11-04T15:27:15.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.890+0000 7f074d1b5640 1 -- 172.21.15.96:0/3872129474 learned_addr learned my addr 172.21.15.96:0/3872129474 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-11-04T15:27:15.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.890+0000 7f074d9b6640 1 --2- 172.21.15.96:0/3872129474 >> v2:172.21.15.19:3300/0 conn(0x7f0748133ba0 0x7f0748133f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:15.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.890+0000 7f074d1b5640 1 -- 172.21.15.96:0/3872129474 >> v2:172.21.15.19:3300/0 conn(0x7f0748133ba0 msgr2=0x7f0748133f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:15.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.890+0000 7f074d1b5640 1 --2- 172.21.15.96:0/3872129474 >> v2:172.21.15.19:3300/0 conn(0x7f0748133ba0 0x7f0748133f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:15.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.890+0000 7f074d1b5640 1 -- 172.21.15.96:0/3872129474 >> v1:172.21.15.19:6789/0 conn(0x7f074809a060 legacy=0x7f074813e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:15.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.890+0000 7f074d1b5640 1 -- 172.21.15.96:0/3872129474 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074806f770 con 0x7f07481344c0 2023-11-04T15:27:15.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.891+0000 7f074d1b5640 1 --2- 172.21.15.96:0/3872129474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07481344c0 0x7f0748099b20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f07480a99b0 tx=0x7f073802b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dac2c03ce4ae3984 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:15.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.891+0000 7f074c9b4640 1 -- 172.21.15.96:0/3872129474 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07380317e0 con 0x7f07481344c0 2023-11-04T15:27:15.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.891+0000 7f074c9b4640 1 -- 172.21.15.96:0/3872129474 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0738031940 con 0x7f07481344c0 2023-11-04T15:27:15.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.891+0000 7f074c9b4640 1 -- 172.21.15.96:0/3872129474 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0738031cd0 con 0x7f07481344c0 2023-11-04T15:27:15.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.891+0000 7f074fc1a640 1 -- 172.21.15.96:0/3872129474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07481344c0 msgr2=0x7f0748099b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:15.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.891+0000 7f074fc1a640 1 --2- 172.21.15.96:0/3872129474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07481344c0 0x7f0748099b20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f07480a99b0 tx=0x7f073802b880 comp rx=0 tx=0).stop 2023-11-04T15:27:15.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.891+0000 7f074fc1a640 1 -- 172.21.15.96:0/3872129474 shutdown_connections 2023-11-04T15:27:15.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.891+0000 7f074fc1a640 1 --2- 172.21.15.96:0/3872129474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07481344c0 0x7f0748099b20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:15.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.891+0000 7f074fc1a640 1 --2- 172.21.15.96:0/3872129474 >> v2:172.21.15.19:3300/0 conn(0x7f0748133ba0 0x7f0748133f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:15.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.891+0000 7f074fc1a640 1 -- 172.21.15.96:0/3872129474 >> 172.21.15.96:0/3872129474 conn(0x7f07480a8920 msgr2=0x7f07480a8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:15.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.892+0000 7f074fc1a640 1 -- 172.21.15.96:0/3872129474 shutdown_connections 2023-11-04T15:27:15.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.892+0000 7f074fc1a640 1 -- 172.21.15.96:0/3872129474 wait complete. 2023-11-04T15:27:15.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.893+0000 7f074fc1a640 1 Processor -- start 2023-11-04T15:27:15.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.893+0000 7f074fc1a640 1 -- start start 2023-11-04T15:27:15.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.894+0000 7f074fc1a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f074809a060 0x7f07481303d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:15.902 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.894+0000 7f074fc1a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0748133ba0 0x7f0748130910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:15.902 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.894+0000 7f074fc1a640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f07481344c0 0x7f074809c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:15.902 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.894+0000 7f074fc1a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074809d730 con 0x7f0748133ba0 2023-11-04T15:27:15.902 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.894+0000 7f074fc1a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074809f460 con 0x7f074809a060 2023-11-04T15:27:15.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.894+0000 7f074fc1a640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074809e100 con 0x7f07481344c0 2023-11-04T15:27:15.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.894+0000 7f074d9b6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f074809a060 0x7f07481303d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:15.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.894+0000 7f074d9b6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f074809a060 0x7f07481303d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39678/0 (socket says 172.21.15.96:39678) 2023-11-04T15:27:15.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.894+0000 7f074d9b6640 1 -- 172.21.15.96:0/517414987 learned_addr learned my addr 172.21.15.96:0/517414987 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-11-04T15:27:15.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.894+0000 7f074e1b7640 1 --2- 172.21.15.96:0/517414987 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f07481344c0 0x7f074809c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:15.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.894+0000 7f074d1b5640 1 --2- 172.21.15.96:0/517414987 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0748133ba0 0x7f0748130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:15.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.894+0000 7f074d9b6640 1 -- 172.21.15.96:0/517414987 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f07481344c0 msgr2=0x7f074809c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:15.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.894+0000 7f074d9b6640 1 --2- 172.21.15.96:0/517414987 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f07481344c0 0x7f074809c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:15.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.894+0000 7f074d9b6640 1 -- 172.21.15.96:0/517414987 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0748133ba0 msgr2=0x7f0748130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:15.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.894+0000 7f074d9b6640 1 --2- 172.21.15.96:0/517414987 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0748133ba0 0x7f0748130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:15.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.894+0000 7f074d9b6640 1 -- 172.21.15.96:0/517414987 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07380094d0 con 0x7f074809a060 2023-11-04T15:27:15.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.894+0000 7f074d9b6640 1 --2- 172.21.15.96:0/517414987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f074809a060 0x7f07481303d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f074400e9b0 tx=0x7f074400ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:15.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.894+0000 7f073e7fc640 1 -- 172.21.15.96:0/517414987 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0744009670 con 0x7f074809a060 2023-11-04T15:27:15.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.895+0000 7f073e7fc640 1 -- 172.21.15.96:0/517414987 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074400c9a0 con 0x7f074809a060 2023-11-04T15:27:15.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.895+0000 7f073e7fc640 1 -- 172.21.15.96:0/517414987 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074400cd50 con 0x7f074809a060 2023-11-04T15:27:15.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.895+0000 7f074fc1a640 1 -- 172.21.15.96:0/517414987 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07480a6100 con 0x7f074809a060 2023-11-04T15:27:15.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.895+0000 7f074fc1a640 1 -- 172.21.15.96:0/517414987 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07480a5bf0 con 0x7f074809a060 2023-11-04T15:27:15.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.895+0000 7f073e7fc640 1 -- 172.21.15.96:0/517414987 <== mon.1 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0744005c90 con 0x7f074809a060 2023-11-04T15:27:15.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.895+0000 7f073e7fc640 1 -- 172.21.15.96:0/517414987 <== mon.1 v2:172.21.15.96:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f0744013900 con 0x7f074809a060 2023-11-04T15:27:15.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.895+0000 7f074fc1a640 1 -- 172.21.15.96:0/517414987 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0748067d60 con 0x7f074809a060 2023-11-04T15:27:15.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.897+0000 7f073e7fc640 1 -- 172.21.15.96:0/517414987 <== mon.1 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f0744021060 con 0x7f074809a060 2023-11-04T15:27:15.959 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-11-04T15:27:15.957+0000 7efe71842040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-04T15:27:15.970 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.969+0000 7f074fc1a640 1 -- 172.21.15.96:0/517414987 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd new", "uuid": "46505800-d64f-49ef-b811-5b5979f48252", "id": 3} v 0) v1 -- 0x7f0748131220 con 0x7f074809a060 2023-11-04T15:27:15.975 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-11-04T15:27:15.973+0000 7fa97825c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-04T15:27:15.978 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.976+0000 7f073e7fc640 1 -- 172.21.15.96:0/517414987 <== mon.1 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "46505800-d64f-49ef-b811-5b5979f48252", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f074402a0b0 con 0x7f074809a060 2023-11-04T15:27:15.978 INFO:teuthology.orchestra.run.smithi096.stdout:3 2023-11-04T15:27:15.979 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.977+0000 7f074fc1a640 1 -- 172.21.15.96:0/517414987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f074809a060 msgr2=0x7f07481303d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:15.980 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.977+0000 7f074fc1a640 1 --2- 172.21.15.96:0/517414987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f074809a060 0x7f07481303d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f074400e9b0 tx=0x7f074400ee70 comp rx=0 tx=0).stop 2023-11-04T15:27:15.980 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.977+0000 7f074fc1a640 1 -- 172.21.15.96:0/517414987 shutdown_connections 2023-11-04T15:27:15.980 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.977+0000 7f074fc1a640 1 --2- 172.21.15.96:0/517414987 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f07481344c0 0x7f074809c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:15.980 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.977+0000 7f074fc1a640 1 --2- 172.21.15.96:0/517414987 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0748133ba0 0x7f0748130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:15.981 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.977+0000 7f074fc1a640 1 --2- 172.21.15.96:0/517414987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f074809a060 0x7f07481303d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:15.981 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.977+0000 7f074fc1a640 1 -- 172.21.15.96:0/517414987 >> 172.21.15.96:0/517414987 conn(0x7f07480a8920 msgr2=0x7f07480a6790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:15.981 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.977+0000 7f074fc1a640 1 -- 172.21.15.96:0/517414987 shutdown_connections 2023-11-04T15:27:15.981 INFO:teuthology.orchestra.run.smithi096.stderr:2023-11-04T15:27:15.977+0000 7f074fc1a640 1 -- 172.21.15.96:0/517414987 wait complete. 2023-11-04T15:27:15.989 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-04T15:27:15.990 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-04T15:27:15.992 INFO:tasks.ceph.osd.0:Started 2023-11-04T15:27:15.992 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-04T15:27:15.993 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-04T15:27:15.995 INFO:tasks.ceph.osd.1:Started 2023-11-04T15:27:15.995 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-04T15:27:15.996 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-04T15:27:15.998 INFO:tasks.ceph.osd.2:Started 2023-11-04T15:27:15.998 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-04T15:27:15.999 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-04T15:27:16.001 INFO:tasks.ceph.osd.3:Started 2023-11-04T15:27:16.001 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T15:27:16.015 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-11-04T15:27:16.013+0000 7efe71842040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-04T15:27:16.031 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-11-04T15:27:16.029+0000 7fa97825c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-04T15:27:16.066 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-11-04T15:27:16.064+0000 7efe71842040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-04T15:27:16.080 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-11-04T15:27:16.078+0000 7fa97825c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-04T15:27:16.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.109+0000 7ff06d18e640 1 Processor -- start 2023-11-04T15:27:16.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.109+0000 7ff06d18e640 1 -- start start 2023-11-04T15:27:16.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.110+0000 7ff06d18e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff068070f90 0x7ff0681355a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:16.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.110+0000 7ff06d18e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff0681386b0 0x7ff068140330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:16.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.110+0000 7ff06d18e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff068134a80 con 0x7ff0681351c0 2023-11-04T15:27:16.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.110+0000 7ff06d18e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff068071390 con 0x7ff0681386b0 2023-11-04T15:27:16.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.110+0000 7ff06d18e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff068071860 con 0x7ff068070f90 2023-11-04T15:27:16.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.110+0000 7ff066d9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff0681351c0 0x7ff068137fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39900/0 (socket says 172.21.15.19:39900) 2023-11-04T15:27:16.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.110+0000 7ff066d9d640 1 -- 172.21.15.19:0/3712174514 learned_addr learned my addr 172.21.15.19:0/3712174514 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:16.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.110+0000 7ff06759e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff0681386b0 0x7ff068140330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:16.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.110+0000 7ff06659c640 1 --2- 172.21.15.19:0/3712174514 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff068070f90 0x7ff0681355a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:16.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.110+0000 7ff065d9b640 1 -- 172.21.15.19:0/3712174514 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 737550425 0 0) 0x7ff068134a80 con 0x7ff0681351c0 2023-11-04T15:27:16.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.110+0000 7ff065d9b640 1 -- 172.21.15.19:0/3712174514 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff050003520 con 0x7ff0681351c0 2023-11-04T15:27:16.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.110+0000 7ff06759e640 1 -- 172.21.15.19:0/3712174514 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff068070f90 msgr2=0x7ff0681355a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:16.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.110+0000 7ff06759e640 1 --2- 172.21.15.19:0/3712174514 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff068070f90 0x7ff0681355a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:16.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.110+0000 7ff06759e640 1 -- 172.21.15.19:0/3712174514 >> v1:172.21.15.19:6789/0 conn(0x7ff0681351c0 legacy=0x7ff068137fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:16.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.110+0000 7ff06759e640 1 -- 172.21.15.19:0/3712174514 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff068134ce0 con 0x7ff0681386b0 2023-11-04T15:27:16.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.111+0000 7ff06759e640 1 --2- 172.21.15.19:0/3712174514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0681386b0 0x7ff068140330 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff068134c10 tx=0x7ff06002bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b45f62b8f31b84a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:16.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.111+0000 7ff065d9b640 1 -- 172.21.15.19:0/3712174514 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06002cb20 con 0x7ff0681386b0 2023-11-04T15:27:16.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.111+0000 7ff065d9b640 1 -- 172.21.15.19:0/3712174514 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06002cc80 con 0x7ff0681386b0 2023-11-04T15:27:16.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.111+0000 7ff065d9b640 1 -- 172.21.15.19:0/3712174514 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff060034440 con 0x7ff0681386b0 2023-11-04T15:27:16.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.112+0000 7ff06d18e640 1 -- 172.21.15.19:0/3712174514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0681386b0 msgr2=0x7ff068140330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:16.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.112+0000 7ff06d18e640 1 --2- 172.21.15.19:0/3712174514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0681386b0 0x7ff068140330 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff068134c10 tx=0x7ff06002bd70 comp rx=0 tx=0).stop 2023-11-04T15:27:16.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.112+0000 7ff06d18e640 1 -- 172.21.15.19:0/3712174514 shutdown_connections 2023-11-04T15:27:16.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.112+0000 7ff06d18e640 1 --2- 172.21.15.19:0/3712174514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0681386b0 0x7ff068140330 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:16.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.112+0000 7ff06d18e640 1 --2- 172.21.15.19:0/3712174514 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff068070f90 0x7ff0681355a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:16.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.112+0000 7ff06d18e640 1 -- 172.21.15.19:0/3712174514 >> 172.21.15.19:0/3712174514 conn(0x7ff0680aa2c0 msgr2=0x7ff0680aa6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:16.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.112+0000 7ff06d18e640 1 -- 172.21.15.19:0/3712174514 shutdown_connections 2023-11-04T15:27:16.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.112+0000 7ff06d18e640 1 -- 172.21.15.19:0/3712174514 wait complete. 2023-11-04T15:27:16.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.113+0000 7ff06d18e640 1 Processor -- start 2023-11-04T15:27:16.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.113+0000 7ff06d18e640 1 -- start start 2023-11-04T15:27:16.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.114+0000 7ff06d18e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff068070f90 0x7ff068133bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:16.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.114+0000 7ff06d18e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff0681351c0 0x7ff0681340f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:16.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.114+0000 7ff06d18e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0681386b0 0x7ff0681cf030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:16.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.114+0000 7ff06d18e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0681cbac0 con 0x7ff068070f90 2023-11-04T15:27:16.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.114+0000 7ff06d18e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06809e000 con 0x7ff0681386b0 2023-11-04T15:27:16.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.114+0000 7ff06d18e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff06809c7f0 con 0x7ff0681351c0 2023-11-04T15:27:16.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.114+0000 7ff066d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff068070f90 0x7ff068133bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:16.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.114+0000 7ff066d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff068070f90 0x7ff068133bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46258/0 (socket says 172.21.15.19:46258) 2023-11-04T15:27:16.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.114+0000 7ff066d9d640 1 -- 172.21.15.19:0/1648818965 learned_addr learned my addr 172.21.15.19:0/1648818965 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:16.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.114+0000 7ff06659c640 1 --2- 172.21.15.19:0/1648818965 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff0681351c0 0x7ff0681340f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:16.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.114+0000 7ff06759e640 1 --2- 172.21.15.19:0/1648818965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0681386b0 0x7ff0681cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:16.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.114+0000 7ff066d9d640 1 -- 172.21.15.19:0/1648818965 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff0681351c0 msgr2=0x7ff0681340f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:16.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.114+0000 7ff066d9d640 1 --2- 172.21.15.19:0/1648818965 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff0681351c0 0x7ff0681340f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:16.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.114+0000 7ff066d9d640 1 -- 172.21.15.19:0/1648818965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0681386b0 msgr2=0x7ff0681cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:16.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.114+0000 7ff066d9d640 1 --2- 172.21.15.19:0/1648818965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0681386b0 0x7ff0681cf030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:16.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.114+0000 7ff066d9d640 1 -- 172.21.15.19:0/1648818965 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff060009a70 con 0x7ff068070f90 2023-11-04T15:27:16.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.114+0000 7ff066d9d640 1 --2- 172.21.15.19:0/1648818965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff068070f90 0x7ff068133bb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff05c00c410 tx=0x7ff05c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:16.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.114+0000 7ff04f7fe640 1 -- 172.21.15.19:0/1648818965 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05c005ce0 con 0x7ff068070f90 2023-11-04T15:27:16.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.114+0000 7ff04f7fe640 1 -- 172.21.15.19:0/1648818965 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05c005e40 con 0x7ff068070f90 2023-11-04T15:27:16.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.114+0000 7ff04f7fe640 1 -- 172.21.15.19:0/1648818965 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05c0072f0 con 0x7ff068070f90 2023-11-04T15:27:16.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.114+0000 7ff06d18e640 1 -- 172.21.15.19:0/1648818965 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0680a08b0 con 0x7ff068070f90 2023-11-04T15:27:16.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.114+0000 7ff06d18e640 1 -- 172.21.15.19:0/1648818965 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff06809ca20 con 0x7ff068070f90 2023-11-04T15:27:16.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.115+0000 7ff04f7fe640 1 -- 172.21.15.19:0/1648818965 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff05c01c440 con 0x7ff068070f90 2023-11-04T15:27:16.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.115+0000 7ff04f7fe640 1 -- 172.21.15.19:0/1648818965 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7ff05c0129b0 con 0x7ff068070f90 2023-11-04T15:27:16.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.115+0000 7ff06d18e640 1 -- 172.21.15.19:0/1648818965 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff06809ce90 con 0x7ff068070f90 2023-11-04T15:27:16.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.118+0000 7ff04f7fe640 1 -- 172.21.15.19:0/1648818965 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7ff05c017070 con 0x7ff068070f90 2023-11-04T15:27:16.127 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-11-04T15:27:16.125+0000 7efe71842040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-04T15:27:16.134 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-11-04T15:27:16.132+0000 7fa97825c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-04T15:27:16.171 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-11-04T15:27:16.170+0000 7efe71842040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-04T15:27:16.176 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-11-04T15:27:16.174+0000 7fa97825c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-04T15:27:16.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.179+0000 7ff06d18e640 1 -- 172.21.15.19:0/1648818965 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0680a0340 con 0x7ff068070f90 2023-11-04T15:27:16.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.179+0000 7ff04f7fe640 1 -- 172.21.15.19:0/1648818965 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4152 (secure 0 0 0) 0x7ff05c012cd0 con 0x7ff068070f90 2023-11-04T15:27:16.182 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:27:16.182 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":6,"fsid":"e87311d5-496a-4b07-9654-358fe5bbf950","created":"2023-11-04T15:27:14.865121+0000","modified":"2023-11-04T15:27:15.971035+0000","last_up_change":"0.000000","last_in_change":"2023-11-04T15:27:15.971035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"34818469-ebf2-4dd4-8119-af19a0121036","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"92dab290-7912-4eea-b6f6-c754c2480721","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1be47db4-6dd1-4ce5-832b-bc6ad30c78c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"46505800-d64f-49ef-b811-5b5979f48252","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T15:27:16.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.180+0000 7ff06d18e640 1 -- 172.21.15.19:0/1648818965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff068070f90 msgr2=0x7ff068133bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:16.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.180+0000 7ff06d18e640 1 --2- 172.21.15.19:0/1648818965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff068070f90 0x7ff068133bb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff05c00c410 tx=0x7ff05c00c8d0 comp rx=0 tx=0).stop 2023-11-04T15:27:16.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.180+0000 7ff06d18e640 1 -- 172.21.15.19:0/1648818965 shutdown_connections 2023-11-04T15:27:16.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.180+0000 7ff06d18e640 1 --2- 172.21.15.19:0/1648818965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0681386b0 0x7ff0681cf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:16.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.180+0000 7ff06d18e640 1 --2- 172.21.15.19:0/1648818965 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff0681351c0 0x7ff0681340f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:16.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.180+0000 7ff06d18e640 1 --2- 172.21.15.19:0/1648818965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff068070f90 0x7ff068133bb0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:16.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.180+0000 7ff06d18e640 1 -- 172.21.15.19:0/1648818965 >> 172.21.15.19:0/1648818965 conn(0x7ff0680aa2c0 msgr2=0x7ff0680a8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:16.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.180+0000 7ff06d18e640 1 -- 172.21.15.19:0/1648818965 shutdown_connections 2023-11-04T15:27:16.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:16.180+0000 7ff06d18e640 1 -- 172.21.15.19:0/1648818965 wait complete. 2023-11-04T15:27:16.193 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-04T15:27:16.193 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-04T15:27:16.275 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-11-04T15:27:16.273+0000 7fa97825c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-04T15:27:16.278 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-11-04T15:27:16.276+0000 7efe71842040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-04T15:27:16.344 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-11-04T15:27:16.342+0000 7fa97825c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-04T15:27:16.351 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-11-04T15:27:16.349+0000 7efe71842040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-04T15:27:16.390 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-11-04T15:27:16.388+0000 7fa97825c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-04T15:27:16.399 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-11-04T15:27:16.397+0000 7efe71842040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-04T15:27:16.442 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-11-04T15:27:16.440+0000 7fa97825c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-04T15:27:16.453 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-11-04T15:27:16.451+0000 7efe71842040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-04T15:27:16.488 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-11-04T15:27:16.486+0000 7fa97825c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-04T15:27:16.502 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-11-04T15:27:16.500+0000 7efe71842040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-04T15:27:16.593 INFO:tasks.ceph.osd.3.smithi096.stderr:2023-11-04T15:27:16.592+0000 7f4fba3ab500 -1 Falling back to public interface 2023-11-04T15:27:16.594 INFO:tasks.ceph.osd.2.smithi096.stderr:2023-11-04T15:27:16.592+0000 7fbf0120e500 -1 Falling back to public interface 2023-11-04T15:27:16.594 INFO:tasks.ceph.osd.3.smithi096.stderr:2023-11-04T15:27:16.592+0000 7f4fb9352640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6806/0: (98) Address already in use 2023-11-04T15:27:16.597 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-04T15:27:16.598 INFO:tasks.ceph.osd.0.smithi019.stderr:2023-11-04T15:27:16.596+0000 7f1472c8c500 -1 Falling back to public interface 2023-11-04T15:27:16.605 INFO:tasks.ceph.osd.1.smithi019.stderr:2023-11-04T15:27:16.603+0000 7f249ae13500 -1 Falling back to public interface 2023-11-04T15:27:16.691 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.686+0000 7f4df560b640 1 Processor -- start 2023-11-04T15:27:16.692 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.686+0000 7f4df560b640 1 -- start start 2023-11-04T15:27:16.692 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.687+0000 7f4df560b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4df013d240 0x7f4df013f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:16.692 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.687+0000 7f4df560b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4df00a5300 con 0x7f4df013fb70 2023-11-04T15:27:16.692 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.687+0000 7f4df560b640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4df00a61c0 con 0x7f4df0136f20 2023-11-04T15:27:16.692 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.687+0000 7f4df560b640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df00a3dd0 con 0x7f4df013d240 2023-11-04T15:27:16.693 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.687+0000 7f4def7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4df013fb70 0x7f4df0141f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39910/0 (socket says 172.21.15.19:39910) 2023-11-04T15:27:16.693 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.687+0000 7f4def7fe640 1 -- 172.21.15.19:0/583033851 learned_addr learned my addr 172.21.15.19:0/583033851 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:16.693 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.687+0000 7f4dee7fc640 1 --2- 172.21.15.19:0/583033851 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4df013d240 0x7f4df013f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:16.693 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.687+0000 7f4dedffb640 1 -- 172.21.15.19:0/583033851 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3994567561 0 0) 0x7f4df00a5300 con 0x7f4df013fb70 2023-11-04T15:27:16.693 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.688+0000 7f4dedffb640 1 -- 172.21.15.19:0/583033851 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dd8003520 con 0x7f4df013fb70 2023-11-04T15:27:16.694 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.688+0000 7f4dedffb640 1 -- 172.21.15.19:0/583033851 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485602704 0 0) 0x7f4df00a61c0 con 0x7f4df0136f20 2023-11-04T15:27:16.694 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.688+0000 7f4dee7fc640 1 -- 172.21.15.19:0/583033851 >> v1:172.21.15.96:6789/0 conn(0x7f4df0136f20 legacy=0x7f4df0137300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:16.694 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.688+0000 7f4dee7fc640 1 -- 172.21.15.19:0/583033851 >> v1:172.21.15.19:6789/0 conn(0x7f4df013fb70 legacy=0x7f4df0141f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:16.694 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.688+0000 7f4dee7fc640 1 -- 172.21.15.19:0/583033851 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df00a4010 con 0x7f4df013d240 2023-11-04T15:27:16.694 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.688+0000 7f4dee7fc640 1 --2- 172.21.15.19:0/583033851 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4df013d240 0x7f4df013f630 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4de40097d0 tx=0x7f4de402b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5982453f891c3ac server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:16.695 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.689+0000 7f4dedffb640 1 -- 172.21.15.19:0/583033851 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de4031770 con 0x7f4df013d240 2023-11-04T15:27:16.695 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.689+0000 7f4dedffb640 1 -- 172.21.15.19:0/583033851 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de40318d0 con 0x7f4df013d240 2023-11-04T15:27:16.695 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.689+0000 7f4dedffb640 1 -- 172.21.15.19:0/583033851 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de4031c60 con 0x7f4df013d240 2023-11-04T15:27:16.695 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.689+0000 7f4df560b640 1 -- 172.21.15.19:0/583033851 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4df013d240 msgr2=0x7f4df013f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:16.695 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.689+0000 7f4df560b640 1 --2- 172.21.15.19:0/583033851 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4df013d240 0x7f4df013f630 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4de40097d0 tx=0x7f4de402b810 comp rx=0 tx=0).stop 2023-11-04T15:27:16.696 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.689+0000 7f4df560b640 1 -- 172.21.15.19:0/583033851 shutdown_connections 2023-11-04T15:27:16.696 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.689+0000 7f4df560b640 1 --2- 172.21.15.19:0/583033851 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4df013d240 0x7f4df013f630 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:16.696 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.689+0000 7f4df560b640 1 -- 172.21.15.19:0/583033851 >> 172.21.15.19:0/583033851 conn(0x7f4df00a8d70 msgr2=0x7f4df00a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:16.696 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.689+0000 7f4df560b640 1 -- 172.21.15.19:0/583033851 shutdown_connections 2023-11-04T15:27:16.696 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.689+0000 7f4df560b640 1 -- 172.21.15.19:0/583033851 wait complete. 2023-11-04T15:27:16.699 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.690+0000 7f4df560b640 1 Processor -- start 2023-11-04T15:27:16.699 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.690+0000 7f4df560b640 1 -- start start 2023-11-04T15:27:16.699 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.691+0000 7f4df560b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4df0136f20 0x7f4df0133ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:16.700 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.691+0000 7f4df560b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4df013d240 0x7f4df0134430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:16.700 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.691+0000 7f4df560b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4df013fb70 0x7f4df0097a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:16.700 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.691+0000 7f4df560b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df009ac50 con 0x7f4df0136f20 2023-11-04T15:27:16.701 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.691+0000 7f4df560b640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df013a240 con 0x7f4df013fb70 2023-11-04T15:27:16.701 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.691+0000 7f4df560b640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df00a2450 con 0x7f4df013d240 2023-11-04T15:27:16.701 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.691+0000 7f4deeffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4df0136f20 0x7f4df0133ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:16.702 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.691+0000 7f4deeffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4df0136f20 0x7f4df0133ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46266/0 (socket says 172.21.15.19:46266) 2023-11-04T15:27:16.702 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.691+0000 7f4deeffd640 1 -- 172.21.15.19:0/2174535094 learned_addr learned my addr 172.21.15.19:0/2174535094 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:16.703 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.691+0000 7f4def7fe640 1 --2- 172.21.15.19:0/2174535094 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4df013fb70 0x7f4df0097a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:16.703 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.691+0000 7f4dee7fc640 1 --2- 172.21.15.19:0/2174535094 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4df013d240 0x7f4df0134430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:16.703 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.691+0000 7f4def7fe640 1 -- 172.21.15.19:0/2174535094 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4df013d240 msgr2=0x7f4df0134430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:16.704 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.691+0000 7f4def7fe640 1 --2- 172.21.15.19:0/2174535094 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4df013d240 0x7f4df0134430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:16.704 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.691+0000 7f4def7fe640 1 -- 172.21.15.19:0/2174535094 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4df0136f20 msgr2=0x7f4df0133ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:16.704 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.691+0000 7f4def7fe640 1 --2- 172.21.15.19:0/2174535094 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4df0136f20 0x7f4df0133ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:16.705 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.691+0000 7f4def7fe640 1 -- 172.21.15.19:0/2174535094 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de4009400 con 0x7f4df013fb70 2023-11-04T15:27:16.705 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.691+0000 7f4dee7fc640 1 --2- 172.21.15.19:0/2174535094 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4df013d240 0x7f4df0134430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T15:27:16.705 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.691+0000 7f4deeffd640 1 --2- 172.21.15.19:0/2174535094 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4df0136f20 0x7f4df0133ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T15:27:16.706 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.691+0000 7f4def7fe640 1 --2- 172.21.15.19:0/2174535094 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4df013fb70 0x7f4df0097a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4de800ca80 tx=0x7f4de800cf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:16.706 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.692+0000 7f4dd77fe640 1 -- 172.21.15.19:0/2174535094 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de800ac30 con 0x7f4df013fb70 2023-11-04T15:27:16.706 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.692+0000 7f4dd77fe640 1 -- 172.21.15.19:0/2174535094 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de800ad90 con 0x7f4df013fb70 2023-11-04T15:27:16.707 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.692+0000 7f4dd77fe640 1 -- 172.21.15.19:0/2174535094 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de8012600 con 0x7f4df013fb70 2023-11-04T15:27:16.707 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.692+0000 7f4df560b640 1 -- 172.21.15.19:0/2174535094 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df0134970 con 0x7f4df013fb70 2023-11-04T15:27:16.707 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.692+0000 7f4df560b640 1 -- 172.21.15.19:0/2174535094 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4df009ae30 con 0x7f4df013fb70 2023-11-04T15:27:16.708 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.692+0000 7f4dd77fe640 1 -- 172.21.15.19:0/2174535094 <== mon.1 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4de8012a60 con 0x7f4df013fb70 2023-11-04T15:27:16.708 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.692+0000 7f4dd77fe640 1 -- 172.21.15.19:0/2174535094 <== mon.1 v2:172.21.15.96:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f4de8007070 con 0x7f4df013fb70 2023-11-04T15:27:16.708 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.693+0000 7f4df560b640 1 -- 172.21.15.19:0/2174535094 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4df0067d60 con 0x7f4df013fb70 2023-11-04T15:27:16.709 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.695+0000 7f4dd77fe640 1 -- 172.21.15.19:0/2174535094 <== mon.1 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f4de8021060 con 0x7f4df013fb70 2023-11-04T15:27:16.758 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.756+0000 7f4df560b640 1 -- 172.21.15.19:0/2174535094 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4df013c680 con 0x7f4df013fb70 2023-11-04T15:27:16.759 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.756+0000 7f4dd77fe640 1 -- 172.21.15.19:0/2174535094 <== mon.1 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4152 (secure 0 0 0) 0x7f4de8017070 con 0x7f4df013fb70 2023-11-04T15:27:16.759 INFO:teuthology.misc.health.smithi019.stdout: 2023-11-04T15:27:16.760 INFO:teuthology.misc.health.smithi019.stdout:{"epoch":6,"fsid":"e87311d5-496a-4b07-9654-358fe5bbf950","created":"2023-11-04T15:27:14.865121+0000","modified":"2023-11-04T15:27:15.971035+0000","last_up_change":"0.000000","last_in_change":"2023-11-04T15:27:15.971035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"34818469-ebf2-4dd4-8119-af19a0121036","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"92dab290-7912-4eea-b6f6-c754c2480721","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1be47db4-6dd1-4ce5-832b-bc6ad30c78c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"46505800-d64f-49ef-b811-5b5979f48252","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T15:27:16.761 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.757+0000 7f4df560b640 1 -- 172.21.15.19:0/2174535094 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4df013fb70 msgr2=0x7f4df0097a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:16.761 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.757+0000 7f4df560b640 1 --2- 172.21.15.19:0/2174535094 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4df013fb70 0x7f4df0097a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4de800ca80 tx=0x7f4de800cf40 comp rx=0 tx=0).stop 2023-11-04T15:27:16.762 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.757+0000 7f4df560b640 1 -- 172.21.15.19:0/2174535094 shutdown_connections 2023-11-04T15:27:16.762 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.757+0000 7f4df560b640 1 --2- 172.21.15.19:0/2174535094 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4df013fb70 0x7f4df0097a00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:16.763 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.757+0000 7f4df560b640 1 --2- 172.21.15.19:0/2174535094 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4df013d240 0x7f4df0134430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:16.763 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.757+0000 7f4df560b640 1 --2- 172.21.15.19:0/2174535094 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4df0136f20 0x7f4df0133ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:16.763 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.757+0000 7f4df560b640 1 -- 172.21.15.19:0/2174535094 >> 172.21.15.19:0/2174535094 conn(0x7f4df00a8d70 msgr2=0x7f4df00aa070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:16.764 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.757+0000 7f4df560b640 1 -- 172.21.15.19:0/2174535094 shutdown_connections 2023-11-04T15:27:16.764 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:16.758+0000 7f4df560b640 1 -- 172.21.15.19:0/2174535094 wait complete. 2023-11-04T15:27:16.769 DEBUG:teuthology.misc:0 of 4 OSDs are up 2023-11-04T15:27:16.864 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-11-04T15:27:16.862+0000 7fa97825c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-04T15:27:16.911 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-11-04T15:27:16.909+0000 7efe71842040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-04T15:27:17.003 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-11-04T15:27:17.001+0000 7fa97825c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-04T15:27:17.053 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-11-04T15:27:17.051+0000 7efe71842040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-04T15:27:17.131 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-11-04T15:27:17.129+0000 7fa97825c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-04T15:27:17.176 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-11-04T15:27:17.174+0000 7fa97825c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-04T15:27:17.181 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-11-04T15:27:17.179+0000 7efe71842040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-04T15:27:17.229 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-11-04T15:27:17.227+0000 7efe71842040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-04T15:27:17.271 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-11-04T15:27:17.269+0000 7fa97825c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-04T15:27:17.330 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-11-04T15:27:17.328+0000 7efe71842040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-04T15:27:17.364 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-11-04T15:27:17.362+0000 7fa97825c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-04T15:27:17.430 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-11-04T15:27:17.428+0000 7efe71842040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-04T15:27:17.505 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-11-04T15:27:17.503+0000 7fa97825c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-04T15:27:17.549 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-11-04T15:27:17.547+0000 7fa97825c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-04T15:27:17.575 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-11-04T15:27:17.574+0000 7efe71842040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-04T15:27:17.619 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-11-04T15:27:17.618+0000 7efe71842040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-04T15:27:17.688 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-11-04T15:27:17.687+0000 7fa97825c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-04T15:27:17.767 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-11-04T15:27:17.765+0000 7efe71842040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-04T15:27:18.499 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-11-04T15:27:18.497+0000 7fa97825c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-04T15:27:18.600 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-11-04T15:27:18.598+0000 7efe71842040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-04T15:27:18.764 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-11-04T15:27:18.762+0000 7fa97825c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-04T15:27:18.815 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-11-04T15:27:18.813+0000 7fa97825c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-04T15:27:18.885 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-11-04T15:27:18.883+0000 7efe71842040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-04T15:27:18.914 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-11-04T15:27:18.912+0000 7fa97825c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-04T15:27:18.940 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-11-04T15:27:18.938+0000 7efe71842040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-04T15:27:19.048 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-11-04T15:27:19.046+0000 7efe71842040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-04T15:27:19.940 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-11-04T15:27:19.938+0000 7fa9197c8640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-04T15:27:19.941 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-11-04T15:27:19.939+0000 7fa9197c8640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-04T15:27:20.092 INFO:tasks.ceph.osd.2.smithi096.stderr:2023-11-04T15:27:20.090+0000 7fbf0120e500 -1 osd.2 0 log_to_monitors true 2023-11-04T15:27:20.095 INFO:tasks.ceph.osd.3.smithi096.stderr:2023-11-04T15:27:20.093+0000 7f4fba3ab500 -1 osd.3 0 log_to_monitors true 2023-11-04T15:27:20.110 INFO:tasks.ceph.osd.1.smithi019.stderr:2023-11-04T15:27:20.108+0000 7f249ae13500 -1 osd.1 0 log_to_monitors true 2023-11-04T15:27:20.126 INFO:tasks.ceph.osd.0.smithi019.stderr:2023-11-04T15:27:20.124+0000 7f1472c8c500 -1 osd.0 0 log_to_monitors true 2023-11-04T15:27:23.155 INFO:tasks.ceph.osd.3.smithi096.stderr:2023-11-04T15:27:23.153+0000 7f4fb5b13640 -1 osd.3 0 waiting for initial osdmap 2023-11-04T15:27:23.160 INFO:tasks.ceph.osd.2.smithi096.stderr:2023-11-04T15:27:23.158+0000 7fbefe1b1640 -1 osd.2 0 waiting for initial osdmap 2023-11-04T15:27:23.166 INFO:tasks.ceph.osd.3.smithi096.stderr:2023-11-04T15:27:23.164+0000 7f4fae144640 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T15:27:23.169 INFO:tasks.ceph.osd.2.smithi096.stderr:2023-11-04T15:27:23.168+0000 7fbef4fa7640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T15:27:23.173 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-04T15:27:23.203 INFO:tasks.ceph.osd.0.smithi019.stderr:2023-11-04T15:27:23.201+0000 7f146e3f6640 -1 osd.0 0 waiting for initial osdmap 2023-11-04T15:27:23.219 INFO:tasks.ceph.osd.0.smithi019.stderr:2023-11-04T15:27:23.217+0000 7f1466a27640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T15:27:23.255 INFO:tasks.ceph.osd.1.smithi019.stderr:2023-11-04T15:27:23.252+0000 7f2495e9a640 -1 osd.1 0 waiting for initial osdmap 2023-11-04T15:27:23.265 INFO:tasks.ceph.osd.1.smithi019.stderr:2023-11-04T15:27:23.264+0000 7f248e4cb640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T15:27:23.273 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.271+0000 7f85c672e640 1 Processor -- start 2023-11-04T15:27:23.273 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.271+0000 7f85c672e640 1 -- start start 2023-11-04T15:27:23.275 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.272+0000 7f85c672e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f85c0136540 0x7f85c0136920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:23.275 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.272+0000 7f85c672e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c006e3c0 con 0x7f85c01337c0 2023-11-04T15:27:23.276 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.272+0000 7f85c672e640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c009b0f0 con 0x7f85c0136e60 2023-11-04T15:27:23.276 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.272+0000 7f85c672e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c006eb00 con 0x7f85c0136540 2023-11-04T15:27:23.276 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.272+0000 7f85bffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f85c0136540 0x7f85c0136920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:23.276 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.272+0000 7f85c4ccb640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f85c01337c0 0x7f85c013ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:55974/0 (socket says 172.21.15.19:55974) 2023-11-04T15:27:23.276 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.272+0000 7f85c4ccb640 1 -- 172.21.15.19:0/2891750464 learned_addr learned my addr 172.21.15.19:0/2891750464 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:23.277 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.272+0000 7f85bffff640 1 -- 172.21.15.19:0/2891750464 >> v1:172.21.15.96:6789/0 conn(0x7f85c0136e60 legacy=0x7f85c01330b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:23.277 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.272+0000 7f85bffff640 1 -- 172.21.15.19:0/2891750464 >> v1:172.21.15.19:6789/0 conn(0x7f85c01337c0 legacy=0x7f85c013ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:23.277 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.272+0000 7f85bffff640 1 -- 172.21.15.19:0/2891750464 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c0071aa0 con 0x7f85c0136540 2023-11-04T15:27:23.277 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.272+0000 7f85beffd640 1 -- 172.21.15.19:0/2891750464 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1960389719 0 0) 0x7f85c006e3c0 con 0x7f85c01337c0 2023-11-04T15:27:23.277 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.273+0000 7f85bffff640 1 --2- 172.21.15.19:0/2891750464 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85c0136540 0x7f85c0136920 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f85b400ba40 tx=0x7f85b402dd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed588d91ec0e67cc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:23.278 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.273+0000 7f85beffd640 1 -- 172.21.15.19:0/2891750464 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b402eb10 con 0x7f85c0136540 2023-11-04T15:27:23.278 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.273+0000 7f85beffd640 1 -- 172.21.15.19:0/2891750464 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b4032070 con 0x7f85c0136540 2023-11-04T15:27:23.278 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.273+0000 7f85beffd640 1 -- 172.21.15.19:0/2891750464 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b402ee90 con 0x7f85c0136540 2023-11-04T15:27:23.281 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.274+0000 7f85c672e640 1 -- 172.21.15.19:0/2891750464 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85c0136540 msgr2=0x7f85c0136920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:23.282 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.274+0000 7f85c672e640 1 --2- 172.21.15.19:0/2891750464 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85c0136540 0x7f85c0136920 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f85b400ba40 tx=0x7f85b402dd60 comp rx=0 tx=0).stop 2023-11-04T15:27:23.282 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.274+0000 7f85c672e640 1 -- 172.21.15.19:0/2891750464 shutdown_connections 2023-11-04T15:27:23.282 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.274+0000 7f85c672e640 1 --2- 172.21.15.19:0/2891750464 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85c0136540 0x7f85c0136920 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:23.282 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.274+0000 7f85c672e640 1 -- 172.21.15.19:0/2891750464 >> 172.21.15.19:0/2891750464 conn(0x7f85c0069e50 msgr2=0x7f85c006a260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:23.283 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.274+0000 7f85c672e640 1 -- 172.21.15.19:0/2891750464 shutdown_connections 2023-11-04T15:27:23.283 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.274+0000 7f85c672e640 1 -- 172.21.15.19:0/2891750464 wait complete. 2023-11-04T15:27:23.283 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.275+0000 7f85c672e640 1 Processor -- start 2023-11-04T15:27:23.283 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.275+0000 7f85c672e640 1 -- start start 2023-11-04T15:27:23.283 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.275+0000 7f85c672e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85c01337c0 0x7f85c01ca730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:23.284 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.276+0000 7f85c672e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85c0136540 0x7f85c01cac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:23.284 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.276+0000 7f85c672e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85c0136e60 0x7f85c01cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:23.284 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.276+0000 7f85c672e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c00a0f80 con 0x7f85c0136e60 2023-11-04T15:27:23.284 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.276+0000 7f85c672e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c01341a0 con 0x7f85c01337c0 2023-11-04T15:27:23.284 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.276+0000 7f85c672e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c009f250 con 0x7f85c0136540 2023-11-04T15:27:23.285 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.276+0000 7f85c4ccb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85c0136e60 0x7f85c01cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:23.285 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.276+0000 7f85bffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85c01337c0 0x7f85c01ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:23.285 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.276+0000 7f85c4ccb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85c0136e60 0x7f85c01cb1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34282/0 (socket says 172.21.15.19:34282) 2023-11-04T15:27:23.285 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.276+0000 7f85c4ccb640 1 -- 172.21.15.19:0/3751006018 learned_addr learned my addr 172.21.15.19:0/3751006018 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:23.285 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.276+0000 7f85bf7fe640 1 --2- 172.21.15.19:0/3751006018 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85c0136540 0x7f85c01cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:23.286 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.276+0000 7f85c4ccb640 1 -- 172.21.15.19:0/3751006018 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85c0136540 msgr2=0x7f85c01cac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:23.286 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.276+0000 7f85c4ccb640 1 --2- 172.21.15.19:0/3751006018 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85c0136540 0x7f85c01cac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:23.286 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.276+0000 7f85c4ccb640 1 -- 172.21.15.19:0/3751006018 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85c01337c0 msgr2=0x7f85c01ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:23.286 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.276+0000 7f85c4ccb640 1 --2- 172.21.15.19:0/3751006018 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85c01337c0 0x7f85c01ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:23.286 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.276+0000 7f85c4ccb640 1 -- 172.21.15.19:0/3751006018 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b400b6a0 con 0x7f85c0136e60 2023-11-04T15:27:23.287 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.276+0000 7f85c4ccb640 1 --2- 172.21.15.19:0/3751006018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85c0136e60 0x7f85c01cb1b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f85b800c780 tx=0x7f85b800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:23.287 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.276+0000 7f85bcff9640 1 -- 172.21.15.19:0/3751006018 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b800ce90 con 0x7f85c0136e60 2023-11-04T15:27:23.287 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.276+0000 7f85bcff9640 1 -- 172.21.15.19:0/3751006018 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b800a640 con 0x7f85c0136e60 2023-11-04T15:27:23.287 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.276+0000 7f85bcff9640 1 -- 172.21.15.19:0/3751006018 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b800a9d0 con 0x7f85c0136e60 2023-11-04T15:27:23.287 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.276+0000 7f85c672e640 1 -- 172.21.15.19:0/3751006018 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c009f450 con 0x7f85c0136e60 2023-11-04T15:27:23.288 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.276+0000 7f85c672e640 1 -- 172.21.15.19:0/3751006018 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c00a1460 con 0x7f85c0136e60 2023-11-04T15:27:23.288 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.277+0000 7f85c672e640 1 -- 172.21.15.19:0/3751006018 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c009f050 con 0x7f85c0136e60 2023-11-04T15:27:23.288 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.278+0000 7f85bcff9640 1 -- 172.21.15.19:0/3751006018 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 88551+0+0 (secure 0 0 0) 0x7f85b800ab30 con 0x7f85c0136e60 2023-11-04T15:27:23.288 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.278+0000 7f85bcff9640 1 --2- 172.21.15.19:0/3751006018 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f85ac06a3a0 0x7f85ac06c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:23.288 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.278+0000 7f85bcff9640 1 -- 172.21.15.19:0/3751006018 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1623+0+0 (secure 0 0 0) 0x7f85b8086b70 con 0x7f85c0136e60 2023-11-04T15:27:23.289 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.278+0000 7f85bffff640 1 --2- 172.21.15.19:0/3751006018 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f85ac06a3a0 0x7f85ac06c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:23.289 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.279+0000 7f85bffff640 1 --2- 172.21.15.19:0/3751006018 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f85ac06a3a0 0x7f85ac06c860 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f85b4039000 tx=0x7f85b4034000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:23.289 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.283+0000 7f85bcff9640 1 -- 172.21.15.19:0/3751006018 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f85b80532d0 con 0x7f85c0136e60 2023-11-04T15:27:23.460 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.458+0000 7f85c672e640 1 -- 172.21.15.19:0/3751006018 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85c00a23e0 con 0x7f85c0136e60 2023-11-04T15:27:23.461 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.459+0000 7f85bcff9640 1 -- 172.21.15.19:0/3751006018 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) v1 ==== 74+0+4152 (secure 0 0 0) 0x7f85b8018070 con 0x7f85c0136e60 2023-11-04T15:27:23.461 INFO:teuthology.misc.health.smithi019.stdout: 2023-11-04T15:27:23.462 INFO:teuthology.misc.health.smithi019.stdout:{"epoch":8,"fsid":"e87311d5-496a-4b07-9654-358fe5bbf950","created":"2023-11-04T15:27:14.865121+0000","modified":"2023-11-04T15:27:21.986330+0000","last_up_change":"0.000000","last_in_change":"2023-11-04T15:27:15.971035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"34818469-ebf2-4dd4-8119-af19a0121036","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"92dab290-7912-4eea-b6f6-c754c2480721","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1be47db4-6dd1-4ce5-832b-bc6ad30c78c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"46505800-d64f-49ef-b811-5b5979f48252","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T15:27:23.463 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.461+0000 7f85c672e640 1 -- 172.21.15.19:0/3751006018 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f85ac06a3a0 msgr2=0x7f85ac06c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:23.463 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.461+0000 7f85c672e640 1 --2- 172.21.15.19:0/3751006018 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f85ac06a3a0 0x7f85ac06c860 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f85b4039000 tx=0x7f85b4034000 comp rx=0 tx=0).stop 2023-11-04T15:27:23.463 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.461+0000 7f85c672e640 1 -- 172.21.15.19:0/3751006018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85c0136e60 msgr2=0x7f85c01cb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:23.463 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.461+0000 7f85c672e640 1 --2- 172.21.15.19:0/3751006018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85c0136e60 0x7f85c01cb1b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f85b800c780 tx=0x7f85b800cc40 comp rx=0 tx=0).stop 2023-11-04T15:27:23.464 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.461+0000 7f85c672e640 1 -- 172.21.15.19:0/3751006018 shutdown_connections 2023-11-04T15:27:23.464 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.461+0000 7f85c672e640 1 --2- 172.21.15.19:0/3751006018 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f85ac06a3a0 0x7f85ac06c860 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:23.464 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.461+0000 7f85c672e640 1 --2- 172.21.15.19:0/3751006018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85c0136e60 0x7f85c01cb1b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:23.464 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.461+0000 7f85c672e640 1 --2- 172.21.15.19:0/3751006018 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85c0136540 0x7f85c01cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:23.464 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.461+0000 7f85c672e640 1 --2- 172.21.15.19:0/3751006018 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85c01337c0 0x7f85c01ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:23.465 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.461+0000 7f85c672e640 1 -- 172.21.15.19:0/3751006018 >> 172.21.15.19:0/3751006018 conn(0x7f85c0069e50 msgr2=0x7f85c00a7090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:23.465 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.461+0000 7f85c672e640 1 -- 172.21.15.19:0/3751006018 shutdown_connections 2023-11-04T15:27:23.465 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:23.461+0000 7f85c672e640 1 -- 172.21.15.19:0/3751006018 wait complete. 2023-11-04T15:27:23.472 DEBUG:teuthology.misc:0 of 4 OSDs are up 2023-11-04T15:27:24.827 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:27:24.830 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:27:24.832 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:27:29.876 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-04T15:27:29.979 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.977+0000 7f36743e4640 1 Processor -- start 2023-11-04T15:27:29.979 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.977+0000 7f36743e4640 1 -- start start 2023-11-04T15:27:29.982 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.977+0000 7f36743e4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f366c133ec0 0x7f366c1342a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:29.982 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.977+0000 7f36743e4640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f366c06a7a0 0x7f366c1401b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:29.982 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.977+0000 7f36743e4640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f366c0a54f0 con 0x7f366c069c70 2023-11-04T15:27:29.983 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.977+0000 7f36743e4640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f366c0a4e70 con 0x7f366c133ec0 2023-11-04T15:27:29.983 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.977+0000 7f36743e4640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f366c0a5090 con 0x7f366c06a7a0 2023-11-04T15:27:29.983 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.978+0000 7f3672180640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f366c133ec0 0x7f366c1342a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:29.983 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.978+0000 7f367197f640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f366c069c70 0x7f366c06a090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50446/0 (socket says 172.21.15.19:50446) 2023-11-04T15:27:29.983 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.978+0000 7f367197f640 1 -- 172.21.15.19:0/732491070 learned_addr learned my addr 172.21.15.19:0/732491070 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:29.984 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.978+0000 7f3672981640 1 --2- 172.21.15.19:0/732491070 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f366c06a7a0 0x7f366c1401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:29.984 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.978+0000 7f3672180640 1 -- 172.21.15.19:0/732491070 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f366c06a7a0 msgr2=0x7f366c1401b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:29.984 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.978+0000 7f3672180640 1 --2- 172.21.15.19:0/732491070 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f366c06a7a0 0x7f366c1401b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:29.984 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.978+0000 7f3672180640 1 -- 172.21.15.19:0/732491070 >> v1:172.21.15.19:6789/0 conn(0x7f366c069c70 legacy=0x7f366c06a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:29.984 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.978+0000 7f3672180640 1 -- 172.21.15.19:0/732491070 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366c0a4110 con 0x7f366c133ec0 2023-11-04T15:27:29.985 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.978+0000 7f367117e640 1 -- 172.21.15.19:0/732491070 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3422825709 0 0) 0x7f366c0a54f0 con 0x7f366c069c70 2023-11-04T15:27:29.985 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.978+0000 7f3672981640 1 --2- 172.21.15.19:0/732491070 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f366c06a7a0 0x7f366c1401b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:27:29.985 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.979+0000 7f3672180640 1 --2- 172.21.15.19:0/732491070 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f366c133ec0 0x7f366c1342a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f36680097a0 tx=0x7f366802b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dcebc7328335d2e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:29.985 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.979+0000 7f367117e640 1 -- 172.21.15.19:0/732491070 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36680316f0 con 0x7f366c133ec0 2023-11-04T15:27:29.986 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.979+0000 7f367117e640 1 -- 172.21.15.19:0/732491070 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3668031850 con 0x7f366c133ec0 2023-11-04T15:27:29.986 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.979+0000 7f367117e640 1 -- 172.21.15.19:0/732491070 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3668031be0 con 0x7f366c133ec0 2023-11-04T15:27:29.986 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.979+0000 7f36743e4640 1 -- 172.21.15.19:0/732491070 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f366c133ec0 msgr2=0x7f366c1342a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:29.986 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.979+0000 7f36743e4640 1 --2- 172.21.15.19:0/732491070 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f366c133ec0 0x7f366c1342a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f36680097a0 tx=0x7f366802b790 comp rx=0 tx=0).stop 2023-11-04T15:27:29.986 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.980+0000 7f36743e4640 1 -- 172.21.15.19:0/732491070 shutdown_connections 2023-11-04T15:27:29.987 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.980+0000 7f36743e4640 1 --2- 172.21.15.19:0/732491070 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f366c06a7a0 0x7f366c1401b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:29.987 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.980+0000 7f36743e4640 1 --2- 172.21.15.19:0/732491070 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f366c133ec0 0x7f366c1342a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:29.987 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.980+0000 7f36743e4640 1 -- 172.21.15.19:0/732491070 >> 172.21.15.19:0/732491070 conn(0x7f366c0a9140 msgr2=0x7f366c0a9550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:29.987 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.980+0000 7f36743e4640 1 -- 172.21.15.19:0/732491070 shutdown_connections 2023-11-04T15:27:29.987 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.980+0000 7f36743e4640 1 -- 172.21.15.19:0/732491070 wait complete. 2023-11-04T15:27:29.991 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.981+0000 7f36743e4640 1 Processor -- start 2023-11-04T15:27:29.991 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.981+0000 7f36743e4640 1 -- start start 2023-11-04T15:27:29.992 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.981+0000 7f36743e4640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f366c069c70 0x7f366c1ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:29.992 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.981+0000 7f36743e4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f366c06a7a0 0x7f366c1cd030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:29.992 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.981+0000 7f36743e4640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f366c133ec0 0x7f366c1cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:29.992 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.981+0000 7f36743e4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366c11ffc0 con 0x7f366c06a7a0 2023-11-04T15:27:29.992 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.981+0000 7f36743e4640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366c121430 con 0x7f366c069c70 2023-11-04T15:27:29.993 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.981+0000 7f36743e4640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f366c120960 con 0x7f366c133ec0 2023-11-04T15:27:29.993 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.981+0000 7f367197f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f366c06a7a0 0x7f366c1cd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:29.993 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.981+0000 7f367197f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f366c06a7a0 0x7f366c1cd030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45678/0 (socket says 172.21.15.19:45678) 2023-11-04T15:27:29.994 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.981+0000 7f367197f640 1 -- 172.21.15.19:0/1280717250 learned_addr learned my addr 172.21.15.19:0/1280717250 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:29.994 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.981+0000 7f3672981640 1 --2- 172.21.15.19:0/1280717250 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f366c133ec0 0x7f366c1cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:29.995 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.981+0000 7f3672180640 1 --2- 172.21.15.19:0/1280717250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f366c069c70 0x7f366c1ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:29.995 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.982+0000 7f367197f640 1 -- 172.21.15.19:0/1280717250 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f366c133ec0 msgr2=0x7f366c1cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:29.995 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.982+0000 7f367197f640 1 --2- 172.21.15.19:0/1280717250 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f366c133ec0 0x7f366c1cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:29.995 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.982+0000 7f367197f640 1 -- 172.21.15.19:0/1280717250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f366c069c70 msgr2=0x7f366c1ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:29.996 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.982+0000 7f367197f640 1 --2- 172.21.15.19:0/1280717250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f366c069c70 0x7f366c1ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:29.996 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.982+0000 7f367197f640 1 -- 172.21.15.19:0/1280717250 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3668009400 con 0x7f366c06a7a0 2023-11-04T15:27:29.996 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.982+0000 7f367197f640 1 --2- 172.21.15.19:0/1280717250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f366c06a7a0 0x7f366c1cd030 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f365c00c4d0 tx=0x7f365c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:29.996 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.982+0000 7f3662ffd640 1 -- 172.21.15.19:0/1280717250 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c0074e0 con 0x7f366c06a7a0 2023-11-04T15:27:29.996 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.982+0000 7f3662ffd640 1 -- 172.21.15.19:0/1280717250 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365c007660 con 0x7f366c06a7a0 2023-11-04T15:27:29.997 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.982+0000 7f3662ffd640 1 -- 172.21.15.19:0/1280717250 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c004a20 con 0x7f366c06a7a0 2023-11-04T15:27:29.997 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.982+0000 7f36743e4640 1 -- 172.21.15.19:0/1280717250 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f366c0a45c0 con 0x7f366c06a7a0 2023-11-04T15:27:29.997 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.982+0000 7f36743e4640 1 -- 172.21.15.19:0/1280717250 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f366c1203e0 con 0x7f366c06a7a0 2023-11-04T15:27:29.997 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.983+0000 7f36743e4640 1 -- 172.21.15.19:0/1280717250 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f366c067d60 con 0x7f366c06a7a0 2023-11-04T15:27:29.997 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.983+0000 7f3662ffd640 1 -- 172.21.15.19:0/1280717250 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f365c004b80 con 0x7f366c06a7a0 2023-11-04T15:27:29.997 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.984+0000 7f3662ffd640 1 --2- 172.21.15.19:0/1280717250 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f365006a430 0x7f365006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:29.998 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.984+0000 7f3662ffd640 1 -- 172.21.15.19:0/1280717250 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3129+0+0 (secure 0 0 0) 0x7f365c0870c0 con 0x7f366c06a7a0 2023-11-04T15:27:29.998 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.984+0000 7f3672180640 1 --2- 172.21.15.19:0/1280717250 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f365006a430 0x7f365006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:29.998 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.984+0000 7f3672180640 1 --2- 172.21.15.19:0/1280717250 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f365006a430 0x7f365006c8f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3668036000 tx=0x7f3668008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:29.998 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:29.988+0000 7f3662ffd640 1 -- 172.21.15.19:0/1280717250 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f365c0530b0 con 0x7f366c06a7a0 2023-11-04T15:27:30.167 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:30.165+0000 7f36743e4640 1 -- 172.21.15.19:0/1280717250 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f366c0a3ef0 con 0x7f366c06a7a0 2023-11-04T15:27:30.168 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:30.166+0000 7f3662ffd640 1 -- 172.21.15.19:0/1280717250 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7677 (secure 0 0 0) 0x7f365c018020 con 0x7f366c06a7a0 2023-11-04T15:27:30.168 INFO:teuthology.misc.health.smithi019.stdout: 2023-11-04T15:27:30.168 INFO:teuthology.misc.health.smithi019.stdout:{"epoch":12,"fsid":"e87311d5-496a-4b07-9654-358fe5bbf950","created":"2023-11-04T15:27:14.865121+0000","modified":"2023-11-04T15:27:27.203563+0000","last_up_change":"2023-11-04T15:27:24.162282+0000","last_in_change":"2023-11-04T15:27:15.971035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T15:27:24.987312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"34818469-ebf2-4dd4-8119-af19a0121036","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":82879},{"type":"v1","addr":"172.21.15.19:6801","nonce":82879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":82879},{"type":"v1","addr":"172.21.15.19:6803","nonce":82879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":82879},{"type":"v1","addr":"172.21.15.19:6807","nonce":82879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":82879},{"type":"v1","addr":"172.21.15.19:6805","nonce":82879}]},"public_addr":"172.21.15.19:6801/82879","cluster_addr":"172.21.15.19:6803/82879","heartbeat_back_addr":"172.21.15.19:6807/82879","heartbeat_front_addr":"172.21.15.19:6805/82879","state":["exists","up"]},{"osd":1,"uuid":"92dab290-7912-4eea-b6f6-c754c2480721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":82880},{"type":"v1","addr":"172.21.15.19:6809","nonce":82880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":82880},{"type":"v1","addr":"172.21.15.19:6811","nonce":82880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":82880},{"type":"v1","addr":"172.21.15.19:6815","nonce":82880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":82880},{"type":"v1","addr":"172.21.15.19:6813","nonce":82880}]},"public_addr":"172.21.15.19:6809/82880","cluster_addr":"172.21.15.19:6811/82880","heartbeat_back_addr":"172.21.15.19:6815/82880","heartbeat_front_addr":"172.21.15.19:6813/82880","state":["exists","up"]},{"osd":2,"uuid":"1be47db4-6dd1-4ce5-832b-bc6ad30c78c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":83458},{"type":"v1","addr":"172.21.15.96:6808","nonce":83458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":83458},{"type":"v1","addr":"172.21.15.96:6811","nonce":83458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":83458},{"type":"v1","addr":"172.21.15.96:6815","nonce":83458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":83458},{"type":"v1","addr":"172.21.15.96:6813","nonce":83458}]},"public_addr":"172.21.15.96:6808/83458","cluster_addr":"172.21.15.96:6811/83458","heartbeat_back_addr":"172.21.15.96:6815/83458","heartbeat_front_addr":"172.21.15.96:6813/83458","state":["exists","up"]},{"osd":3,"uuid":"46505800-d64f-49ef-b811-5b5979f48252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":83459},{"type":"v1","addr":"172.21.15.96:6801","nonce":83459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":83459},{"type":"v1","addr":"172.21.15.96:6803","nonce":83459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6807","nonce":83459},{"type":"v1","addr":"172.21.15.96:6809","nonce":83459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":83459},{"type":"v1","addr":"172.21.15.96:6805","nonce":83459}]},"public_addr":"172.21.15.96:6801/83459","cluster_addr":"172.21.15.96:6803/83459","heartbeat_back_addr":"172.21.15.96:6809/83459","heartbeat_front_addr":"172.21.15.96:6805/83459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.081547+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.132075+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.094919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.074106+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T15:27:30.170 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:30.168+0000 7f36743e4640 1 -- 172.21.15.19:0/1280717250 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f365006a430 msgr2=0x7f365006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:30.170 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:30.168+0000 7f36743e4640 1 --2- 172.21.15.19:0/1280717250 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f365006a430 0x7f365006c8f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3668036000 tx=0x7f3668008030 comp rx=0 tx=0).stop 2023-11-04T15:27:30.170 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:30.168+0000 7f36743e4640 1 -- 172.21.15.19:0/1280717250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f366c06a7a0 msgr2=0x7f366c1cd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:30.171 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:30.168+0000 7f36743e4640 1 --2- 172.21.15.19:0/1280717250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f366c06a7a0 0x7f366c1cd030 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f365c00c4d0 tx=0x7f365c00c990 comp rx=0 tx=0).stop 2023-11-04T15:27:30.171 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:30.168+0000 7f36743e4640 1 -- 172.21.15.19:0/1280717250 shutdown_connections 2023-11-04T15:27:30.171 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:30.168+0000 7f36743e4640 1 --2- 172.21.15.19:0/1280717250 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f365006a430 0x7f365006c8f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:30.171 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:30.168+0000 7f36743e4640 1 --2- 172.21.15.19:0/1280717250 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f366c133ec0 0x7f366c1cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:30.171 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:30.168+0000 7f36743e4640 1 --2- 172.21.15.19:0/1280717250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f366c06a7a0 0x7f366c1cd030 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:30.172 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:30.168+0000 7f36743e4640 1 --2- 172.21.15.19:0/1280717250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f366c069c70 0x7f366c1ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:30.172 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:30.168+0000 7f36743e4640 1 -- 172.21.15.19:0/1280717250 >> 172.21.15.19:0/1280717250 conn(0x7f366c0a9140 msgr2=0x7f366c0a6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:30.172 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:30.168+0000 7f36743e4640 1 -- 172.21.15.19:0/1280717250 shutdown_connections 2023-11-04T15:27:30.172 INFO:teuthology.misc.health.smithi019.stderr:2023-11-04T15:27:30.168+0000 7f36743e4640 1 -- 172.21.15.19:0/1280717250 wait complete. 2023-11-04T15:27:30.179 DEBUG:teuthology.misc:4 of 4 OSDs are up 2023-11-04T15:27:30.179 INFO:tasks.ceph:Creating RBD pool 2023-11-04T15:27:30.180 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph osd pool create rbd 8 2023-11-04T15:27:30.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.283+0000 7f4c6bda4640 1 Processor -- start 2023-11-04T15:27:30.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.283+0000 7f4c6bda4640 1 -- start start 2023-11-04T15:27:30.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.284+0000 7f4c6bda4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4c640a6370 0x7f4c6413f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:30.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.284+0000 7f4c6bda4640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4c6413f990 0x7f4c64141d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:30.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.284+0000 7f4c6bda4640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c640abe60 con 0x7f4c64136090 2023-11-04T15:27:30.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.284+0000 7f4c6bda4640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c640a68d0 con 0x7f4c640a6370 2023-11-04T15:27:30.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.284+0000 7f4c6bda4640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c640a30a0 con 0x7f4c6413f990 2023-11-04T15:27:30.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.284+0000 7f4c6933f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4c640a6370 0x7f4c6413f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:30.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.284+0000 7f4c6933f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4c640a6370 0x7f4c6413f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45686/0 (socket says 172.21.15.19:45686) 2023-11-04T15:27:30.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.284+0000 7f4c6933f640 1 -- 172.21.15.19:0/2296903759 learned_addr learned my addr 172.21.15.19:0/2296903759 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:30.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.284+0000 7f4c6a341640 1 --2- 172.21.15.19:0/2296903759 >> v2:172.21.15.96:3300/0 conn(0x7f4c6413f990 0x7f4c64141d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:30.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.284+0000 7f4c6933f640 1 -- 172.21.15.19:0/2296903759 >> v2:172.21.15.96:3300/0 conn(0x7f4c6413f990 msgr2=0x7f4c64141d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:30.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.284+0000 7f4c6933f640 1 --2- 172.21.15.19:0/2296903759 >> v2:172.21.15.96:3300/0 conn(0x7f4c6413f990 0x7f4c64141d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:30.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.284+0000 7f4c6933f640 1 -- 172.21.15.19:0/2296903759 >> v1:172.21.15.96:6789/0 conn(0x7f4c64136090 legacy=0x7f4c64136470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:30.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.284+0000 7f4c6933f640 1 -- 172.21.15.19:0/2296903759 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c640a4b90 con 0x7f4c640a6370 2023-11-04T15:27:30.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.284+0000 7f4c6a341640 1 --2- 172.21.15.19:0/2296903759 >> v2:172.21.15.96:3300/0 conn(0x7f4c6413f990 0x7f4c64141d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T15:27:30.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.285+0000 7f4c6933f640 1 --2- 172.21.15.19:0/2296903759 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c640a6370 0x7f4c6413f450 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4c6406a7e0 tx=0x7f4c5802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=285b8dfc841fed2f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:30.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.285+0000 7f4c68b3e640 1 -- 172.21.15.19:0/2296903759 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c58031750 con 0x7f4c640a6370 2023-11-04T15:27:30.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.285+0000 7f4c68b3e640 1 -- 172.21.15.19:0/2296903759 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c580318b0 con 0x7f4c640a6370 2023-11-04T15:27:30.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.285+0000 7f4c68b3e640 1 -- 172.21.15.19:0/2296903759 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c58031c40 con 0x7f4c640a6370 2023-11-04T15:27:30.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.285+0000 7f4c6bda4640 1 -- 172.21.15.19:0/2296903759 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c640a6370 msgr2=0x7f4c6413f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:30.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.285+0000 7f4c6bda4640 1 --2- 172.21.15.19:0/2296903759 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c640a6370 0x7f4c6413f450 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4c6406a7e0 tx=0x7f4c5802b7f0 comp rx=0 tx=0).stop 2023-11-04T15:27:30.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.286+0000 7f4c6bda4640 1 -- 172.21.15.19:0/2296903759 shutdown_connections 2023-11-04T15:27:30.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.286+0000 7f4c6bda4640 1 --2- 172.21.15.19:0/2296903759 >> v2:172.21.15.96:3300/0 conn(0x7f4c6413f990 0x7f4c64141d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:30.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.286+0000 7f4c6bda4640 1 --2- 172.21.15.19:0/2296903759 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c640a6370 0x7f4c6413f450 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:30.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.286+0000 7f4c6bda4640 1 -- 172.21.15.19:0/2296903759 >> 172.21.15.19:0/2296903759 conn(0x7f4c640ac3f0 msgr2=0x7f4c640ac800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:30.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.286+0000 7f4c6bda4640 1 -- 172.21.15.19:0/2296903759 shutdown_connections 2023-11-04T15:27:30.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.286+0000 7f4c6bda4640 1 -- 172.21.15.19:0/2296903759 wait complete. 2023-11-04T15:27:30.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.286+0000 7f4c6bda4640 1 Processor -- start 2023-11-04T15:27:30.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.287+0000 7f4c6bda4640 1 -- start start 2023-11-04T15:27:30.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.287+0000 7f4c6bda4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c640a6370 0x7f4c6412ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:30.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.287+0000 7f4c6bda4640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c64136090 0x7f4c6412f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:30.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.287+0000 7f4c6bda4640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4c6413f990 0x7f4c641ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:30.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.287+0000 7f4c6bda4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6413e560 con 0x7f4c640a6370 2023-11-04T15:27:30.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.287+0000 7f4c6bda4640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6413b340 con 0x7f4c64136090 2023-11-04T15:27:30.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.287+0000 7f4c6bda4640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6413d090 con 0x7f4c6413f990 2023-11-04T15:27:30.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.287+0000 7f4c69b40640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c640a6370 0x7f4c6412ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:30.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.287+0000 7f4c69b40640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c640a6370 0x7f4c6412ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45692/0 (socket says 172.21.15.19:45692) 2023-11-04T15:27:30.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.287+0000 7f4c69b40640 1 -- 172.21.15.19:0/722727075 learned_addr learned my addr 172.21.15.19:0/722727075 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:30.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.287+0000 7f4c6933f640 1 --2- 172.21.15.19:0/722727075 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c64136090 0x7f4c6412f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:30.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.287+0000 7f4c69b40640 1 -- 172.21.15.19:0/722727075 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4c6413f990 msgr2=0x7f4c641ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:30.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.287+0000 7f4c69b40640 1 --2- 172.21.15.19:0/722727075 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4c6413f990 0x7f4c641ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:30.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.287+0000 7f4c69b40640 1 -- 172.21.15.19:0/722727075 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c64136090 msgr2=0x7f4c6412f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:30.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.287+0000 7f4c69b40640 1 --2- 172.21.15.19:0/722727075 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c64136090 0x7f4c6412f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:30.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.287+0000 7f4c69b40640 1 -- 172.21.15.19:0/722727075 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c580094d0 con 0x7f4c640a6370 2023-11-04T15:27:30.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.288+0000 7f4c69b40640 1 --2- 172.21.15.19:0/722727075 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c640a6370 0x7f4c6412ef20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c00c430 tx=0x7f4c5c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:30.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.288+0000 7f4c627fc640 1 -- 172.21.15.19:0/722727075 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c011790 con 0x7f4c640a6370 2023-11-04T15:27:30.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.288+0000 7f4c627fc640 1 -- 172.21.15.19:0/722727075 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5c0118f0 con 0x7f4c640a6370 2023-11-04T15:27:30.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.288+0000 7f4c6bda4640 1 -- 172.21.15.19:0/722727075 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c6413ccb0 con 0x7f4c640a6370 2023-11-04T15:27:30.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.288+0000 7f4c627fc640 1 -- 172.21.15.19:0/722727075 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c011ca0 con 0x7f4c640a6370 2023-11-04T15:27:30.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.288+0000 7f4c6bda4640 1 -- 172.21.15.19:0/722727075 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c6413d630 con 0x7f4c640a6370 2023-11-04T15:27:30.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.289+0000 7f4c6bda4640 1 -- 172.21.15.19:0/722727075 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c6413acb0 con 0x7f4c640a6370 2023-11-04T15:27:30.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.289+0000 7f4c627fc640 1 -- 172.21.15.19:0/722727075 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4c5c01c460 con 0x7f4c640a6370 2023-11-04T15:27:30.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.290+0000 7f4c627fc640 1 --2- 172.21.15.19:0/722727075 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f4c5006a430 0x7f4c5006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:30.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.290+0000 7f4c627fc640 1 -- 172.21.15.19:0/722727075 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3129+0+0 (secure 0 0 0) 0x7f4c5c087db0 con 0x7f4c640a6370 2023-11-04T15:27:30.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.290+0000 7f4c6933f640 1 --2- 172.21.15.19:0/722727075 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f4c5006a430 0x7f4c5006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:30.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.291+0000 7f4c6933f640 1 --2- 172.21.15.19:0/722727075 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f4c5006a430 0x7f4c5006c8f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4c58035000 tx=0x7f4c58008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:30.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.294+0000 7f4c627fc640 1 -- 172.21.15.19:0/722727075 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4c5c053e40 con 0x7f4c640a6370 2023-11-04T15:27:30.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.469+0000 7f4c6bda4640 1 -- 172.21.15.19:0/722727075 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f4c64067d60 con 0x7f4c640a6370 2023-11-04T15:27:30.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.614+0000 7f4c627fc640 1 -- 172.21.15.19:0/722727075 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v13) v1 ==== 109+0+0 (secure 0 0 0) 0x7f4c5c057460 con 0x7f4c640a6370 2023-11-04T15:27:30.617 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'rbd' created 2023-11-04T15:27:30.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.617+0000 7f4c6bda4640 1 -- 172.21.15.19:0/722727075 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f4c5006a430 msgr2=0x7f4c5006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:30.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.617+0000 7f4c6bda4640 1 --2- 172.21.15.19:0/722727075 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f4c5006a430 0x7f4c5006c8f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4c58035000 tx=0x7f4c58008030 comp rx=0 tx=0).stop 2023-11-04T15:27:30.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.617+0000 7f4c6bda4640 1 -- 172.21.15.19:0/722727075 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c640a6370 msgr2=0x7f4c6412ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:30.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.617+0000 7f4c6bda4640 1 --2- 172.21.15.19:0/722727075 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c640a6370 0x7f4c6412ef20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c00c430 tx=0x7f4c5c00c8f0 comp rx=0 tx=0).stop 2023-11-04T15:27:30.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.617+0000 7f4c6bda4640 1 -- 172.21.15.19:0/722727075 shutdown_connections 2023-11-04T15:27:30.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.617+0000 7f4c6bda4640 1 --2- 172.21.15.19:0/722727075 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f4c5006a430 0x7f4c5006c8f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:30.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.617+0000 7f4c6bda4640 1 --2- 172.21.15.19:0/722727075 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4c6413f990 0x7f4c641ceb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:30.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.617+0000 7f4c6bda4640 1 --2- 172.21.15.19:0/722727075 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c64136090 0x7f4c6412f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:30.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.617+0000 7f4c6bda4640 1 --2- 172.21.15.19:0/722727075 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c640a6370 0x7f4c6412ef20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:30.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.617+0000 7f4c6bda4640 1 -- 172.21.15.19:0/722727075 >> 172.21.15.19:0/722727075 conn(0x7f4c640ac3f0 msgr2=0x7f4c64133400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:30.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.617+0000 7f4c6bda4640 1 -- 172.21.15.19:0/722727075 shutdown_connections 2023-11-04T15:27:30.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.617+0000 7f4c6bda4640 1 -- 172.21.15.19:0/722727075 wait complete. 2023-11-04T15:27:30.630 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-11-04T15:27:30.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.735+0000 7fc62c010640 1 Processor -- start 2023-11-04T15:27:30.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.735+0000 7fc62c010640 1 -- start start 2023-11-04T15:27:30.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.735+0000 7fc62c010640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc6241361a0 0x7fc6240a64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:30.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.735+0000 7fc62c010640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc6241370f0 0x7fc624137500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:30.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.735+0000 7fc62c010640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6240a52e0 con 0x7fc624136580 2023-11-04T15:27:30.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.735+0000 7fc62c010640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6240a4ef0 con 0x7fc6241361a0 2023-11-04T15:27:30.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.735+0000 7fc62c010640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6240a55a0 con 0x7fc6241370f0 2023-11-04T15:27:30.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.735+0000 7fc629dac640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc6241361a0 0x7fc6240a64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:30.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.735+0000 7fc629dac640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc6241361a0 0x7fc6240a64f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45696/0 (socket says 172.21.15.19:45696) 2023-11-04T15:27:30.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.735+0000 7fc629dac640 1 -- 172.21.15.19:0/2887579618 learned_addr learned my addr 172.21.15.19:0/2887579618 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:30.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.736+0000 7fc62a5ad640 1 --2- 172.21.15.19:0/2887579618 >> v2:172.21.15.96:3300/0 conn(0x7fc6241370f0 0x7fc624137500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:30.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.736+0000 7fc629dac640 1 -- 172.21.15.19:0/2887579618 >> v2:172.21.15.96:3300/0 conn(0x7fc6241370f0 msgr2=0x7fc624137500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:30.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.736+0000 7fc629dac640 1 --2- 172.21.15.19:0/2887579618 >> v2:172.21.15.96:3300/0 conn(0x7fc6241370f0 0x7fc624137500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:30.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.736+0000 7fc629dac640 1 -- 172.21.15.19:0/2887579618 >> v1:172.21.15.96:6789/0 conn(0x7fc624136580 legacy=0x7fc6241369e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:30.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.736+0000 7fc629dac640 1 -- 172.21.15.19:0/2887579618 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6240a5880 con 0x7fc6241361a0 2023-11-04T15:27:30.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.736+0000 7fc629dac640 1 --2- 172.21.15.19:0/2887579618 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6241361a0 0x7fc6240a64f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc6240a3ca0 tx=0x7fc61c02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ca7a7cf736b89a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:30.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.737+0000 7fc628daa640 1 -- 172.21.15.19:0/2887579618 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c031750 con 0x7fc6241361a0 2023-11-04T15:27:30.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.737+0000 7fc628daa640 1 -- 172.21.15.19:0/2887579618 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61c0318b0 con 0x7fc6241361a0 2023-11-04T15:27:30.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.737+0000 7fc628daa640 1 -- 172.21.15.19:0/2887579618 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c031c40 con 0x7fc6241361a0 2023-11-04T15:27:30.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.737+0000 7fc62c010640 1 -- 172.21.15.19:0/2887579618 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6241361a0 msgr2=0x7fc6240a64f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:30.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.737+0000 7fc62c010640 1 --2- 172.21.15.19:0/2887579618 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6241361a0 0x7fc6240a64f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc6240a3ca0 tx=0x7fc61c02b7f0 comp rx=0 tx=0).stop 2023-11-04T15:27:30.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.737+0000 7fc62c010640 1 -- 172.21.15.19:0/2887579618 shutdown_connections 2023-11-04T15:27:30.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.737+0000 7fc62c010640 1 --2- 172.21.15.19:0/2887579618 >> v2:172.21.15.96:3300/0 conn(0x7fc6241370f0 0x7fc624137500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:30.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.737+0000 7fc62c010640 1 --2- 172.21.15.19:0/2887579618 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6241361a0 0x7fc6240a64f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:30.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.737+0000 7fc62c010640 1 -- 172.21.15.19:0/2887579618 >> 172.21.15.19:0/2887579618 conn(0x7fc6240ac3f0 msgr2=0x7fc6240ac800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:30.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.737+0000 7fc62c010640 1 -- 172.21.15.19:0/2887579618 shutdown_connections 2023-11-04T15:27:30.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.737+0000 7fc62c010640 1 -- 172.21.15.19:0/2887579618 wait complete. 2023-11-04T15:27:30.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.738+0000 7fc62c010640 1 Processor -- start 2023-11-04T15:27:30.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.738+0000 7fc62c010640 1 -- start start 2023-11-04T15:27:30.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.739+0000 7fc62c010640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6241361a0 0x7fc6240998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:30.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.739+0000 7fc62c010640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc624136580 0x7fc624099e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:30.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.739+0000 7fc62c010640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc6241370f0 0x7fc62409a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:30.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.739+0000 7fc62c010640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62409d980 con 0x7fc6241361a0 2023-11-04T15:27:30.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.739+0000 7fc62c010640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62409b5b0 con 0x7fc624136580 2023-11-04T15:27:30.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.739+0000 7fc62c010640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc62409c330 con 0x7fc6241370f0 2023-11-04T15:27:30.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.739+0000 7fc629dac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6241361a0 0x7fc6240998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:30.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.739+0000 7fc629dac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6241361a0 0x7fc6240998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45698/0 (socket says 172.21.15.19:45698) 2023-11-04T15:27:30.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.739+0000 7fc629dac640 1 -- 172.21.15.19:0/3388425100 learned_addr learned my addr 172.21.15.19:0/3388425100 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:30.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.739+0000 7fc6295ab640 1 --2- 172.21.15.19:0/3388425100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc624136580 0x7fc624099e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:30.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.739+0000 7fc62a5ad640 1 --2- 172.21.15.19:0/3388425100 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc6241370f0 0x7fc62409a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:30.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.739+0000 7fc629dac640 1 -- 172.21.15.19:0/3388425100 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc6241370f0 msgr2=0x7fc62409a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:30.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.739+0000 7fc629dac640 1 --2- 172.21.15.19:0/3388425100 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc6241370f0 0x7fc62409a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:30.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.739+0000 7fc629dac640 1 -- 172.21.15.19:0/3388425100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc624136580 msgr2=0x7fc624099e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:30.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.739+0000 7fc629dac640 1 --2- 172.21.15.19:0/3388425100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc624136580 0x7fc624099e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:30.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.739+0000 7fc629dac640 1 -- 172.21.15.19:0/3388425100 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61c0094d0 con 0x7fc6241361a0 2023-11-04T15:27:30.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.739+0000 7fc629dac640 1 --2- 172.21.15.19:0/3388425100 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6241361a0 0x7fc6240998e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc61c02b830 tx=0x7fc61c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:30.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.739+0000 7fc61a7fc640 1 -- 172.21.15.19:0/3388425100 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c033c80 con 0x7fc6241361a0 2023-11-04T15:27:30.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.739+0000 7fc61a7fc640 1 -- 172.21.15.19:0/3388425100 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61c033de0 con 0x7fc6241361a0 2023-11-04T15:27:30.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.739+0000 7fc61a7fc640 1 -- 172.21.15.19:0/3388425100 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c03c620 con 0x7fc6241361a0 2023-11-04T15:27:30.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.739+0000 7fc62c010640 1 -- 172.21.15.19:0/3388425100 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc62409d6c0 con 0x7fc6241361a0 2023-11-04T15:27:30.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.740+0000 7fc62c010640 1 -- 172.21.15.19:0/3388425100 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc62409cc60 con 0x7fc6241361a0 2023-11-04T15:27:30.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.740+0000 7fc62c010640 1 -- 172.21.15.19:0/3388425100 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc62409dbc0 con 0x7fc6241361a0 2023-11-04T15:27:30.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.741+0000 7fc61a7fc640 1 -- 172.21.15.19:0/3388425100 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc61c03a040 con 0x7fc6241361a0 2023-11-04T15:27:30.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.741+0000 7fc61a7fc640 1 --2- 172.21.15.19:0/3388425100 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc60806a430 0x7fc60806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:30.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.741+0000 7fc61a7fc640 1 -- 172.21.15.19:0/3388425100 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 3471+0+0 (secure 0 0 0) 0x7fc61c0a9c60 con 0x7fc6241361a0 2023-11-04T15:27:30.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.742+0000 7fc6295ab640 1 --2- 172.21.15.19:0/3388425100 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc60806a430 0x7fc60806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:30.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.742+0000 7fc6295ab640 1 --2- 172.21.15.19:0/3388425100 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc60806a430 0x7fc60806c8f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc624135240 tx=0x7fc614009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:30.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.746+0000 7fc61a7fc640 1 -- 172.21.15.19:0/3388425100 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc61c075ba0 con 0x7fc6241361a0 2023-11-04T15:27:30.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:30.921+0000 7fc62c010640 1 -- 172.21.15.19:0/3388425100 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc62404e040 con 0x7fc6241361a0 2023-11-04T15:27:31.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.617+0000 7fc61a7fc640 1 -- 172.21.15.19:0/3388425100 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v14) v1 ==== 173+0+0 (secure 0 0 0) 0x7fc61c038070 con 0x7fc6241361a0 2023-11-04T15:27:31.619 INFO:teuthology.orchestra.run.smithi019.stderr:enabled application 'rbd' on pool 'rbd' 2023-11-04T15:27:31.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.621+0000 7fc62c010640 1 -- 172.21.15.19:0/3388425100 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc60806a430 msgr2=0x7fc60806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:31.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.621+0000 7fc62c010640 1 --2- 172.21.15.19:0/3388425100 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc60806a430 0x7fc60806c8f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc624135240 tx=0x7fc614009040 comp rx=0 tx=0).stop 2023-11-04T15:27:31.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.621+0000 7fc62c010640 1 -- 172.21.15.19:0/3388425100 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6241361a0 msgr2=0x7fc6240998e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:31.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.621+0000 7fc62c010640 1 --2- 172.21.15.19:0/3388425100 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6241361a0 0x7fc6240998e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc61c02b830 tx=0x7fc61c0046c0 comp rx=0 tx=0).stop 2023-11-04T15:27:31.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.621+0000 7fc62c010640 1 -- 172.21.15.19:0/3388425100 shutdown_connections 2023-11-04T15:27:31.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.621+0000 7fc62c010640 1 --2- 172.21.15.19:0/3388425100 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc60806a430 0x7fc60806c8f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:31.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.621+0000 7fc62c010640 1 --2- 172.21.15.19:0/3388425100 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc6241370f0 0x7fc62409a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:31.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.621+0000 7fc62c010640 1 --2- 172.21.15.19:0/3388425100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc624136580 0x7fc624099e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:31.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.621+0000 7fc62c010640 1 --2- 172.21.15.19:0/3388425100 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6241361a0 0x7fc6240998e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:31.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.621+0000 7fc62c010640 1 -- 172.21.15.19:0/3388425100 >> 172.21.15.19:0/3388425100 conn(0x7fc6240ac3f0 msgr2=0x7fc6240aa1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:31.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.622+0000 7fc62c010640 1 -- 172.21.15.19:0/3388425100 shutdown_connections 2023-11-04T15:27:31.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.622+0000 7fc62c010640 1 -- 172.21.15.19:0/3388425100 wait complete. 2023-11-04T15:27:31.637 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-04T15:27:31.637 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T15:27:31.638 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T15:27:31.640 INFO:tasks.ceph.mds.a:Started 2023-11-04T15:27:31.640 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T15:27:31.641 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T15:27:31.643 INFO:tasks.ceph.mds.b:Started 2023-11-04T15:27:31.644 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-04T15:27:31.644 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T15:27:31.723 INFO:tasks.ceph.mds.b.smithi096.stdout:starting mds.b at 2023-11-04T15:27:31.724 INFO:tasks.ceph.mds.a.smithi019.stdout:starting mds.a at 2023-11-04T15:27:31.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.755+0000 7fa9d4549640 1 Processor -- start 2023-11-04T15:27:31.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.755+0000 7fa9d4549640 1 -- start start 2023-11-04T15:27:31.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.756+0000 7fa9d4549640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa9cc137270 0x7fa9cc0a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:31.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.756+0000 7fa9d4549640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa9cc137650 0x7fa9cc13a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:31.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.756+0000 7fa9d4549640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9cc0a4c20 con 0x7fa9cc0a3e90 2023-11-04T15:27:31.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.756+0000 7fa9d4549640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9cc0a3060 con 0x7fa9cc137270 2023-11-04T15:27:31.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.756+0000 7fa9d4549640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9cc0a5080 con 0x7fa9cc137650 2023-11-04T15:27:31.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.756+0000 7fa9d22e5640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa9cc137270 0x7fa9cc0a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:31.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.756+0000 7fa9d22e5640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa9cc137270 0x7fa9cc0a6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45734/0 (socket says 172.21.15.19:45734) 2023-11-04T15:27:31.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.756+0000 7fa9d22e5640 1 -- 172.21.15.19:0/190603085 learned_addr learned my addr 172.21.15.19:0/190603085 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:31.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.756+0000 7fa9d2ae6640 1 --2- 172.21.15.19:0/190603085 >> v2:172.21.15.96:3300/0 conn(0x7fa9cc137650 0x7fa9cc13a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:31.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.756+0000 7fa9d22e5640 1 -- 172.21.15.19:0/190603085 >> v2:172.21.15.96:3300/0 conn(0x7fa9cc137650 msgr2=0x7fa9cc13a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:31.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.756+0000 7fa9d22e5640 1 --2- 172.21.15.19:0/190603085 >> v2:172.21.15.96:3300/0 conn(0x7fa9cc137650 0x7fa9cc13a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:31.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.756+0000 7fa9d22e5640 1 -- 172.21.15.19:0/190603085 >> v1:172.21.15.96:6789/0 conn(0x7fa9cc0a3e90 legacy=0x7fa9cc139f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:31.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.756+0000 7fa9d22e5640 1 -- 172.21.15.19:0/190603085 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9cc0a3440 con 0x7fa9cc137270 2023-11-04T15:27:31.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.757+0000 7fa9d22e5640 1 --2- 172.21.15.19:0/190603085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9cc137270 0x7fa9cc0a6200 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc0a5800 tx=0x7fa9c802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=862f510e802a2ee0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:31.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.757+0000 7fa9d12e3640 1 -- 172.21.15.19:0/190603085 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c80317e0 con 0x7fa9cc137270 2023-11-04T15:27:31.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.757+0000 7fa9d12e3640 1 -- 172.21.15.19:0/190603085 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c8031940 con 0x7fa9cc137270 2023-11-04T15:27:31.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.757+0000 7fa9d12e3640 1 -- 172.21.15.19:0/190603085 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8031cd0 con 0x7fa9cc137270 2023-11-04T15:27:31.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.757+0000 7fa9d4549640 1 -- 172.21.15.19:0/190603085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9cc137270 msgr2=0x7fa9cc0a6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:31.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.757+0000 7fa9d4549640 1 --2- 172.21.15.19:0/190603085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9cc137270 0x7fa9cc0a6200 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc0a5800 tx=0x7fa9c802b880 comp rx=0 tx=0).stop 2023-11-04T15:27:31.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.758+0000 7fa9d4549640 1 -- 172.21.15.19:0/190603085 shutdown_connections 2023-11-04T15:27:31.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.758+0000 7fa9d4549640 1 --2- 172.21.15.19:0/190603085 >> v2:172.21.15.96:3300/0 conn(0x7fa9cc137650 0x7fa9cc13a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:31.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.758+0000 7fa9d4549640 1 --2- 172.21.15.19:0/190603085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9cc137270 0x7fa9cc0a6200 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:31.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.758+0000 7fa9d4549640 1 -- 172.21.15.19:0/190603085 >> 172.21.15.19:0/190603085 conn(0x7fa9cc0a8d70 msgr2=0x7fa9cc0a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:31.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.758+0000 7fa9d4549640 1 -- 172.21.15.19:0/190603085 shutdown_connections 2023-11-04T15:27:31.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.758+0000 7fa9d4549640 1 -- 172.21.15.19:0/190603085 wait complete. 2023-11-04T15:27:31.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.758+0000 7fa9d4549640 1 Processor -- start 2023-11-04T15:27:31.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.759+0000 7fa9d4549640 1 -- start start 2023-11-04T15:27:31.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.759+0000 7fa9d4549640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9cc0a3e90 0x7fa9cc1cba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:31.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.759+0000 7fa9d4549640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9cc137270 0x7fa9cc1cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:31.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.759+0000 7fa9d4549640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9cc137650 0x7fa9cc1cead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:31.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.759+0000 7fa9d4549640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc09f6a0 con 0x7fa9cc0a3e90 2023-11-04T15:27:31.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.759+0000 7fa9d4549640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc09e470 con 0x7fa9cc137270 2023-11-04T15:27:31.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.759+0000 7fa9d4549640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc09cd20 con 0x7fa9cc137650 2023-11-04T15:27:31.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.759+0000 7fa9d22e5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9cc0a3e90 0x7fa9cc1cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:31.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.759+0000 7fa9d22e5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9cc0a3e90 0x7fa9cc1cba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45740/0 (socket says 172.21.15.19:45740) 2023-11-04T15:27:31.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.759+0000 7fa9d22e5640 1 -- 172.21.15.19:0/1352749606 learned_addr learned my addr 172.21.15.19:0/1352749606 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:31.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.759+0000 7fa9d1ae4640 1 --2- 172.21.15.19:0/1352749606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9cc137270 0x7fa9cc1cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:31.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.759+0000 7fa9d2ae6640 1 --2- 172.21.15.19:0/1352749606 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9cc137650 0x7fa9cc1cead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:31.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.759+0000 7fa9d22e5640 1 -- 172.21.15.19:0/1352749606 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9cc137650 msgr2=0x7fa9cc1cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:31.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.759+0000 7fa9d22e5640 1 --2- 172.21.15.19:0/1352749606 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9cc137650 0x7fa9cc1cead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:31.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.759+0000 7fa9d22e5640 1 -- 172.21.15.19:0/1352749606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9cc137270 msgr2=0x7fa9cc1cbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:31.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.759+0000 7fa9d22e5640 1 --2- 172.21.15.19:0/1352749606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9cc137270 0x7fa9cc1cbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:31.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.759+0000 7fa9d22e5640 1 -- 172.21.15.19:0/1352749606 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c80094d0 con 0x7fa9cc0a3e90 2023-11-04T15:27:31.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.759+0000 7fa9d2ae6640 1 --2- 172.21.15.19:0/1352749606 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9cc137650 0x7fa9cc1cead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:27:31.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.760+0000 7fa9d22e5640 1 --2- 172.21.15.19:0/1352749606 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9cc0a3e90 0x7fa9cc1cba80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8000c00 tx=0x7fa9c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:31.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.760+0000 7fa9c2ffd640 1 -- 172.21.15.19:0/1352749606 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8032880 con 0x7fa9cc0a3e90 2023-11-04T15:27:31.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.760+0000 7fa9c2ffd640 1 -- 172.21.15.19:0/1352749606 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c8032a00 con 0x7fa9cc0a3e90 2023-11-04T15:27:31.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.760+0000 7fa9d4549640 1 -- 172.21.15.19:0/1352749606 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9cc09fb60 con 0x7fa9cc0a3e90 2023-11-04T15:27:31.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.760+0000 7fa9c2ffd640 1 -- 172.21.15.19:0/1352749606 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8032db0 con 0x7fa9cc0a3e90 2023-11-04T15:27:31.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.760+0000 7fa9d4549640 1 -- 172.21.15.19:0/1352749606 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9cc09f880 con 0x7fa9cc0a3e90 2023-11-04T15:27:31.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.761+0000 7fa9d4549640 1 -- 172.21.15.19:0/1352749606 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9cc067d60 con 0x7fa9cc0a3e90 2023-11-04T15:27:31.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.761+0000 7fa9c2ffd640 1 -- 172.21.15.19:0/1352749606 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa9c804e450 con 0x7fa9cc0a3e90 2023-11-04T15:27:31.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.761+0000 7fa9c2ffd640 1 --2- 172.21.15.19:0/1352749606 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa9b006a430 0x7fa9b006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:31.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.762+0000 7fa9c2ffd640 1 -- 172.21.15.19:0/1352749606 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fa9c80aa160 con 0x7fa9cc0a3e90 2023-11-04T15:27:31.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.762+0000 7fa9d1ae4640 1 --2- 172.21.15.19:0/1352749606 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa9b006a430 0x7fa9b006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:31.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.762+0000 7fa9d1ae4640 1 --2- 172.21.15.19:0/1352749606 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa9b006a430 0x7fa9b006c8f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc09d0b0 tx=0x7fa9bc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:31.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.766+0000 7fa9c2ffd640 1 -- 172.21.15.19:0/1352749606 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa9c8076090 con 0x7fa9cc0a3e90 2023-11-04T15:27:31.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.943+0000 7fa9d4549640 1 -- 172.21.15.19:0/1352749606 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9cc0a3af0 con 0x7fa9cc0a3e90 2023-11-04T15:27:31.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.944+0000 7fa9c2ffd640 1 -- 172.21.15.19:0/1352749606 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9423 (secure 0 0 0) 0x7fa9c80796b0 con 0x7fa9cc0a3e90 2023-11-04T15:27:31.946 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:27:31.947 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":14,"fsid":"e87311d5-496a-4b07-9654-358fe5bbf950","created":"2023-11-04T15:27:14.865121+0000","modified":"2023-11-04T15:27:31.613756+0000","last_up_change":"2023-11-04T15:27:24.162282+0000","last_in_change":"2023-11-04T15:27:15.971035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T15:27:24.987312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-04T15:27:30.500235+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"34818469-ebf2-4dd4-8119-af19a0121036","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":82879},{"type":"v1","addr":"172.21.15.19:6801","nonce":82879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":82879},{"type":"v1","addr":"172.21.15.19:6803","nonce":82879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":82879},{"type":"v1","addr":"172.21.15.19:6807","nonce":82879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":82879},{"type":"v1","addr":"172.21.15.19:6805","nonce":82879}]},"public_addr":"172.21.15.19:6801/82879","cluster_addr":"172.21.15.19:6803/82879","heartbeat_back_addr":"172.21.15.19:6807/82879","heartbeat_front_addr":"172.21.15.19:6805/82879","state":["exists","up"]},{"osd":1,"uuid":"92dab290-7912-4eea-b6f6-c754c2480721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":82880},{"type":"v1","addr":"172.21.15.19:6809","nonce":82880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":82880},{"type":"v1","addr":"172.21.15.19:6811","nonce":82880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":82880},{"type":"v1","addr":"172.21.15.19:6815","nonce":82880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":82880},{"type":"v1","addr":"172.21.15.19:6813","nonce":82880}]},"public_addr":"172.21.15.19:6809/82880","cluster_addr":"172.21.15.19:6811/82880","heartbeat_back_addr":"172.21.15.19:6815/82880","heartbeat_front_addr":"172.21.15.19:6813/82880","state":["exists","up"]},{"osd":2,"uuid":"1be47db4-6dd1-4ce5-832b-bc6ad30c78c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":83458},{"type":"v1","addr":"172.21.15.96:6808","nonce":83458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":83458},{"type":"v1","addr":"172.21.15.96:6811","nonce":83458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":83458},{"type":"v1","addr":"172.21.15.96:6815","nonce":83458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":83458},{"type":"v1","addr":"172.21.15.96:6813","nonce":83458}]},"public_addr":"172.21.15.96:6808/83458","cluster_addr":"172.21.15.96:6811/83458","heartbeat_back_addr":"172.21.15.96:6815/83458","heartbeat_front_addr":"172.21.15.96:6813/83458","state":["exists","up"]},{"osd":3,"uuid":"46505800-d64f-49ef-b811-5b5979f48252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":83459},{"type":"v1","addr":"172.21.15.96:6801","nonce":83459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":83459},{"type":"v1","addr":"172.21.15.96:6803","nonce":83459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6807","nonce":83459},{"type":"v1","addr":"172.21.15.96:6809","nonce":83459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":83459},{"type":"v1","addr":"172.21.15.96:6805","nonce":83459}]},"public_addr":"172.21.15.96:6801/83459","cluster_addr":"172.21.15.96:6803/83459","heartbeat_back_addr":"172.21.15.96:6809/83459","heartbeat_front_addr":"172.21.15.96:6805/83459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.081547+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.132075+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.094919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.074106+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T15:27:31.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.946+0000 7fa9d4549640 1 -- 172.21.15.19:0/1352749606 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa9b006a430 msgr2=0x7fa9b006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:31.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.946+0000 7fa9d4549640 1 --2- 172.21.15.19:0/1352749606 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa9b006a430 0x7fa9b006c8f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc09d0b0 tx=0x7fa9bc009040 comp rx=0 tx=0).stop 2023-11-04T15:27:31.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.946+0000 7fa9d4549640 1 -- 172.21.15.19:0/1352749606 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9cc0a3e90 msgr2=0x7fa9cc1cba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:31.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.946+0000 7fa9d4549640 1 --2- 172.21.15.19:0/1352749606 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9cc0a3e90 0x7fa9cc1cba80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8000c00 tx=0x7fa9c80046c0 comp rx=0 tx=0).stop 2023-11-04T15:27:31.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.946+0000 7fa9d4549640 1 -- 172.21.15.19:0/1352749606 shutdown_connections 2023-11-04T15:27:31.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.946+0000 7fa9d4549640 1 --2- 172.21.15.19:0/1352749606 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa9b006a430 0x7fa9b006c8f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:31.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.946+0000 7fa9d4549640 1 --2- 172.21.15.19:0/1352749606 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9cc137650 0x7fa9cc1cead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:31.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.946+0000 7fa9d4549640 1 --2- 172.21.15.19:0/1352749606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9cc137270 0x7fa9cc1cbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:31.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.946+0000 7fa9d4549640 1 --2- 172.21.15.19:0/1352749606 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9cc0a3e90 0x7fa9cc1cba80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:31.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.946+0000 7fa9d4549640 1 -- 172.21.15.19:0/1352749606 >> 172.21.15.19:0/1352749606 conn(0x7fa9cc0a8d70 msgr2=0x7fa9cc139d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:31.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.946+0000 7fa9d4549640 1 -- 172.21.15.19:0/1352749606 shutdown_connections 2023-11-04T15:27:31.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:31.946+0000 7fa9d4549640 1 -- 172.21.15.19:0/1352749606 wait complete. 2023-11-04T15:27:31.959 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T15:27:24.987312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-04T15:27:30.500235+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T15:27:31.960 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T15:27:32.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.066+0000 7f0626fdd640 1 Processor -- start 2023-11-04T15:27:32.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.066+0000 7f0626fdd640 1 -- start start 2023-11-04T15:27:32.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.067+0000 7f0626fdd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0620130ef0 0x7f06201312d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:32.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.067+0000 7f0626fdd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0620136f10 0x7f0620137370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:32.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.067+0000 7f0626fdd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f06201378b0 0x7f062013e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:32.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.067+0000 7f0626fdd640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06200a0d20 con 0x7f0620130ef0 2023-11-04T15:27:32.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.067+0000 7f0626fdd640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06200a57d0 con 0x7f06201378b0 2023-11-04T15:27:32.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.067+0000 7f0626fdd640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0620137d40 con 0x7f0620136f10 2023-11-04T15:27:32.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.067+0000 7f0624d79640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0620130ef0 0x7f06201312d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:32.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.067+0000 7f0624d79640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0620130ef0 0x7f06201312d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45752/0 (socket says 172.21.15.19:45752) 2023-11-04T15:27:32.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.067+0000 7f0624d79640 1 -- 172.21.15.19:0/2899278145 learned_addr learned my addr 172.21.15.19:0/2899278145 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:32.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.067+0000 7f062557a640 1 --2- 172.21.15.19:0/2899278145 >> v2:172.21.15.96:3300/0 conn(0x7f06201378b0 0x7f062013e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:32.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.067+0000 7f061ffff640 1 --2- 172.21.15.19:0/2899278145 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0620136f10 0x7f0620137370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:32.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.067+0000 7f0624d79640 1 -- 172.21.15.19:0/2899278145 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0620136f10 msgr2=0x7f0620137370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:32.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.067+0000 7f0624d79640 1 --2- 172.21.15.19:0/2899278145 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0620136f10 0x7f0620137370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:32.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.067+0000 7f0624d79640 1 -- 172.21.15.19:0/2899278145 >> v2:172.21.15.96:3300/0 conn(0x7f06201378b0 msgr2=0x7f062013e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:32.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.067+0000 7f0624d79640 1 --2- 172.21.15.19:0/2899278145 >> v2:172.21.15.96:3300/0 conn(0x7f06201378b0 0x7f062013e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:32.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.067+0000 7f0624d79640 1 -- 172.21.15.19:0/2899278145 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06200a2350 con 0x7f0620130ef0 2023-11-04T15:27:32.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.068+0000 7f0624d79640 1 --2- 172.21.15.19:0/2899278145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0620130ef0 0x7f06201312d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0620134ab0 tx=0x7f061402b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bde00e4c8a1dfd8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:32.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.068+0000 7f061f7fe640 1 -- 172.21.15.19:0/2899278145 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0614031750 con 0x7f0620130ef0 2023-11-04T15:27:32.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.068+0000 7f061f7fe640 1 -- 172.21.15.19:0/2899278145 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06140318b0 con 0x7f0620130ef0 2023-11-04T15:27:32.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.068+0000 7f061f7fe640 1 -- 172.21.15.19:0/2899278145 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0614031c40 con 0x7f0620130ef0 2023-11-04T15:27:32.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.069+0000 7f0626fdd640 1 -- 172.21.15.19:0/2899278145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0620130ef0 msgr2=0x7f06201312d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:32.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.069+0000 7f0626fdd640 1 --2- 172.21.15.19:0/2899278145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0620130ef0 0x7f06201312d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0620134ab0 tx=0x7f061402b7f0 comp rx=0 tx=0).stop 2023-11-04T15:27:32.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.069+0000 7f0626fdd640 1 -- 172.21.15.19:0/2899278145 shutdown_connections 2023-11-04T15:27:32.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.069+0000 7f0626fdd640 1 --2- 172.21.15.19:0/2899278145 >> v2:172.21.15.96:3300/0 conn(0x7f06201378b0 0x7f062013e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:32.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.069+0000 7f0626fdd640 1 --2- 172.21.15.19:0/2899278145 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0620136f10 0x7f0620137370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:32.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.069+0000 7f0626fdd640 1 --2- 172.21.15.19:0/2899278145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0620130ef0 0x7f06201312d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:32.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.069+0000 7f0626fdd640 1 -- 172.21.15.19:0/2899278145 >> 172.21.15.19:0/2899278145 conn(0x7f06200a90b0 msgr2=0x7f06200a94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:32.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.069+0000 7f0626fdd640 1 -- 172.21.15.19:0/2899278145 shutdown_connections 2023-11-04T15:27:32.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.069+0000 7f0626fdd640 1 -- 172.21.15.19:0/2899278145 wait complete. 2023-11-04T15:27:32.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.070+0000 7f0626fdd640 1 Processor -- start 2023-11-04T15:27:32.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.070+0000 7f0626fdd640 1 -- start start 2023-11-04T15:27:32.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.070+0000 7f0626fdd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0620130ef0 0x7f0620126dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:32.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.070+0000 7f0626fdd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0620136f10 0x7f0620127300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:32.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.070+0000 7f0626fdd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f06201378b0 0x7f06201cf140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:32.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.070+0000 7f0626fdd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0620070750 con 0x7f0620130ef0 2023-11-04T15:27:32.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.070+0000 7f0626fdd640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062012ad40 con 0x7f0620136f10 2023-11-04T15:27:32.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.070+0000 7f0626fdd640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f062006eb90 con 0x7f06201378b0 2023-11-04T15:27:32.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.070+0000 7f0624d79640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0620130ef0 0x7f0620126dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:32.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.070+0000 7f0624d79640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0620130ef0 0x7f0620126dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45758/0 (socket says 172.21.15.19:45758) 2023-11-04T15:27:32.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.070+0000 7f0624d79640 1 -- 172.21.15.19:0/3857005419 learned_addr learned my addr 172.21.15.19:0/3857005419 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:32.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.071+0000 7f062557a640 1 --2- 172.21.15.19:0/3857005419 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f06201378b0 0x7f06201cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:32.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.071+0000 7f061ffff640 1 --2- 172.21.15.19:0/3857005419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0620136f10 0x7f0620127300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:32.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.071+0000 7f0624d79640 1 -- 172.21.15.19:0/3857005419 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f06201378b0 msgr2=0x7f06201cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:32.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.071+0000 7f0624d79640 1 --2- 172.21.15.19:0/3857005419 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f06201378b0 0x7f06201cf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:32.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.071+0000 7f0624d79640 1 -- 172.21.15.19:0/3857005419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0620136f10 msgr2=0x7f0620127300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:32.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.071+0000 7f0624d79640 1 --2- 172.21.15.19:0/3857005419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0620136f10 0x7f0620127300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:32.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.071+0000 7f0624d79640 1 -- 172.21.15.19:0/3857005419 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06140094d0 con 0x7f0620130ef0 2023-11-04T15:27:32.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.071+0000 7f0624d79640 1 --2- 172.21.15.19:0/3857005419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0620130ef0 0x7f0620126dc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0614000c00 tx=0x7f06140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:32.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.071+0000 7f061d7fa640 1 -- 172.21.15.19:0/3857005419 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06140338d0 con 0x7f0620130ef0 2023-11-04T15:27:32.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.071+0000 7f061d7fa640 1 -- 172.21.15.19:0/3857005419 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0614033a30 con 0x7f0620130ef0 2023-11-04T15:27:32.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.071+0000 7f0626fdd640 1 -- 172.21.15.19:0/3857005419 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0620070080 con 0x7f0620130ef0 2023-11-04T15:27:32.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.071+0000 7f061d7fa640 1 -- 172.21.15.19:0/3857005419 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0614033dc0 con 0x7f0620130ef0 2023-11-04T15:27:32.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.071+0000 7f0626fdd640 1 -- 172.21.15.19:0/3857005419 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0620070ca0 con 0x7f0620130ef0 2023-11-04T15:27:32.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.072+0000 7f0626fdd640 1 -- 172.21.15.19:0/3857005419 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0620067d60 con 0x7f0620130ef0 2023-11-04T15:27:32.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.072+0000 7f061d7fa640 1 -- 172.21.15.19:0/3857005419 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f061403a040 con 0x7f0620130ef0 2023-11-04T15:27:32.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.073+0000 7f061d7fa640 1 --2- 172.21.15.19:0/3857005419 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f060406a430 0x7f060406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:32.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.073+0000 7f061d7fa640 1 -- 172.21.15.19:0/3857005419 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f06140a9bd0 con 0x7f0620130ef0 2023-11-04T15:27:32.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.073+0000 7f061ffff640 1 --2- 172.21.15.19:0/3857005419 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f060406a430 0x7f060406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:32.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.073+0000 7f061ffff640 1 --2- 172.21.15.19:0/3857005419 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f060406a430 0x7f060406c8f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f062012af80 tx=0x7f060c008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:32.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.077+0000 7f061d7fa640 1 -- 172.21.15.19:0/3857005419 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0614075c20 con 0x7f0620130ef0 2023-11-04T15:27:32.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.251+0000 7f0626fdd640 1 -- 172.21.15.19:0/3857005419 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f06200a0b00 con 0x7f0620130ef0 2023-11-04T15:27:32.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.252+0000 7f061d7fa640 1 -- 172.21.15.19:0/3857005419 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v14) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0614038030 con 0x7f0620130ef0 2023-11-04T15:27:32.254 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-11-04T15:27:32.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.254+0000 7f0626fdd640 1 -- 172.21.15.19:0/3857005419 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f060406a430 msgr2=0x7f060406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:32.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.254+0000 7f0626fdd640 1 --2- 172.21.15.19:0/3857005419 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f060406a430 0x7f060406c8f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f062012af80 tx=0x7f060c008040 comp rx=0 tx=0).stop 2023-11-04T15:27:32.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.254+0000 7f0626fdd640 1 -- 172.21.15.19:0/3857005419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0620130ef0 msgr2=0x7f0620126dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:32.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.254+0000 7f0626fdd640 1 --2- 172.21.15.19:0/3857005419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0620130ef0 0x7f0620126dc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0614000c00 tx=0x7f06140046c0 comp rx=0 tx=0).stop 2023-11-04T15:27:32.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.254+0000 7f0626fdd640 1 -- 172.21.15.19:0/3857005419 shutdown_connections 2023-11-04T15:27:32.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.254+0000 7f0626fdd640 1 --2- 172.21.15.19:0/3857005419 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f060406a430 0x7f060406c8f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:32.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.254+0000 7f0626fdd640 1 --2- 172.21.15.19:0/3857005419 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f06201378b0 0x7f06201cf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:32.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.254+0000 7f0626fdd640 1 --2- 172.21.15.19:0/3857005419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0620136f10 0x7f0620127300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:32.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.254+0000 7f0626fdd640 1 --2- 172.21.15.19:0/3857005419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0620130ef0 0x7f0620126dc0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:32.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.254+0000 7f0626fdd640 1 -- 172.21.15.19:0/3857005419 >> 172.21.15.19:0/3857005419 conn(0x7f06200a90b0 msgr2=0x7f0620129a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:32.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.254+0000 7f0626fdd640 1 -- 172.21.15.19:0/3857005419 shutdown_connections 2023-11-04T15:27:32.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.254+0000 7f0626fdd640 1 -- 172.21.15.19:0/3857005419 wait complete. 2023-11-04T15:27:32.266 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-04T15:27:32.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.373+0000 7f994740b640 1 Processor -- start 2023-11-04T15:27:32.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.373+0000 7f994740b640 1 -- start start 2023-11-04T15:27:32.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.373+0000 7f994740b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9940136090 0x7f9940136470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:32.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.373+0000 7f994740b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99400abe60 con 0x7f994013a840 2023-11-04T15:27:32.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.373+0000 7f994740b640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99400a30a0 con 0x7f99400a6370 2023-11-04T15:27:32.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.373+0000 7f994740b640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99400a4b90 con 0x7f9940136090 2023-11-04T15:27:32.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.373+0000 7f99459a8640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f994013a840 0x7f9940142470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50464/0 (socket says 172.21.15.19:50464) 2023-11-04T15:27:32.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.373+0000 7f99459a8640 1 -- 172.21.15.19:0/4124130715 learned_addr learned my addr 172.21.15.19:0/4124130715 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:32.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.374+0000 7f99451a7640 1 --2- 172.21.15.19:0/4124130715 >> v2:172.21.15.96:3300/0 conn(0x7f9940136090 0x7f9940136470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:32.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.374+0000 7f9937fff640 1 -- 172.21.15.19:0/4124130715 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2352868596 0 0) 0x7f99400abe60 con 0x7f994013a840 2023-11-04T15:27:32.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.374+0000 7f9937fff640 1 -- 172.21.15.19:0/4124130715 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f992c003520 con 0x7f994013a840 2023-11-04T15:27:32.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.374+0000 7f99451a7640 1 -- 172.21.15.19:0/4124130715 >> v1:172.21.15.96:6789/0 conn(0x7f99400a6370 legacy=0x7f994013a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:32.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.374+0000 7f9937fff640 1 -- 172.21.15.19:0/4124130715 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3563088011 0 0) 0x7f99400a30a0 con 0x7f99400a6370 2023-11-04T15:27:32.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.374+0000 7f99451a7640 1 -- 172.21.15.19:0/4124130715 >> v1:172.21.15.19:6789/0 conn(0x7f994013a840 legacy=0x7f9940142470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:32.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.374+0000 7f99451a7640 1 -- 172.21.15.19:0/4124130715 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99400a51f0 con 0x7f9940136090 2023-11-04T15:27:32.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.375+0000 7f99451a7640 1 --2- 172.21.15.19:0/4124130715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9940136090 0x7f9940136470 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f993c0097a0 tx=0x7f993c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f572f062c43ff386 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:32.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.375+0000 7f9937fff640 1 -- 172.21.15.19:0/4124130715 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c02e070 con 0x7f9940136090 2023-11-04T15:27:32.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.375+0000 7f9937fff640 1 -- 172.21.15.19:0/4124130715 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993c0315a0 con 0x7f9940136090 2023-11-04T15:27:32.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.375+0000 7f9937fff640 1 -- 172.21.15.19:0/4124130715 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c031930 con 0x7f9940136090 2023-11-04T15:27:32.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.375+0000 7f994740b640 1 -- 172.21.15.19:0/4124130715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9940136090 msgr2=0x7f9940136470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:32.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.375+0000 7f994740b640 1 --2- 172.21.15.19:0/4124130715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9940136090 0x7f9940136470 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f993c0097a0 tx=0x7f993c02b840 comp rx=0 tx=0).stop 2023-11-04T15:27:32.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.375+0000 7f994740b640 1 -- 172.21.15.19:0/4124130715 shutdown_connections 2023-11-04T15:27:32.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.375+0000 7f994740b640 1 --2- 172.21.15.19:0/4124130715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9940136090 0x7f9940136470 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:32.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.375+0000 7f994740b640 1 -- 172.21.15.19:0/4124130715 >> 172.21.15.19:0/4124130715 conn(0x7f99400ac3f0 msgr2=0x7f99400ac800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:32.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.375+0000 7f994740b640 1 -- 172.21.15.19:0/4124130715 shutdown_connections 2023-11-04T15:27:32.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.375+0000 7f994740b640 1 -- 172.21.15.19:0/4124130715 wait complete. 2023-11-04T15:27:32.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.376+0000 7f994740b640 1 Processor -- start 2023-11-04T15:27:32.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.376+0000 7f994740b640 1 -- start start 2023-11-04T15:27:32.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.377+0000 7f994740b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99400a6370 0x7f9940131f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:32.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.377+0000 7f994740b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9940136090 0x7f9940132490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:32.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.377+0000 7f994740b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f994013a840 0x7f99401ce840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:32.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.377+0000 7f994740b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9940099fd0 con 0x7f99400a6370 2023-11-04T15:27:32.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.377+0000 7f994740b640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99400a8180 con 0x7f9940136090 2023-11-04T15:27:32.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.377+0000 7f994740b640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9940098640 con 0x7f994013a840 2023-11-04T15:27:32.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.377+0000 7f99451a7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99400a6370 0x7f9940131f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:32.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.377+0000 7f99451a7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99400a6370 0x7f9940131f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45764/0 (socket says 172.21.15.19:45764) 2023-11-04T15:27:32.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.377+0000 7f99451a7640 1 -- 172.21.15.19:0/747169520 learned_addr learned my addr 172.21.15.19:0/747169520 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:32.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.377+0000 7f99449a6640 1 --2- 172.21.15.19:0/747169520 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9940136090 0x7f9940132490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:32.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.377+0000 7f99459a8640 1 --2- 172.21.15.19:0/747169520 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f994013a840 0x7f99401ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:32.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.377+0000 7f99451a7640 1 -- 172.21.15.19:0/747169520 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f994013a840 msgr2=0x7f99401ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:32.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.377+0000 7f99451a7640 1 --2- 172.21.15.19:0/747169520 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f994013a840 0x7f99401ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:32.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.377+0000 7f99451a7640 1 -- 172.21.15.19:0/747169520 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9940136090 msgr2=0x7f9940132490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:32.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.377+0000 7f99451a7640 1 --2- 172.21.15.19:0/747169520 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9940136090 0x7f9940132490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:32.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.377+0000 7f99451a7640 1 -- 172.21.15.19:0/747169520 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f993c009400 con 0x7f99400a6370 2023-11-04T15:27:32.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.377+0000 7f99449a6640 1 --2- 172.21.15.19:0/747169520 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9940136090 0x7f9940132490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:27:32.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.377+0000 7f99459a8640 1 --2- 172.21.15.19:0/747169520 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f994013a840 0x7f99401ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:27:32.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.377+0000 7f99451a7640 1 --2- 172.21.15.19:0/747169520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99400a6370 0x7f9940131f50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f993c02be50 tx=0x7f993c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:32.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.378+0000 7f9935ffb640 1 -- 172.21.15.19:0/747169520 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c032630 con 0x7f99400a6370 2023-11-04T15:27:32.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.378+0000 7f9935ffb640 1 -- 172.21.15.19:0/747169520 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993c032790 con 0x7f99400a6370 2023-11-04T15:27:32.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.378+0000 7f994740b640 1 -- 172.21.15.19:0/747169520 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9940097c00 con 0x7f99400a6370 2023-11-04T15:27:32.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.378+0000 7f9935ffb640 1 -- 172.21.15.19:0/747169520 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c032b20 con 0x7f99400a6370 2023-11-04T15:27:32.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.378+0000 7f994740b640 1 -- 172.21.15.19:0/747169520 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9940099bf0 con 0x7f99400a6370 2023-11-04T15:27:32.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.379+0000 7f994740b640 1 -- 172.21.15.19:0/747169520 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f994009ab80 con 0x7f99400a6370 2023-11-04T15:27:32.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.379+0000 7f9935ffb640 1 -- 172.21.15.19:0/747169520 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f993c043070 con 0x7f99400a6370 2023-11-04T15:27:32.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.380+0000 7f9935ffb640 1 --2- 172.21.15.19:0/747169520 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f992406a430 0x7f992406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:32.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.380+0000 7f9935ffb640 1 -- 172.21.15.19:0/747169520 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f993c0a9920 con 0x7f99400a6370 2023-11-04T15:27:32.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.380+0000 7f99449a6640 1 --2- 172.21.15.19:0/747169520 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f992406a430 0x7f992406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:32.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.380+0000 7f99449a6640 1 --2- 172.21.15.19:0/747169520 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f992406a430 0x7f992406c8f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f99400a9d50 tx=0x7f9930009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:32.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.384+0000 7f9935ffb640 1 -- 172.21.15.19:0/747169520 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f993c0757b0 con 0x7f99400a6370 2023-11-04T15:27:32.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.560+0000 7f994740b640 1 -- 172.21.15.19:0/747169520 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f99400a2050 con 0x7f99400a6370 2023-11-04T15:27:32.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.561+0000 7f9935ffb640 1 -- 172.21.15.19:0/747169520 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v14) v1 ==== 92+0+10 (secure 0 0 0) 0x7f993c078dd0 con 0x7f99400a6370 2023-11-04T15:27:32.563 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 8 2023-11-04T15:27:32.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.563+0000 7f994740b640 1 -- 172.21.15.19:0/747169520 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f992406a430 msgr2=0x7f992406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:32.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.563+0000 7f994740b640 1 --2- 172.21.15.19:0/747169520 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f992406a430 0x7f992406c8f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f99400a9d50 tx=0x7f9930009040 comp rx=0 tx=0).stop 2023-11-04T15:27:32.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.563+0000 7f994740b640 1 -- 172.21.15.19:0/747169520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99400a6370 msgr2=0x7f9940131f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:32.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.563+0000 7f994740b640 1 --2- 172.21.15.19:0/747169520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99400a6370 0x7f9940131f50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f993c02be50 tx=0x7f993c0046c0 comp rx=0 tx=0).stop 2023-11-04T15:27:32.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.563+0000 7f994740b640 1 -- 172.21.15.19:0/747169520 shutdown_connections 2023-11-04T15:27:32.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.563+0000 7f994740b640 1 --2- 172.21.15.19:0/747169520 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f992406a430 0x7f992406c8f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:32.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.563+0000 7f994740b640 1 --2- 172.21.15.19:0/747169520 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f994013a840 0x7f99401ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:32.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.563+0000 7f994740b640 1 --2- 172.21.15.19:0/747169520 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9940136090 0x7f9940132490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:32.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.563+0000 7f994740b640 1 --2- 172.21.15.19:0/747169520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99400a6370 0x7f9940131f50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:32.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.563+0000 7f994740b640 1 -- 172.21.15.19:0/747169520 >> 172.21.15.19:0/747169520 conn(0x7f99400ac3f0 msgr2=0x7f99401c22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:32.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.563+0000 7f994740b640 1 -- 172.21.15.19:0/747169520 shutdown_connections 2023-11-04T15:27:32.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.563+0000 7f994740b640 1 -- 172.21.15.19:0/747169520 wait complete. 2023-11-04T15:27:32.576 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T15:27:32.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.680+0000 7f0d8cd50640 1 Processor -- start 2023-11-04T15:27:32.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.680+0000 7f0d8cd50640 1 -- start start 2023-11-04T15:27:32.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.680+0000 7f0d8cd50640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0d88135480 0x7f0d881384e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:32.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.680+0000 7f0d8cd50640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0d8813e100 0x7f0d881404f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:32.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.680+0000 7f0d8cd50640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d880710a0 con 0x7f0d881350a0 2023-11-04T15:27:32.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.680+0000 7f0d8cd50640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d880a4610 con 0x7f0d8813e100 2023-11-04T15:27:32.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.680+0000 7f0d8cd50640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d880a6810 con 0x7f0d88135480 2023-11-04T15:27:32.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.681+0000 7f0d8659c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0d881350a0 0x7f0d88137dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50480/0 (socket says 172.21.15.19:50480) 2023-11-04T15:27:32.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.681+0000 7f0d8659c640 1 -- 172.21.15.19:0/1329538279 learned_addr learned my addr 172.21.15.19:0/1329538279 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:32.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.681+0000 7f0d85d9b640 1 -- 172.21.15.19:0/1329538279 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2885856127 0 0) 0x7f0d880710a0 con 0x7f0d881350a0 2023-11-04T15:27:32.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.681+0000 7f0d7ffff640 1 --2- 172.21.15.19:0/1329538279 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0d88135480 0x7f0d881384e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:32.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.681+0000 7f0d86d9d640 1 --2- 172.21.15.19:0/1329538279 >> v2:172.21.15.96:3300/0 conn(0x7f0d8813e100 0x7f0d881404f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:32.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.681+0000 7f0d85d9b640 1 -- 172.21.15.19:0/1329538279 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d74003520 con 0x7f0d881350a0 2023-11-04T15:27:32.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.681+0000 7f0d85d9b640 1 -- 172.21.15.19:0/1329538279 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1486512389 0 0) 0x7f0d74003520 con 0x7f0d881350a0 2023-11-04T15:27:32.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.681+0000 7f0d85d9b640 1 -- 172.21.15.19:0/1329538279 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0d88135480 msgr2=0x7f0d881384e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:32.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.681+0000 7f0d85d9b640 1 --2- 172.21.15.19:0/1329538279 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0d88135480 0x7f0d881384e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:32.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.681+0000 7f0d85d9b640 1 -- 172.21.15.19:0/1329538279 >> v2:172.21.15.96:3300/0 conn(0x7f0d8813e100 msgr2=0x7f0d881404f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:32.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.681+0000 7f0d85d9b640 1 --2- 172.21.15.19:0/1329538279 >> v2:172.21.15.96:3300/0 conn(0x7f0d8813e100 0x7f0d881404f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:32.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.681+0000 7f0d85d9b640 1 -- 172.21.15.19:0/1329538279 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d88070420 con 0x7f0d881350a0 2023-11-04T15:27:32.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.681+0000 7f0d85d9b640 1 -- 172.21.15.19:0/1329538279 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3646097784 0 0) 0x7f0d78001670 con 0x7f0d881350a0 2023-11-04T15:27:32.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.681+0000 7f0d85d9b640 1 -- 172.21.15.19:0/1329538279 >> v1:172.21.15.19:6789/0 conn(0x7f0d881350a0 legacy=0x7f0d88137dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:32.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.681+0000 7f0d85d9b640 1 --2- 172.21.15.19:0/1329538279 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d74003970 0x7f0d74003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:32.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.681+0000 7f0d85d9b640 1 --2- 172.21.15.19:0/1329538279 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0d88135480 0x7f0d740047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:32.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.681+0000 7f0d85d9b640 1 --2- 172.21.15.19:0/1329538279 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d74004d00 0x7f0d74005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:32.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.681+0000 7f0d85d9b640 1 -- 172.21.15.19:0/1329538279 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d880a6810 con 0x7f0d74003970 2023-11-04T15:27:32.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.681+0000 7f0d85d9b640 1 -- 172.21.15.19:0/1329538279 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7400b980 con 0x7f0d74004d00 2023-11-04T15:27:32.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.681+0000 7f0d85d9b640 1 -- 172.21.15.19:0/1329538279 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7400bac0 con 0x7f0d88135480 2023-11-04T15:27:32.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.681+0000 7f0d8659c640 1 --2- 172.21.15.19:0/1329538279 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d74003970 0x7f0d74003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:32.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.681+0000 7f0d7ffff640 1 --2- 172.21.15.19:0/1329538279 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0d88135480 0x7f0d740047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:32.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.681+0000 7f0d86d9d640 1 --2- 172.21.15.19:0/1329538279 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d74004d00 0x7f0d74005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:32.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.682+0000 7f0d8659c640 1 -- 172.21.15.19:0/1329538279 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0d88135480 msgr2=0x7f0d740047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:32.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.682+0000 7f0d8659c640 1 --2- 172.21.15.19:0/1329538279 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0d88135480 0x7f0d740047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:32.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.682+0000 7f0d8659c640 1 -- 172.21.15.19:0/1329538279 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d74004d00 msgr2=0x7f0d74005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:32.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.682+0000 7f0d8659c640 1 --2- 172.21.15.19:0/1329538279 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d74004d00 0x7f0d74005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:32.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.682+0000 7f0d8659c640 1 -- 172.21.15.19:0/1329538279 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d74003520 con 0x7f0d74003970 2023-11-04T15:27:32.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.682+0000 7f0d8659c640 1 --2- 172.21.15.19:0/1329538279 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d74003970 0x7f0d74003d90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0d7800c210 tx=0x7f0d740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb02fbb1d5de087 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:32.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.682+0000 7f0d85d9b640 1 -- 172.21.15.19:0/1329538279 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d78005ad0 con 0x7f0d74003970 2023-11-04T15:27:32.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.683+0000 7f0d85d9b640 1 -- 172.21.15.19:0/1329538279 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d78005c30 con 0x7f0d74003970 2023-11-04T15:27:32.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.683+0000 7f0d85d9b640 1 -- 172.21.15.19:0/1329538279 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7802c8d0 con 0x7f0d74003970 2023-11-04T15:27:32.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.683+0000 7f0d8cd50640 1 -- 172.21.15.19:0/1329538279 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d74003970 msgr2=0x7f0d74003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:32.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.683+0000 7f0d8cd50640 1 --2- 172.21.15.19:0/1329538279 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d74003970 0x7f0d74003d90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0d7800c210 tx=0x7f0d740057f0 comp rx=0 tx=0).stop 2023-11-04T15:27:32.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.683+0000 7f0d86d9d640 1 -- 172.21.15.19:0/1329538279 reap_dead start 2023-11-04T15:27:32.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.683+0000 7f0d8cd50640 1 -- 172.21.15.19:0/1329538279 shutdown_connections 2023-11-04T15:27:32.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.683+0000 7f0d8cd50640 1 -- 172.21.15.19:0/1329538279 >> 172.21.15.19:0/1329538279 conn(0x7f0d880a6b70 msgr2=0x7f0d880a6f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:32.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.683+0000 7f0d8cd50640 1 -- 172.21.15.19:0/1329538279 shutdown_connections 2023-11-04T15:27:32.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.683+0000 7f0d8cd50640 1 -- 172.21.15.19:0/1329538279 wait complete. 2023-11-04T15:27:32.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.684+0000 7f0d8cd50640 1 Processor -- start 2023-11-04T15:27:32.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.684+0000 7f0d8cd50640 1 -- start start 2023-11-04T15:27:32.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.685+0000 7f0d8cd50640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0d74003970 0x7f0d881cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:32.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.685+0000 7f0d8cd50640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d881cbe00 0x7f0d881ce850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:32.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.685+0000 7f0d8cd50640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d881ced90 0x7f0d881cf210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:32.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.685+0000 7f0d8cd50640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d88097ec0 con 0x7f0d881ced90 2023-11-04T15:27:32.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.685+0000 7f0d8cd50640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d880994f0 con 0x7f0d881cbe00 2023-11-04T15:27:32.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.685+0000 7f0d8cd50640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d881cc280 con 0x7f0d74003970 2023-11-04T15:27:32.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.685+0000 7f0d86d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d881ced90 0x7f0d881cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:32.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.685+0000 7f0d86d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d881ced90 0x7f0d881cf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45790/0 (socket says 172.21.15.19:45790) 2023-11-04T15:27:32.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.685+0000 7f0d86d9d640 1 -- 172.21.15.19:0/2449834422 learned_addr learned my addr 172.21.15.19:0/2449834422 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:32.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.685+0000 7f0d8659c640 1 --2- 172.21.15.19:0/2449834422 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0d74003970 0x7f0d881cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:32.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.685+0000 7f0d7ffff640 1 --2- 172.21.15.19:0/2449834422 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d881cbe00 0x7f0d881ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:32.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.685+0000 7f0d86d9d640 1 -- 172.21.15.19:0/2449834422 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0d74003970 msgr2=0x7f0d881cb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:32.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.685+0000 7f0d86d9d640 1 --2- 172.21.15.19:0/2449834422 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0d74003970 0x7f0d881cb8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:32.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.685+0000 7f0d86d9d640 1 -- 172.21.15.19:0/2449834422 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d881cbe00 msgr2=0x7f0d881ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:32.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.685+0000 7f0d86d9d640 1 --2- 172.21.15.19:0/2449834422 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d881cbe00 0x7f0d881ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:32.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.685+0000 7f0d86d9d640 1 -- 172.21.15.19:0/2449834422 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8806c790 con 0x7f0d881ced90 2023-11-04T15:27:32.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.685+0000 7f0d86d9d640 1 --2- 172.21.15.19:0/2449834422 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d881ced90 0x7f0d881cf210 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0d8806d6d0 tx=0x7f0d8000f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:32.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.685+0000 7f0d7effd640 1 -- 172.21.15.19:0/2449834422 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8000e040 con 0x7f0d881ced90 2023-11-04T15:27:32.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.685+0000 7f0d7effd640 1 -- 172.21.15.19:0/2449834422 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8000f040 con 0x7f0d881ced90 2023-11-04T15:27:32.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.685+0000 7f0d7effd640 1 -- 172.21.15.19:0/2449834422 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d80015430 con 0x7f0d881ced90 2023-11-04T15:27:32.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.685+0000 7f0d8cd50640 1 -- 172.21.15.19:0/2449834422 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d88098be0 con 0x7f0d881ced90 2023-11-04T15:27:32.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.686+0000 7f0d8cd50640 1 -- 172.21.15.19:0/2449834422 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d88099210 con 0x7f0d881ced90 2023-11-04T15:27:32.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.687+0000 7f0d8cd50640 1 -- 172.21.15.19:0/2449834422 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d88067d60 con 0x7f0d881ced90 2023-11-04T15:27:32.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.687+0000 7f0d7effd640 1 -- 172.21.15.19:0/2449834422 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0d80015590 con 0x7f0d881ced90 2023-11-04T15:27:32.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.687+0000 7f0d7effd640 1 --2- 172.21.15.19:0/2449834422 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f0d6806a460 0x7f0d6806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:32.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.687+0000 7f0d7effd640 1 -- 172.21.15.19:0/2449834422 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f0d80088530 con 0x7f0d881ced90 2023-11-04T15:27:32.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.688+0000 7f0d8659c640 1 --2- 172.21.15.19:0/2449834422 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f0d6806a460 0x7f0d6806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:32.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.688+0000 7f0d8659c640 1 --2- 172.21.15.19:0/2449834422 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f0d6806a460 0x7f0d6806c920 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0d78034000 tx=0x7f0d78007000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:32.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.692+0000 7f0d7effd640 1 -- 172.21.15.19:0/2449834422 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0d80054460 con 0x7f0d881ced90 2023-11-04T15:27:32.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.905+0000 7f0d8cd50640 1 -- 172.21.15.19:0/2449834422 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d8806fde0 con 0x7f0d881ced90 2023-11-04T15:27:32.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.905+0000 7f0d7effd640 1 -- 172.21.15.19:0/2449834422 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2012 (secure 0 0 0) 0x7f0d80057a80 con 0x7f0d881ced90 2023-11-04T15:27:32.908 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:27:32.908 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4219,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6819/3642584554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3642584554},{"type":"v1","addr":"172.21.15.96:6819","nonce":3642584554}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6817/2992197248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2992197248},{"type":"v1","addr":"172.21.15.19:6817","nonce":2992197248}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-11-04T15:27:32.908 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 3 2023-11-04T15:27:32.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.907+0000 7f0d8cd50640 1 -- 172.21.15.19:0/2449834422 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f0d6806a460 msgr2=0x7f0d6806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:32.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.907+0000 7f0d8cd50640 1 --2- 172.21.15.19:0/2449834422 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f0d6806a460 0x7f0d6806c920 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0d78034000 tx=0x7f0d78007000 comp rx=0 tx=0).stop 2023-11-04T15:27:32.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.907+0000 7f0d8cd50640 1 -- 172.21.15.19:0/2449834422 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d881ced90 msgr2=0x7f0d881cf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:32.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.907+0000 7f0d8cd50640 1 --2- 172.21.15.19:0/2449834422 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d881ced90 0x7f0d881cf210 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0d8806d6d0 tx=0x7f0d8000f1b0 comp rx=0 tx=0).stop 2023-11-04T15:27:32.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.907+0000 7f0d8cd50640 1 -- 172.21.15.19:0/2449834422 shutdown_connections 2023-11-04T15:27:32.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.907+0000 7f0d8cd50640 1 --2- 172.21.15.19:0/2449834422 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f0d6806a460 0x7f0d6806c920 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:32.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.907+0000 7f0d8cd50640 1 --2- 172.21.15.19:0/2449834422 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d881ced90 0x7f0d881cf210 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:32.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.907+0000 7f0d8cd50640 1 --2- 172.21.15.19:0/2449834422 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d881cbe00 0x7f0d881ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:32.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.907+0000 7f0d8cd50640 1 --2- 172.21.15.19:0/2449834422 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0d74003970 0x7f0d881cb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:32.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.907+0000 7f0d8cd50640 1 -- 172.21.15.19:0/2449834422 >> 172.21.15.19:0/2449834422 conn(0x7f0d880a6b70 msgr2=0x7f0d880a2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:32.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.907+0000 7f0d8cd50640 1 -- 172.21.15.19:0/2449834422 shutdown_connections 2023-11-04T15:27:32.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:32.907+0000 7f0d8cd50640 1 -- 172.21.15.19:0/2449834422 wait complete. 2023-11-04T15:27:32.920 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T15:27:33.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.025+0000 7f52e4841640 1 Processor -- start 2023-11-04T15:27:33.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.025+0000 7f52e4841640 1 -- start start 2023-11-04T15:27:33.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.026+0000 7f52e4841640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f52e013a6a0 0x7f52e013aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:33.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.026+0000 7f52e4841640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f52e0065af0 0x7f52e0098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:33.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.026+0000 7f52e4841640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e006f930 con 0x7f52e006e2d0 2023-11-04T15:27:33.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.026+0000 7f52e4841640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52e013afc0 con 0x7f52e0065af0 2023-11-04T15:27:33.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.026+0000 7f52e4841640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e006f510 con 0x7f52e013a6a0 2023-11-04T15:27:33.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.026+0000 7f52ded9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f52e006e2d0 0x7f52e0098f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50492/0 (socket says 172.21.15.19:50492) 2023-11-04T15:27:33.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.026+0000 7f52ded9d640 1 -- 172.21.15.19:0/2153669733 learned_addr learned my addr 172.21.15.19:0/2153669733 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:33.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.026+0000 7f52de59c640 1 --2- 172.21.15.19:0/2153669733 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f52e013a6a0 0x7f52e013aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:33.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.026+0000 7f52dd59a640 1 -- 172.21.15.19:0/2153669733 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3775856179 0 0) 0x7f52e006f930 con 0x7f52e006e2d0 2023-11-04T15:27:33.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.026+0000 7f52ddd9b640 1 --2- 172.21.15.19:0/2153669733 >> v2:172.21.15.96:3300/0 conn(0x7f52e0065af0 0x7f52e0098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:33.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.026+0000 7f52dd59a640 1 -- 172.21.15.19:0/2153669733 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52c8003520 con 0x7f52e006e2d0 2023-11-04T15:27:33.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.026+0000 7f52dd59a640 1 -- 172.21.15.19:0/2153669733 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3947438936 0 0) 0x7f52c8003520 con 0x7f52e006e2d0 2023-11-04T15:27:33.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.026+0000 7f52dd59a640 1 -- 172.21.15.19:0/2153669733 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f52e013a6a0 msgr2=0x7f52e013aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:33.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.026+0000 7f52dd59a640 1 --2- 172.21.15.19:0/2153669733 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f52e013a6a0 0x7f52e013aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.026+0000 7f52dd59a640 1 -- 172.21.15.19:0/2153669733 >> v2:172.21.15.96:3300/0 conn(0x7f52e0065af0 msgr2=0x7f52e0098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:33.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.026+0000 7f52dd59a640 1 --2- 172.21.15.19:0/2153669733 >> v2:172.21.15.96:3300/0 conn(0x7f52e0065af0 0x7f52e0098a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.026+0000 7f52dd59a640 1 -- 172.21.15.19:0/2153669733 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e006e7b0 con 0x7f52e006e2d0 2023-11-04T15:27:33.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.026+0000 7f52dd59a640 1 -- 172.21.15.19:0/2153669733 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3646097784 0 0) 0x7f52d00019f0 con 0x7f52e006e2d0 2023-11-04T15:27:33.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.027+0000 7f52dd59a640 1 -- 172.21.15.19:0/2153669733 >> v1:172.21.15.19:6789/0 conn(0x7f52e006e2d0 legacy=0x7f52e0098f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:33.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.027+0000 7f52dd59a640 1 --2- 172.21.15.19:0/2153669733 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52c8003970 0x7f52c8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:33.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.027+0000 7f52dd59a640 1 --2- 172.21.15.19:0/2153669733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52c80047c0 0x7f52c8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:33.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.027+0000 7f52dd59a640 1 --2- 172.21.15.19:0/2153669733 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f52e013a6a0 0x7f52c8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:33.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.027+0000 7f52dd59a640 1 -- 172.21.15.19:0/2153669733 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e013afc0 con 0x7f52c8003970 2023-11-04T15:27:33.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.027+0000 7f52dd59a640 1 -- 172.21.15.19:0/2153669733 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e006f510 con 0x7f52c80047c0 2023-11-04T15:27:33.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.027+0000 7f52dd59a640 1 -- 172.21.15.19:0/2153669733 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c800ba00 con 0x7f52e013a6a0 2023-11-04T15:27:33.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.027+0000 7f52de59c640 1 --2- 172.21.15.19:0/2153669733 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52c8003970 0x7f52c8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:33.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.027+0000 7f52ddd9b640 1 --2- 172.21.15.19:0/2153669733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52c80047c0 0x7f52c8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:33.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.027+0000 7f52ded9d640 1 --2- 172.21.15.19:0/2153669733 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f52e013a6a0 0x7f52c8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:33.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.027+0000 7f52de59c640 1 -- 172.21.15.19:0/2153669733 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f52e013a6a0 msgr2=0x7f52c8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:33.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.027+0000 7f52de59c640 1 --2- 172.21.15.19:0/2153669733 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f52e013a6a0 0x7f52c8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.027+0000 7f52de59c640 1 -- 172.21.15.19:0/2153669733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52c80047c0 msgr2=0x7f52c8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:33.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.027+0000 7f52de59c640 1 --2- 172.21.15.19:0/2153669733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52c80047c0 0x7f52c8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.027+0000 7f52de59c640 1 -- 172.21.15.19:0/2153669733 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c8003520 con 0x7f52c8003970 2023-11-04T15:27:33.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.027+0000 7f52ded9d640 1 --2- 172.21.15.19:0/2153669733 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f52e013a6a0 0x7f52c8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:27:33.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.028+0000 7f52de59c640 1 --2- 172.21.15.19:0/2153669733 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52c8003970 0x7f52c8003d90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f52d8009ac0 tx=0x7f52c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c5bee31bd76cf32 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:33.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.028+0000 7f52dd59a640 1 -- 172.21.15.19:0/2153669733 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d802c6b0 con 0x7f52c8003970 2023-11-04T15:27:33.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.028+0000 7f52dd59a640 1 -- 172.21.15.19:0/2153669733 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d802c810 con 0x7f52c8003970 2023-11-04T15:27:33.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.028+0000 7f52dd59a640 1 -- 172.21.15.19:0/2153669733 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d802cba0 con 0x7f52c8003970 2023-11-04T15:27:33.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.028+0000 7f52e4841640 1 -- 172.21.15.19:0/2153669733 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52c8003970 msgr2=0x7f52c8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:33.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.028+0000 7f52e4841640 1 --2- 172.21.15.19:0/2153669733 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52c8003970 0x7f52c8003d90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f52d8009ac0 tx=0x7f52c80057f0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.028+0000 7f52ded9d640 1 -- 172.21.15.19:0/2153669733 reap_dead start 2023-11-04T15:27:33.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.028+0000 7f52e4841640 1 -- 172.21.15.19:0/2153669733 shutdown_connections 2023-11-04T15:27:33.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.028+0000 7f52e4841640 1 -- 172.21.15.19:0/2153669733 >> 172.21.15.19:0/2153669733 conn(0x7f52e0069c70 msgr2=0x7f52e006a080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:33.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.028+0000 7f52e4841640 1 -- 172.21.15.19:0/2153669733 shutdown_connections 2023-11-04T15:27:33.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.028+0000 7f52e4841640 1 -- 172.21.15.19:0/2153669733 wait complete. 2023-11-04T15:27:33.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.029+0000 7f52e4841640 1 Processor -- start 2023-11-04T15:27:33.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.029+0000 7f52e4841640 1 -- start start 2023-11-04T15:27:33.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.030+0000 7f52e4841640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52c8003970 0x7f52e01cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:33.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.030+0000 7f52e4841640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f52e011f160 0x7f52e01cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:33.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.030+0000 7f52e4841640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52e01cea10 0x7f52e01ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:33.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.030+0000 7f52e4841640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e00a3eb0 con 0x7f52e01cea10 2023-11-04T15:27:33.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.030+0000 7f52e4841640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e011fc00 con 0x7f52c8003970 2023-11-04T15:27:33.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.030+0000 7f52e4841640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e01cc450 con 0x7f52e011f160 2023-11-04T15:27:33.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.030+0000 7f52ded9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52e01cea10 0x7f52e01ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:33.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.030+0000 7f52ded9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52e01cea10 0x7f52e01ceea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45800/0 (socket says 172.21.15.19:45800) 2023-11-04T15:27:33.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.030+0000 7f52ded9d640 1 -- 172.21.15.19:0/4183527867 learned_addr learned my addr 172.21.15.19:0/4183527867 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:33.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.030+0000 7f52ddd9b640 1 --2- 172.21.15.19:0/4183527867 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f52e011f160 0x7f52e01cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:33.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.030+0000 7f52de59c640 1 --2- 172.21.15.19:0/4183527867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52c8003970 0x7f52e01cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:33.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.030+0000 7f52ded9d640 1 -- 172.21.15.19:0/4183527867 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f52e011f160 msgr2=0x7f52e01cbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:33.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.030+0000 7f52ded9d640 1 --2- 172.21.15.19:0/4183527867 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f52e011f160 0x7f52e01cbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.030+0000 7f52ded9d640 1 -- 172.21.15.19:0/4183527867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52c8003970 msgr2=0x7f52e01cb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:33.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.030+0000 7f52ded9d640 1 --2- 172.21.15.19:0/4183527867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52c8003970 0x7f52e01cb9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.030+0000 7f52ded9d640 1 -- 172.21.15.19:0/4183527867 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e011f660 con 0x7f52e01cea10 2023-11-04T15:27:33.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.030+0000 7f52ddd9b640 1 --2- 172.21.15.19:0/4183527867 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f52e011f160 0x7f52e01cbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:27:33.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.030+0000 7f52de59c640 1 --2- 172.21.15.19:0/4183527867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52c8003970 0x7f52e01cb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:27:33.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.030+0000 7f52ded9d640 1 --2- 172.21.15.19:0/4183527867 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52e01cea10 0x7f52e01ceea0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f52e009a9c0 tx=0x7f52d000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:33.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.031+0000 7f52ceffd640 1 -- 172.21.15.19:0/4183527867 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d000eb30 con 0x7f52e01cea10 2023-11-04T15:27:33.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.031+0000 7f52ceffd640 1 -- 172.21.15.19:0/4183527867 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d000ecb0 con 0x7f52e01cea10 2023-11-04T15:27:33.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.031+0000 7f52e4841640 1 -- 172.21.15.19:0/4183527867 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52e00a4f70 con 0x7f52e01cea10 2023-11-04T15:27:33.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.031+0000 7f52ceffd640 1 -- 172.21.15.19:0/4183527867 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d0014430 con 0x7f52e01cea10 2023-11-04T15:27:33.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.031+0000 7f52e4841640 1 -- 172.21.15.19:0/4183527867 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52e011f920 con 0x7f52e01cea10 2023-11-04T15:27:33.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.032+0000 7f52e4841640 1 -- 172.21.15.19:0/4183527867 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52e0067d60 con 0x7f52e01cea10 2023-11-04T15:27:33.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.032+0000 7f52ceffd640 1 -- 172.21.15.19:0/4183527867 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f52d0014590 con 0x7f52e01cea10 2023-11-04T15:27:33.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.032+0000 7f52ceffd640 1 --2- 172.21.15.19:0/4183527867 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f52c006a460 0x7f52c006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:33.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.033+0000 7f52ceffd640 1 -- 172.21.15.19:0/4183527867 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f52d0087cd0 con 0x7f52e01cea10 2023-11-04T15:27:33.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.033+0000 7f52de59c640 1 --2- 172.21.15.19:0/4183527867 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f52c006a460 0x7f52c006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:33.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.033+0000 7f52de59c640 1 --2- 172.21.15.19:0/4183527867 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f52c006a460 0x7f52c006c920 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f52d8036000 tx=0x7f52d8030000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:33.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.037+0000 7f52ceffd640 1 -- 172.21.15.19:0/4183527867 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f52d0053c00 con 0x7f52e01cea10 2023-11-04T15:27:33.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.213+0000 7f52e4841640 1 -- 172.21.15.19:0/4183527867 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52e006b140 con 0x7f52e01cea10 2023-11-04T15:27:33.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.214+0000 7f52ceffd640 1 -- 172.21.15.19:0/4183527867 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+9410 (secure 0 0 0) 0x7f52d0057220 con 0x7f52e01cea10 2023-11-04T15:27:33.216 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:27:33.216 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":15,"fsid":"e87311d5-496a-4b07-9654-358fe5bbf950","created":"2023-11-04T15:27:14.865121+0000","modified":"2023-11-04T15:27:32.615285+0000","last_up_change":"2023-11-04T15:27:24.162282+0000","last_in_change":"2023-11-04T15:27:15.971035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T15:27:24.987312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-04T15:27:30.500235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"34818469-ebf2-4dd4-8119-af19a0121036","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":82879},{"type":"v1","addr":"172.21.15.19:6801","nonce":82879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":82879},{"type":"v1","addr":"172.21.15.19:6803","nonce":82879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":82879},{"type":"v1","addr":"172.21.15.19:6807","nonce":82879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":82879},{"type":"v1","addr":"172.21.15.19:6805","nonce":82879}]},"public_addr":"172.21.15.19:6801/82879","cluster_addr":"172.21.15.19:6803/82879","heartbeat_back_addr":"172.21.15.19:6807/82879","heartbeat_front_addr":"172.21.15.19:6805/82879","state":["exists","up"]},{"osd":1,"uuid":"92dab290-7912-4eea-b6f6-c754c2480721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":82880},{"type":"v1","addr":"172.21.15.19:6809","nonce":82880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":82880},{"type":"v1","addr":"172.21.15.19:6811","nonce":82880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":82880},{"type":"v1","addr":"172.21.15.19:6815","nonce":82880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":82880},{"type":"v1","addr":"172.21.15.19:6813","nonce":82880}]},"public_addr":"172.21.15.19:6809/82880","cluster_addr":"172.21.15.19:6811/82880","heartbeat_back_addr":"172.21.15.19:6815/82880","heartbeat_front_addr":"172.21.15.19:6813/82880","state":["exists","up"]},{"osd":2,"uuid":"1be47db4-6dd1-4ce5-832b-bc6ad30c78c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":83458},{"type":"v1","addr":"172.21.15.96:6808","nonce":83458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":83458},{"type":"v1","addr":"172.21.15.96:6811","nonce":83458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":83458},{"type":"v1","addr":"172.21.15.96:6815","nonce":83458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":83458},{"type":"v1","addr":"172.21.15.96:6813","nonce":83458}]},"public_addr":"172.21.15.96:6808/83458","cluster_addr":"172.21.15.96:6811/83458","heartbeat_back_addr":"172.21.15.96:6815/83458","heartbeat_front_addr":"172.21.15.96:6813/83458","state":["exists","up"]},{"osd":3,"uuid":"46505800-d64f-49ef-b811-5b5979f48252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":83459},{"type":"v1","addr":"172.21.15.96:6801","nonce":83459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":83459},{"type":"v1","addr":"172.21.15.96:6803","nonce":83459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6807","nonce":83459},{"type":"v1","addr":"172.21.15.96:6809","nonce":83459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":83459},{"type":"v1","addr":"172.21.15.96:6805","nonce":83459}]},"public_addr":"172.21.15.96:6801/83459","cluster_addr":"172.21.15.96:6803/83459","heartbeat_back_addr":"172.21.15.96:6809/83459","heartbeat_front_addr":"172.21.15.96:6805/83459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.081547+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.132075+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.094919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.074106+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T15:27:33.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.216+0000 7f52e4841640 1 -- 172.21.15.19:0/4183527867 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f52c006a460 msgr2=0x7f52c006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:33.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.216+0000 7f52e4841640 1 --2- 172.21.15.19:0/4183527867 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f52c006a460 0x7f52c006c920 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f52d8036000 tx=0x7f52d8030000 comp rx=0 tx=0).stop 2023-11-04T15:27:33.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.216+0000 7f52e4841640 1 -- 172.21.15.19:0/4183527867 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52e01cea10 msgr2=0x7f52e01ceea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:33.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.216+0000 7f52e4841640 1 --2- 172.21.15.19:0/4183527867 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52e01cea10 0x7f52e01ceea0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f52e009a9c0 tx=0x7f52d000e530 comp rx=0 tx=0).stop 2023-11-04T15:27:33.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.216+0000 7f52e4841640 1 -- 172.21.15.19:0/4183527867 shutdown_connections 2023-11-04T15:27:33.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.216+0000 7f52e4841640 1 --2- 172.21.15.19:0/4183527867 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f52c006a460 0x7f52c006c920 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.216+0000 7f52e4841640 1 --2- 172.21.15.19:0/4183527867 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52e01cea10 0x7f52e01ceea0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.216+0000 7f52e4841640 1 --2- 172.21.15.19:0/4183527867 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f52e011f160 0x7f52e01cbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.216+0000 7f52e4841640 1 --2- 172.21.15.19:0/4183527867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52c8003970 0x7f52e01cb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.216+0000 7f52e4841640 1 -- 172.21.15.19:0/4183527867 >> 172.21.15.19:0/4183527867 conn(0x7f52e0069c70 msgr2=0x7f52e0097a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:33.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.216+0000 7f52e4841640 1 -- 172.21.15.19:0/4183527867 shutdown_connections 2023-11-04T15:27:33.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.216+0000 7f52e4841640 1 -- 172.21.15.19:0/4183527867 wait complete. 2023-11-04T15:27:33.228 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T15:27:24.987312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-04T15:27:30.500235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T15:27:33.229 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T15:27:33.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.335+0000 7f5787c41640 1 Processor -- start 2023-11-04T15:27:33.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.335+0000 7f5787c41640 1 -- start start 2023-11-04T15:27:33.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.335+0000 7f5787c41640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f57800a6370 0x7f578013f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:33.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.335+0000 7f5787c41640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f578013f990 0x7f5780141d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:33.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.336+0000 7f5787c41640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57800abe60 con 0x7f5780136090 2023-11-04T15:27:33.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.336+0000 7f5787c41640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57800a68d0 con 0x7f57800a6370 2023-11-04T15:27:33.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.336+0000 7f5787c41640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57800a30a0 con 0x7f578013f990 2023-11-04T15:27:33.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.336+0000 7f57851dc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f57800a6370 0x7f578013f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:33.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.336+0000 7f57859dd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5780136090 0x7f5780136470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50494/0 (socket says 172.21.15.19:50494) 2023-11-04T15:27:33.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.336+0000 7f57859dd640 1 -- 172.21.15.19:0/556691126 learned_addr learned my addr 172.21.15.19:0/556691126 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:33.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.336+0000 7f57861de640 1 --2- 172.21.15.19:0/556691126 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f578013f990 0x7f5780141d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:33.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.336+0000 7f57851dc640 1 -- 172.21.15.19:0/556691126 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f578013f990 msgr2=0x7f5780141d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:33.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.336+0000 7f57851dc640 1 --2- 172.21.15.19:0/556691126 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f578013f990 0x7f5780141d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.336+0000 7f57851dc640 1 -- 172.21.15.19:0/556691126 >> v1:172.21.15.19:6789/0 conn(0x7f5780136090 legacy=0x7f5780136470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:33.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.336+0000 7f57849db640 1 -- 172.21.15.19:0/556691126 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1567911589 0 0) 0x7f57800abe60 con 0x7f5780136090 2023-11-04T15:27:33.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.336+0000 7f57851dc640 1 -- 172.21.15.19:0/556691126 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57800a4b90 con 0x7f57800a6370 2023-11-04T15:27:33.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.337+0000 7f57851dc640 1 --2- 172.21.15.19:0/556691126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57800a6370 0x7f578013f450 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f57700097a0 tx=0x7f577002b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac45f1f9973fe15 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:33.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.337+0000 7f57849db640 1 -- 172.21.15.19:0/556691126 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577002f050 con 0x7f57800a6370 2023-11-04T15:27:33.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.337+0000 7f57849db640 1 -- 172.21.15.19:0/556691126 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5770031700 con 0x7f57800a6370 2023-11-04T15:27:33.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.337+0000 7f57849db640 1 -- 172.21.15.19:0/556691126 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5770031a90 con 0x7f57800a6370 2023-11-04T15:27:33.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.337+0000 7f5787c41640 1 -- 172.21.15.19:0/556691126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57800a6370 msgr2=0x7f578013f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:33.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.337+0000 7f5787c41640 1 --2- 172.21.15.19:0/556691126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57800a6370 0x7f578013f450 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f57700097a0 tx=0x7f577002b7a0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.337+0000 7f5787c41640 1 -- 172.21.15.19:0/556691126 shutdown_connections 2023-11-04T15:27:33.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.337+0000 7f5787c41640 1 --2- 172.21.15.19:0/556691126 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f578013f990 0x7f5780141d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.337+0000 7f5787c41640 1 --2- 172.21.15.19:0/556691126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57800a6370 0x7f578013f450 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.337+0000 7f5787c41640 1 -- 172.21.15.19:0/556691126 >> 172.21.15.19:0/556691126 conn(0x7f57800ac3f0 msgr2=0x7f57800ac800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:33.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.338+0000 7f5787c41640 1 -- 172.21.15.19:0/556691126 shutdown_connections 2023-11-04T15:27:33.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.338+0000 7f5787c41640 1 -- 172.21.15.19:0/556691126 wait complete. 2023-11-04T15:27:33.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.338+0000 7f5787c41640 1 Processor -- start 2023-11-04T15:27:33.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.339+0000 7f5787c41640 1 -- start start 2023-11-04T15:27:33.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.339+0000 7f5787c41640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57800a6370 0x7f57801cec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:33.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.339+0000 7f5787c41640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5780136090 0x7f57801cf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:33.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.339+0000 7f5787c41640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f578013f990 0x7f57801cf710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:33.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.339+0000 7f5787c41640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57800a5f90 con 0x7f57800a6370 2023-11-04T15:27:33.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.339+0000 7f5787c41640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578013cd40 con 0x7f578013f990 2023-11-04T15:27:33.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.339+0000 7f5787c41640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578013e180 con 0x7f5780136090 2023-11-04T15:27:33.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.339+0000 7f57859dd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57800a6370 0x7f57801cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:33.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.339+0000 7f57859dd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57800a6370 0x7f57801cec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45808/0 (socket says 172.21.15.19:45808) 2023-11-04T15:27:33.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.339+0000 7f57859dd640 1 -- 172.21.15.19:0/3964940364 learned_addr learned my addr 172.21.15.19:0/3964940364 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:33.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.339+0000 7f57851dc640 1 --2- 172.21.15.19:0/3964940364 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5780136090 0x7f57801cf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:33.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.339+0000 7f57861de640 1 --2- 172.21.15.19:0/3964940364 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f578013f990 0x7f57801cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:33.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.339+0000 7f57859dd640 1 -- 172.21.15.19:0/3964940364 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5780136090 msgr2=0x7f57801cf1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:33.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.339+0000 7f57859dd640 1 --2- 172.21.15.19:0/3964940364 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5780136090 0x7f57801cf1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.339+0000 7f57859dd640 1 -- 172.21.15.19:0/3964940364 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f578013f990 msgr2=0x7f57801cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:33.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.339+0000 7f57859dd640 1 --2- 172.21.15.19:0/3964940364 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f578013f990 0x7f57801cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.339+0000 7f57859dd640 1 -- 172.21.15.19:0/3964940364 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5770009400 con 0x7f57800a6370 2023-11-04T15:27:33.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.339+0000 7f57851dc640 1 --2- 172.21.15.19:0/3964940364 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5780136090 0x7f57801cf1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T15:27:33.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.339+0000 7f57861de640 1 --2- 172.21.15.19:0/3964940364 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f578013f990 0x7f57801cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T15:27:33.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.340+0000 7f57859dd640 1 --2- 172.21.15.19:0/3964940364 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57800a6370 0x7f57801cec90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f577c00c4d0 tx=0x7f577c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:33.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.340+0000 7f57767fc640 1 -- 172.21.15.19:0/3964940364 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c0074e0 con 0x7f57800a6370 2023-11-04T15:27:33.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.340+0000 7f57767fc640 1 -- 172.21.15.19:0/3964940364 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577c007660 con 0x7f57800a6370 2023-11-04T15:27:33.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.340+0000 7f5787c41640 1 -- 172.21.15.19:0/3964940364 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f578013c3c0 con 0x7f57800a6370 2023-11-04T15:27:33.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.340+0000 7f57767fc640 1 -- 172.21.15.19:0/3964940364 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c004a20 con 0x7f57800a6370 2023-11-04T15:27:33.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.340+0000 7f5787c41640 1 -- 172.21.15.19:0/3964940364 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57800a2710 con 0x7f57800a6370 2023-11-04T15:27:33.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.341+0000 7f5787c41640 1 -- 172.21.15.19:0/3964940364 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5780067d60 con 0x7f57800a6370 2023-11-04T15:27:33.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.341+0000 7f57767fc640 1 -- 172.21.15.19:0/3964940364 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f577c004b80 con 0x7f57800a6370 2023-11-04T15:27:33.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.341+0000 7f57767fc640 1 --2- 172.21.15.19:0/3964940364 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f576406a430 0x7f576406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:33.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.342+0000 7f57767fc640 1 -- 172.21.15.19:0/3964940364 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f577c087550 con 0x7f57800a6370 2023-11-04T15:27:33.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.342+0000 7f57851dc640 1 --2- 172.21.15.19:0/3964940364 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f576406a430 0x7f576406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:33.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.342+0000 7f57851dc640 1 --2- 172.21.15.19:0/3964940364 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f576406a430 0x7f576406c8f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5770035000 tx=0x7f5770008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:33.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.346+0000 7f57767fc640 1 -- 172.21.15.19:0/3964940364 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f577c053480 con 0x7f57800a6370 2023-11-04T15:27:33.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.519+0000 7f5787c41640 1 -- 172.21.15.19:0/3964940364 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f57800ab1f0 con 0x7f57800a6370 2023-11-04T15:27:33.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.520+0000 7f57767fc640 1 -- 172.21.15.19:0/3964940364 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v15) v1 ==== 93+0+10 (secure 0 0 0) 0x7f577c0180a0 con 0x7f57800a6370 2023-11-04T15:27:33.522 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-11-04T15:27:33.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.521+0000 7f5787c41640 1 -- 172.21.15.19:0/3964940364 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f576406a430 msgr2=0x7f576406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:33.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.521+0000 7f5787c41640 1 --2- 172.21.15.19:0/3964940364 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f576406a430 0x7f576406c8f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5770035000 tx=0x7f5770008030 comp rx=0 tx=0).stop 2023-11-04T15:27:33.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.521+0000 7f5787c41640 1 -- 172.21.15.19:0/3964940364 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57800a6370 msgr2=0x7f57801cec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:33.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.521+0000 7f5787c41640 1 --2- 172.21.15.19:0/3964940364 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57800a6370 0x7f57801cec90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f577c00c4d0 tx=0x7f577c00c990 comp rx=0 tx=0).stop 2023-11-04T15:27:33.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.521+0000 7f5787c41640 1 -- 172.21.15.19:0/3964940364 shutdown_connections 2023-11-04T15:27:33.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.521+0000 7f5787c41640 1 --2- 172.21.15.19:0/3964940364 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f576406a430 0x7f576406c8f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.521+0000 7f5787c41640 1 --2- 172.21.15.19:0/3964940364 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f578013f990 0x7f57801cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.521+0000 7f5787c41640 1 --2- 172.21.15.19:0/3964940364 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5780136090 0x7f57801cf1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.521+0000 7f5787c41640 1 --2- 172.21.15.19:0/3964940364 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57800a6370 0x7f57801cec90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.521+0000 7f5787c41640 1 -- 172.21.15.19:0/3964940364 >> 172.21.15.19:0/3964940364 conn(0x7f57800ac3f0 msgr2=0x7f57800a7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:33.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.521+0000 7f5787c41640 1 -- 172.21.15.19:0/3964940364 shutdown_connections 2023-11-04T15:27:33.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.521+0000 7f5787c41640 1 -- 172.21.15.19:0/3964940364 wait complete. 2023-11-04T15:27:33.534 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-04T15:27:33.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.640+0000 7f6a1448b640 1 Processor -- start 2023-11-04T15:27:33.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.640+0000 7f6a1448b640 1 -- start start 2023-11-04T15:27:33.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.640+0000 7f6a1448b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6a0c136090 0x7f6a0c136470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:33.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.640+0000 7f6a1448b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6a0c0a6370 0x7f6a0c13a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:33.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.640+0000 7f6a1448b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6a0c13a670 0x7f6a0c13ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:33.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.640+0000 7f6a1448b640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a0c0a68d0 con 0x7f6a0c0a6370 2023-11-04T15:27:33.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.640+0000 7f6a1448b640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a0c0abe60 con 0x7f6a0c136090 2023-11-04T15:27:33.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.640+0000 7f6a1448b640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c0a30a0 con 0x7f6a0c13a670 2023-11-04T15:27:33.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.640+0000 7f6a11a26640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6a0c0a6370 0x7f6a0c13a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:33.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.640+0000 7f6a11a26640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6a0c0a6370 0x7f6a0c13a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45824/0 (socket says 172.21.15.19:45824) 2023-11-04T15:27:33.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.640+0000 7f6a11a26640 1 -- 172.21.15.19:0/945422567 learned_addr learned my addr 172.21.15.19:0/945422567 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:33.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.641+0000 7f6a12a28640 1 --2- 172.21.15.19:0/945422567 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6a0c13a670 0x7f6a0c13ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:33.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.641+0000 7f6a12227640 1 --2- 172.21.15.19:0/945422567 >> v2:172.21.15.96:3300/0 conn(0x7f6a0c136090 0x7f6a0c136470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:33.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.641+0000 7f6a11a26640 1 -- 172.21.15.19:0/945422567 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6a0c13a670 msgr2=0x7f6a0c13ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:33.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.641+0000 7f6a11a26640 1 --2- 172.21.15.19:0/945422567 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6a0c13a670 0x7f6a0c13ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.641+0000 7f6a11a26640 1 -- 172.21.15.19:0/945422567 >> v2:172.21.15.96:3300/0 conn(0x7f6a0c136090 msgr2=0x7f6a0c136470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:33.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.641+0000 7f6a11a26640 1 --2- 172.21.15.19:0/945422567 >> v2:172.21.15.96:3300/0 conn(0x7f6a0c136090 0x7f6a0c136470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.641+0000 7f6a11a26640 1 -- 172.21.15.19:0/945422567 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a0c0a4b90 con 0x7f6a0c0a6370 2023-11-04T15:27:33.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.641+0000 7f6a12227640 1 --2- 172.21.15.19:0/945422567 >> v2:172.21.15.96:3300/0 conn(0x7f6a0c136090 0x7f6a0c136470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:27:33.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.641+0000 7f6a12a28640 1 --2- 172.21.15.19:0/945422567 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6a0c13a670 0x7f6a0c13ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:27:33.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.641+0000 7f6a11a26640 1 --2- 172.21.15.19:0/945422567 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a0c0a6370 0x7f6a0c13a130 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c0a3990 tx=0x7f69fc02b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a543451131eebd9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:33.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.642+0000 7f6a11225640 1 -- 172.21.15.19:0/945422567 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc031740 con 0x7f6a0c0a6370 2023-11-04T15:27:33.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.642+0000 7f6a11225640 1 -- 172.21.15.19:0/945422567 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69fc0318a0 con 0x7f6a0c0a6370 2023-11-04T15:27:33.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.642+0000 7f6a11225640 1 -- 172.21.15.19:0/945422567 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc031c30 con 0x7f6a0c0a6370 2023-11-04T15:27:33.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.642+0000 7f6a1448b640 1 -- 172.21.15.19:0/945422567 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a0c0a6370 msgr2=0x7f6a0c13a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:33.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.642+0000 7f6a1448b640 1 --2- 172.21.15.19:0/945422567 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a0c0a6370 0x7f6a0c13a130 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c0a3990 tx=0x7f69fc02b7e0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.642+0000 7f6a1448b640 1 -- 172.21.15.19:0/945422567 shutdown_connections 2023-11-04T15:27:33.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.642+0000 7f6a1448b640 1 --2- 172.21.15.19:0/945422567 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6a0c13a670 0x7f6a0c13ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.642+0000 7f6a1448b640 1 --2- 172.21.15.19:0/945422567 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a0c0a6370 0x7f6a0c13a130 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.642+0000 7f6a1448b640 1 --2- 172.21.15.19:0/945422567 >> v2:172.21.15.96:3300/0 conn(0x7f6a0c136090 0x7f6a0c136470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.642+0000 7f6a1448b640 1 -- 172.21.15.19:0/945422567 >> 172.21.15.19:0/945422567 conn(0x7f6a0c0ac3f0 msgr2=0x7f6a0c0ac800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:33.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.642+0000 7f6a1448b640 1 -- 172.21.15.19:0/945422567 shutdown_connections 2023-11-04T15:27:33.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.642+0000 7f6a1448b640 1 -- 172.21.15.19:0/945422567 wait complete. 2023-11-04T15:27:33.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.643+0000 7f6a1448b640 1 Processor -- start 2023-11-04T15:27:33.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.643+0000 7f6a1448b640 1 -- start start 2023-11-04T15:27:33.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.644+0000 7f6a1448b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a0c0a6370 0x7f6a0c12ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:33.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.644+0000 7f6a1448b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6a0c136090 0x7f6a0c12f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:33.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.644+0000 7f6a1448b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a0c13a670 0x7f6a0c097a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:33.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.644+0000 7f6a1448b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c0a96a0 con 0x7f6a0c13a670 2023-11-04T15:27:33.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.644+0000 7f6a1448b640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c09a340 con 0x7f6a0c0a6370 2023-11-04T15:27:33.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.644+0000 7f6a1448b640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c0a8a80 con 0x7f6a0c136090 2023-11-04T15:27:33.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.644+0000 7f6a12a28640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a0c13a670 0x7f6a0c097a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:33.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.644+0000 7f6a12a28640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a0c13a670 0x7f6a0c097a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45838/0 (socket says 172.21.15.19:45838) 2023-11-04T15:27:33.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.644+0000 7f6a12a28640 1 -- 172.21.15.19:0/3897378870 learned_addr learned my addr 172.21.15.19:0/3897378870 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:33.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.644+0000 7f6a11a26640 1 --2- 172.21.15.19:0/3897378870 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6a0c136090 0x7f6a0c12f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:33.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.644+0000 7f6a12227640 1 --2- 172.21.15.19:0/3897378870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a0c0a6370 0x7f6a0c12ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:33.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.644+0000 7f6a12a28640 1 -- 172.21.15.19:0/3897378870 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6a0c136090 msgr2=0x7f6a0c12f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:33.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.644+0000 7f6a12a28640 1 --2- 172.21.15.19:0/3897378870 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6a0c136090 0x7f6a0c12f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.644+0000 7f6a12a28640 1 -- 172.21.15.19:0/3897378870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a0c0a6370 msgr2=0x7f6a0c12ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:33.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.644+0000 7f6a12a28640 1 --2- 172.21.15.19:0/3897378870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a0c0a6370 0x7f6a0c12ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.644+0000 7f6a12a28640 1 -- 172.21.15.19:0/3897378870 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69fc0094d0 con 0x7f6a0c13a670 2023-11-04T15:27:33.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.644+0000 7f6a12a28640 1 --2- 172.21.15.19:0/3897378870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a0c13a670 0x7f6a0c097a00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6a04007e70 tx=0x7f6a0400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:33.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.644+0000 7f6a02ffd640 1 -- 172.21.15.19:0/3897378870 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a04003b90 con 0x7f6a0c13a670 2023-11-04T15:27:33.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.645+0000 7f6a02ffd640 1 -- 172.21.15.19:0/3897378870 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0400f040 con 0x7f6a0c13a670 2023-11-04T15:27:33.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.645+0000 7f6a02ffd640 1 -- 172.21.15.19:0/3897378870 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0400de80 con 0x7f6a0c13a670 2023-11-04T15:27:33.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.645+0000 7f6a1448b640 1 -- 172.21.15.19:0/3897378870 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a0c0a9a60 con 0x7f6a0c13a670 2023-11-04T15:27:33.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.645+0000 7f6a1448b640 1 -- 172.21.15.19:0/3897378870 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a0c0a8d70 con 0x7f6a0c13a670 2023-11-04T15:27:33.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.645+0000 7f6a1448b640 1 -- 172.21.15.19:0/3897378870 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a0c0a44d0 con 0x7f6a0c13a670 2023-11-04T15:27:33.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.646+0000 7f6a02ffd640 1 -- 172.21.15.19:0/3897378870 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6a04004030 con 0x7f6a0c13a670 2023-11-04T15:27:33.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.646+0000 7f6a02ffd640 1 --2- 172.21.15.19:0/3897378870 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f69f006a460 0x7f69f006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:33.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.646+0000 7f6a02ffd640 1 -- 172.21.15.19:0/3897378870 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f6a04088240 con 0x7f6a0c13a670 2023-11-04T15:27:33.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.646+0000 7f6a12227640 1 --2- 172.21.15.19:0/3897378870 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f69f006a460 0x7f69f006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:33.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.647+0000 7f6a12227640 1 --2- 172.21.15.19:0/3897378870 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f69f006a460 0x7f69f006c920 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6a08009950 tx=0x7f6a08008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:33.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.651+0000 7f6a02ffd640 1 -- 172.21.15.19:0/3897378870 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6a04054220 con 0x7f6a0c13a670 2023-11-04T15:27:33.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.825+0000 7f6a1448b640 1 -- 172.21.15.19:0/3897378870 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6a0c067d60 con 0x7f6a0c13a670 2023-11-04T15:27:33.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.825+0000 7f6a02ffd640 1 -- 172.21.15.19:0/3897378870 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6a0401a0a0 con 0x7f6a0c13a670 2023-11-04T15:27:33.828 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 8 2023-11-04T15:27:33.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.827+0000 7f6a1448b640 1 -- 172.21.15.19:0/3897378870 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f69f006a460 msgr2=0x7f69f006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:33.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.827+0000 7f6a1448b640 1 --2- 172.21.15.19:0/3897378870 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f69f006a460 0x7f69f006c920 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6a08009950 tx=0x7f6a08008040 comp rx=0 tx=0).stop 2023-11-04T15:27:33.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.827+0000 7f6a1448b640 1 -- 172.21.15.19:0/3897378870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a0c13a670 msgr2=0x7f6a0c097a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:33.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.827+0000 7f6a1448b640 1 --2- 172.21.15.19:0/3897378870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a0c13a670 0x7f6a0c097a00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6a04007e70 tx=0x7f6a0400d4a0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.827+0000 7f6a1448b640 1 -- 172.21.15.19:0/3897378870 shutdown_connections 2023-11-04T15:27:33.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.827+0000 7f6a1448b640 1 --2- 172.21.15.19:0/3897378870 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f69f006a460 0x7f69f006c920 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.827+0000 7f6a1448b640 1 --2- 172.21.15.19:0/3897378870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a0c13a670 0x7f6a0c097a00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.827+0000 7f6a1448b640 1 --2- 172.21.15.19:0/3897378870 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6a0c136090 0x7f6a0c12f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.827+0000 7f6a1448b640 1 --2- 172.21.15.19:0/3897378870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a0c0a6370 0x7f6a0c12ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.828+0000 7f6a1448b640 1 -- 172.21.15.19:0/3897378870 >> 172.21.15.19:0/3897378870 conn(0x7f6a0c0ac3f0 msgr2=0x7f6a0c1339e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:33.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.828+0000 7f6a1448b640 1 -- 172.21.15.19:0/3897378870 shutdown_connections 2023-11-04T15:27:33.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.828+0000 7f6a1448b640 1 -- 172.21.15.19:0/3897378870 wait complete. 2023-11-04T15:27:33.840 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T15:27:33.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.944+0000 7fb38068f640 1 Processor -- start 2023-11-04T15:27:33.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.944+0000 7fb38068f640 1 -- start start 2023-11-04T15:27:33.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.944+0000 7fb38068f640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb378137270 0x7fb3780a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:33.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.944+0000 7fb38068f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb3780a3e90 0x7fb378139f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:33.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.944+0000 7fb38068f640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3780a4c20 con 0x7fb378137650 2023-11-04T15:27:33.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.944+0000 7fb38068f640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3780a3060 con 0x7fb378137270 2023-11-04T15:27:33.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.944+0000 7fb38068f640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3780a5080 con 0x7fb3780a3e90 2023-11-04T15:27:33.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.945+0000 7fb37e42b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb378137270 0x7fb3780a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:33.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.945+0000 7fb37e42b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb378137270 0x7fb3780a6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45846/0 (socket says 172.21.15.19:45846) 2023-11-04T15:27:33.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.945+0000 7fb37e42b640 1 -- 172.21.15.19:0/1215113706 learned_addr learned my addr 172.21.15.19:0/1215113706 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:33.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.945+0000 7fb37dc2a640 1 --2- 172.21.15.19:0/1215113706 >> v2:172.21.15.96:3300/0 conn(0x7fb3780a3e90 0x7fb378139f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:33.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.945+0000 7fb37e42b640 1 -- 172.21.15.19:0/1215113706 >> v2:172.21.15.96:3300/0 conn(0x7fb3780a3e90 msgr2=0x7fb378139f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:33.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.945+0000 7fb37e42b640 1 --2- 172.21.15.19:0/1215113706 >> v2:172.21.15.96:3300/0 conn(0x7fb3780a3e90 0x7fb378139f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.945+0000 7fb37e42b640 1 -- 172.21.15.19:0/1215113706 >> v1:172.21.15.96:6789/0 conn(0x7fb378137650 legacy=0x7fb37813a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:33.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.945+0000 7fb37e42b640 1 -- 172.21.15.19:0/1215113706 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3780a3440 con 0x7fb378137270 2023-11-04T15:27:33.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.945+0000 7fb37dc2a640 1 --2- 172.21.15.19:0/1215113706 >> v2:172.21.15.96:3300/0 conn(0x7fb3780a3e90 0x7fb378139f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T15:27:33.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.946+0000 7fb37e42b640 1 --2- 172.21.15.19:0/1215113706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb378137270 0x7fb3780a6200 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb3780aa140 tx=0x7fb37402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da9ff8248e3bd8cb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:33.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.946+0000 7fb37d429640 1 -- 172.21.15.19:0/1215113706 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3740317e0 con 0x7fb378137270 2023-11-04T15:27:33.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.946+0000 7fb37d429640 1 -- 172.21.15.19:0/1215113706 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb374031940 con 0x7fb378137270 2023-11-04T15:27:33.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.946+0000 7fb37d429640 1 -- 172.21.15.19:0/1215113706 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb374031cd0 con 0x7fb378137270 2023-11-04T15:27:33.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.946+0000 7fb38068f640 1 -- 172.21.15.19:0/1215113706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb378137270 msgr2=0x7fb3780a6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:33.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.946+0000 7fb38068f640 1 --2- 172.21.15.19:0/1215113706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb378137270 0x7fb3780a6200 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb3780aa140 tx=0x7fb37402b880 comp rx=0 tx=0).stop 2023-11-04T15:27:33.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.946+0000 7fb38068f640 1 -- 172.21.15.19:0/1215113706 shutdown_connections 2023-11-04T15:27:33.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.946+0000 7fb38068f640 1 --2- 172.21.15.19:0/1215113706 >> v2:172.21.15.96:3300/0 conn(0x7fb3780a3e90 0x7fb378139f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.946+0000 7fb38068f640 1 --2- 172.21.15.19:0/1215113706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb378137270 0x7fb3780a6200 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.946+0000 7fb38068f640 1 -- 172.21.15.19:0/1215113706 >> 172.21.15.19:0/1215113706 conn(0x7fb3780a8d70 msgr2=0x7fb3780a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:33.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.947+0000 7fb38068f640 1 -- 172.21.15.19:0/1215113706 shutdown_connections 2023-11-04T15:27:33.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.947+0000 7fb38068f640 1 -- 172.21.15.19:0/1215113706 wait complete. 2023-11-04T15:27:33.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.947+0000 7fb38068f640 1 Processor -- start 2023-11-04T15:27:33.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.947+0000 7fb38068f640 1 -- start start 2023-11-04T15:27:33.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.948+0000 7fb38068f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3780a3e90 0x7fb37809ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:33.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.948+0000 7fb38068f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb378137270 0x7fb37809ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:33.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.948+0000 7fb38068f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb378137650 0x7fb37809f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:33.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.948+0000 7fb38068f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3780a6200 con 0x7fb378137650 2023-11-04T15:27:33.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.948+0000 7fb38068f640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb378137b50 con 0x7fb3780a3e90 2023-11-04T15:27:33.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.948+0000 7fb38068f640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3780a09f0 con 0x7fb378137270 2023-11-04T15:27:33.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.948+0000 7fb37ec2c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb378137650 0x7fb37809f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:33.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.948+0000 7fb37ec2c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb378137650 0x7fb37809f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45848/0 (socket says 172.21.15.19:45848) 2023-11-04T15:27:33.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.948+0000 7fb37ec2c640 1 -- 172.21.15.19:0/1749168899 learned_addr learned my addr 172.21.15.19:0/1749168899 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:33.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.948+0000 7fb37dc2a640 1 --2- 172.21.15.19:0/1749168899 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb378137270 0x7fb37809ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:33.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.948+0000 7fb37e42b640 1 --2- 172.21.15.19:0/1749168899 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3780a3e90 0x7fb37809ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:33.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.948+0000 7fb37ec2c640 1 -- 172.21.15.19:0/1749168899 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb378137270 msgr2=0x7fb37809ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:33.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.948+0000 7fb37ec2c640 1 --2- 172.21.15.19:0/1749168899 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb378137270 0x7fb37809ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.948+0000 7fb37ec2c640 1 -- 172.21.15.19:0/1749168899 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3780a3e90 msgr2=0x7fb37809ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:33.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.948+0000 7fb37ec2c640 1 --2- 172.21.15.19:0/1749168899 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3780a3e90 0x7fb37809ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:33.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.948+0000 7fb37ec2c640 1 -- 172.21.15.19:0/1749168899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3740094d0 con 0x7fb378137650 2023-11-04T15:27:33.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.948+0000 7fb37e42b640 1 --2- 172.21.15.19:0/1749168899 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3780a3e90 0x7fb37809ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T15:27:33.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.949+0000 7fb37ec2c640 1 --2- 172.21.15.19:0/1749168899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb378137650 0x7fb37809f480 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb37000c7d0 tx=0x7fb37000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:33.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.949+0000 7fb36effd640 1 -- 172.21.15.19:0/1749168899 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb370003b70 con 0x7fb378137650 2023-11-04T15:27:33.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.949+0000 7fb36effd640 1 -- 172.21.15.19:0/1749168899 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb370003cf0 con 0x7fb378137650 2023-11-04T15:27:33.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.949+0000 7fb38068f640 1 -- 172.21.15.19:0/1749168899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3780a0630 con 0x7fb378137650 2023-11-04T15:27:33.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.949+0000 7fb36effd640 1 -- 172.21.15.19:0/1749168899 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37000aa90 con 0x7fb378137650 2023-11-04T15:27:33.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.949+0000 7fb38068f640 1 -- 172.21.15.19:0/1749168899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3780a1ce0 con 0x7fb378137650 2023-11-04T15:27:33.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.950+0000 7fb38068f640 1 -- 172.21.15.19:0/1749168899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb378067d60 con 0x7fb378137650 2023-11-04T15:27:33.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.950+0000 7fb36effd640 1 -- 172.21.15.19:0/1749168899 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb37000abf0 con 0x7fb378137650 2023-11-04T15:27:33.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.951+0000 7fb36effd640 1 --2- 172.21.15.19:0/1749168899 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fb35c06a430 0x7fb35c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:33.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.951+0000 7fb36effd640 1 -- 172.21.15.19:0/1749168899 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fb370087e00 con 0x7fb378137650 2023-11-04T15:27:33.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.951+0000 7fb37e42b640 1 --2- 172.21.15.19:0/1749168899 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fb35c06a430 0x7fb35c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:33.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.951+0000 7fb37e42b640 1 --2- 172.21.15.19:0/1749168899 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fb35c06a430 0x7fb35c06c8f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb374036000 tx=0x7fb37403d040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:33.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:33.955+0000 7fb36effd640 1 -- 172.21.15.19:0/1749168899 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb370053d30 con 0x7fb378137650 2023-11-04T15:27:34.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.134+0000 7fb38068f640 1 -- 172.21.15.19:0/1749168899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb3780a3af0 con 0x7fb378137650 2023-11-04T15:27:34.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.135+0000 7fb36effd640 1 -- 172.21.15.19:0/1749168899 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v15) v1 ==== 84+0+126 (secure 0 0 0) 0x7fb370003e60 con 0x7fb378137650 2023-11-04T15:27:34.137 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:27:34.137 INFO:teuthology.orchestra.run.smithi019.stdout:[ 2023-11-04T15:27:34.138 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-11-04T15:27:34.138 INFO:teuthology.orchestra.run.smithi019.stdout: "poolnum": 1, 2023-11-04T15:27:34.138 INFO:teuthology.orchestra.run.smithi019.stdout: "poolname": ".mgr" 2023-11-04T15:27:34.138 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-11-04T15:27:34.139 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-11-04T15:27:34.139 INFO:teuthology.orchestra.run.smithi019.stdout: "poolnum": 2, 2023-11-04T15:27:34.139 INFO:teuthology.orchestra.run.smithi019.stdout: "poolname": "rbd" 2023-11-04T15:27:34.139 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-11-04T15:27:34.139 INFO:teuthology.orchestra.run.smithi019.stdout:] 2023-11-04T15:27:34.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.137+0000 7fb38068f640 1 -- 172.21.15.19:0/1749168899 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fb35c06a430 msgr2=0x7fb35c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:34.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.137+0000 7fb38068f640 1 --2- 172.21.15.19:0/1749168899 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fb35c06a430 0x7fb35c06c8f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb374036000 tx=0x7fb37403d040 comp rx=0 tx=0).stop 2023-11-04T15:27:34.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.137+0000 7fb38068f640 1 -- 172.21.15.19:0/1749168899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb378137650 msgr2=0x7fb37809f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:34.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.137+0000 7fb38068f640 1 --2- 172.21.15.19:0/1749168899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb378137650 0x7fb37809f480 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb37000c7d0 tx=0x7fb37000cc90 comp rx=0 tx=0).stop 2023-11-04T15:27:34.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.137+0000 7fb38068f640 1 -- 172.21.15.19:0/1749168899 shutdown_connections 2023-11-04T15:27:34.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.137+0000 7fb38068f640 1 --2- 172.21.15.19:0/1749168899 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fb35c06a430 0x7fb35c06c8f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:34.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.137+0000 7fb38068f640 1 --2- 172.21.15.19:0/1749168899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb378137650 0x7fb37809f480 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:34.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.137+0000 7fb38068f640 1 --2- 172.21.15.19:0/1749168899 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb378137270 0x7fb37809ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:34.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.137+0000 7fb38068f640 1 --2- 172.21.15.19:0/1749168899 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3780a3e90 0x7fb37809ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:34.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.137+0000 7fb38068f640 1 -- 172.21.15.19:0/1749168899 >> 172.21.15.19:0/1749168899 conn(0x7fb3780a8d70 msgr2=0x7fb378099a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:34.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.137+0000 7fb38068f640 1 -- 172.21.15.19:0/1749168899 shutdown_connections 2023-11-04T15:27:34.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.137+0000 7fb38068f640 1 -- 172.21.15.19:0/1749168899 wait complete. 2023-11-04T15:27:34.149 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T15:27:34.150 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T15:27:34.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.257+0000 7fc82610a640 1 Processor -- start 2023-11-04T15:27:34.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.257+0000 7fc82610a640 1 -- start start 2023-11-04T15:27:34.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.258+0000 7fc82610a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc8201361a0 0x7fc8200a64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:34.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.258+0000 7fc82610a640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc820136580 0x7fc8201369e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:34.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.258+0000 7fc82610a640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc820136f20 0x7fc8201373b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:34.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.258+0000 7fc82610a640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8200a52e0 con 0x7fc820136f20 2023-11-04T15:27:34.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.258+0000 7fc82610a640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8200a4ef0 con 0x7fc8201361a0 2023-11-04T15:27:34.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.258+0000 7fc82610a640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8200a55a0 con 0x7fc820136580 2023-11-04T15:27:34.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.258+0000 7fc81ffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc820136f20 0x7fc8201373b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:34.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.258+0000 7fc81ffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc820136f20 0x7fc8201373b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45856/0 (socket says 172.21.15.19:45856) 2023-11-04T15:27:34.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.258+0000 7fc81ffff640 1 -- 172.21.15.19:0/2229473532 learned_addr learned my addr 172.21.15.19:0/2229473532 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:34.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.258+0000 7fc81effd640 1 --2- 172.21.15.19:0/2229473532 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc820136580 0x7fc8201369e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:34.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.258+0000 7fc81f7fe640 1 --2- 172.21.15.19:0/2229473532 >> v2:172.21.15.96:3300/0 conn(0x7fc8201361a0 0x7fc8200a64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:34.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.258+0000 7fc81ffff640 1 -- 172.21.15.19:0/2229473532 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc820136580 msgr2=0x7fc8201369e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:34.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.258+0000 7fc81ffff640 1 --2- 172.21.15.19:0/2229473532 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc820136580 0x7fc8201369e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:34.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.258+0000 7fc81ffff640 1 -- 172.21.15.19:0/2229473532 >> v2:172.21.15.96:3300/0 conn(0x7fc8201361a0 msgr2=0x7fc8200a64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:34.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.258+0000 7fc81ffff640 1 --2- 172.21.15.19:0/2229473532 >> v2:172.21.15.96:3300/0 conn(0x7fc8201361a0 0x7fc8200a64f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:34.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.258+0000 7fc81ffff640 1 -- 172.21.15.19:0/2229473532 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8200a5880 con 0x7fc820136f20 2023-11-04T15:27:34.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.258+0000 7fc81effd640 1 --2- 172.21.15.19:0/2229473532 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc820136580 0x7fc8201369e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T15:27:34.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.259+0000 7fc81ffff640 1 --2- 172.21.15.19:0/2229473532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc820136f20 0x7fc8201373b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc8200abbf0 tx=0x7fc81802bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45c64c3d24568ecd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:34.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.259+0000 7fc81e7fc640 1 -- 172.21.15.19:0/2229473532 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81802c950 con 0x7fc820136f20 2023-11-04T15:27:34.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.259+0000 7fc81e7fc640 1 -- 172.21.15.19:0/2229473532 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81802cab0 con 0x7fc820136f20 2023-11-04T15:27:34.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.259+0000 7fc81e7fc640 1 -- 172.21.15.19:0/2229473532 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81802ce40 con 0x7fc820136f20 2023-11-04T15:27:34.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.259+0000 7fc82610a640 1 -- 172.21.15.19:0/2229473532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc820136f20 msgr2=0x7fc8201373b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:34.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.259+0000 7fc82610a640 1 --2- 172.21.15.19:0/2229473532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc820136f20 0x7fc8201373b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc8200abbf0 tx=0x7fc81802bdb0 comp rx=0 tx=0).stop 2023-11-04T15:27:34.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.259+0000 7fc82610a640 1 -- 172.21.15.19:0/2229473532 shutdown_connections 2023-11-04T15:27:34.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.259+0000 7fc82610a640 1 --2- 172.21.15.19:0/2229473532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc820136f20 0x7fc8201373b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:34.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.259+0000 7fc82610a640 1 --2- 172.21.15.19:0/2229473532 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc820136580 0x7fc8201369e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:34.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.259+0000 7fc82610a640 1 --2- 172.21.15.19:0/2229473532 >> v2:172.21.15.96:3300/0 conn(0x7fc8201361a0 0x7fc8200a64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:34.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.259+0000 7fc82610a640 1 -- 172.21.15.19:0/2229473532 >> 172.21.15.19:0/2229473532 conn(0x7fc8200ac3f0 msgr2=0x7fc8200ac800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:34.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.260+0000 7fc82610a640 1 -- 172.21.15.19:0/2229473532 shutdown_connections 2023-11-04T15:27:34.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.260+0000 7fc82610a640 1 -- 172.21.15.19:0/2229473532 wait complete. 2023-11-04T15:27:34.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.260+0000 7fc82610a640 1 Processor -- start 2023-11-04T15:27:34.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.261+0000 7fc82610a640 1 -- start start 2023-11-04T15:27:34.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.261+0000 7fc82610a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8201361a0 0x7fc8201ced70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:34.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.261+0000 7fc82610a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc820136580 0x7fc8201cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:34.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.261+0000 7fc82610a640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc820136f20 0x7fc8201cb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:34.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.261+0000 7fc82610a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82009b760 con 0x7fc820136580 2023-11-04T15:27:34.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.261+0000 7fc82610a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82009b530 con 0x7fc8201361a0 2023-11-04T15:27:34.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.261+0000 7fc82610a640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc820137e00 con 0x7fc820136f20 2023-11-04T15:27:34.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.261+0000 7fc81effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc820136580 0x7fc8201cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:34.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.261+0000 7fc81effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc820136580 0x7fc8201cf2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45872/0 (socket says 172.21.15.19:45872) 2023-11-04T15:27:34.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.261+0000 7fc81effd640 1 -- 172.21.15.19:0/1967321586 learned_addr learned my addr 172.21.15.19:0/1967321586 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:34.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.261+0000 7fc81ffff640 1 --2- 172.21.15.19:0/1967321586 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc820136f20 0x7fc8201cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:34.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.261+0000 7fc81f7fe640 1 --2- 172.21.15.19:0/1967321586 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8201361a0 0x7fc8201ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:34.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.261+0000 7fc81effd640 1 -- 172.21.15.19:0/1967321586 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc820136f20 msgr2=0x7fc8201cb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:34.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.261+0000 7fc81effd640 1 --2- 172.21.15.19:0/1967321586 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc820136f20 0x7fc8201cb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:34.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.261+0000 7fc81effd640 1 -- 172.21.15.19:0/1967321586 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8201361a0 msgr2=0x7fc8201ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:34.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.261+0000 7fc81effd640 1 --2- 172.21.15.19:0/1967321586 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8201361a0 0x7fc8201ced70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:34.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.261+0000 7fc81effd640 1 -- 172.21.15.19:0/1967321586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc818009b30 con 0x7fc820136580 2023-11-04T15:27:34.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.261+0000 7fc81f7fe640 1 --2- 172.21.15.19:0/1967321586 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8201361a0 0x7fc8201ced70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T15:27:34.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.262+0000 7fc81effd640 1 --2- 172.21.15.19:0/1967321586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc820136580 0x7fc8201cf2b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc81400c7f0 tx=0x7fc81400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:34.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.262+0000 7fc807fff640 1 -- 172.21.15.19:0/1967321586 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81400cea0 con 0x7fc820136580 2023-11-04T15:27:34.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.262+0000 7fc807fff640 1 -- 172.21.15.19:0/1967321586 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc814004220 con 0x7fc820136580 2023-11-04T15:27:34.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.262+0000 7fc82610a640 1 -- 172.21.15.19:0/1967321586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc82009c2c0 con 0x7fc820136580 2023-11-04T15:27:34.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.262+0000 7fc807fff640 1 -- 172.21.15.19:0/1967321586 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8140077d0 con 0x7fc820136580 2023-11-04T15:27:34.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.262+0000 7fc82610a640 1 -- 172.21.15.19:0/1967321586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc82009d440 con 0x7fc820136580 2023-11-04T15:27:34.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.263+0000 7fc82610a640 1 -- 172.21.15.19:0/1967321586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8201376c0 con 0x7fc820136580 2023-11-04T15:27:34.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.263+0000 7fc807fff640 1 -- 172.21.15.19:0/1967321586 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc814007930 con 0x7fc820136580 2023-11-04T15:27:34.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.263+0000 7fc807fff640 1 --2- 172.21.15.19:0/1967321586 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc80c06a430 0x7fc80c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:34.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.264+0000 7fc807fff640 1 -- 172.21.15.19:0/1967321586 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fc814087d70 con 0x7fc820136580 2023-11-04T15:27:34.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.264+0000 7fc81f7fe640 1 --2- 172.21.15.19:0/1967321586 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc80c06a430 0x7fc80c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:34.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.264+0000 7fc81f7fe640 1 --2- 172.21.15.19:0/1967321586 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc80c06a430 0x7fc80c06c8f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc810006fd0 tx=0x7fc810008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:34.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.268+0000 7fc807fff640 1 -- 172.21.15.19:0/1967321586 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc814053ca0 con 0x7fc820136580 2023-11-04T15:27:34.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.445+0000 7fc82610a640 1 -- 172.21.15.19:0/1967321586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc82004e040 con 0x7fc820136580 2023-11-04T15:27:34.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.748+0000 7fc807fff640 1 -- 172.21.15.19:0/1967321586 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v16) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc81401e020 con 0x7fc820136580 2023-11-04T15:27:34.751 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' created 2023-11-04T15:27:34.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.752+0000 7fc82610a640 1 -- 172.21.15.19:0/1967321586 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc80c06a430 msgr2=0x7fc80c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:34.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.752+0000 7fc82610a640 1 --2- 172.21.15.19:0/1967321586 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc80c06a430 0x7fc80c06c8f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc810006fd0 tx=0x7fc810008040 comp rx=0 tx=0).stop 2023-11-04T15:27:34.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.752+0000 7fc82610a640 1 -- 172.21.15.19:0/1967321586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc820136580 msgr2=0x7fc8201cf2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:34.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.752+0000 7fc82610a640 1 --2- 172.21.15.19:0/1967321586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc820136580 0x7fc8201cf2b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc81400c7f0 tx=0x7fc81400ccb0 comp rx=0 tx=0).stop 2023-11-04T15:27:34.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.752+0000 7fc82610a640 1 -- 172.21.15.19:0/1967321586 shutdown_connections 2023-11-04T15:27:34.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.752+0000 7fc82610a640 1 --2- 172.21.15.19:0/1967321586 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc80c06a430 0x7fc80c06c8f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:34.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.752+0000 7fc82610a640 1 --2- 172.21.15.19:0/1967321586 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc820136f20 0x7fc8201cb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:34.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.752+0000 7fc82610a640 1 --2- 172.21.15.19:0/1967321586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc820136580 0x7fc8201cf2b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:34.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.752+0000 7fc82610a640 1 --2- 172.21.15.19:0/1967321586 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8201361a0 0x7fc8201ced70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:34.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.752+0000 7fc82610a640 1 -- 172.21.15.19:0/1967321586 >> 172.21.15.19:0/1967321586 conn(0x7fc8200ac3f0 msgr2=0x7fc8200a6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:34.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.753+0000 7fc82610a640 1 -- 172.21.15.19:0/1967321586 shutdown_connections 2023-11-04T15:27:34.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.753+0000 7fc82610a640 1 -- 172.21.15.19:0/1967321586 wait complete. 2023-11-04T15:27:34.766 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T15:27:34.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.876+0000 7f691337e640 1 Processor -- start 2023-11-04T15:27:34.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.876+0000 7f691337e640 1 -- start start 2023-11-04T15:27:34.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.877+0000 7f691337e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f690c137050 0x7f690c137430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:34.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.877+0000 7f691337e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f690c0a6430 0x7f690c139ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:34.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.877+0000 7f691337e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f690c13a430 0x7f690c13a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:34.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.877+0000 7f691337e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f690c0a3f20 con 0x7f690c0a6430 2023-11-04T15:27:34.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.877+0000 7f691337e640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f690c13adc0 con 0x7f690c13a430 2023-11-04T15:27:34.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.877+0000 7f691337e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690c137970 con 0x7f690c137050 2023-11-04T15:27:34.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.877+0000 7f6910919640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f690c0a6430 0x7f690c139ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:34.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.877+0000 7f6910919640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f690c0a6430 0x7f690c139ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45880/0 (socket says 172.21.15.19:45880) 2023-11-04T15:27:34.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.877+0000 7f6910919640 1 -- 172.21.15.19:0/3723042420 learned_addr learned my addr 172.21.15.19:0/3723042420 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:34.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.877+0000 7f691111a640 1 --2- 172.21.15.19:0/3723042420 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f690c137050 0x7f690c137430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:34.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.877+0000 7f691191b640 1 --2- 172.21.15.19:0/3723042420 >> v2:172.21.15.96:3300/0 conn(0x7f690c13a430 0x7f690c13a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:34.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.877+0000 7f6910919640 1 -- 172.21.15.19:0/3723042420 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f690c137050 msgr2=0x7f690c137430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:34.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.877+0000 7f6910919640 1 --2- 172.21.15.19:0/3723042420 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f690c137050 0x7f690c137430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:34.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.877+0000 7f6910919640 1 -- 172.21.15.19:0/3723042420 >> v2:172.21.15.96:3300/0 conn(0x7f690c13a430 msgr2=0x7f690c13a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:34.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.877+0000 7f6910919640 1 --2- 172.21.15.19:0/3723042420 >> v2:172.21.15.96:3300/0 conn(0x7f690c13a430 0x7f690c13a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:34.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.877+0000 7f6910919640 1 -- 172.21.15.19:0/3723042420 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f690c0a3cf0 con 0x7f690c0a6430 2023-11-04T15:27:34.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.877+0000 7f691191b640 1 --2- 172.21.15.19:0/3723042420 >> v2:172.21.15.96:3300/0 conn(0x7f690c13a430 0x7f690c13a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:27:34.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.878+0000 7f6910919640 1 --2- 172.21.15.19:0/3723042420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f690c0a6430 0x7f690c139ef0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f69000098a0 tx=0x7f690002b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e36e52d732b205 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:34.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.878+0000 7f690bfff640 1 -- 172.21.15.19:0/3723042420 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6900031520 con 0x7f690c0a6430 2023-11-04T15:27:34.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.878+0000 7f690bfff640 1 -- 172.21.15.19:0/3723042420 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6900031680 con 0x7f690c0a6430 2023-11-04T15:27:34.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.878+0000 7f690bfff640 1 -- 172.21.15.19:0/3723042420 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6900031a10 con 0x7f690c0a6430 2023-11-04T15:27:34.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.879+0000 7f691337e640 1 -- 172.21.15.19:0/3723042420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f690c0a6430 msgr2=0x7f690c139ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:34.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.879+0000 7f691337e640 1 --2- 172.21.15.19:0/3723042420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f690c0a6430 0x7f690c139ef0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f69000098a0 tx=0x7f690002b7c0 comp rx=0 tx=0).stop 2023-11-04T15:27:34.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.879+0000 7f691337e640 1 -- 172.21.15.19:0/3723042420 shutdown_connections 2023-11-04T15:27:34.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.879+0000 7f691337e640 1 --2- 172.21.15.19:0/3723042420 >> v2:172.21.15.96:3300/0 conn(0x7f690c13a430 0x7f690c13a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:34.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.879+0000 7f691337e640 1 --2- 172.21.15.19:0/3723042420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f690c0a6430 0x7f690c139ef0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:34.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.879+0000 7f691337e640 1 --2- 172.21.15.19:0/3723042420 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f690c137050 0x7f690c137430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:34.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.879+0000 7f691337e640 1 -- 172.21.15.19:0/3723042420 >> 172.21.15.19:0/3723042420 conn(0x7f690c0a8d70 msgr2=0x7f690c0a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:34.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.879+0000 7f691337e640 1 -- 172.21.15.19:0/3723042420 shutdown_connections 2023-11-04T15:27:34.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.879+0000 7f691337e640 1 -- 172.21.15.19:0/3723042420 wait complete. 2023-11-04T15:27:34.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.880+0000 7f691337e640 1 Processor -- start 2023-11-04T15:27:34.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.880+0000 7f691337e640 1 -- start start 2023-11-04T15:27:34.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.880+0000 7f691337e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f690c137050 0x7f690c09d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:34.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.880+0000 7f691337e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f690c13a430 0x7f690c09de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:34.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.880+0000 7f691337e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f690c09e380 0x7f690c134e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:34.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.880+0000 7f691337e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690c137b70 con 0x7f690c09e380 2023-11-04T15:27:34.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.880+0000 7f691337e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690c09f7a0 con 0x7f690c13a430 2023-11-04T15:27:34.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.880+0000 7f691337e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690c0a0350 con 0x7f690c137050 2023-11-04T15:27:34.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.880+0000 7f691191b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f690c09e380 0x7f690c134e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:34.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.880+0000 7f691191b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f690c09e380 0x7f690c134e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45886/0 (socket says 172.21.15.19:45886) 2023-11-04T15:27:34.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.880+0000 7f691191b640 1 -- 172.21.15.19:0/2668489708 learned_addr learned my addr 172.21.15.19:0/2668489708 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:34.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.880+0000 7f691111a640 1 --2- 172.21.15.19:0/2668489708 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f690c137050 0x7f690c09d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:34.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.880+0000 7f6910919640 1 --2- 172.21.15.19:0/2668489708 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f690c13a430 0x7f690c09de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:34.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.881+0000 7f691191b640 1 -- 172.21.15.19:0/2668489708 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f690c137050 msgr2=0x7f690c09d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:34.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.881+0000 7f691191b640 1 --2- 172.21.15.19:0/2668489708 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f690c137050 0x7f690c09d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:34.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.881+0000 7f691191b640 1 -- 172.21.15.19:0/2668489708 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f690c13a430 msgr2=0x7f690c09de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:34.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.881+0000 7f691191b640 1 --2- 172.21.15.19:0/2668489708 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f690c13a430 0x7f690c09de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:34.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.881+0000 7f691191b640 1 -- 172.21.15.19:0/2668489708 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69000094d0 con 0x7f690c09e380 2023-11-04T15:27:34.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.881+0000 7f691191b640 1 --2- 172.21.15.19:0/2668489708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f690c09e380 0x7f690c134e90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f68fc007ea0 tx=0x7f68fc007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:34.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.881+0000 7f6909ffb640 1 -- 172.21.15.19:0/2668489708 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc003990 con 0x7f690c09e380 2023-11-04T15:27:34.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.881+0000 7f6909ffb640 1 -- 172.21.15.19:0/2668489708 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68fc00f040 con 0x7f690c09e380 2023-11-04T15:27:34.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.881+0000 7f6909ffb640 1 -- 172.21.15.19:0/2668489708 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc003d50 con 0x7f690c09e380 2023-11-04T15:27:34.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.881+0000 7f691337e640 1 -- 172.21.15.19:0/2668489708 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f690c09f9e0 con 0x7f690c09e380 2023-11-04T15:27:34.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.881+0000 7f691337e640 1 -- 172.21.15.19:0/2668489708 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f690c0a1730 con 0x7f690c09e380 2023-11-04T15:27:34.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.882+0000 7f691337e640 1 -- 172.21.15.19:0/2668489708 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f690c067d60 con 0x7f690c09e380 2023-11-04T15:27:34.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.883+0000 7f6909ffb640 1 -- 172.21.15.19:0/2668489708 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f68fc004030 con 0x7f690c09e380 2023-11-04T15:27:34.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.883+0000 7f6909ffb640 1 --2- 172.21.15.19:0/2668489708 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f68f806a460 0x7f68f806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:34.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.883+0000 7f6909ffb640 1 -- 172.21.15.19:0/2668489708 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3852+0+0 (secure 0 0 0) 0x7f68fc0882d0 con 0x7f690c09e380 2023-11-04T15:27:34.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.883+0000 7f691111a640 1 --2- 172.21.15.19:0/2668489708 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f68f806a460 0x7f68f806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:34.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.884+0000 7f691111a640 1 --2- 172.21.15.19:0/2668489708 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f68f806a460 0x7f68f806c920 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6904009b40 tx=0x7f6904009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:34.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:34.887+0000 7f6909ffb640 1 -- 172.21.15.19:0/2668489708 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f68fc054140 con 0x7f690c09e380 2023-11-04T15:27:35.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.065+0000 7f691337e640 1 -- 172.21.15.19:0/2668489708 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f690c0a3ad0 con 0x7f690c09e380 2023-11-04T15:27:35.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.757+0000 7f6909ffb640 1 -- 172.21.15.19:0/2668489708 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v17) v1 ==== 170+0+0 (secure 0 0 0) 0x7f68fc01a0d0 con 0x7f690c09e380 2023-11-04T15:27:35.759 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' created 2023-11-04T15:27:35.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.762+0000 7f691337e640 1 -- 172.21.15.19:0/2668489708 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f68f806a460 msgr2=0x7f68f806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:35.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.762+0000 7f691337e640 1 --2- 172.21.15.19:0/2668489708 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f68f806a460 0x7f68f806c920 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6904009b40 tx=0x7f6904009190 comp rx=0 tx=0).stop 2023-11-04T15:27:35.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.762+0000 7f691337e640 1 -- 172.21.15.19:0/2668489708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f690c09e380 msgr2=0x7f690c134e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:35.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.762+0000 7f691337e640 1 --2- 172.21.15.19:0/2668489708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f690c09e380 0x7f690c134e90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f68fc007ea0 tx=0x7f68fc007f90 comp rx=0 tx=0).stop 2023-11-04T15:27:35.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.763+0000 7f691337e640 1 -- 172.21.15.19:0/2668489708 shutdown_connections 2023-11-04T15:27:35.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.763+0000 7f691337e640 1 --2- 172.21.15.19:0/2668489708 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f68f806a460 0x7f68f806c920 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:35.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.763+0000 7f691337e640 1 --2- 172.21.15.19:0/2668489708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f690c09e380 0x7f690c134e90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:35.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.763+0000 7f691337e640 1 --2- 172.21.15.19:0/2668489708 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f690c13a430 0x7f690c09de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:35.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.763+0000 7f691337e640 1 --2- 172.21.15.19:0/2668489708 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f690c137050 0x7f690c09d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:35.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.763+0000 7f691337e640 1 -- 172.21.15.19:0/2668489708 >> 172.21.15.19:0/2668489708 conn(0x7f690c0a8d70 msgr2=0x7f690c138b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:35.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.764+0000 7f691337e640 1 -- 172.21.15.19:0/2668489708 shutdown_connections 2023-11-04T15:27:35.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.764+0000 7f691337e640 1 -- 172.21.15.19:0/2668489708 wait complete. 2023-11-04T15:27:35.784 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T15:27:35.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.898+0000 7ff367cca640 1 Processor -- start 2023-11-04T15:27:35.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.898+0000 7ff367cca640 1 -- start start 2023-11-04T15:27:35.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.899+0000 7ff367cca640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff360136090 0x7ff360136470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:35.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.899+0000 7ff367cca640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff3600a6370 0x7ff36013a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:35.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.899+0000 7ff367cca640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3600abe60 con 0x7ff36013a670 2023-11-04T15:27:35.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.899+0000 7ff367cca640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3600a30a0 con 0x7ff3600a6370 2023-11-04T15:27:35.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.899+0000 7ff367cca640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3600a4b90 con 0x7ff360136090 2023-11-04T15:27:35.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.899+0000 7ff365265640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff3600a6370 0x7ff36013a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:35.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.899+0000 7ff365265640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff3600a6370 0x7ff36013a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45892/0 (socket says 172.21.15.19:45892) 2023-11-04T15:27:35.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.899+0000 7ff365265640 1 -- 172.21.15.19:0/2764038581 learned_addr learned my addr 172.21.15.19:0/2764038581 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:35.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.899+0000 7ff365a66640 1 --2- 172.21.15.19:0/2764038581 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff360136090 0x7ff360136470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:35.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.899+0000 7ff365265640 1 -- 172.21.15.19:0/2764038581 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff360136090 msgr2=0x7ff360136470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:35.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.899+0000 7ff365265640 1 --2- 172.21.15.19:0/2764038581 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff360136090 0x7ff360136470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:35.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.899+0000 7ff365265640 1 -- 172.21.15.19:0/2764038581 >> v1:172.21.15.96:6789/0 conn(0x7ff36013a670 legacy=0x7ff360141460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:35.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.899+0000 7ff365265640 1 -- 172.21.15.19:0/2764038581 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3600a51f0 con 0x7ff3600a6370 2023-11-04T15:27:35.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.899+0000 7ff365a66640 1 --2- 172.21.15.19:0/2764038581 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff360136090 0x7ff360136470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T15:27:35.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.900+0000 7ff365265640 1 --2- 172.21.15.19:0/2764038581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3600a6370 0x7ff36013a130 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff350009870 tx=0x7ff35002b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c79470ca26a35599 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:35.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.900+0000 7ff364a64640 1 -- 172.21.15.19:0/2764038581 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff350031740 con 0x7ff3600a6370 2023-11-04T15:27:35.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.900+0000 7ff364a64640 1 -- 172.21.15.19:0/2764038581 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3500318a0 con 0x7ff3600a6370 2023-11-04T15:27:35.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.900+0000 7ff364a64640 1 -- 172.21.15.19:0/2764038581 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff350031c30 con 0x7ff3600a6370 2023-11-04T15:27:35.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.900+0000 7ff367cca640 1 -- 172.21.15.19:0/2764038581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3600a6370 msgr2=0x7ff36013a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:35.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.900+0000 7ff367cca640 1 --2- 172.21.15.19:0/2764038581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3600a6370 0x7ff36013a130 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff350009870 tx=0x7ff35002b7e0 comp rx=0 tx=0).stop 2023-11-04T15:27:35.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.901+0000 7ff367cca640 1 -- 172.21.15.19:0/2764038581 shutdown_connections 2023-11-04T15:27:35.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.901+0000 7ff367cca640 1 --2- 172.21.15.19:0/2764038581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3600a6370 0x7ff36013a130 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:35.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.901+0000 7ff367cca640 1 --2- 172.21.15.19:0/2764038581 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff360136090 0x7ff360136470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:35.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.901+0000 7ff367cca640 1 -- 172.21.15.19:0/2764038581 >> 172.21.15.19:0/2764038581 conn(0x7ff3600ac3f0 msgr2=0x7ff3600ac800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:35.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.901+0000 7ff367cca640 1 -- 172.21.15.19:0/2764038581 shutdown_connections 2023-11-04T15:27:35.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.901+0000 7ff367cca640 1 -- 172.21.15.19:0/2764038581 wait complete. 2023-11-04T15:27:35.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.901+0000 7ff367cca640 1 Processor -- start 2023-11-04T15:27:35.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.902+0000 7ff367cca640 1 -- start start 2023-11-04T15:27:35.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.902+0000 7ff367cca640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff3600a6370 0x7ff360097a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:35.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.902+0000 7ff367cca640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff360136090 0x7ff360097f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:35.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.902+0000 7ff367cca640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff36013a670 0x7ff360098480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:35.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.902+0000 7ff367cca640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36009a7d0 con 0x7ff360136090 2023-11-04T15:27:35.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.902+0000 7ff367cca640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3600a9630 con 0x7ff36013a670 2023-11-04T15:27:35.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.902+0000 7ff367cca640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3600a8940 con 0x7ff3600a6370 2023-11-04T15:27:35.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.902+0000 7ff365265640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff360136090 0x7ff360097f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:35.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.902+0000 7ff365265640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff360136090 0x7ff360097f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45904/0 (socket says 172.21.15.19:45904) 2023-11-04T15:27:35.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.902+0000 7ff365265640 1 -- 172.21.15.19:0/96200409 learned_addr learned my addr 172.21.15.19:0/96200409 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:35.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.902+0000 7ff365a66640 1 --2- 172.21.15.19:0/96200409 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff3600a6370 0x7ff360097a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:35.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.902+0000 7ff366267640 1 --2- 172.21.15.19:0/96200409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff36013a670 0x7ff360098480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:35.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.902+0000 7ff365265640 1 -- 172.21.15.19:0/96200409 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff3600a6370 msgr2=0x7ff360097a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:35.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.902+0000 7ff365265640 1 --2- 172.21.15.19:0/96200409 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff3600a6370 0x7ff360097a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:35.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.902+0000 7ff365265640 1 -- 172.21.15.19:0/96200409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff36013a670 msgr2=0x7ff360098480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:35.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.902+0000 7ff365265640 1 --2- 172.21.15.19:0/96200409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff36013a670 0x7ff360098480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:35.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.902+0000 7ff365265640 1 -- 172.21.15.19:0/96200409 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3500094d0 con 0x7ff360136090 2023-11-04T15:27:35.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.902+0000 7ff366267640 1 --2- 172.21.15.19:0/96200409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff36013a670 0x7ff360098480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T15:27:35.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.903+0000 7ff365265640 1 --2- 172.21.15.19:0/96200409 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff360136090 0x7ff360097f40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff350000c00 tx=0x7ff3500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:35.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.903+0000 7ff3567fc640 1 -- 172.21.15.19:0/96200409 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff350033d60 con 0x7ff360136090 2023-11-04T15:27:35.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.903+0000 7ff3567fc640 1 -- 172.21.15.19:0/96200409 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35003c400 con 0x7ff360136090 2023-11-04T15:27:35.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.903+0000 7ff367cca640 1 -- 172.21.15.19:0/96200409 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3600a8bc0 con 0x7ff360136090 2023-11-04T15:27:35.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.903+0000 7ff3567fc640 1 -- 172.21.15.19:0/96200409 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35003c7b0 con 0x7ff360136090 2023-11-04T15:27:35.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.903+0000 7ff367cca640 1 -- 172.21.15.19:0/96200409 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff36009a410 con 0x7ff360136090 2023-11-04T15:27:35.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.904+0000 7ff367cca640 1 -- 172.21.15.19:0/96200409 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff36009b3a0 con 0x7ff360136090 2023-11-04T15:27:35.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.904+0000 7ff3567fc640 1 -- 172.21.15.19:0/96200409 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff35003a040 con 0x7ff360136090 2023-11-04T15:27:35.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.905+0000 7ff3567fc640 1 --2- 172.21.15.19:0/96200409 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7ff34406a430 0x7ff34406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:35.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.905+0000 7ff3567fc640 1 -- 172.21.15.19:0/96200409 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4234+0+0 (secure 0 0 0) 0x7ff3500a9fe0 con 0x7ff360136090 2023-11-04T15:27:35.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.905+0000 7ff365a66640 1 --2- 172.21.15.19:0/96200409 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7ff34406a430 0x7ff34406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:35.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.905+0000 7ff365a66640 1 --2- 172.21.15.19:0/96200409 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7ff34406a430 0x7ff34406c8f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff35c00a990 tx=0x7ff35c008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:35.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:35.909+0000 7ff3567fc640 1 -- 172.21.15.19:0/96200409 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff350075ce0 con 0x7ff360136090 2023-11-04T15:27:36.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.123+0000 7ff367cca640 1 -- 172.21.15.19:0/96200409 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff360067d60 con 0x7ff360136090 2023-11-04T15:27:36.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.129+0000 7ff3567fc640 1 -- 172.21.15.19:0/96200409 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff3500380c0 con 0x7ff360136090 2023-11-04T15:27:36.131 INFO:teuthology.orchestra.run.smithi019.stderr:new fs with metadata pool 3 and data pool 4 2023-11-04T15:27:36.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.135+0000 7ff367cca640 1 -- 172.21.15.19:0/96200409 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7ff34406a430 msgr2=0x7ff34406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:36.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.135+0000 7ff367cca640 1 --2- 172.21.15.19:0/96200409 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7ff34406a430 0x7ff34406c8f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff35c00a990 tx=0x7ff35c008040 comp rx=0 tx=0).stop 2023-11-04T15:27:36.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.135+0000 7ff367cca640 1 -- 172.21.15.19:0/96200409 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff360136090 msgr2=0x7ff360097f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:36.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.135+0000 7ff367cca640 1 --2- 172.21.15.19:0/96200409 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff360136090 0x7ff360097f40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff350000c00 tx=0x7ff3500046c0 comp rx=0 tx=0).stop 2023-11-04T15:27:36.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.136+0000 7ff367cca640 1 -- 172.21.15.19:0/96200409 shutdown_connections 2023-11-04T15:27:36.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.136+0000 7ff367cca640 1 --2- 172.21.15.19:0/96200409 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7ff34406a430 0x7ff34406c8f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:36.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.136+0000 7ff367cca640 1 --2- 172.21.15.19:0/96200409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff36013a670 0x7ff360098480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:36.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.136+0000 7ff367cca640 1 --2- 172.21.15.19:0/96200409 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff360136090 0x7ff360097f40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:36.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.136+0000 7ff367cca640 1 --2- 172.21.15.19:0/96200409 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff3600a6370 0x7ff360097a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:36.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.136+0000 7ff367cca640 1 -- 172.21.15.19:0/96200409 >> 172.21.15.19:0/96200409 conn(0x7ff3600ac3f0 msgr2=0x7ff360133940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:36.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.136+0000 7ff367cca640 1 -- 172.21.15.19:0/96200409 shutdown_connections 2023-11-04T15:27:36.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.138+0000 7ff367cca640 1 -- 172.21.15.19:0/96200409 wait complete. 2023-11-04T15:27:36.157 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T15:27:36.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.260+0000 7efd57fd0640 1 Processor -- start 2023-11-04T15:27:36.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.261+0000 7efd57fd0640 1 -- start start 2023-11-04T15:27:36.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.261+0000 7efd57fd0640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efd50070090 0x7efd5006c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:36.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.261+0000 7efd57fd0640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7efd501370c0 0x7efd50137500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:36.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.261+0000 7efd57fd0640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd5006cac0 con 0x7efd5013a180 2023-11-04T15:27:36.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.261+0000 7efd57fd0640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd50136e00 con 0x7efd50070090 2023-11-04T15:27:36.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.261+0000 7efd57fd0640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd5006c250 con 0x7efd501370c0 2023-11-04T15:27:36.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.261+0000 7efd55d6c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efd50070090 0x7efd5006c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:36.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.261+0000 7efd55d6c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efd50070090 0x7efd5006c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45912/0 (socket says 172.21.15.19:45912) 2023-11-04T15:27:36.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.261+0000 7efd55d6c640 1 -- 172.21.15.19:0/3070706811 learned_addr learned my addr 172.21.15.19:0/3070706811 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:36.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.261+0000 7efd5556b640 1 --2- 172.21.15.19:0/3070706811 >> v2:172.21.15.96:3300/0 conn(0x7efd501370c0 0x7efd50137500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:36.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.262+0000 7efd55d6c640 1 -- 172.21.15.19:0/3070706811 >> v2:172.21.15.96:3300/0 conn(0x7efd501370c0 msgr2=0x7efd50137500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:36.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.262+0000 7efd55d6c640 1 --2- 172.21.15.19:0/3070706811 >> v2:172.21.15.96:3300/0 conn(0x7efd501370c0 0x7efd50137500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:36.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.262+0000 7efd55d6c640 1 -- 172.21.15.19:0/3070706811 >> v1:172.21.15.96:6789/0 conn(0x7efd5013a180 legacy=0x7efd5013a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:36.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.262+0000 7efd55d6c640 1 -- 172.21.15.19:0/3070706811 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5006be90 con 0x7efd50070090 2023-11-04T15:27:36.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.262+0000 7efd5556b640 1 --2- 172.21.15.19:0/3070706811 >> v2:172.21.15.96:3300/0 conn(0x7efd501370c0 0x7efd50137500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T15:27:36.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.262+0000 7efd55d6c640 1 --2- 172.21.15.19:0/3070706811 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd50070090 0x7efd5006c4b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efd5006ee90 tx=0x7efd4002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19bc9b7b74158040 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:36.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.262+0000 7efd54d6a640 1 -- 172.21.15.19:0/3070706811 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4002c9f0 con 0x7efd50070090 2023-11-04T15:27:36.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.262+0000 7efd54d6a640 1 -- 172.21.15.19:0/3070706811 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd4002cb50 con 0x7efd50070090 2023-11-04T15:27:36.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.262+0000 7efd54d6a640 1 -- 172.21.15.19:0/3070706811 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd400343f0 con 0x7efd50070090 2023-11-04T15:27:36.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.263+0000 7efd57fd0640 1 -- 172.21.15.19:0/3070706811 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd50070090 msgr2=0x7efd5006c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:36.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.263+0000 7efd57fd0640 1 --2- 172.21.15.19:0/3070706811 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd50070090 0x7efd5006c4b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efd5006ee90 tx=0x7efd4002be50 comp rx=0 tx=0).stop 2023-11-04T15:27:36.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.263+0000 7efd57fd0640 1 -- 172.21.15.19:0/3070706811 shutdown_connections 2023-11-04T15:27:36.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.263+0000 7efd57fd0640 1 --2- 172.21.15.19:0/3070706811 >> v2:172.21.15.96:3300/0 conn(0x7efd501370c0 0x7efd50137500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:36.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.263+0000 7efd57fd0640 1 --2- 172.21.15.19:0/3070706811 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd50070090 0x7efd5006c4b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:36.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.263+0000 7efd57fd0640 1 -- 172.21.15.19:0/3070706811 >> 172.21.15.19:0/3070706811 conn(0x7efd500aa2c0 msgr2=0x7efd500aa6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:36.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.263+0000 7efd57fd0640 1 -- 172.21.15.19:0/3070706811 shutdown_connections 2023-11-04T15:27:36.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.263+0000 7efd57fd0640 1 -- 172.21.15.19:0/3070706811 wait complete. 2023-11-04T15:27:36.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.264+0000 7efd57fd0640 1 Processor -- start 2023-11-04T15:27:36.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.264+0000 7efd57fd0640 1 -- start start 2023-11-04T15:27:36.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.264+0000 7efd57fd0640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efd50070090 0x7efd50132d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:36.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.265+0000 7efd57fd0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd501370c0 0x7efd50133250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:36.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.265+0000 7efd57fd0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd5013a180 0x7efd500a1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:36.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.265+0000 7efd57fd0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd500a2770 con 0x7efd5013a180 2023-11-04T15:27:36.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.265+0000 7efd57fd0640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd500a2960 con 0x7efd501370c0 2023-11-04T15:27:36.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.265+0000 7efd57fd0640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd5009c1c0 con 0x7efd50070090 2023-11-04T15:27:36.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.265+0000 7efd5656d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd5013a180 0x7efd500a1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:36.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.265+0000 7efd5656d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd5013a180 0x7efd500a1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45926/0 (socket says 172.21.15.19:45926) 2023-11-04T15:27:36.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.265+0000 7efd55d6c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efd50070090 0x7efd50132d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:36.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.265+0000 7efd5656d640 1 -- 172.21.15.19:0/2057414251 learned_addr learned my addr 172.21.15.19:0/2057414251 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:36.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.265+0000 7efd5556b640 1 --2- 172.21.15.19:0/2057414251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd501370c0 0x7efd50133250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:36.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.265+0000 7efd5656d640 1 -- 172.21.15.19:0/2057414251 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efd50070090 msgr2=0x7efd50132d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:36.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.265+0000 7efd5656d640 1 --2- 172.21.15.19:0/2057414251 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efd50070090 0x7efd50132d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:36.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.265+0000 7efd5656d640 1 -- 172.21.15.19:0/2057414251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd501370c0 msgr2=0x7efd50133250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:36.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.265+0000 7efd5656d640 1 --2- 172.21.15.19:0/2057414251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd501370c0 0x7efd50133250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:36.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.265+0000 7efd5656d640 1 -- 172.21.15.19:0/2057414251 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd40009b30 con 0x7efd5013a180 2023-11-04T15:27:36.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.265+0000 7efd5656d640 1 --2- 172.21.15.19:0/2057414251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd5013a180 0x7efd500a1410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efd4800c440 tx=0x7efd4800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:36.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.265+0000 7efd4e7fc640 1 -- 172.21.15.19:0/2057414251 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd48011790 con 0x7efd5013a180 2023-11-04T15:27:36.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.265+0000 7efd4e7fc640 1 -- 172.21.15.19:0/2057414251 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd480118f0 con 0x7efd5013a180 2023-11-04T15:27:36.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.265+0000 7efd4e7fc640 1 -- 172.21.15.19:0/2057414251 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd48011ca0 con 0x7efd5013a180 2023-11-04T15:27:36.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.265+0000 7efd57fd0640 1 -- 172.21.15.19:0/2057414251 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd50133790 con 0x7efd5013a180 2023-11-04T15:27:36.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.265+0000 7efd57fd0640 1 -- 172.21.15.19:0/2057414251 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd500a0ca0 con 0x7efd5013a180 2023-11-04T15:27:36.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.266+0000 7efd57fd0640 1 -- 172.21.15.19:0/2057414251 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd500a1180 con 0x7efd5013a180 2023-11-04T15:27:36.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.267+0000 7efd4e7fc640 1 -- 172.21.15.19:0/2057414251 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efd4801c460 con 0x7efd5013a180 2023-11-04T15:27:36.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.267+0000 7efd4e7fc640 1 --2- 172.21.15.19:0/2057414251 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7efd3c06a460 0x7efd3c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:36.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.267+0000 7efd4e7fc640 1 -- 172.21.15.19:0/2057414251 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4334+0+0 (secure 0 0 0) 0x7efd48088040 con 0x7efd5013a180 2023-11-04T15:27:36.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.267+0000 7efd55d6c640 1 --2- 172.21.15.19:0/2057414251 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7efd3c06a460 0x7efd3c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:36.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.268+0000 7efd55d6c640 1 --2- 172.21.15.19:0/2057414251 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7efd3c06a460 0x7efd3c06c920 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efd40035000 tx=0x7efd40030000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:36.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.272+0000 7efd4e7fc640 1 -- 172.21.15.19:0/2057414251 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efd48053cd0 con 0x7efd5013a180 2023-11-04T15:27:36.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.448+0000 7efd57fd0640 1 -- 172.21.15.19:0/2057414251 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd50067d60 con 0x7efd5013a180 2023-11-04T15:27:36.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.450+0000 7efd4e7fc640 1 -- 172.21.15.19:0/2057414251 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+13193 (secure 0 0 0) 0x7efd480572f0 con 0x7efd5013a180 2023-11-04T15:27:36.454 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:27:36.454 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":18,"fsid":"e87311d5-496a-4b07-9654-358fe5bbf950","created":"2023-11-04T15:27:14.865121+0000","modified":"2023-11-04T15:27:36.125458+0000","last_up_change":"2023-11-04T15:27:24.162282+0000","last_in_change":"2023-11-04T15:27:15.971035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T15:27:24.987312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-04T15:27:30.500235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-04T15:27:34.476271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-04T15:27:35.096759+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"34818469-ebf2-4dd4-8119-af19a0121036","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":82879},{"type":"v1","addr":"172.21.15.19:6801","nonce":82879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":82879},{"type":"v1","addr":"172.21.15.19:6803","nonce":82879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":82879},{"type":"v1","addr":"172.21.15.19:6807","nonce":82879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":82879},{"type":"v1","addr":"172.21.15.19:6805","nonce":82879}]},"public_addr":"172.21.15.19:6801/82879","cluster_addr":"172.21.15.19:6803/82879","heartbeat_back_addr":"172.21.15.19:6807/82879","heartbeat_front_addr":"172.21.15.19:6805/82879","state":["exists","up"]},{"osd":1,"uuid":"92dab290-7912-4eea-b6f6-c754c2480721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":82880},{"type":"v1","addr":"172.21.15.19:6809","nonce":82880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":82880},{"type":"v1","addr":"172.21.15.19:6811","nonce":82880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":82880},{"type":"v1","addr":"172.21.15.19:6815","nonce":82880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":82880},{"type":"v1","addr":"172.21.15.19:6813","nonce":82880}]},"public_addr":"172.21.15.19:6809/82880","cluster_addr":"172.21.15.19:6811/82880","heartbeat_back_addr":"172.21.15.19:6815/82880","heartbeat_front_addr":"172.21.15.19:6813/82880","state":["exists","up"]},{"osd":2,"uuid":"1be47db4-6dd1-4ce5-832b-bc6ad30c78c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":83458},{"type":"v1","addr":"172.21.15.96:6808","nonce":83458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":83458},{"type":"v1","addr":"172.21.15.96:6811","nonce":83458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":83458},{"type":"v1","addr":"172.21.15.96:6815","nonce":83458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":83458},{"type":"v1","addr":"172.21.15.96:6813","nonce":83458}]},"public_addr":"172.21.15.96:6808/83458","cluster_addr":"172.21.15.96:6811/83458","heartbeat_back_addr":"172.21.15.96:6815/83458","heartbeat_front_addr":"172.21.15.96:6813/83458","state":["exists","up"]},{"osd":3,"uuid":"46505800-d64f-49ef-b811-5b5979f48252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":83459},{"type":"v1","addr":"172.21.15.96:6801","nonce":83459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":83459},{"type":"v1","addr":"172.21.15.96:6803","nonce":83459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6807","nonce":83459},{"type":"v1","addr":"172.21.15.96:6809","nonce":83459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":83459},{"type":"v1","addr":"172.21.15.96:6805","nonce":83459}]},"public_addr":"172.21.15.96:6801/83459","cluster_addr":"172.21.15.96:6803/83459","heartbeat_back_addr":"172.21.15.96:6809/83459","heartbeat_front_addr":"172.21.15.96:6805/83459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.081547+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.132075+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.094919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.074106+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T15:27:36.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.451+0000 7efd57fd0640 1 -- 172.21.15.19:0/2057414251 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7efd3c06a460 msgr2=0x7efd3c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:36.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.452+0000 7efd57fd0640 1 --2- 172.21.15.19:0/2057414251 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7efd3c06a460 0x7efd3c06c920 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efd40035000 tx=0x7efd40030000 comp rx=0 tx=0).stop 2023-11-04T15:27:36.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.452+0000 7efd57fd0640 1 -- 172.21.15.19:0/2057414251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd5013a180 msgr2=0x7efd500a1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:36.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.452+0000 7efd57fd0640 1 --2- 172.21.15.19:0/2057414251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd5013a180 0x7efd500a1410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efd4800c440 tx=0x7efd4800c900 comp rx=0 tx=0).stop 2023-11-04T15:27:36.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.452+0000 7efd57fd0640 1 -- 172.21.15.19:0/2057414251 shutdown_connections 2023-11-04T15:27:36.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.452+0000 7efd57fd0640 1 --2- 172.21.15.19:0/2057414251 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7efd3c06a460 0x7efd3c06c920 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:36.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.452+0000 7efd57fd0640 1 --2- 172.21.15.19:0/2057414251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd5013a180 0x7efd500a1410 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:36.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.452+0000 7efd57fd0640 1 --2- 172.21.15.19:0/2057414251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd501370c0 0x7efd50133250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:36.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.452+0000 7efd57fd0640 1 --2- 172.21.15.19:0/2057414251 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efd50070090 0x7efd50132d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:36.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.452+0000 7efd57fd0640 1 -- 172.21.15.19:0/2057414251 >> 172.21.15.19:0/2057414251 conn(0x7efd500aa2c0 msgr2=0x7efd50133c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:36.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.452+0000 7efd57fd0640 1 -- 172.21.15.19:0/2057414251 shutdown_connections 2023-11-04T15:27:36.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.452+0000 7efd57fd0640 1 -- 172.21.15.19:0/2057414251 wait complete. 2023-11-04T15:27:36.466 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T15:27:36.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.570+0000 7f2ad877e640 1 Processor -- start 2023-11-04T15:27:36.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.570+0000 7f2ad877e640 1 -- start start 2023-11-04T15:27:36.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.571+0000 7f2ad877e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2ad0141270 0x7f2ad0143660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:36.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.571+0000 7f2ad877e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad00a6590 con 0x7f2ad0137150 2023-11-04T15:27:36.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.571+0000 7f2ad877e640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad00a2ef0 con 0x7f2ad0137530 2023-11-04T15:27:36.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.571+0000 7f2ad877e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad0137990 con 0x7f2ad0141270 2023-11-04T15:27:36.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.571+0000 7f2ad651a640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2ad0137150 0x7f2ad0139ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50502/0 (socket says 172.21.15.19:50502) 2023-11-04T15:27:36.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.571+0000 7f2ad651a640 1 -- 172.21.15.19:0/3381647203 learned_addr learned my addr 172.21.15.19:0/3381647203 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:36.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.571+0000 7f2ad6d1b640 1 --2- 172.21.15.19:0/3381647203 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2ad0141270 0x7f2ad0143660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:36.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.571+0000 7f2ad5518640 1 -- 172.21.15.19:0/3381647203 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1300977625 0 0) 0x7f2ad00a6590 con 0x7f2ad0137150 2023-11-04T15:27:36.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.571+0000 7f2ad5518640 1 -- 172.21.15.19:0/3381647203 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ab8003520 con 0x7f2ad0137150 2023-11-04T15:27:36.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.571+0000 7f2ad5518640 1 -- 172.21.15.19:0/3381647203 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3641783300 0 0) 0x7f2ab8003520 con 0x7f2ad0137150 2023-11-04T15:27:36.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.571+0000 7f2ad5518640 1 -- 172.21.15.19:0/3381647203 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2ad0141270 msgr2=0x7f2ad0143660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:36.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.571+0000 7f2ad5518640 1 --2- 172.21.15.19:0/3381647203 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2ad0141270 0x7f2ad0143660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:36.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.571+0000 7f2ad5518640 1 -- 172.21.15.19:0/3381647203 >> v1:172.21.15.96:6789/0 conn(0x7f2ad0137530 legacy=0x7f2ad013a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:36.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.571+0000 7f2ad5518640 1 -- 172.21.15.19:0/3381647203 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad013ad10 con 0x7f2ad0137150 2023-11-04T15:27:36.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.572+0000 7f2ad5518640 1 -- 172.21.15.19:0/3381647203 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3646097784 0 0) 0x7f2ac8001670 con 0x7f2ad0137150 2023-11-04T15:27:36.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.572+0000 7f2ad5518640 1 -- 172.21.15.19:0/3381647203 >> v1:172.21.15.19:6789/0 conn(0x7f2ad0137150 legacy=0x7f2ad0139ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:36.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.572+0000 7f2ad5518640 1 --2- 172.21.15.19:0/3381647203 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2ad0141270 0x7f2ab80039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:36.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.572+0000 7f2ad5518640 1 --2- 172.21.15.19:0/3381647203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ab8003f20 0x7f2ab80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:36.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.572+0000 7f2ad5518640 1 --2- 172.21.15.19:0/3381647203 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ab8004d00 0x7f2ab8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:36.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.572+0000 7f2ad5518640 1 -- 172.21.15.19:0/3381647203 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab800bb10 con 0x7f2ab8004d00 2023-11-04T15:27:36.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.572+0000 7f2ad5518640 1 -- 172.21.15.19:0/3381647203 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab800bc50 con 0x7f2ab8003f20 2023-11-04T15:27:36.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.572+0000 7f2ad5518640 1 -- 172.21.15.19:0/3381647203 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab800be10 con 0x7f2ad0141270 2023-11-04T15:27:36.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.572+0000 7f2ad6d1b640 1 --2- 172.21.15.19:0/3381647203 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ab8004d00 0x7f2ab8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:36.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.572+0000 7f2ad651a640 1 --2- 172.21.15.19:0/3381647203 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2ad0141270 0x7f2ab80039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:36.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.572+0000 7f2ad5d19640 1 --2- 172.21.15.19:0/3381647203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ab8003f20 0x7f2ab80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:36.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.572+0000 7f2ad6d1b640 1 -- 172.21.15.19:0/3381647203 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2ad0141270 msgr2=0x7f2ab80039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:36.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.572+0000 7f2ad6d1b640 1 --2- 172.21.15.19:0/3381647203 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2ad0141270 0x7f2ab80039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:36.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.572+0000 7f2ad6d1b640 1 -- 172.21.15.19:0/3381647203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ab8003f20 msgr2=0x7f2ab80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:36.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.572+0000 7f2ad6d1b640 1 --2- 172.21.15.19:0/3381647203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ab8003f20 0x7f2ab80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:36.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.572+0000 7f2ad6d1b640 1 -- 172.21.15.19:0/3381647203 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab8003520 con 0x7f2ab8004d00 2023-11-04T15:27:36.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.573+0000 7f2ad6d1b640 1 --2- 172.21.15.19:0/3381647203 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ab8004d00 0x7f2ab8005180 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2ad00aa140 tx=0x7f2ab80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b27f8060d7a8a4e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:36.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.573+0000 7f2ad5518640 1 -- 172.21.15.19:0/3381647203 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac002cb90 con 0x7f2ab8004d00 2023-11-04T15:27:36.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.573+0000 7f2ad5518640 1 -- 172.21.15.19:0/3381647203 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac000f040 con 0x7f2ab8004d00 2023-11-04T15:27:36.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.573+0000 7f2ad5518640 1 -- 172.21.15.19:0/3381647203 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac0034440 con 0x7f2ab8004d00 2023-11-04T15:27:36.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.573+0000 7f2ad877e640 1 -- 172.21.15.19:0/3381647203 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ab8004d00 msgr2=0x7f2ab8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:36.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.573+0000 7f2ad877e640 1 --2- 172.21.15.19:0/3381647203 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ab8004d00 0x7f2ab8005180 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2ad00aa140 tx=0x7f2ab80057f0 comp rx=0 tx=0).stop 2023-11-04T15:27:36.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.573+0000 7f2ad6d1b640 1 -- 172.21.15.19:0/3381647203 reap_dead start 2023-11-04T15:27:36.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.574+0000 7f2ad877e640 1 -- 172.21.15.19:0/3381647203 shutdown_connections 2023-11-04T15:27:36.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.574+0000 7f2ad877e640 1 -- 172.21.15.19:0/3381647203 >> 172.21.15.19:0/3381647203 conn(0x7f2ad00a8d70 msgr2=0x7f2ad00a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:36.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.574+0000 7f2ad877e640 1 -- 172.21.15.19:0/3381647203 shutdown_connections 2023-11-04T15:27:36.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.574+0000 7f2ad877e640 1 -- 172.21.15.19:0/3381647203 wait complete. 2023-11-04T15:27:36.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.574+0000 7f2ad877e640 1 Processor -- start 2023-11-04T15:27:36.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.574+0000 7f2ad877e640 1 -- start start 2023-11-04T15:27:36.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.575+0000 7f2ad877e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ab8004d00 0x7f2ad0131a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:36.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.575+0000 7f2ad877e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ad0131f50 0x7f2ad01323b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:36.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.575+0000 7f2ad877e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2ad01cb7a0 0x7f2ad01cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:36.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.575+0000 7f2ad877e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad013fc90 con 0x7f2ad0131f50 2023-11-04T15:27:36.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.575+0000 7f2ad877e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad013fec0 con 0x7f2ab8004d00 2023-11-04T15:27:36.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.575+0000 7f2ad877e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad0140860 con 0x7f2ad01cb7a0 2023-11-04T15:27:36.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.575+0000 7f2ad5d19640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ad0131f50 0x7f2ad01323b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:36.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.575+0000 7f2ad5d19640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ad0131f50 0x7f2ad01323b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45936/0 (socket says 172.21.15.19:45936) 2023-11-04T15:27:36.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.575+0000 7f2ad5d19640 1 -- 172.21.15.19:0/103713979 learned_addr learned my addr 172.21.15.19:0/103713979 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:36.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.575+0000 7f2ad651a640 1 --2- 172.21.15.19:0/103713979 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ab8004d00 0x7f2ad0131a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:36.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.575+0000 7f2ad6d1b640 1 --2- 172.21.15.19:0/103713979 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2ad01cb7a0 0x7f2ad01cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:36.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.575+0000 7f2ad5d19640 1 -- 172.21.15.19:0/103713979 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2ad01cb7a0 msgr2=0x7f2ad01cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:36.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.575+0000 7f2ad5d19640 1 --2- 172.21.15.19:0/103713979 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2ad01cb7a0 0x7f2ad01cbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:36.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.575+0000 7f2ad5d19640 1 -- 172.21.15.19:0/103713979 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ab8004d00 msgr2=0x7f2ad0131a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:36.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.575+0000 7f2ad5d19640 1 --2- 172.21.15.19:0/103713979 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ab8004d00 0x7f2ad0131a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:36.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.575+0000 7f2ad5d19640 1 -- 172.21.15.19:0/103713979 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad0140430 con 0x7f2ad0131f50 2023-11-04T15:27:36.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.575+0000 7f2ad6d1b640 1 --2- 172.21.15.19:0/103713979 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2ad01cb7a0 0x7f2ad01cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:27:36.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.575+0000 7f2ad5d19640 1 --2- 172.21.15.19:0/103713979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ad0131f50 0x7f2ad01323b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2ac400f820 tx=0x7f2ac400fc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:36.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.576+0000 7f2aceffd640 1 -- 172.21.15.19:0/103713979 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac40050d0 con 0x7f2ad0131f50 2023-11-04T15:27:36.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.576+0000 7f2aceffd640 1 -- 172.21.15.19:0/103713979 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac4005230 con 0x7f2ad0131f50 2023-11-04T15:27:36.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.576+0000 7f2aceffd640 1 -- 172.21.15.19:0/103713979 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac400d730 con 0x7f2ad0131f50 2023-11-04T15:27:36.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.576+0000 7f2ad877e640 1 -- 172.21.15.19:0/103713979 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad0140ab0 con 0x7f2ad0131f50 2023-11-04T15:27:36.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.576+0000 7f2ad877e640 1 -- 172.21.15.19:0/103713979 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad013f380 con 0x7f2ad0131f50 2023-11-04T15:27:36.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.577+0000 7f2ad877e640 1 -- 172.21.15.19:0/103713979 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad00a8710 con 0x7f2ad0131f50 2023-11-04T15:27:36.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.577+0000 7f2aceffd640 1 -- 172.21.15.19:0/103713979 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2ac400d890 con 0x7f2ad0131f50 2023-11-04T15:27:36.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.577+0000 7f2aceffd640 1 --2- 172.21.15.19:0/103713979 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f2abc06a430 0x7f2abc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:36.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.577+0000 7f2aceffd640 1 -- 172.21.15.19:0/103713979 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f2ac4088270 con 0x7f2ad0131f50 2023-11-04T15:27:36.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.578+0000 7f2ad651a640 1 --2- 172.21.15.19:0/103713979 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f2abc06a430 0x7f2abc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:36.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.578+0000 7f2ad651a640 1 --2- 172.21.15.19:0/103713979 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f2abc06a430 0x7f2abc06c8f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8001050 tx=0x7f2ac8001470 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:36.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.582+0000 7f2aceffd640 1 -- 172.21.15.19:0/103713979 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2ac4053dc0 con 0x7f2ad0131f50 2023-11-04T15:27:36.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.761+0000 7f2ad877e640 1 -- 172.21.15.19:0/103713979 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ad0067d60 con 0x7f2ad0131f50 2023-11-04T15:27:36.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.762+0000 7f2aceffd640 1 -- 172.21.15.19:0/103713979 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+13193 (secure 0 0 0) 0x7f2ac40573e0 con 0x7f2ad0131f50 2023-11-04T15:27:36.764 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:27:36.765 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":18,"fsid":"e87311d5-496a-4b07-9654-358fe5bbf950","created":"2023-11-04T15:27:14.865121+0000","modified":"2023-11-04T15:27:36.125458+0000","last_up_change":"2023-11-04T15:27:24.162282+0000","last_in_change":"2023-11-04T15:27:15.971035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T15:27:24.987312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-04T15:27:30.500235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-04T15:27:34.476271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-04T15:27:35.096759+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"34818469-ebf2-4dd4-8119-af19a0121036","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":82879},{"type":"v1","addr":"172.21.15.19:6801","nonce":82879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":82879},{"type":"v1","addr":"172.21.15.19:6803","nonce":82879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":82879},{"type":"v1","addr":"172.21.15.19:6807","nonce":82879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":82879},{"type":"v1","addr":"172.21.15.19:6805","nonce":82879}]},"public_addr":"172.21.15.19:6801/82879","cluster_addr":"172.21.15.19:6803/82879","heartbeat_back_addr":"172.21.15.19:6807/82879","heartbeat_front_addr":"172.21.15.19:6805/82879","state":["exists","up"]},{"osd":1,"uuid":"92dab290-7912-4eea-b6f6-c754c2480721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":82880},{"type":"v1","addr":"172.21.15.19:6809","nonce":82880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":82880},{"type":"v1","addr":"172.21.15.19:6811","nonce":82880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":82880},{"type":"v1","addr":"172.21.15.19:6815","nonce":82880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":82880},{"type":"v1","addr":"172.21.15.19:6813","nonce":82880}]},"public_addr":"172.21.15.19:6809/82880","cluster_addr":"172.21.15.19:6811/82880","heartbeat_back_addr":"172.21.15.19:6815/82880","heartbeat_front_addr":"172.21.15.19:6813/82880","state":["exists","up"]},{"osd":2,"uuid":"1be47db4-6dd1-4ce5-832b-bc6ad30c78c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":83458},{"type":"v1","addr":"172.21.15.96:6808","nonce":83458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":83458},{"type":"v1","addr":"172.21.15.96:6811","nonce":83458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":83458},{"type":"v1","addr":"172.21.15.96:6815","nonce":83458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":83458},{"type":"v1","addr":"172.21.15.96:6813","nonce":83458}]},"public_addr":"172.21.15.96:6808/83458","cluster_addr":"172.21.15.96:6811/83458","heartbeat_back_addr":"172.21.15.96:6815/83458","heartbeat_front_addr":"172.21.15.96:6813/83458","state":["exists","up"]},{"osd":3,"uuid":"46505800-d64f-49ef-b811-5b5979f48252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":83459},{"type":"v1","addr":"172.21.15.96:6801","nonce":83459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":83459},{"type":"v1","addr":"172.21.15.96:6803","nonce":83459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6807","nonce":83459},{"type":"v1","addr":"172.21.15.96:6809","nonce":83459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":83459},{"type":"v1","addr":"172.21.15.96:6805","nonce":83459}]},"public_addr":"172.21.15.96:6801/83459","cluster_addr":"172.21.15.96:6803/83459","heartbeat_back_addr":"172.21.15.96:6809/83459","heartbeat_front_addr":"172.21.15.96:6805/83459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.081547+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.132075+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.094919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.074106+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T15:27:36.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.764+0000 7f2ad877e640 1 -- 172.21.15.19:0/103713979 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f2abc06a430 msgr2=0x7f2abc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:36.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.764+0000 7f2ad877e640 1 --2- 172.21.15.19:0/103713979 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f2abc06a430 0x7f2abc06c8f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8001050 tx=0x7f2ac8001470 comp rx=0 tx=0).stop 2023-11-04T15:27:36.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.764+0000 7f2ad877e640 1 -- 172.21.15.19:0/103713979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ad0131f50 msgr2=0x7f2ad01323b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:36.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.764+0000 7f2ad877e640 1 --2- 172.21.15.19:0/103713979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ad0131f50 0x7f2ad01323b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2ac400f820 tx=0x7f2ac400fc20 comp rx=0 tx=0).stop 2023-11-04T15:27:36.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.764+0000 7f2ad877e640 1 -- 172.21.15.19:0/103713979 shutdown_connections 2023-11-04T15:27:36.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.764+0000 7f2ad877e640 1 --2- 172.21.15.19:0/103713979 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f2abc06a430 0x7f2abc06c8f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:36.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.764+0000 7f2ad877e640 1 --2- 172.21.15.19:0/103713979 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2ad01cb7a0 0x7f2ad01cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:36.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.764+0000 7f2ad877e640 1 --2- 172.21.15.19:0/103713979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ad0131f50 0x7f2ad01323b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:36.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.764+0000 7f2ad877e640 1 --2- 172.21.15.19:0/103713979 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ab8004d00 0x7f2ad0131a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:36.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.764+0000 7f2ad877e640 1 -- 172.21.15.19:0/103713979 >> 172.21.15.19:0/103713979 conn(0x7f2ad00a8d70 msgr2=0x7f2ad0135de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:36.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.764+0000 7f2ad877e640 1 -- 172.21.15.19:0/103713979 shutdown_connections 2023-11-04T15:27:36.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.764+0000 7f2ad877e640 1 -- 172.21.15.19:0/103713979 wait complete. 2023-11-04T15:27:36.777 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T15:27:36.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.884+0000 7f7f67d3c640 1 Processor -- start 2023-11-04T15:27:36.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.884+0000 7f7f67d3c640 1 -- start start 2023-11-04T15:27:36.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.884+0000 7f7f67d3c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7f60136090 0x7f7f60136470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:36.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.884+0000 7f7f67d3c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7f600a6370 0x7f7f6013a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:36.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.884+0000 7f7f67d3c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f600abe60 con 0x7f7f6013a670 2023-11-04T15:27:36.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.884+0000 7f7f67d3c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f600a30a0 con 0x7f7f60136090 2023-11-04T15:27:36.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.884+0000 7f7f67d3c640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f600a4b90 con 0x7f7f600a6370 2023-11-04T15:27:36.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.885+0000 7f7f65ad8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7f60136090 0x7f7f60136470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:36.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.885+0000 7f7f65ad8640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7f60136090 0x7f7f60136470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45948/0 (socket says 172.21.15.19:45948) 2023-11-04T15:27:36.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.885+0000 7f7f65ad8640 1 -- 172.21.15.19:0/1556286742 learned_addr learned my addr 172.21.15.19:0/1556286742 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:36.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.885+0000 7f7f652d7640 1 --2- 172.21.15.19:0/1556286742 >> v2:172.21.15.96:3300/0 conn(0x7f7f600a6370 0x7f7f6013a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:36.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.885+0000 7f7f65ad8640 1 -- 172.21.15.19:0/1556286742 >> v2:172.21.15.96:3300/0 conn(0x7f7f600a6370 msgr2=0x7f7f6013a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:36.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.885+0000 7f7f65ad8640 1 --2- 172.21.15.19:0/1556286742 >> v2:172.21.15.96:3300/0 conn(0x7f7f600a6370 0x7f7f6013a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:36.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.885+0000 7f7f65ad8640 1 -- 172.21.15.19:0/1556286742 >> v1:172.21.15.96:6789/0 conn(0x7f7f6013a670 legacy=0x7f7f60141460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:36.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.885+0000 7f7f65ad8640 1 -- 172.21.15.19:0/1556286742 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f600a51f0 con 0x7f7f60136090 2023-11-04T15:27:36.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.885+0000 7f7f652d7640 1 --2- 172.21.15.19:0/1556286742 >> v2:172.21.15.96:3300/0 conn(0x7f7f600a6370 0x7f7f6013a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:27:36.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.886+0000 7f7f65ad8640 1 --2- 172.21.15.19:0/1556286742 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f60136090 0x7f7f60136470 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7f600a9f40 tx=0x7f7f5c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9749251c2924b677 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:36.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.886+0000 7f7f64ad6640 1 -- 172.21.15.19:0/1556286742 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c0317e0 con 0x7f7f60136090 2023-11-04T15:27:36.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.886+0000 7f7f64ad6640 1 -- 172.21.15.19:0/1556286742 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f5c031940 con 0x7f7f60136090 2023-11-04T15:27:36.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.886+0000 7f7f64ad6640 1 -- 172.21.15.19:0/1556286742 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c031cd0 con 0x7f7f60136090 2023-11-04T15:27:36.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.886+0000 7f7f67d3c640 1 -- 172.21.15.19:0/1556286742 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f60136090 msgr2=0x7f7f60136470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:36.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.886+0000 7f7f67d3c640 1 --2- 172.21.15.19:0/1556286742 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f60136090 0x7f7f60136470 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7f600a9f40 tx=0x7f7f5c02b880 comp rx=0 tx=0).stop 2023-11-04T15:27:36.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.886+0000 7f7f67d3c640 1 -- 172.21.15.19:0/1556286742 shutdown_connections 2023-11-04T15:27:36.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.886+0000 7f7f67d3c640 1 --2- 172.21.15.19:0/1556286742 >> v2:172.21.15.96:3300/0 conn(0x7f7f600a6370 0x7f7f6013a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:36.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.886+0000 7f7f67d3c640 1 --2- 172.21.15.19:0/1556286742 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f60136090 0x7f7f60136470 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:36.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.886+0000 7f7f67d3c640 1 -- 172.21.15.19:0/1556286742 >> 172.21.15.19:0/1556286742 conn(0x7f7f600ac3f0 msgr2=0x7f7f600ac800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:36.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.886+0000 7f7f67d3c640 1 -- 172.21.15.19:0/1556286742 shutdown_connections 2023-11-04T15:27:36.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.887+0000 7f7f67d3c640 1 -- 172.21.15.19:0/1556286742 wait complete. 2023-11-04T15:27:36.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.887+0000 7f7f67d3c640 1 Processor -- start 2023-11-04T15:27:36.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.887+0000 7f7f67d3c640 1 -- start start 2023-11-04T15:27:36.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.888+0000 7f7f67d3c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f600a6370 0x7f7f601ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:36.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.888+0000 7f7f67d3c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f60136090 0x7f7f601cef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:36.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.888+0000 7f7f67d3c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7f6013a670 0x7f7f601cf460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:36.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.888+0000 7f7f67d3c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f600a9800 con 0x7f7f600a6370 2023-11-04T15:27:36.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.888+0000 7f7f67d3c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f60097a70 con 0x7f7f60136090 2023-11-04T15:27:36.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.888+0000 7f7f67d3c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f60099c60 con 0x7f7f6013a670 2023-11-04T15:27:36.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.888+0000 7f7f65ad8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f600a6370 0x7f7f601ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:36.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.888+0000 7f7f65ad8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f600a6370 0x7f7f601ce9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45952/0 (socket says 172.21.15.19:45952) 2023-11-04T15:27:36.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.888+0000 7f7f65ad8640 1 -- 172.21.15.19:0/1728960574 learned_addr learned my addr 172.21.15.19:0/1728960574 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:36.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.888+0000 7f7f652d7640 1 --2- 172.21.15.19:0/1728960574 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f60136090 0x7f7f601cef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:36.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.888+0000 7f7f662d9640 1 --2- 172.21.15.19:0/1728960574 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7f6013a670 0x7f7f601cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:36.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.888+0000 7f7f65ad8640 1 -- 172.21.15.19:0/1728960574 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7f6013a670 msgr2=0x7f7f601cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:36.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.888+0000 7f7f65ad8640 1 --2- 172.21.15.19:0/1728960574 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7f6013a670 0x7f7f601cf460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:36.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.888+0000 7f7f65ad8640 1 -- 172.21.15.19:0/1728960574 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f60136090 msgr2=0x7f7f601cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:36.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.888+0000 7f7f65ad8640 1 --2- 172.21.15.19:0/1728960574 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f60136090 0x7f7f601cef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:36.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.888+0000 7f7f65ad8640 1 -- 172.21.15.19:0/1728960574 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5c0094d0 con 0x7f7f600a6370 2023-11-04T15:27:36.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.888+0000 7f7f662d9640 1 --2- 172.21.15.19:0/1728960574 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7f6013a670 0x7f7f601cf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T15:27:36.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.888+0000 7f7f65ad8640 1 --2- 172.21.15.19:0/1728960574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f600a6370 0x7f7f601ce9e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c000c00 tx=0x7f7f5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:36.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.889+0000 7f7f567fc640 1 -- 172.21.15.19:0/1728960574 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c032880 con 0x7f7f600a6370 2023-11-04T15:27:36.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.889+0000 7f7f567fc640 1 -- 172.21.15.19:0/1728960574 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f5c032a00 con 0x7f7f600a6370 2023-11-04T15:27:36.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.889+0000 7f7f67d3c640 1 -- 172.21.15.19:0/1728960574 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f60099a00 con 0x7f7f600a6370 2023-11-04T15:27:36.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.889+0000 7f7f567fc640 1 -- 172.21.15.19:0/1728960574 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c032db0 con 0x7f7f600a6370 2023-11-04T15:27:36.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.889+0000 7f7f67d3c640 1 -- 172.21.15.19:0/1728960574 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f600a21f0 con 0x7f7f600a6370 2023-11-04T15:27:36.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.889+0000 7f7f67d3c640 1 -- 172.21.15.19:0/1728960574 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f60067d60 con 0x7f7f600a6370 2023-11-04T15:27:36.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.890+0000 7f7f567fc640 1 -- 172.21.15.19:0/1728960574 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7f5c04e450 con 0x7f7f600a6370 2023-11-04T15:27:36.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.890+0000 7f7f567fc640 1 --2- 172.21.15.19:0/1728960574 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f7f4406a430 0x7f7f4406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:36.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.890+0000 7f7f567fc640 1 -- 172.21.15.19:0/1728960574 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f7f5c0aa350 con 0x7f7f600a6370 2023-11-04T15:27:36.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.890+0000 7f7f652d7640 1 --2- 172.21.15.19:0/1728960574 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f7f4406a430 0x7f7f4406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:36.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.891+0000 7f7f652d7640 1 --2- 172.21.15.19:0/1728960574 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f7f4406a430 0x7f7f4406c8f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7f600998d0 tx=0x7f7f50008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:36.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:36.895+0000 7f7f567fc640 1 -- 172.21.15.19:0/1728960574 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7f5c075f30 con 0x7f7f600a6370 2023-11-04T15:27:37.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.111+0000 7f7f67d3c640 1 -- 172.21.15.19:0/1728960574 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7f60099a00 con 0x7f7f600a6370 2023-11-04T15:27:37.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.140+0000 7f7f567fc640 1 -- 172.21.15.19:0/1728960574 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7f60099a00 con 0x7f7f600a6370 2023-11-04T15:27:37.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.142+0000 7f7f67d3c640 1 -- 172.21.15.19:0/1728960574 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f7f4406a430 msgr2=0x7f7f4406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:37.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.142+0000 7f7f67d3c640 1 --2- 172.21.15.19:0/1728960574 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f7f4406a430 0x7f7f4406c8f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7f600998d0 tx=0x7f7f50008040 comp rx=0 tx=0).stop 2023-11-04T15:27:37.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.142+0000 7f7f67d3c640 1 -- 172.21.15.19:0/1728960574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f600a6370 msgr2=0x7f7f601ce9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:37.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.142+0000 7f7f67d3c640 1 --2- 172.21.15.19:0/1728960574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f600a6370 0x7f7f601ce9e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c000c00 tx=0x7f7f5c0046c0 comp rx=0 tx=0).stop 2023-11-04T15:27:37.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.142+0000 7f7f67d3c640 1 -- 172.21.15.19:0/1728960574 shutdown_connections 2023-11-04T15:27:37.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.142+0000 7f7f67d3c640 1 --2- 172.21.15.19:0/1728960574 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f7f4406a430 0x7f7f4406c8f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:37.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.142+0000 7f7f67d3c640 1 --2- 172.21.15.19:0/1728960574 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7f6013a670 0x7f7f601cf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:37.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.142+0000 7f7f67d3c640 1 --2- 172.21.15.19:0/1728960574 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f60136090 0x7f7f601cef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:37.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.142+0000 7f7f67d3c640 1 --2- 172.21.15.19:0/1728960574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f600a6370 0x7f7f601ce9e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:37.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.142+0000 7f7f67d3c640 1 -- 172.21.15.19:0/1728960574 >> 172.21.15.19:0/1728960574 conn(0x7f7f600ac3f0 msgr2=0x7f7f601339e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:37.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.142+0000 7f7f67d3c640 1 -- 172.21.15.19:0/1728960574 shutdown_connections 2023-11-04T15:27:37.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.142+0000 7f7f67d3c640 1 -- 172.21.15.19:0/1728960574 wait complete. 2023-11-04T15:27:37.155 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-04T15:27:37.155 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T15:27:37.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.262+0000 7f5a2485c640 1 Processor -- start 2023-11-04T15:27:37.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.262+0000 7f5a2485c640 1 -- start start 2023-11-04T15:27:37.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.263+0000 7f5a2485c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a20136090 0x7f5a20136470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:37.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.263+0000 7f5a2485c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5a2013a840 0x7f5a20142470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:37.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.263+0000 7f5a2485c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a200abe60 con 0x7f5a200a6370 2023-11-04T15:27:37.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.263+0000 7f5a2485c640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a200a30a0 con 0x7f5a2013a840 2023-11-04T15:27:37.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.263+0000 7f5a2485c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a200a4b90 con 0x7f5a20136090 2023-11-04T15:27:37.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.263+0000 7f5a1e59c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a20136090 0x7f5a20136470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:37.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.263+0000 7f5a1ed9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5a2013a840 0x7f5a20142470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:37.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.263+0000 7f5a1dd9b640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f5a200a6370 0x7f5a2013a130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.19:33084/0 (socket says 172.21.15.19:33084) 2023-11-04T15:27:37.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.263+0000 7f5a1dd9b640 1 -- 172.21.15.19:0/2934163314 learned_addr learned my addr 172.21.15.19:0/2934163314 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:37.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.263+0000 7f5a1e59c640 1 -- 172.21.15.19:0/2934163314 >> v2:172.21.15.96:3300/0 conn(0x7f5a2013a840 msgr2=0x7f5a20142470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:37.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.263+0000 7f5a1e59c640 1 --2- 172.21.15.19:0/2934163314 >> v2:172.21.15.96:3300/0 conn(0x7f5a2013a840 0x7f5a20142470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:37.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.263+0000 7f5a1e59c640 1 -- 172.21.15.19:0/2934163314 >> v1:172.21.15.96:6789/0 conn(0x7f5a200a6370 legacy=0x7f5a2013a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:37.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.263+0000 7f5a1e59c640 1 -- 172.21.15.19:0/2934163314 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a200a51f0 con 0x7f5a20136090 2023-11-04T15:27:37.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.263+0000 7f5a1ed9d640 1 --2- 172.21.15.19:0/2934163314 >> v2:172.21.15.96:3300/0 conn(0x7f5a2013a840 0x7f5a20142470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T15:27:37.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.264+0000 7f5a1e59c640 1 --2- 172.21.15.19:0/2934163314 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a20136090 0x7f5a20136470 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5a10009d90 tx=0x7f5a1002bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=972798bc749d0294 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:37.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.264+0000 7f5a1d59a640 1 -- 172.21.15.19:0/2934163314 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1002cb30 con 0x7f5a20136090 2023-11-04T15:27:37.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.264+0000 7f5a1d59a640 1 -- 172.21.15.19:0/2934163314 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1002cc90 con 0x7f5a20136090 2023-11-04T15:27:37.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.264+0000 7f5a1d59a640 1 -- 172.21.15.19:0/2934163314 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a10034440 con 0x7f5a20136090 2023-11-04T15:27:37.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.265+0000 7f5a2485c640 1 -- 172.21.15.19:0/2934163314 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a20136090 msgr2=0x7f5a20136470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:37.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.265+0000 7f5a2485c640 1 --2- 172.21.15.19:0/2934163314 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a20136090 0x7f5a20136470 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5a10009d90 tx=0x7f5a1002bd80 comp rx=0 tx=0).stop 2023-11-04T15:27:37.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.265+0000 7f5a2485c640 1 -- 172.21.15.19:0/2934163314 shutdown_connections 2023-11-04T15:27:37.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.265+0000 7f5a2485c640 1 --2- 172.21.15.19:0/2934163314 >> v2:172.21.15.96:3300/0 conn(0x7f5a2013a840 0x7f5a20142470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:37.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.265+0000 7f5a2485c640 1 --2- 172.21.15.19:0/2934163314 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a20136090 0x7f5a20136470 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:37.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.265+0000 7f5a2485c640 1 -- 172.21.15.19:0/2934163314 >> 172.21.15.19:0/2934163314 conn(0x7f5a200ac3f0 msgr2=0x7f5a200ac800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:37.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.265+0000 7f5a2485c640 1 -- 172.21.15.19:0/2934163314 shutdown_connections 2023-11-04T15:27:37.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.265+0000 7f5a2485c640 1 -- 172.21.15.19:0/2934163314 wait complete. 2023-11-04T15:27:37.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.266+0000 7f5a2485c640 1 Processor -- start 2023-11-04T15:27:37.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.266+0000 7f5a2485c640 1 -- start start 2023-11-04T15:27:37.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.267+0000 7f5a2485c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a200a6370 0x7f5a20097a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:37.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.267+0000 7f5a2485c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a20136090 0x7f5a20097f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:37.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.267+0000 7f5a2485c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a2013a840 0x7f5a20098480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:37.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.267+0000 7f5a2485c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a200991c0 con 0x7f5a200a6370 2023-11-04T15:27:37.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.267+0000 7f5a2485c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2009b720 con 0x7f5a2013a840 2023-11-04T15:27:37.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.267+0000 7f5a2485c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a200a9a10 con 0x7f5a20136090 2023-11-04T15:27:37.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.267+0000 7f5a1e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a200a6370 0x7f5a20097a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:37.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.267+0000 7f5a1e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a200a6370 0x7f5a20097a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45956/0 (socket says 172.21.15.19:45956) 2023-11-04T15:27:37.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.267+0000 7f5a1e59c640 1 -- 172.21.15.19:0/4109718089 learned_addr learned my addr 172.21.15.19:0/4109718089 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:37.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.267+0000 7f5a1ed9d640 1 --2- 172.21.15.19:0/4109718089 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a2013a840 0x7f5a20098480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:37.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.267+0000 7f5a1dd9b640 1 --2- 172.21.15.19:0/4109718089 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a20136090 0x7f5a20097f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:37.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.267+0000 7f5a1e59c640 1 -- 172.21.15.19:0/4109718089 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a20136090 msgr2=0x7f5a20097f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:37.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.267+0000 7f5a1e59c640 1 --2- 172.21.15.19:0/4109718089 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a20136090 0x7f5a20097f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:37.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.267+0000 7f5a1e59c640 1 -- 172.21.15.19:0/4109718089 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a2013a840 msgr2=0x7f5a20098480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:37.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.267+0000 7f5a1e59c640 1 --2- 172.21.15.19:0/4109718089 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a2013a840 0x7f5a20098480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:37.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.267+0000 7f5a1e59c640 1 -- 172.21.15.19:0/4109718089 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a18009400 con 0x7f5a200a6370 2023-11-04T15:27:37.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.267+0000 7f5a1dd9b640 1 --2- 172.21.15.19:0/4109718089 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a20136090 0x7f5a20097f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:27:37.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.267+0000 7f5a1e59c640 1 --2- 172.21.15.19:0/4109718089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a200a6370 0x7f5a20097a00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5a10037040 tx=0x7f5a10004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:37.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.267+0000 7f5a16ffd640 1 -- 172.21.15.19:0/4109718089 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a10040450 con 0x7f5a200a6370 2023-11-04T15:27:37.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.267+0000 7f5a16ffd640 1 -- 172.21.15.19:0/4109718089 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a100405b0 con 0x7f5a200a6370 2023-11-04T15:27:37.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.267+0000 7f5a2485c640 1 -- 172.21.15.19:0/4109718089 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a10009a70 con 0x7f5a200a6370 2023-11-04T15:27:37.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.267+0000 7f5a16ffd640 1 -- 172.21.15.19:0/4109718089 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a10040960 con 0x7f5a200a6370 2023-11-04T15:27:37.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.267+0000 7f5a2485c640 1 -- 172.21.15.19:0/4109718089 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a200a9c50 con 0x7f5a200a6370 2023-11-04T15:27:37.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.268+0000 7f5a2485c640 1 -- 172.21.15.19:0/4109718089 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a20067d60 con 0x7f5a200a6370 2023-11-04T15:27:37.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.269+0000 7f5a16ffd640 1 -- 172.21.15.19:0/4109718089 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5a10040ac0 con 0x7f5a200a6370 2023-11-04T15:27:37.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.269+0000 7f5a16ffd640 1 --2- 172.21.15.19:0/4109718089 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f5a0006a430 0x7f5a0006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:37.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.269+0000 7f5a16ffd640 1 -- 172.21.15.19:0/4109718089 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f5a100aae70 con 0x7f5a200a6370 2023-11-04T15:27:37.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.269+0000 7f5a1dd9b640 1 --2- 172.21.15.19:0/4109718089 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f5a0006a430 0x7f5a0006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:37.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.270+0000 7f5a1dd9b640 1 --2- 172.21.15.19:0/4109718089 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f5a0006a430 0x7f5a0006c8f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5a20071580 tx=0x7f5a08009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:37.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.273+0000 7f5a16ffd640 1 -- 172.21.15.19:0/4109718089 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5a10076a50 con 0x7f5a200a6370 2023-11-04T15:27:37.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:37.485+0000 7f5a2485c640 1 -- 172.21.15.19:0/4109718089 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5a200ab060 con 0x7f5a200a6370 2023-11-04T15:27:37.744 INFO:tasks.ceph.mds.a.smithi019.stderr:2023-11-04T15:27:37.743+0000 7f0e251bf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T15:27:38.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.141+0000 7f5a16ffd640 1 -- 172.21.15.19:0/4109718089 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5a1007a070 con 0x7f5a200a6370 2023-11-04T15:27:38.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.144+0000 7f5a2485c640 1 -- 172.21.15.19:0/4109718089 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f5a0006a430 msgr2=0x7f5a0006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:38.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.144+0000 7f5a2485c640 1 --2- 172.21.15.19:0/4109718089 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f5a0006a430 0x7f5a0006c8f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5a20071580 tx=0x7f5a08009040 comp rx=0 tx=0).stop 2023-11-04T15:27:38.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.144+0000 7f5a2485c640 1 -- 172.21.15.19:0/4109718089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a200a6370 msgr2=0x7f5a20097a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:38.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.144+0000 7f5a2485c640 1 --2- 172.21.15.19:0/4109718089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a200a6370 0x7f5a20097a00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5a10037040 tx=0x7f5a10004a40 comp rx=0 tx=0).stop 2023-11-04T15:27:38.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.144+0000 7f5a2485c640 1 -- 172.21.15.19:0/4109718089 shutdown_connections 2023-11-04T15:27:38.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.144+0000 7f5a2485c640 1 --2- 172.21.15.19:0/4109718089 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f5a0006a430 0x7f5a0006c8f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:38.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.144+0000 7f5a2485c640 1 --2- 172.21.15.19:0/4109718089 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a2013a840 0x7f5a20098480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:38.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.144+0000 7f5a2485c640 1 --2- 172.21.15.19:0/4109718089 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a20136090 0x7f5a20097f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:38.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.144+0000 7f5a2485c640 1 --2- 172.21.15.19:0/4109718089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a200a6370 0x7f5a20097a00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:38.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.144+0000 7f5a2485c640 1 -- 172.21.15.19:0/4109718089 >> 172.21.15.19:0/4109718089 conn(0x7f5a200ac3f0 msgr2=0x7f5a20133ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:38.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.144+0000 7f5a2485c640 1 -- 172.21.15.19:0/4109718089 shutdown_connections 2023-11-04T15:27:38.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.144+0000 7f5a2485c640 1 -- 172.21.15.19:0/4109718089 wait complete. 2023-11-04T15:27:38.159 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T15:27:38.161 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T15:27:38.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.271+0000 7f5b2ccf7640 1 Processor -- start 2023-11-04T15:27:38.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.271+0000 7f5b2ccf7640 1 -- start start 2023-11-04T15:27:38.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.272+0000 7f5b2ccf7640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5b28137270 0x7f5b280a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:38.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.272+0000 7f5b2ccf7640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b280a3e90 0x7f5b28139f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:38.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.272+0000 7f5b2ccf7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5b28137650 0x7f5b2813a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:38.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.272+0000 7f5b2ccf7640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b280a3060 con 0x7f5b28137650 2023-11-04T15:27:38.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.272+0000 7f5b2ccf7640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b280a4c20 con 0x7f5b28137270 2023-11-04T15:27:38.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.272+0000 7f5b2ccf7640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b280a5080 con 0x7f5b280a3e90 2023-11-04T15:27:38.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.272+0000 7f5b26d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5b28137650 0x7f5b2813a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:38.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.272+0000 7f5b26d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5b28137650 0x7f5b2813a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45960/0 (socket says 172.21.15.19:45960) 2023-11-04T15:27:38.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.272+0000 7f5b26d9d640 1 -- 172.21.15.19:0/4256239346 learned_addr learned my addr 172.21.15.19:0/4256239346 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:38.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.272+0000 7f5b2659c640 1 --2- 172.21.15.19:0/4256239346 >> v2:172.21.15.96:3300/0 conn(0x7f5b28137270 0x7f5b280a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:38.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.272+0000 7f5b25d9b640 1 --2- 172.21.15.19:0/4256239346 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b280a3e90 0x7f5b28139f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:38.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.272+0000 7f5b26d9d640 1 -- 172.21.15.19:0/4256239346 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b280a3e90 msgr2=0x7f5b28139f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:38.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.272+0000 7f5b26d9d640 1 --2- 172.21.15.19:0/4256239346 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b280a3e90 0x7f5b28139f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:38.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.272+0000 7f5b26d9d640 1 -- 172.21.15.19:0/4256239346 >> v2:172.21.15.96:3300/0 conn(0x7f5b28137270 msgr2=0x7f5b280a6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:38.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.272+0000 7f5b26d9d640 1 --2- 172.21.15.19:0/4256239346 >> v2:172.21.15.96:3300/0 conn(0x7f5b28137270 0x7f5b280a6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:38.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.272+0000 7f5b26d9d640 1 -- 172.21.15.19:0/4256239346 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b280a3440 con 0x7f5b28137650 2023-11-04T15:27:38.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.272+0000 7f5b25d9b640 1 --2- 172.21.15.19:0/4256239346 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b280a3e90 0x7f5b28139f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T15:27:38.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.273+0000 7f5b26d9d640 1 --2- 172.21.15.19:0/4256239346 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b28137650 0x7f5b2813a4a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5b280ad2d0 tx=0x7f5b1802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66ac1afe3f9178fb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:38.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.273+0000 7f5b2559a640 1 -- 172.21.15.19:0/4256239346 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b18031750 con 0x7f5b28137650 2023-11-04T15:27:38.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.273+0000 7f5b2559a640 1 -- 172.21.15.19:0/4256239346 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b180318b0 con 0x7f5b28137650 2023-11-04T15:27:38.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.273+0000 7f5b2559a640 1 -- 172.21.15.19:0/4256239346 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b18031c40 con 0x7f5b28137650 2023-11-04T15:27:38.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.274+0000 7f5b2ccf7640 1 -- 172.21.15.19:0/4256239346 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b28137650 msgr2=0x7f5b2813a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:38.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.274+0000 7f5b2ccf7640 1 --2- 172.21.15.19:0/4256239346 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b28137650 0x7f5b2813a4a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5b280ad2d0 tx=0x7f5b1802b7f0 comp rx=0 tx=0).stop 2023-11-04T15:27:38.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.274+0000 7f5b2ccf7640 1 -- 172.21.15.19:0/4256239346 shutdown_connections 2023-11-04T15:27:38.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.274+0000 7f5b2ccf7640 1 --2- 172.21.15.19:0/4256239346 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b28137650 0x7f5b2813a4a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:38.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.274+0000 7f5b2ccf7640 1 --2- 172.21.15.19:0/4256239346 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b280a3e90 0x7f5b28139f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:38.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.274+0000 7f5b2ccf7640 1 --2- 172.21.15.19:0/4256239346 >> v2:172.21.15.96:3300/0 conn(0x7f5b28137270 0x7f5b280a6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:38.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.274+0000 7f5b2ccf7640 1 -- 172.21.15.19:0/4256239346 >> 172.21.15.19:0/4256239346 conn(0x7f5b280a8d70 msgr2=0x7f5b280a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:38.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.274+0000 7f5b2ccf7640 1 -- 172.21.15.19:0/4256239346 shutdown_connections 2023-11-04T15:27:38.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.274+0000 7f5b2ccf7640 1 -- 172.21.15.19:0/4256239346 wait complete. 2023-11-04T15:27:38.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.275+0000 7f5b2ccf7640 1 Processor -- start 2023-11-04T15:27:38.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.275+0000 7f5b2ccf7640 1 -- start start 2023-11-04T15:27:38.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.276+0000 7f5b2ccf7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b280a3e90 0x7f5b281ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:38.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.276+0000 7f5b2ccf7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b28137270 0x7f5b281cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:38.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.276+0000 7f5b2ccf7640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b28137650 0x7f5b281cf920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:38.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.276+0000 7f5b2ccf7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2809e5f0 con 0x7f5b28137270 2023-11-04T15:27:38.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.276+0000 7f5b2ccf7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2809e970 con 0x7f5b280a3e90 2023-11-04T15:27:38.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.276+0000 7f5b2ccf7640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b280a0b70 con 0x7f5b28137650 2023-11-04T15:27:38.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.276+0000 7f5b25d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b28137270 0x7f5b281cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:38.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.276+0000 7f5b25d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b28137270 0x7f5b281cf3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45968/0 (socket says 172.21.15.19:45968) 2023-11-04T15:27:38.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.276+0000 7f5b25d9b640 1 -- 172.21.15.19:0/2733657024 learned_addr learned my addr 172.21.15.19:0/2733657024 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:38.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.276+0000 7f5b26d9d640 1 --2- 172.21.15.19:0/2733657024 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b28137650 0x7f5b281cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:38.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.276+0000 7f5b2659c640 1 --2- 172.21.15.19:0/2733657024 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b280a3e90 0x7f5b281ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:38.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.276+0000 7f5b25d9b640 1 -- 172.21.15.19:0/2733657024 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b28137650 msgr2=0x7f5b281cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:38.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.276+0000 7f5b25d9b640 1 --2- 172.21.15.19:0/2733657024 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b28137650 0x7f5b281cf920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:38.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.276+0000 7f5b25d9b640 1 -- 172.21.15.19:0/2733657024 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b280a3e90 msgr2=0x7f5b281ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:38.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.276+0000 7f5b25d9b640 1 --2- 172.21.15.19:0/2733657024 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b280a3e90 0x7f5b281ceea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:38.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.276+0000 7f5b25d9b640 1 -- 172.21.15.19:0/2733657024 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b180094d0 con 0x7f5b28137270 2023-11-04T15:27:38.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.276+0000 7f5b25d9b640 1 --2- 172.21.15.19:0/2733657024 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b28137270 0x7f5b281cf3e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5b1000c820 tx=0x7f5b1000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:38.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.276+0000 7f5b1effd640 1 -- 172.21.15.19:0/2733657024 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b10007a30 con 0x7f5b28137270 2023-11-04T15:27:38.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.276+0000 7f5b1effd640 1 -- 172.21.15.19:0/2733657024 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b10007b90 con 0x7f5b28137270 2023-11-04T15:27:38.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.276+0000 7f5b1effd640 1 -- 172.21.15.19:0/2733657024 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b100113f0 con 0x7f5b28137270 2023-11-04T15:27:38.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.276+0000 7f5b2ccf7640 1 -- 172.21.15.19:0/2733657024 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b2809dbc0 con 0x7f5b28137270 2023-11-04T15:27:38.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.276+0000 7f5b2ccf7640 1 -- 172.21.15.19:0/2733657024 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b2809eeb0 con 0x7f5b28137270 2023-11-04T15:27:38.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.277+0000 7f5b2ccf7640 1 -- 172.21.15.19:0/2733657024 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b2809f510 con 0x7f5b28137270 2023-11-04T15:27:38.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.278+0000 7f5b1effd640 1 -- 172.21.15.19:0/2733657024 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5b10011550 con 0x7f5b28137270 2023-11-04T15:27:38.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.278+0000 7f5b1effd640 1 --2- 172.21.15.19:0/2733657024 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f5b0806a430 0x7f5b0806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:38.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.278+0000 7f5b1effd640 1 -- 172.21.15.19:0/2733657024 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f5b100881b0 con 0x7f5b28137270 2023-11-04T15:27:38.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.278+0000 7f5b2659c640 1 --2- 172.21.15.19:0/2733657024 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f5b0806a430 0x7f5b0806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:38.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.279+0000 7f5b2659c640 1 --2- 172.21.15.19:0/2733657024 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f5b0806a430 0x7f5b0806c8f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5b200099e0 tx=0x7f5b20003cd0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:38.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.282+0000 7f5b1effd640 1 -- 172.21.15.19:0/2733657024 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5b10053d90 con 0x7f5b28137270 2023-11-04T15:27:38.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.497+0000 7f5b2ccf7640 1 -- 172.21.15.19:0/2733657024 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b28067d60 con 0x7f5b28137270 2023-11-04T15:27:38.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.497+0000 7f5b1effd640 1 -- 172.21.15.19:0/2733657024 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3130 (secure 0 0 0) 0x7f5b1001fc50 con 0x7f5b28137270 2023-11-04T15:27:38.500 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:27:38.500 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4219,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6819/3642584554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3642584554},{"type":"v1","addr":"172.21.15.96:6819","nonce":3642584554}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T15:27:36.125743+0000","modified":"2023-11-04T15:27:38.140154+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6817/2992197248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2992197248},{"type":"v1","addr":"172.21.15.19:6817","nonce":2992197248}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T15:27:38.501 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 6 2023-11-04T15:27:38.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.499+0000 7f5b2ccf7640 1 -- 172.21.15.19:0/2733657024 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f5b0806a430 msgr2=0x7f5b0806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:38.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.499+0000 7f5b2ccf7640 1 --2- 172.21.15.19:0/2733657024 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f5b0806a430 0x7f5b0806c8f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5b200099e0 tx=0x7f5b20003cd0 comp rx=0 tx=0).stop 2023-11-04T15:27:38.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.499+0000 7f5b2ccf7640 1 -- 172.21.15.19:0/2733657024 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b28137270 msgr2=0x7f5b281cf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:38.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.499+0000 7f5b2ccf7640 1 --2- 172.21.15.19:0/2733657024 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b28137270 0x7f5b281cf3e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5b1000c820 tx=0x7f5b1000cce0 comp rx=0 tx=0).stop 2023-11-04T15:27:38.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.499+0000 7f5b2ccf7640 1 -- 172.21.15.19:0/2733657024 shutdown_connections 2023-11-04T15:27:38.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.499+0000 7f5b2ccf7640 1 --2- 172.21.15.19:0/2733657024 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f5b0806a430 0x7f5b0806c8f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:38.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.499+0000 7f5b2ccf7640 1 --2- 172.21.15.19:0/2733657024 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b28137650 0x7f5b281cf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:38.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.499+0000 7f5b2ccf7640 1 --2- 172.21.15.19:0/2733657024 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b28137270 0x7f5b281cf3e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:38.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.499+0000 7f5b2ccf7640 1 --2- 172.21.15.19:0/2733657024 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b280a3e90 0x7f5b281ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:38.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.499+0000 7f5b2ccf7640 1 -- 172.21.15.19:0/2733657024 >> 172.21.15.19:0/2733657024 conn(0x7f5b280a8d70 msgr2=0x7f5b28139d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:38.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.499+0000 7f5b2ccf7640 1 -- 172.21.15.19:0/2733657024 shutdown_connections 2023-11-04T15:27:38.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.499+0000 7f5b2ccf7640 1 -- 172.21.15.19:0/2733657024 wait complete. 2023-11-04T15:27:38.512 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T15:27:38.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.615+0000 7f7c76284640 1 Processor -- start 2023-11-04T15:27:38.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.615+0000 7f7c76284640 1 -- start start 2023-11-04T15:27:38.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.616+0000 7f7c76284640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c700a8d60 0x7f7c700a9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:38.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.616+0000 7f7c76284640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7c70137e60 0x7f7c701382a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:38.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.616+0000 7f7c76284640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c70071660 con 0x7f7c701387e0 2023-11-04T15:27:38.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.616+0000 7f7c76284640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c700a9680 con 0x7f7c70137e60 2023-11-04T15:27:38.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.616+0000 7f7c76284640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c70071b90 con 0x7f7c700a8d60 2023-11-04T15:27:38.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.616+0000 7f7c6ffff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c700a8d60 0x7f7c700a9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:38.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.616+0000 7f7c6f7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7c70137e60 0x7f7c701382a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:38.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.616+0000 7f7c6ffff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c700a8d60 0x7f7c700a9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.19:49766/0 (socket says 172.21.15.19:49766) 2023-11-04T15:27:38.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.616+0000 7f7c6ffff640 1 -- 172.21.15.19:0/2330763968 learned_addr learned my addr 172.21.15.19:0/2330763968 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:38.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.616+0000 7f7c74821640 1 --1- 172.21.15.19:0/2330763968 >> v1:172.21.15.96:6789/0 conn(0x7f7c701387e0 0x7f7c7013f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.19:33100/0 (socket says 172.21.15.19:33100) 2023-11-04T15:27:38.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.616+0000 7f7c6f7fe640 1 -- 172.21.15.19:0/2330763968 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c700a8d60 msgr2=0x7f7c700a9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:38.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.616+0000 7f7c6f7fe640 1 --2- 172.21.15.19:0/2330763968 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c700a8d60 0x7f7c700a9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:38.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.616+0000 7f7c6f7fe640 1 -- 172.21.15.19:0/2330763968 >> v1:172.21.15.96:6789/0 conn(0x7f7c701387e0 legacy=0x7f7c7013f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:38.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.616+0000 7f7c6effd640 1 -- 172.21.15.19:0/2330763968 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3018021369 0 0) 0x7f7c70071660 con 0x7f7c701387e0 2023-11-04T15:27:38.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.616+0000 7f7c6f7fe640 1 -- 172.21.15.19:0/2330763968 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c70071320 con 0x7f7c70137e60 2023-11-04T15:27:38.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.616+0000 7f7c6ffff640 1 --2- 172.21.15.19:0/2330763968 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c700a8d60 0x7f7c700a9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T15:27:38.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.617+0000 7f7c6f7fe640 1 --2- 172.21.15.19:0/2330763968 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c70137e60 0x7f7c701382a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7c580097a0 tx=0x7f7c5802b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5348892431538e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:38.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.617+0000 7f7c6effd640 1 -- 172.21.15.19:0/2330763968 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5802f050 con 0x7f7c70137e60 2023-11-04T15:27:38.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.617+0000 7f7c6effd640 1 -- 172.21.15.19:0/2330763968 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c58031700 con 0x7f7c70137e60 2023-11-04T15:27:38.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.617+0000 7f7c6effd640 1 -- 172.21.15.19:0/2330763968 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c58031a90 con 0x7f7c70137e60 2023-11-04T15:27:38.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.618+0000 7f7c76284640 1 -- 172.21.15.19:0/2330763968 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c70137e60 msgr2=0x7f7c701382a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:38.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.618+0000 7f7c76284640 1 --2- 172.21.15.19:0/2330763968 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c70137e60 0x7f7c701382a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7c580097a0 tx=0x7f7c5802b7a0 comp rx=0 tx=0).stop 2023-11-04T15:27:38.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.618+0000 7f7c76284640 1 -- 172.21.15.19:0/2330763968 shutdown_connections 2023-11-04T15:27:38.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.618+0000 7f7c76284640 1 --2- 172.21.15.19:0/2330763968 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c70137e60 0x7f7c701382a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:38.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.618+0000 7f7c76284640 1 --2- 172.21.15.19:0/2330763968 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c700a8d60 0x7f7c700a9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:38.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.618+0000 7f7c76284640 1 -- 172.21.15.19:0/2330763968 >> 172.21.15.19:0/2330763968 conn(0x7f7c700a6e30 msgr2=0x7f7c700a7240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:38.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.618+0000 7f7c76284640 1 -- 172.21.15.19:0/2330763968 shutdown_connections 2023-11-04T15:27:38.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.618+0000 7f7c76284640 1 -- 172.21.15.19:0/2330763968 wait complete. 2023-11-04T15:27:38.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.619+0000 7f7c76284640 1 Processor -- start 2023-11-04T15:27:38.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.619+0000 7f7c76284640 1 -- start start 2023-11-04T15:27:38.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.619+0000 7f7c76284640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c700a8d60 0x7f7c701cce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:38.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.619+0000 7f7c76284640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c70137e60 0x7f7c701cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:38.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.620+0000 7f7c76284640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c701387e0 0x7f7c701cd910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:38.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.620+0000 7f7c76284640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7009f750 con 0x7f7c701387e0 2023-11-04T15:27:38.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.620+0000 7f7c76284640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c70134f20 con 0x7f7c700a8d60 2023-11-04T15:27:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.620+0000 7f7c76284640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7009fab0 con 0x7f7c70137e60 2023-11-04T15:27:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.620+0000 7f7c74821640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c701387e0 0x7f7c701cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.620+0000 7f7c74821640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c701387e0 0x7f7c701cd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45980/0 (socket says 172.21.15.19:45980) 2023-11-04T15:27:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.620+0000 7f7c6ffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c700a8d60 0x7f7c701cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.620+0000 7f7c74821640 1 -- 172.21.15.19:0/1811664553 learned_addr learned my addr 172.21.15.19:0/1811664553 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:38.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.620+0000 7f7c6f7fe640 1 --2- 172.21.15.19:0/1811664553 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c70137e60 0x7f7c701cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:38.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.620+0000 7f7c74821640 1 -- 172.21.15.19:0/1811664553 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c70137e60 msgr2=0x7f7c701cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:38.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.620+0000 7f7c74821640 1 --2- 172.21.15.19:0/1811664553 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c70137e60 0x7f7c701cd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:38.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.620+0000 7f7c74821640 1 -- 172.21.15.19:0/1811664553 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c700a8d60 msgr2=0x7f7c701cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:38.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.620+0000 7f7c74821640 1 --2- 172.21.15.19:0/1811664553 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c700a8d60 0x7f7c701cce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:38.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.620+0000 7f7c74821640 1 -- 172.21.15.19:0/1811664553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c600094d0 con 0x7f7c701387e0 2023-11-04T15:27:38.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.620+0000 7f7c6ffff640 1 --2- 172.21.15.19:0/1811664553 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c700a8d60 0x7f7c701cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T15:27:38.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.620+0000 7f7c74821640 1 --2- 172.21.15.19:0/1811664553 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c701387e0 0x7f7c701cd910 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7c6800c830 tx=0x7f7c6800ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:38.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.620+0000 7f7c6cff9640 1 -- 172.21.15.19:0/1811664553 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6800ce20 con 0x7f7c701387e0 2023-11-04T15:27:38.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.620+0000 7f7c6cff9640 1 -- 172.21.15.19:0/1811664553 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6800a640 con 0x7f7c701387e0 2023-11-04T15:27:38.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.620+0000 7f7c76284640 1 -- 172.21.15.19:0/1811664553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c58009400 con 0x7f7c701387e0 2023-11-04T15:27:38.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.620+0000 7f7c6cff9640 1 -- 172.21.15.19:0/1811664553 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6800a9f0 con 0x7f7c701387e0 2023-11-04T15:27:38.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.620+0000 7f7c76284640 1 -- 172.21.15.19:0/1811664553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7009ed20 con 0x7f7c701387e0 2023-11-04T15:27:38.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.621+0000 7f7c76284640 1 -- 172.21.15.19:0/1811664553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c7006d600 con 0x7f7c701387e0 2023-11-04T15:27:38.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.622+0000 7f7c6cff9640 1 -- 172.21.15.19:0/1811664553 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7c6800ab50 con 0x7f7c701387e0 2023-11-04T15:27:38.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.622+0000 7f7c6cff9640 1 --2- 172.21.15.19:0/1811664553 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f7c5006a430 0x7f7c5006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:38.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.622+0000 7f7c6cff9640 1 -- 172.21.15.19:0/1811664553 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f7c680877e0 con 0x7f7c701387e0 2023-11-04T15:27:38.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.622+0000 7f7c6ffff640 1 --2- 172.21.15.19:0/1811664553 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f7c5006a430 0x7f7c5006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:38.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.623+0000 7f7c6ffff640 1 --2- 172.21.15.19:0/1811664553 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f7c5006a430 0x7f7c5006c8f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7c60006ca0 tx=0x7f7c60009240 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:38.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.626+0000 7f7c6cff9640 1 -- 172.21.15.19:0/1811664553 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7c68053490 con 0x7f7c701387e0 2023-11-04T15:27:38.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.806+0000 7f7c76284640 1 -- 172.21.15.19:0/1811664553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c70067d60 con 0x7f7c701387e0 2023-11-04T15:27:38.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.807+0000 7f7c6cff9640 1 -- 172.21.15.19:0/1811664553 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+13180 (secure 0 0 0) 0x7f7c68018090 con 0x7f7c701387e0 2023-11-04T15:27:38.809 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:27:38.809 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":19,"fsid":"e87311d5-496a-4b07-9654-358fe5bbf950","created":"2023-11-04T15:27:14.865121+0000","modified":"2023-11-04T15:27:37.127226+0000","last_up_change":"2023-11-04T15:27:24.162282+0000","last_in_change":"2023-11-04T15:27:15.971035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T15:27:24.987312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-04T15:27:30.500235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-04T15:27:34.476271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-04T15:27:35.096759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"34818469-ebf2-4dd4-8119-af19a0121036","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":82879},{"type":"v1","addr":"172.21.15.19:6801","nonce":82879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":82879},{"type":"v1","addr":"172.21.15.19:6803","nonce":82879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":82879},{"type":"v1","addr":"172.21.15.19:6807","nonce":82879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":82879},{"type":"v1","addr":"172.21.15.19:6805","nonce":82879}]},"public_addr":"172.21.15.19:6801/82879","cluster_addr":"172.21.15.19:6803/82879","heartbeat_back_addr":"172.21.15.19:6807/82879","heartbeat_front_addr":"172.21.15.19:6805/82879","state":["exists","up"]},{"osd":1,"uuid":"92dab290-7912-4eea-b6f6-c754c2480721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":82880},{"type":"v1","addr":"172.21.15.19:6809","nonce":82880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":82880},{"type":"v1","addr":"172.21.15.19:6811","nonce":82880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":82880},{"type":"v1","addr":"172.21.15.19:6815","nonce":82880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":82880},{"type":"v1","addr":"172.21.15.19:6813","nonce":82880}]},"public_addr":"172.21.15.19:6809/82880","cluster_addr":"172.21.15.19:6811/82880","heartbeat_back_addr":"172.21.15.19:6815/82880","heartbeat_front_addr":"172.21.15.19:6813/82880","state":["exists","up"]},{"osd":2,"uuid":"1be47db4-6dd1-4ce5-832b-bc6ad30c78c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":83458},{"type":"v1","addr":"172.21.15.96:6808","nonce":83458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":83458},{"type":"v1","addr":"172.21.15.96:6811","nonce":83458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":83458},{"type":"v1","addr":"172.21.15.96:6815","nonce":83458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":83458},{"type":"v1","addr":"172.21.15.96:6813","nonce":83458}]},"public_addr":"172.21.15.96:6808/83458","cluster_addr":"172.21.15.96:6811/83458","heartbeat_back_addr":"172.21.15.96:6815/83458","heartbeat_front_addr":"172.21.15.96:6813/83458","state":["exists","up"]},{"osd":3,"uuid":"46505800-d64f-49ef-b811-5b5979f48252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":83459},{"type":"v1","addr":"172.21.15.96:6801","nonce":83459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":83459},{"type":"v1","addr":"172.21.15.96:6803","nonce":83459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6807","nonce":83459},{"type":"v1","addr":"172.21.15.96:6809","nonce":83459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":83459},{"type":"v1","addr":"172.21.15.96:6805","nonce":83459}]},"public_addr":"172.21.15.96:6801/83459","cluster_addr":"172.21.15.96:6803/83459","heartbeat_back_addr":"172.21.15.96:6809/83459","heartbeat_front_addr":"172.21.15.96:6805/83459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.081547+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.132075+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.094919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.074106+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T15:27:38.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.809+0000 7f7c76284640 1 -- 172.21.15.19:0/1811664553 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f7c5006a430 msgr2=0x7f7c5006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:38.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.809+0000 7f7c76284640 1 --2- 172.21.15.19:0/1811664553 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f7c5006a430 0x7f7c5006c8f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7c60006ca0 tx=0x7f7c60009240 comp rx=0 tx=0).stop 2023-11-04T15:27:38.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.809+0000 7f7c76284640 1 -- 172.21.15.19:0/1811664553 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c701387e0 msgr2=0x7f7c701cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:38.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.809+0000 7f7c76284640 1 --2- 172.21.15.19:0/1811664553 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c701387e0 0x7f7c701cd910 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7c6800c830 tx=0x7f7c6800ccf0 comp rx=0 tx=0).stop 2023-11-04T15:27:38.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.809+0000 7f7c76284640 1 -- 172.21.15.19:0/1811664553 shutdown_connections 2023-11-04T15:27:38.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.809+0000 7f7c76284640 1 --2- 172.21.15.19:0/1811664553 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f7c5006a430 0x7f7c5006c8f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:38.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.809+0000 7f7c76284640 1 --2- 172.21.15.19:0/1811664553 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c701387e0 0x7f7c701cd910 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:38.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.809+0000 7f7c76284640 1 --2- 172.21.15.19:0/1811664553 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c70137e60 0x7f7c701cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:38.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.809+0000 7f7c76284640 1 --2- 172.21.15.19:0/1811664553 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c700a8d60 0x7f7c701cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:38.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.809+0000 7f7c76284640 1 -- 172.21.15.19:0/1811664553 >> 172.21.15.19:0/1811664553 conn(0x7f7c700a6e30 msgr2=0x7f7c70097a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:38.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.809+0000 7f7c76284640 1 -- 172.21.15.19:0/1811664553 shutdown_connections 2023-11-04T15:27:38.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.809+0000 7f7c76284640 1 -- 172.21.15.19:0/1811664553 wait complete. 2023-11-04T15:27:38.822 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T15:27:38.823 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T15:27:38.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.926+0000 7f81e0e87640 1 Processor -- start 2023-11-04T15:27:38.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.926+0000 7f81e0e87640 1 -- start start 2023-11-04T15:27:38.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.927+0000 7f81e0e87640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f81dc137650 0x7f81dc0a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:38.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.927+0000 7f81e0e87640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81dc0a4c20 con 0x7f81dc137270 2023-11-04T15:27:38.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.927+0000 7f81e0e87640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81dc13ad80 con 0x7f81dc0a3e90 2023-11-04T15:27:38.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.927+0000 7f81e0e87640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc0a3060 con 0x7f81dc137650 2023-11-04T15:27:38.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.927+0000 7f81da59c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f81dc137270 0x7f81dc139f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50512/0 (socket says 172.21.15.19:50512) 2023-11-04T15:27:38.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.927+0000 7f81da59c640 1 -- 172.21.15.19:0/4164722261 learned_addr learned my addr 172.21.15.19:0/4164722261 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:38.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.927+0000 7f81dad9d640 1 --2- 172.21.15.19:0/4164722261 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f81dc137650 0x7f81dc0a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:38.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.927+0000 7f81d959a640 1 -- 172.21.15.19:0/4164722261 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2900768457 0 0) 0x7f81dc0a4c20 con 0x7f81dc137270 2023-11-04T15:27:38.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.927+0000 7f81d959a640 1 -- 172.21.15.19:0/4164722261 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81c8003520 con 0x7f81dc137270 2023-11-04T15:27:38.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.927+0000 7f81d959a640 1 -- 172.21.15.19:0/4164722261 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1910763112 0 0) 0x7f81c8003520 con 0x7f81dc137270 2023-11-04T15:27:38.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.927+0000 7f81d959a640 1 -- 172.21.15.19:0/4164722261 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f81dc137650 msgr2=0x7f81dc0a6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:38.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.927+0000 7f81d959a640 1 --2- 172.21.15.19:0/4164722261 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f81dc137650 0x7f81dc0a6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:38.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.927+0000 7f81d959a640 1 -- 172.21.15.19:0/4164722261 >> v1:172.21.15.96:6789/0 conn(0x7f81dc0a3e90 legacy=0x7f81dc13a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:38.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.927+0000 7f81d959a640 1 -- 172.21.15.19:0/4164722261 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81dc0a5080 con 0x7f81dc137270 2023-11-04T15:27:38.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.927+0000 7f81d959a640 1 -- 172.21.15.19:0/4164722261 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3646097784 0 0) 0x7f81d4001690 con 0x7f81dc137270 2023-11-04T15:27:38.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.927+0000 7f81d959a640 1 -- 172.21.15.19:0/4164722261 >> v1:172.21.15.19:6789/0 conn(0x7f81dc137270 legacy=0x7f81dc139f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:38.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.928+0000 7f81d959a640 1 --2- 172.21.15.19:0/4164722261 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81c80039a0 0x7f81c8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:38.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.928+0000 7f81d959a640 1 --2- 172.21.15.19:0/4164722261 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f81dc137650 0x7f81c80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:38.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.928+0000 7f81d959a640 1 --2- 172.21.15.19:0/4164722261 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81c8004d00 0x7f81c8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:38.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.928+0000 7f81d959a640 1 -- 172.21.15.19:0/4164722261 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc0a3060 con 0x7f81c80039a0 2023-11-04T15:27:38.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.928+0000 7f81d959a640 1 -- 172.21.15.19:0/4164722261 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c800bb10 con 0x7f81c8004d00 2023-11-04T15:27:38.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.928+0000 7f81d959a640 1 -- 172.21.15.19:0/4164722261 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c800bcd0 con 0x7f81dc137650 2023-11-04T15:27:38.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.928+0000 7f81da59c640 1 --2- 172.21.15.19:0/4164722261 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81c80039a0 0x7f81c8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:38.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.928+0000 7f81d9d9b640 1 --2- 172.21.15.19:0/4164722261 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f81dc137650 0x7f81c80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:38.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.928+0000 7f81dad9d640 1 --2- 172.21.15.19:0/4164722261 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81c8004d00 0x7f81c8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:38.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.928+0000 7f81da59c640 1 -- 172.21.15.19:0/4164722261 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f81dc137650 msgr2=0x7f81c80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:38.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.928+0000 7f81da59c640 1 --2- 172.21.15.19:0/4164722261 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f81dc137650 0x7f81c80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:38.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.928+0000 7f81da59c640 1 -- 172.21.15.19:0/4164722261 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81c8004d00 msgr2=0x7f81c8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:38.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.928+0000 7f81da59c640 1 --2- 172.21.15.19:0/4164722261 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81c8004d00 0x7f81c8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:38.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.928+0000 7f81da59c640 1 -- 172.21.15.19:0/4164722261 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c8003520 con 0x7f81c80039a0 2023-11-04T15:27:38.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.928+0000 7f81dad9d640 1 --2- 172.21.15.19:0/4164722261 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81c8004d00 0x7f81c8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:27:38.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.929+0000 7f81da59c640 1 --2- 172.21.15.19:0/4164722261 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81c80039a0 0x7f81c8003da0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f81dc0a8bb0 tx=0x7f81c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63fb8c5f9f8d20e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:38.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.929+0000 7f81d959a640 1 -- 172.21.15.19:0/4164722261 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d4005ad0 con 0x7f81c80039a0 2023-11-04T15:27:38.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.929+0000 7f81d959a640 1 -- 172.21.15.19:0/4164722261 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d4005c50 con 0x7f81c80039a0 2023-11-04T15:27:38.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.929+0000 7f81d959a640 1 -- 172.21.15.19:0/4164722261 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d402c8a0 con 0x7f81c80039a0 2023-11-04T15:27:38.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.929+0000 7f81e0e87640 1 -- 172.21.15.19:0/4164722261 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81c80039a0 msgr2=0x7f81c8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:38.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.929+0000 7f81e0e87640 1 --2- 172.21.15.19:0/4164722261 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81c80039a0 0x7f81c8003da0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f81dc0a8bb0 tx=0x7f81c80057f0 comp rx=0 tx=0).stop 2023-11-04T15:27:38.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.929+0000 7f81dad9d640 1 -- 172.21.15.19:0/4164722261 reap_dead start 2023-11-04T15:27:38.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.929+0000 7f81e0e87640 1 -- 172.21.15.19:0/4164722261 shutdown_connections 2023-11-04T15:27:38.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.929+0000 7f81e0e87640 1 -- 172.21.15.19:0/4164722261 >> 172.21.15.19:0/4164722261 conn(0x7f81dc0a8d70 msgr2=0x7f81dc0a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:38.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.929+0000 7f81e0e87640 1 -- 172.21.15.19:0/4164722261 shutdown_connections 2023-11-04T15:27:38.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.929+0000 7f81e0e87640 1 -- 172.21.15.19:0/4164722261 wait complete. 2023-11-04T15:27:38.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.930+0000 7f81e0e87640 1 Processor -- start 2023-11-04T15:27:38.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.930+0000 7f81e0e87640 1 -- start start 2023-11-04T15:27:38.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.931+0000 7f81e0e87640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81c80039a0 0x7f81dc131d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:38.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.931+0000 7f81e0e87640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81dc1322a0 0x7f81dc1cee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:38.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.931+0000 7f81e0e87640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f81dc1cf390 0x7f81dc1cf810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:38.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.931+0000 7f81e0e87640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc09d960 con 0x7f81c80039a0 2023-11-04T15:27:38.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.931+0000 7f81e0e87640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc0a1ff0 con 0x7f81dc1322a0 2023-11-04T15:27:38.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.931+0000 7f81e0e87640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc09de90 con 0x7f81dc1cf390 2023-11-04T15:27:38.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.931+0000 7f81da59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81c80039a0 0x7f81dc131d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:38.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.931+0000 7f81da59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81c80039a0 0x7f81dc131d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45988/0 (socket says 172.21.15.19:45988) 2023-11-04T15:27:38.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.931+0000 7f81da59c640 1 -- 172.21.15.19:0/3931805674 learned_addr learned my addr 172.21.15.19:0/3931805674 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.931+0000 7f81dad9d640 1 --2- 172.21.15.19:0/3931805674 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f81dc1cf390 0x7f81dc1cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.931+0000 7f81d9d9b640 1 --2- 172.21.15.19:0/3931805674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81dc1322a0 0x7f81dc1cee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.931+0000 7f81da59c640 1 -- 172.21.15.19:0/3931805674 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f81dc1cf390 msgr2=0x7f81dc1cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.931+0000 7f81da59c640 1 --2- 172.21.15.19:0/3931805674 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f81dc1cf390 0x7f81dc1cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:38.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.931+0000 7f81da59c640 1 -- 172.21.15.19:0/3931805674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81dc1322a0 msgr2=0x7f81dc1cee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:38.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.931+0000 7f81da59c640 1 --2- 172.21.15.19:0/3931805674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81dc1322a0 0x7f81dc1cee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:38.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.931+0000 7f81da59c640 1 -- 172.21.15.19:0/3931805674 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81dc09d480 con 0x7f81c80039a0 2023-11-04T15:27:38.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.931+0000 7f81da59c640 1 --2- 172.21.15.19:0/3931805674 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81c80039a0 0x7f81dc131d60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f81d402c510 tx=0x7f81d4001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:38.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.932+0000 7f81d2ffd640 1 -- 172.21.15.19:0/3931805674 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d4039070 con 0x7f81c80039a0 2023-11-04T15:27:38.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.932+0000 7f81d2ffd640 1 -- 172.21.15.19:0/3931805674 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d402caa0 con 0x7f81c80039a0 2023-11-04T15:27:38.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.932+0000 7f81e0e87640 1 -- 172.21.15.19:0/3931805674 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81dc09bba0 con 0x7f81c80039a0 2023-11-04T15:27:38.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.932+0000 7f81d2ffd640 1 -- 172.21.15.19:0/3931805674 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d402ce30 con 0x7f81c80039a0 2023-11-04T15:27:38.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.932+0000 7f81e0e87640 1 -- 172.21.15.19:0/3931805674 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81dc09b870 con 0x7f81c80039a0 2023-11-04T15:27:38.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.933+0000 7f81e0e87640 1 -- 172.21.15.19:0/3931805674 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81dc0ad0f0 con 0x7f81c80039a0 2023-11-04T15:27:38.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.933+0000 7f81d2ffd640 1 -- 172.21.15.19:0/3931805674 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f81d4032070 con 0x7f81c80039a0 2023-11-04T15:27:38.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.933+0000 7f81d2ffd640 1 --2- 172.21.15.19:0/3931805674 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f81bc06a460 0x7f81bc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:38.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.934+0000 7f81d2ffd640 1 -- 172.21.15.19:0/3931805674 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f81d403c040 con 0x7f81c80039a0 2023-11-04T15:27:38.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.934+0000 7f81d9d9b640 1 --2- 172.21.15.19:0/3931805674 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f81bc06a460 0x7f81bc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:38.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.934+0000 7f81d9d9b640 1 --2- 172.21.15.19:0/3931805674 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f81bc06a460 0x7f81bc06c920 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f81dc09b3e0 tx=0x7f81c4009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:38.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:38.938+0000 7f81d2ffd640 1 -- 172.21.15.19:0/3931805674 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f81d40755e0 con 0x7f81c80039a0 2023-11-04T15:27:39.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.112+0000 7f81e0e87640 1 -- 172.21.15.19:0/3931805674 --> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f81dc0a5340 con 0x7f81bc06a460 2023-11-04T15:27:39.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.120+0000 7f81d2ffd640 1 -- 172.21.15.19:0/3931805674 <== mgr.4114 v2:172.21.15.96:6816/83123 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+261519 (secure 0 0 0) 0x7f81c4001530 con 0x7f81bc06a460 2023-11-04T15:27:39.125 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:27:39.127 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-11-04T15:27:39.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.123+0000 7f81e0e87640 1 -- 172.21.15.19:0/3931805674 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f81bc06a460 msgr2=0x7f81bc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:39.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.123+0000 7f81e0e87640 1 --2- 172.21.15.19:0/3931805674 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f81bc06a460 0x7f81bc06c920 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f81dc09b3e0 tx=0x7f81c4009040 comp rx=0 tx=0).stop 2023-11-04T15:27:39.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.123+0000 7f81e0e87640 1 -- 172.21.15.19:0/3931805674 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81c80039a0 msgr2=0x7f81dc131d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:39.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.123+0000 7f81e0e87640 1 --2- 172.21.15.19:0/3931805674 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81c80039a0 0x7f81dc131d60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f81d402c510 tx=0x7f81d4001a20 comp rx=0 tx=0).stop 2023-11-04T15:27:39.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.123+0000 7f81e0e87640 1 -- 172.21.15.19:0/3931805674 shutdown_connections 2023-11-04T15:27:39.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.123+0000 7f81e0e87640 1 --2- 172.21.15.19:0/3931805674 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f81bc06a460 0x7f81bc06c920 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:39.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.123+0000 7f81e0e87640 1 --2- 172.21.15.19:0/3931805674 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f81dc1cf390 0x7f81dc1cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:39.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.123+0000 7f81e0e87640 1 --2- 172.21.15.19:0/3931805674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f81dc1322a0 0x7f81dc1cee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:39.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.123+0000 7f81e0e87640 1 --2- 172.21.15.19:0/3931805674 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81c80039a0 0x7f81dc131d60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:39.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.123+0000 7f81e0e87640 1 -- 172.21.15.19:0/3931805674 >> 172.21.15.19:0/3931805674 conn(0x7f81dc0a8d70 msgr2=0x7f81dc134390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:39.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.123+0000 7f81e0e87640 1 -- 172.21.15.19:0/3931805674 shutdown_connections 2023-11-04T15:27:39.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.123+0000 7f81e0e87640 1 -- 172.21.15.19:0/3931805674 wait complete. 2023-11-04T15:27:39.138 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-11-04T15:27:38.934881+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109488,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":107776,"kb_avail":377377872,"statfs":{"total":386547056640,"available":386434940928,"internally_reserved":0,"allocated":1720320,"data_stored":1349154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110362624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.186690"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751301+0000","last_change":"2023-11-04T15:27:34.751301+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751301+0000","last_undegraded":"2023-11-04T15:27:34.751301+0000","last_fullsized":"2023-11-04T15:27:34.751301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:14:34.175377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.752559+0000","last_change":"2023-11-04T15:27:34.752559+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.752559+0000","last_undegraded":"2023-11-04T15:27:34.752559+0000","last_fullsized":"2023-11-04T15:27:34.752559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:11:01.495068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751681+0000","last_change":"2023-11-04T15:27:34.751681+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751681+0000","last_undegraded":"2023-11-04T15:27:34.751681+0000","last_fullsized":"2023-11-04T15:27:34.751681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:44:09.266115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.752833+0000","last_change":"2023-11-04T15:27:34.752833+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.752833+0000","last_undegraded":"2023-11-04T15:27:34.752833+0000","last_fullsized":"2023-11-04T15:27:34.752833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:02:27.460776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750349+0000","last_change":"2023-11-04T15:27:34.750349+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750349+0000","last_undegraded":"2023-11-04T15:27:34.750349+0000","last_fullsized":"2023-11-04T15:27:34.750349+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:11:01.495068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750465+0000","last_change":"2023-11-04T15:27:34.750465+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750465+0000","last_undegraded":"2023-11-04T15:27:34.750465+0000","last_fullsized":"2023-11-04T15:27:34.750465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:02:11.972760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750140+0000","last_change":"2023-11-04T15:27:34.750140+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750140+0000","last_undegraded":"2023-11-04T15:27:34.750140+0000","last_fullsized":"2023-11-04T15:27:34.750140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:52:13.268866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750531+0000","last_change":"2023-11-04T15:27:34.750531+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750531+0000","last_undegraded":"2023-11-04T15:27:34.750531+0000","last_fullsized":"2023-11-04T15:27:34.750531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:42:49.218866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751147+0000","last_change":"2023-11-04T15:27:34.751147+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751147+0000","last_undegraded":"2023-11-04T15:27:34.751147+0000","last_fullsized":"2023-11-04T15:27:34.751147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:42:49.218866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751324+0000","last_change":"2023-11-04T15:27:34.751324+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751324+0000","last_undegraded":"2023-11-04T15:27:34.751324+0000","last_fullsized":"2023-11-04T15:27:34.751324+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:30:45.293294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750154+0000","last_change":"2023-11-04T15:27:34.750154+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750154+0000","last_undegraded":"2023-11-04T15:27:34.750154+0000","last_fullsized":"2023-11-04T15:27:34.750154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:17:14.527023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751114+0000","last_change":"2023-11-04T15:27:34.751114+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751114+0000","last_undegraded":"2023-11-04T15:27:34.751114+0000","last_fullsized":"2023-11-04T15:27:34.751114+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:01:29.923726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":164,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-11-04T15:27:32.618980+0000","last_change":"2023-11-04T15:27:26.267129+0000","last_active":"2023-11-04T15:27:32.618980+0000","last_peered":"2023-11-04T15:27:32.618980+0000","last_clean":"2023-11-04T15:27:32.618980+0000","last_became_active":"2023-11-04T15:27:26.266242+0000","last_became_peered":"2023-11-04T15:27:26.266242+0000","last_unstale":"2023-11-04T15:27:32.618980+0000","last_undegraded":"2023-11-04T15:27:32.618980+0000","last_fullsized":"2023-11-04T15:27:32.618980+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:25.163848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:25.163848+0000","last_clean_scrub_stamp":"2023-11-04T15:27:25.163848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:54:55.231471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-04T15:27:34.753914+0000","last_change":"2023-11-04T15:27:31.620178+0000","last_active":"2023-11-04T15:27:34.753914+0000","last_peered":"2023-11-04T15:27:34.753914+0000","last_clean":"2023-11-04T15:27:34.753914+0000","last_became_active":"2023-11-04T15:27:31.619798+0000","last_became_peered":"2023-11-04T15:27:31.619798+0000","last_unstale":"2023-11-04T15:27:34.753914+0000","last_undegraded":"2023-11-04T15:27:34.753914+0000","last_fullsized":"2023-11-04T15:27:34.753914+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:50:31.717109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750413+0000","last_change":"2023-11-04T15:27:34.750413+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750413+0000","last_undegraded":"2023-11-04T15:27:34.750413+0000","last_fullsized":"2023-11-04T15:27:34.750413+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:15:19.151223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-04T15:27:34.754064+0000","last_change":"2023-11-04T15:27:31.622106+0000","last_active":"2023-11-04T15:27:34.754064+0000","last_peered":"2023-11-04T15:27:34.754064+0000","last_clean":"2023-11-04T15:27:34.754064+0000","last_became_active":"2023-11-04T15:27:31.621889+0000","last_became_peered":"2023-11-04T15:27:31.621889+0000","last_unstale":"2023-11-04T15:27:34.754064+0000","last_undegraded":"2023-11-04T15:27:34.754064+0000","last_fullsized":"2023-11-04T15:27:34.754064+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:11:00.327441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.752728+0000","last_change":"2023-11-04T15:27:34.752728+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.752728+0000","last_undegraded":"2023-11-04T15:27:34.752728+0000","last_fullsized":"2023-11-04T15:27:34.752728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:23:45.371175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-04T15:27:34.749776+0000","last_change":"2023-11-04T15:27:31.622710+0000","last_active":"2023-11-04T15:27:34.749776+0000","last_peered":"2023-11-04T15:27:34.749776+0000","last_clean":"2023-11-04T15:27:34.749776+0000","last_became_active":"2023-11-04T15:27:31.622378+0000","last_became_peered":"2023-11-04T15:27:31.622378+0000","last_unstale":"2023-11-04T15:27:34.749776+0000","last_undegraded":"2023-11-04T15:27:34.749776+0000","last_fullsized":"2023-11-04T15:27:34.749776+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:49:04.803105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750394+0000","last_change":"2023-11-04T15:27:34.750394+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750394+0000","last_undegraded":"2023-11-04T15:27:34.750394+0000","last_fullsized":"2023-11-04T15:27:34.750394+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:44:38.690122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-04T15:27:34.753879+0000","last_change":"2023-11-04T15:27:31.622105+0000","last_active":"2023-11-04T15:27:34.753879+0000","last_peered":"2023-11-04T15:27:34.753879+0000","last_clean":"2023-11-04T15:27:34.753879+0000","last_became_active":"2023-11-04T15:27:31.621849+0000","last_became_peered":"2023-11-04T15:27:31.621849+0000","last_unstale":"2023-11-04T15:27:34.753879+0000","last_undegraded":"2023-11-04T15:27:34.753879+0000","last_fullsized":"2023-11-04T15:27:34.753879+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:20:41.777316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750556+0000","last_change":"2023-11-04T15:27:34.750556+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750556+0000","last_undegraded":"2023-11-04T15:27:34.750556+0000","last_fullsized":"2023-11-04T15:27:34.750556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:08:22.991334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750286+0000","last_change":"2023-11-04T15:27:34.750286+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750286+0000","last_undegraded":"2023-11-04T15:27:34.750286+0000","last_fullsized":"2023-11-04T15:27:34.750286+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:00:20.246822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-04T15:27:34.749830+0000","last_change":"2023-11-04T15:27:31.622663+0000","last_active":"2023-11-04T15:27:34.749830+0000","last_peered":"2023-11-04T15:27:34.749830+0000","last_clean":"2023-11-04T15:27:34.749830+0000","last_became_active":"2023-11-04T15:27:31.622350+0000","last_became_peered":"2023-11-04T15:27:31.622350+0000","last_unstale":"2023-11-04T15:27:34.749830+0000","last_undegraded":"2023-11-04T15:27:34.749830+0000","last_fullsized":"2023-11-04T15:27:34.749830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:31:02.273249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750413+0000","last_change":"2023-11-04T15:27:34.750413+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750413+0000","last_undegraded":"2023-11-04T15:27:34.750413+0000","last_fullsized":"2023-11-04T15:27:34.750413+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T22:02:04.025848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-04T15:27:34.754163+0000","last_change":"2023-11-04T15:27:31.619973+0000","last_active":"2023-11-04T15:27:34.754163+0000","last_peered":"2023-11-04T15:27:34.754163+0000","last_clean":"2023-11-04T15:27:34.754163+0000","last_became_active":"2023-11-04T15:27:31.619702+0000","last_became_peered":"2023-11-04T15:27:31.619702+0000","last_unstale":"2023-11-04T15:27:34.754163+0000","last_undegraded":"2023-11-04T15:27:34.754163+0000","last_fullsized":"2023-11-04T15:27:34.754163+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:24:34.782619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750459+0000","last_change":"2023-11-04T15:27:34.750459+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750459+0000","last_undegraded":"2023-11-04T15:27:34.750459+0000","last_fullsized":"2023-11-04T15:27:34.750459+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:14:58.601545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-04T15:27:34.749800+0000","last_change":"2023-11-04T15:27:31.624625+0000","last_active":"2023-11-04T15:27:34.749800+0000","last_peered":"2023-11-04T15:27:34.749800+0000","last_clean":"2023-11-04T15:27:34.749800+0000","last_became_active":"2023-11-04T15:27:31.624347+0000","last_became_peered":"2023-11-04T15:27:31.624347+0000","last_unstale":"2023-11-04T15:27:34.749800+0000","last_undegraded":"2023-11-04T15:27:34.749800+0000","last_fullsized":"2023-11-04T15:27:34.749800+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:53:45.131692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.752693+0000","last_change":"2023-11-04T15:27:34.752693+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.752693+0000","last_undegraded":"2023-11-04T15:27:34.752693+0000","last_fullsized":"2023-11-04T15:27:34.752693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:58:09.475936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-04T15:27:34.754149+0000","last_change":"2023-11-04T15:27:31.620235+0000","last_active":"2023-11-04T15:27:34.754149+0000","last_peered":"2023-11-04T15:27:34.754149+0000","last_clean":"2023-11-04T15:27:34.754149+0000","last_became_active":"2023-11-04T15:27:31.619831+0000","last_became_peered":"2023-11-04T15:27:31.619831+0000","last_unstale":"2023-11-04T15:27:34.754149+0000","last_undegraded":"2023-11-04T15:27:34.754149+0000","last_fullsized":"2023-11-04T15:27:34.754149+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:44:07.412379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751515+0000","last_change":"2023-11-04T15:27:34.751515+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751515+0000","last_undegraded":"2023-11-04T15:27:34.751515+0000","last_fullsized":"2023-11-04T15:27:34.751515+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:36:12.941030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751488+0000","last_change":"2023-11-04T15:27:34.751488+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751488+0000","last_undegraded":"2023-11-04T15:27:34.751488+0000","last_fullsized":"2023-11-04T15:27:34.751488+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:58:09.475936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751729+0000","last_change":"2023-11-04T15:27:34.751729+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751729+0000","last_undegraded":"2023-11-04T15:27:34.751729+0000","last_fullsized":"2023-11-04T15:27:34.751729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:23:45.371175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.752775+0000","last_change":"2023-11-04T15:27:34.752775+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.752775+0000","last_undegraded":"2023-11-04T15:27:34.752775+0000","last_fullsized":"2023-11-04T15:27:34.752775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:14:58.601545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751810+0000","last_change":"2023-11-04T15:27:34.751810+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751810+0000","last_undegraded":"2023-11-04T15:27:34.751810+0000","last_fullsized":"2023-11-04T15:27:34.751810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:03:49.354013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751672+0000","last_change":"2023-11-04T15:27:34.751672+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751672+0000","last_undegraded":"2023-11-04T15:27:34.751672+0000","last_fullsized":"2023-11-04T15:27:34.751672+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:55:22.956180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750521+0000","last_change":"2023-11-04T15:27:34.750521+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750521+0000","last_undegraded":"2023-11-04T15:27:34.750521+0000","last_fullsized":"2023-11-04T15:27:34.750521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:14:58.601545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.752683+0000","last_change":"2023-11-04T15:27:34.752683+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.752683+0000","last_undegraded":"2023-11-04T15:27:34.752683+0000","last_fullsized":"2023-11-04T15:27:34.752683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:00:20.246822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750251+0000","last_change":"2023-11-04T15:27:34.750251+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750251+0000","last_undegraded":"2023-11-04T15:27:34.750251+0000","last_fullsized":"2023-11-04T15:27:34.750251+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:47:47.130490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751865+0000","last_change":"2023-11-04T15:27:34.751865+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751865+0000","last_undegraded":"2023-11-04T15:27:34.751865+0000","last_fullsized":"2023-11-04T15:27:34.751865+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:13:42.865721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.753557+0000","last_change":"2023-11-04T15:27:34.753557+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.753557+0000","last_undegraded":"2023-11-04T15:27:34.753557+0000","last_fullsized":"2023-11-04T15:27:34.753557+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:02:11.972760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.753707+0000","last_change":"2023-11-04T15:27:34.753707+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.753707+0000","last_undegraded":"2023-11-04T15:27:34.753707+0000","last_fullsized":"2023-11-04T15:27:34.753707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:08:22.991334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":716,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":733184,"data_stored":635804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]}]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27080,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344760,"statfs":{"total":96636764160,"available":96609034240,"internally_reserved":0,"allocated":131072,"data_stored":40994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27080,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344760,"statfs":{"total":96636764160,"available":96609034240,"internally_reserved":0,"allocated":131072,"data_stored":40994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":724992,"data_stored":631362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T15:27:39.145 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T15:27:39.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.281+0000 7fec98d50640 1 Processor -- start 2023-11-04T15:27:39.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.281+0000 7fec98d50640 1 -- start start 2023-11-04T15:27:39.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.282+0000 7fec98d50640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fec941373d0 0x7fec941377b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:39.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.282+0000 7fec98d50640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fec9413ac30 0x7fec94142440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:39.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.282+0000 7fec98d50640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec9406f9e0 con 0x7fec9413a100 2023-11-04T15:27:39.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.282+0000 7fec98d50640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec940705c0 con 0x7fec9413ac30 2023-11-04T15:27:39.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.282+0000 7fec98d50640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec9406c860 con 0x7fec941373d0 2023-11-04T15:27:39.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.282+0000 7fec92d9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fec9413ac30 0x7fec94142440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:39.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.282+0000 7fec91d9b640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fec9413a100 0x7fec9413a520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50522/0 (socket says 172.21.15.19:50522) 2023-11-04T15:27:39.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.282+0000 7fec91d9b640 1 -- 172.21.15.19:0/330886831 learned_addr learned my addr 172.21.15.19:0/330886831 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:39.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.282+0000 7fec9259c640 1 --2- 172.21.15.19:0/330886831 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fec941373d0 0x7fec941377b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:39.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.282+0000 7fec92d9d640 1 -- 172.21.15.19:0/330886831 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fec941373d0 msgr2=0x7fec941377b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:39.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.282+0000 7fec92d9d640 1 --2- 172.21.15.19:0/330886831 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fec941373d0 0x7fec941377b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:39.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.282+0000 7fec92d9d640 1 -- 172.21.15.19:0/330886831 >> v1:172.21.15.19:6789/0 conn(0x7fec9413a100 legacy=0x7fec9413a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:39.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.282+0000 7fec92d9d640 1 -- 172.21.15.19:0/330886831 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec941371b0 con 0x7fec9413ac30 2023-11-04T15:27:39.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.282+0000 7fec9159a640 1 -- 172.21.15.19:0/330886831 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3027279543 0 0) 0x7fec9406f9e0 con 0x7fec9413a100 2023-11-04T15:27:39.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.283+0000 7fec92d9d640 1 --2- 172.21.15.19:0/330886831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec9413ac30 0x7fec94142440 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fec8c0097a0 tx=0x7fec8c02b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7c1ad25b99a4f42 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:39.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.283+0000 7fec9159a640 1 -- 172.21.15.19:0/330886831 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c02f050 con 0x7fec9413ac30 2023-11-04T15:27:39.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.283+0000 7fec9159a640 1 -- 172.21.15.19:0/330886831 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8c031700 con 0x7fec9413ac30 2023-11-04T15:27:39.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.283+0000 7fec9159a640 1 -- 172.21.15.19:0/330886831 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c031a90 con 0x7fec9413ac30 2023-11-04T15:27:39.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.283+0000 7fec98d50640 1 -- 172.21.15.19:0/330886831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec9413ac30 msgr2=0x7fec94142440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:39.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.283+0000 7fec98d50640 1 --2- 172.21.15.19:0/330886831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec9413ac30 0x7fec94142440 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fec8c0097a0 tx=0x7fec8c02b7a0 comp rx=0 tx=0).stop 2023-11-04T15:27:39.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.284+0000 7fec98d50640 1 -- 172.21.15.19:0/330886831 shutdown_connections 2023-11-04T15:27:39.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.284+0000 7fec98d50640 1 --2- 172.21.15.19:0/330886831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec9413ac30 0x7fec94142440 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:39.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.284+0000 7fec98d50640 1 --2- 172.21.15.19:0/330886831 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fec941373d0 0x7fec941377b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:39.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.284+0000 7fec98d50640 1 -- 172.21.15.19:0/330886831 >> 172.21.15.19:0/330886831 conn(0x7fec940a6e30 msgr2=0x7fec940a7240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:39.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.284+0000 7fec98d50640 1 -- 172.21.15.19:0/330886831 shutdown_connections 2023-11-04T15:27:39.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.284+0000 7fec98d50640 1 -- 172.21.15.19:0/330886831 wait complete. 2023-11-04T15:27:39.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.285+0000 7fec98d50640 1 Processor -- start 2023-11-04T15:27:39.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.285+0000 7fec98d50640 1 -- start start 2023-11-04T15:27:39.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.285+0000 7fec98d50640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec941373d0 0x7fec9409dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:39.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.285+0000 7fec98d50640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec9413a100 0x7fec9409e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:39.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.285+0000 7fec98d50640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fec9413ac30 0x7fec9409e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:39.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.285+0000 7fec98d50640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec94120a50 con 0x7fec9413a100 2023-11-04T15:27:39.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.285+0000 7fec98d50640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec94120820 con 0x7fec941373d0 2023-11-04T15:27:39.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.285+0000 7fec98d50640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec94137d60 con 0x7fec9413ac30 2023-11-04T15:27:39.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.285+0000 7fec91d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec9413a100 0x7fec9409e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:39.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.285+0000 7fec91d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec9413a100 0x7fec9409e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46000/0 (socket says 172.21.15.19:46000) 2023-11-04T15:27:39.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.285+0000 7fec91d9b640 1 -- 172.21.15.19:0/555363451 learned_addr learned my addr 172.21.15.19:0/555363451 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:39.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.285+0000 7fec91d9b640 1 -- 172.21.15.19:0/555363451 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fec9413ac30 msgr2=0x7fec9409e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:39.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.285+0000 7fec92d9d640 1 --2- 172.21.15.19:0/555363451 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fec9413ac30 0x7fec9409e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:39.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.285+0000 7fec91d9b640 1 --2- 172.21.15.19:0/555363451 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fec9413ac30 0x7fec9409e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:39.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.285+0000 7fec91d9b640 1 -- 172.21.15.19:0/555363451 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec941373d0 msgr2=0x7fec9409dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:39.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.285+0000 7fec91d9b640 1 --2- 172.21.15.19:0/555363451 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec941373d0 0x7fec9409dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:39.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.286+0000 7fec91d9b640 1 -- 172.21.15.19:0/555363451 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec8c009400 con 0x7fec9413a100 2023-11-04T15:27:39.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.286+0000 7fec91d9b640 1 --2- 172.21.15.19:0/555363451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec9413a100 0x7fec9409e2d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fec7c00c430 tx=0x7fec7c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:39.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.286+0000 7fec8affd640 1 -- 172.21.15.19:0/555363451 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c0074e0 con 0x7fec9413a100 2023-11-04T15:27:39.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.286+0000 7fec8affd640 1 -- 172.21.15.19:0/555363451 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7c007660 con 0x7fec9413a100 2023-11-04T15:27:39.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.286+0000 7fec98d50640 1 -- 172.21.15.19:0/555363451 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec941213e0 con 0x7fec9413a100 2023-11-04T15:27:39.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.286+0000 7fec8affd640 1 -- 172.21.15.19:0/555363451 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c004a20 con 0x7fec9413a100 2023-11-04T15:27:39.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.286+0000 7fec98d50640 1 -- 172.21.15.19:0/555363451 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec941216a0 con 0x7fec9413a100 2023-11-04T15:27:39.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.287+0000 7fec98d50640 1 -- 172.21.15.19:0/555363451 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec9409fa10 con 0x7fec9413a100 2023-11-04T15:27:39.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.287+0000 7fec8affd640 1 -- 172.21.15.19:0/555363451 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fec7c004b80 con 0x7fec9413a100 2023-11-04T15:27:39.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.288+0000 7fec8affd640 1 --2- 172.21.15.19:0/555363451 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fec7406a430 0x7fec7406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:39.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.288+0000 7fec8affd640 1 -- 172.21.15.19:0/555363451 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7fec7c0880e0 con 0x7fec9413a100 2023-11-04T15:27:39.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.288+0000 7fec9259c640 1 --2- 172.21.15.19:0/555363451 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fec7406a430 0x7fec7406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:39.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.288+0000 7fec9259c640 1 --2- 172.21.15.19:0/555363451 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fec7406a430 0x7fec7406c8f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fec840070b0 tx=0x7fec84007040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:39.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.292+0000 7fec8affd640 1 -- 172.21.15.19:0/555363451 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fec7c053cc0 con 0x7fec9413a100 2023-11-04T15:27:39.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.464+0000 7fec98d50640 1 -- 172.21.15.19:0/555363451 --> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fec9406bdf0 con 0x7fec7406a430 2023-11-04T15:27:39.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.471+0000 7fec8affd640 1 -- 172.21.15.19:0/555363451 <== mgr.4114 v2:172.21.15.96:6816/83123 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+261519 (secure 0 0 0) 0x7fec84009b10 con 0x7fec7406a430 2023-11-04T15:27:39.475 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:27:39.476 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-11-04T15:27:39.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.473+0000 7fec98d50640 1 -- 172.21.15.19:0/555363451 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fec7406a430 msgr2=0x7fec7406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:39.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.473+0000 7fec98d50640 1 --2- 172.21.15.19:0/555363451 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fec7406a430 0x7fec7406c8f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fec840070b0 tx=0x7fec84007040 comp rx=0 tx=0).stop 2023-11-04T15:27:39.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.473+0000 7fec98d50640 1 -- 172.21.15.19:0/555363451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec9413a100 msgr2=0x7fec9409e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:39.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.473+0000 7fec98d50640 1 --2- 172.21.15.19:0/555363451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec9413a100 0x7fec9409e2d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fec7c00c430 tx=0x7fec7c00c8f0 comp rx=0 tx=0).stop 2023-11-04T15:27:39.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.473+0000 7fec98d50640 1 -- 172.21.15.19:0/555363451 shutdown_connections 2023-11-04T15:27:39.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.473+0000 7fec98d50640 1 --2- 172.21.15.19:0/555363451 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fec7406a430 0x7fec7406c8f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:39.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.473+0000 7fec98d50640 1 --2- 172.21.15.19:0/555363451 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fec9413ac30 0x7fec9409e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:39.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.473+0000 7fec98d50640 1 --2- 172.21.15.19:0/555363451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec9413a100 0x7fec9409e2d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:39.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.473+0000 7fec98d50640 1 --2- 172.21.15.19:0/555363451 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec941373d0 0x7fec9409dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:39.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.473+0000 7fec98d50640 1 -- 172.21.15.19:0/555363451 >> 172.21.15.19:0/555363451 conn(0x7fec940a6e30 msgr2=0x7fec940a12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:39.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.474+0000 7fec98d50640 1 -- 172.21.15.19:0/555363451 shutdown_connections 2023-11-04T15:27:39.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.474+0000 7fec98d50640 1 -- 172.21.15.19:0/555363451 wait complete. 2023-11-04T15:27:39.486 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-11-04T15:27:38.934881+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109488,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":107776,"kb_avail":377377872,"statfs":{"total":386547056640,"available":386434940928,"internally_reserved":0,"allocated":1720320,"data_stored":1349154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110362624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.186690"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751301+0000","last_change":"2023-11-04T15:27:34.751301+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751301+0000","last_undegraded":"2023-11-04T15:27:34.751301+0000","last_fullsized":"2023-11-04T15:27:34.751301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:14:34.175377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.752559+0000","last_change":"2023-11-04T15:27:34.752559+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.752559+0000","last_undegraded":"2023-11-04T15:27:34.752559+0000","last_fullsized":"2023-11-04T15:27:34.752559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:11:01.495068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751681+0000","last_change":"2023-11-04T15:27:34.751681+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751681+0000","last_undegraded":"2023-11-04T15:27:34.751681+0000","last_fullsized":"2023-11-04T15:27:34.751681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:44:09.266115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.752833+0000","last_change":"2023-11-04T15:27:34.752833+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.752833+0000","last_undegraded":"2023-11-04T15:27:34.752833+0000","last_fullsized":"2023-11-04T15:27:34.752833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:02:27.460776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750349+0000","last_change":"2023-11-04T15:27:34.750349+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750349+0000","last_undegraded":"2023-11-04T15:27:34.750349+0000","last_fullsized":"2023-11-04T15:27:34.750349+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:11:01.495068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750465+0000","last_change":"2023-11-04T15:27:34.750465+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750465+0000","last_undegraded":"2023-11-04T15:27:34.750465+0000","last_fullsized":"2023-11-04T15:27:34.750465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:02:11.972760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750140+0000","last_change":"2023-11-04T15:27:34.750140+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750140+0000","last_undegraded":"2023-11-04T15:27:34.750140+0000","last_fullsized":"2023-11-04T15:27:34.750140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:52:13.268866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750531+0000","last_change":"2023-11-04T15:27:34.750531+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750531+0000","last_undegraded":"2023-11-04T15:27:34.750531+0000","last_fullsized":"2023-11-04T15:27:34.750531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:42:49.218866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751147+0000","last_change":"2023-11-04T15:27:34.751147+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751147+0000","last_undegraded":"2023-11-04T15:27:34.751147+0000","last_fullsized":"2023-11-04T15:27:34.751147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:42:49.218866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751324+0000","last_change":"2023-11-04T15:27:34.751324+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751324+0000","last_undegraded":"2023-11-04T15:27:34.751324+0000","last_fullsized":"2023-11-04T15:27:34.751324+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:30:45.293294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750154+0000","last_change":"2023-11-04T15:27:34.750154+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750154+0000","last_undegraded":"2023-11-04T15:27:34.750154+0000","last_fullsized":"2023-11-04T15:27:34.750154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:17:14.527023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751114+0000","last_change":"2023-11-04T15:27:34.751114+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751114+0000","last_undegraded":"2023-11-04T15:27:34.751114+0000","last_fullsized":"2023-11-04T15:27:34.751114+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:01:29.923726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":164,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-11-04T15:27:32.618980+0000","last_change":"2023-11-04T15:27:26.267129+0000","last_active":"2023-11-04T15:27:32.618980+0000","last_peered":"2023-11-04T15:27:32.618980+0000","last_clean":"2023-11-04T15:27:32.618980+0000","last_became_active":"2023-11-04T15:27:26.266242+0000","last_became_peered":"2023-11-04T15:27:26.266242+0000","last_unstale":"2023-11-04T15:27:32.618980+0000","last_undegraded":"2023-11-04T15:27:32.618980+0000","last_fullsized":"2023-11-04T15:27:32.618980+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:25.163848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:25.163848+0000","last_clean_scrub_stamp":"2023-11-04T15:27:25.163848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:54:55.231471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-04T15:27:34.753914+0000","last_change":"2023-11-04T15:27:31.620178+0000","last_active":"2023-11-04T15:27:34.753914+0000","last_peered":"2023-11-04T15:27:34.753914+0000","last_clean":"2023-11-04T15:27:34.753914+0000","last_became_active":"2023-11-04T15:27:31.619798+0000","last_became_peered":"2023-11-04T15:27:31.619798+0000","last_unstale":"2023-11-04T15:27:34.753914+0000","last_undegraded":"2023-11-04T15:27:34.753914+0000","last_fullsized":"2023-11-04T15:27:34.753914+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:50:31.717109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750413+0000","last_change":"2023-11-04T15:27:34.750413+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750413+0000","last_undegraded":"2023-11-04T15:27:34.750413+0000","last_fullsized":"2023-11-04T15:27:34.750413+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:15:19.151223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-04T15:27:34.754064+0000","last_change":"2023-11-04T15:27:31.622106+0000","last_active":"2023-11-04T15:27:34.754064+0000","last_peered":"2023-11-04T15:27:34.754064+0000","last_clean":"2023-11-04T15:27:34.754064+0000","last_became_active":"2023-11-04T15:27:31.621889+0000","last_became_peered":"2023-11-04T15:27:31.621889+0000","last_unstale":"2023-11-04T15:27:34.754064+0000","last_undegraded":"2023-11-04T15:27:34.754064+0000","last_fullsized":"2023-11-04T15:27:34.754064+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:11:00.327441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.752728+0000","last_change":"2023-11-04T15:27:34.752728+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.752728+0000","last_undegraded":"2023-11-04T15:27:34.752728+0000","last_fullsized":"2023-11-04T15:27:34.752728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:23:45.371175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-04T15:27:34.749776+0000","last_change":"2023-11-04T15:27:31.622710+0000","last_active":"2023-11-04T15:27:34.749776+0000","last_peered":"2023-11-04T15:27:34.749776+0000","last_clean":"2023-11-04T15:27:34.749776+0000","last_became_active":"2023-11-04T15:27:31.622378+0000","last_became_peered":"2023-11-04T15:27:31.622378+0000","last_unstale":"2023-11-04T15:27:34.749776+0000","last_undegraded":"2023-11-04T15:27:34.749776+0000","last_fullsized":"2023-11-04T15:27:34.749776+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:49:04.803105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750394+0000","last_change":"2023-11-04T15:27:34.750394+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750394+0000","last_undegraded":"2023-11-04T15:27:34.750394+0000","last_fullsized":"2023-11-04T15:27:34.750394+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:44:38.690122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-04T15:27:34.753879+0000","last_change":"2023-11-04T15:27:31.622105+0000","last_active":"2023-11-04T15:27:34.753879+0000","last_peered":"2023-11-04T15:27:34.753879+0000","last_clean":"2023-11-04T15:27:34.753879+0000","last_became_active":"2023-11-04T15:27:31.621849+0000","last_became_peered":"2023-11-04T15:27:31.621849+0000","last_unstale":"2023-11-04T15:27:34.753879+0000","last_undegraded":"2023-11-04T15:27:34.753879+0000","last_fullsized":"2023-11-04T15:27:34.753879+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:20:41.777316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750556+0000","last_change":"2023-11-04T15:27:34.750556+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750556+0000","last_undegraded":"2023-11-04T15:27:34.750556+0000","last_fullsized":"2023-11-04T15:27:34.750556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:08:22.991334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750286+0000","last_change":"2023-11-04T15:27:34.750286+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750286+0000","last_undegraded":"2023-11-04T15:27:34.750286+0000","last_fullsized":"2023-11-04T15:27:34.750286+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:00:20.246822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-04T15:27:34.749830+0000","last_change":"2023-11-04T15:27:31.622663+0000","last_active":"2023-11-04T15:27:34.749830+0000","last_peered":"2023-11-04T15:27:34.749830+0000","last_clean":"2023-11-04T15:27:34.749830+0000","last_became_active":"2023-11-04T15:27:31.622350+0000","last_became_peered":"2023-11-04T15:27:31.622350+0000","last_unstale":"2023-11-04T15:27:34.749830+0000","last_undegraded":"2023-11-04T15:27:34.749830+0000","last_fullsized":"2023-11-04T15:27:34.749830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:31:02.273249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750413+0000","last_change":"2023-11-04T15:27:34.750413+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750413+0000","last_undegraded":"2023-11-04T15:27:34.750413+0000","last_fullsized":"2023-11-04T15:27:34.750413+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T22:02:04.025848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-04T15:27:34.754163+0000","last_change":"2023-11-04T15:27:31.619973+0000","last_active":"2023-11-04T15:27:34.754163+0000","last_peered":"2023-11-04T15:27:34.754163+0000","last_clean":"2023-11-04T15:27:34.754163+0000","last_became_active":"2023-11-04T15:27:31.619702+0000","last_became_peered":"2023-11-04T15:27:31.619702+0000","last_unstale":"2023-11-04T15:27:34.754163+0000","last_undegraded":"2023-11-04T15:27:34.754163+0000","last_fullsized":"2023-11-04T15:27:34.754163+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:24:34.782619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750459+0000","last_change":"2023-11-04T15:27:34.750459+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750459+0000","last_undegraded":"2023-11-04T15:27:34.750459+0000","last_fullsized":"2023-11-04T15:27:34.750459+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:14:58.601545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-04T15:27:34.749800+0000","last_change":"2023-11-04T15:27:31.624625+0000","last_active":"2023-11-04T15:27:34.749800+0000","last_peered":"2023-11-04T15:27:34.749800+0000","last_clean":"2023-11-04T15:27:34.749800+0000","last_became_active":"2023-11-04T15:27:31.624347+0000","last_became_peered":"2023-11-04T15:27:31.624347+0000","last_unstale":"2023-11-04T15:27:34.749800+0000","last_undegraded":"2023-11-04T15:27:34.749800+0000","last_fullsized":"2023-11-04T15:27:34.749800+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:53:45.131692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.752693+0000","last_change":"2023-11-04T15:27:34.752693+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.752693+0000","last_undegraded":"2023-11-04T15:27:34.752693+0000","last_fullsized":"2023-11-04T15:27:34.752693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:58:09.475936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-04T15:27:34.754149+0000","last_change":"2023-11-04T15:27:31.620235+0000","last_active":"2023-11-04T15:27:34.754149+0000","last_peered":"2023-11-04T15:27:34.754149+0000","last_clean":"2023-11-04T15:27:34.754149+0000","last_became_active":"2023-11-04T15:27:31.619831+0000","last_became_peered":"2023-11-04T15:27:31.619831+0000","last_unstale":"2023-11-04T15:27:34.754149+0000","last_undegraded":"2023-11-04T15:27:34.754149+0000","last_fullsized":"2023-11-04T15:27:34.754149+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:44:07.412379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751515+0000","last_change":"2023-11-04T15:27:34.751515+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751515+0000","last_undegraded":"2023-11-04T15:27:34.751515+0000","last_fullsized":"2023-11-04T15:27:34.751515+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:36:12.941030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751488+0000","last_change":"2023-11-04T15:27:34.751488+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751488+0000","last_undegraded":"2023-11-04T15:27:34.751488+0000","last_fullsized":"2023-11-04T15:27:34.751488+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:58:09.475936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751729+0000","last_change":"2023-11-04T15:27:34.751729+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751729+0000","last_undegraded":"2023-11-04T15:27:34.751729+0000","last_fullsized":"2023-11-04T15:27:34.751729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:23:45.371175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.752775+0000","last_change":"2023-11-04T15:27:34.752775+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.752775+0000","last_undegraded":"2023-11-04T15:27:34.752775+0000","last_fullsized":"2023-11-04T15:27:34.752775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:14:58.601545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751810+0000","last_change":"2023-11-04T15:27:34.751810+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751810+0000","last_undegraded":"2023-11-04T15:27:34.751810+0000","last_fullsized":"2023-11-04T15:27:34.751810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:03:49.354013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751672+0000","last_change":"2023-11-04T15:27:34.751672+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751672+0000","last_undegraded":"2023-11-04T15:27:34.751672+0000","last_fullsized":"2023-11-04T15:27:34.751672+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:55:22.956180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750521+0000","last_change":"2023-11-04T15:27:34.750521+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750521+0000","last_undegraded":"2023-11-04T15:27:34.750521+0000","last_fullsized":"2023-11-04T15:27:34.750521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:14:58.601545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.752683+0000","last_change":"2023-11-04T15:27:34.752683+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.752683+0000","last_undegraded":"2023-11-04T15:27:34.752683+0000","last_fullsized":"2023-11-04T15:27:34.752683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:00:20.246822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750251+0000","last_change":"2023-11-04T15:27:34.750251+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750251+0000","last_undegraded":"2023-11-04T15:27:34.750251+0000","last_fullsized":"2023-11-04T15:27:34.750251+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:47:47.130490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751865+0000","last_change":"2023-11-04T15:27:34.751865+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751865+0000","last_undegraded":"2023-11-04T15:27:34.751865+0000","last_fullsized":"2023-11-04T15:27:34.751865+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:13:42.865721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.753557+0000","last_change":"2023-11-04T15:27:34.753557+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.753557+0000","last_undegraded":"2023-11-04T15:27:34.753557+0000","last_fullsized":"2023-11-04T15:27:34.753557+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:02:11.972760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.753707+0000","last_change":"2023-11-04T15:27:34.753707+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.753707+0000","last_undegraded":"2023-11-04T15:27:34.753707+0000","last_fullsized":"2023-11-04T15:27:34.753707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:08:22.991334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":716,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":733184,"data_stored":635804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]}]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27080,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344760,"statfs":{"total":96636764160,"available":96609034240,"internally_reserved":0,"allocated":131072,"data_stored":40994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27080,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344760,"statfs":{"total":96636764160,"available":96609034240,"internally_reserved":0,"allocated":131072,"data_stored":40994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":724992,"data_stored":631362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T15:27:39.491 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T15:27:39.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.630+0000 7f05e9887640 1 Processor -- start 2023-11-04T15:27:39.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.630+0000 7f05e9887640 1 -- start start 2023-11-04T15:27:39.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.631+0000 7f05e9887640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f05e413a680 0x7f05e413aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:39.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.631+0000 7f05e9887640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f05e4098c70 0x7f05e4099090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:39.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.631+0000 7f05e9887640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f05e40995d0 0x7f05e41412e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:39.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.631+0000 7f05e9887640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e406fa50 con 0x7f05e4098c70 2023-11-04T15:27:39.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.631+0000 7f05e9887640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e4065b90 con 0x7f05e40995d0 2023-11-04T15:27:39.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.631+0000 7f05e9887640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e406e8d0 con 0x7f05e413a680 2023-11-04T15:27:39.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.631+0000 7f05e27fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f05e4098c70 0x7f05e4099090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:39.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.631+0000 7f05e27fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f05e4098c70 0x7f05e4099090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46008/0 (socket says 172.21.15.19:46008) 2023-11-04T15:27:39.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.631+0000 7f05e27fc640 1 -- 172.21.15.19:0/1840635043 learned_addr learned my addr 172.21.15.19:0/1840635043 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:39.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.631+0000 7f05e2ffd640 1 --2- 172.21.15.19:0/1840635043 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f05e413a680 0x7f05e413aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:39.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.631+0000 7f05e27fc640 1 -- 172.21.15.19:0/1840635043 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f05e413a680 msgr2=0x7f05e413aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:39.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.631+0000 7f05e27fc640 1 --2- 172.21.15.19:0/1840635043 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f05e413a680 0x7f05e413aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:39.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.631+0000 7f05e27fc640 1 -- 172.21.15.19:0/1840635043 >> v2:172.21.15.96:3300/0 conn(0x7f05e40995d0 msgr2=0x7f05e41412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:39.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.631+0000 7f05e37fe640 1 --2- 172.21.15.19:0/1840635043 >> v2:172.21.15.96:3300/0 conn(0x7f05e40995d0 0x7f05e41412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:39.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.631+0000 7f05e27fc640 1 --2- 172.21.15.19:0/1840635043 >> v2:172.21.15.96:3300/0 conn(0x7f05e40995d0 0x7f05e41412e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:39.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.631+0000 7f05e27fc640 1 -- 172.21.15.19:0/1840635043 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e406fc70 con 0x7f05e4098c70 2023-11-04T15:27:39.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.632+0000 7f05e27fc640 1 --2- 172.21.15.19:0/1840635043 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05e4098c70 0x7f05e4099090 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f05e406afe0 tx=0x7f05cc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33a785dea7ee4619 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:39.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.632+0000 7f05e1ffb640 1 -- 172.21.15.19:0/1840635043 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc0317e0 con 0x7f05e4098c70 2023-11-04T15:27:39.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.632+0000 7f05e1ffb640 1 -- 172.21.15.19:0/1840635043 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05cc031940 con 0x7f05e4098c70 2023-11-04T15:27:39.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.632+0000 7f05e1ffb640 1 -- 172.21.15.19:0/1840635043 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc031cd0 con 0x7f05e4098c70 2023-11-04T15:27:39.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.632+0000 7f05e9887640 1 -- 172.21.15.19:0/1840635043 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05e4098c70 msgr2=0x7f05e4099090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:39.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.633+0000 7f05e9887640 1 --2- 172.21.15.19:0/1840635043 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05e4098c70 0x7f05e4099090 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f05e406afe0 tx=0x7f05cc02b880 comp rx=0 tx=0).stop 2023-11-04T15:27:39.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.633+0000 7f05e9887640 1 -- 172.21.15.19:0/1840635043 shutdown_connections 2023-11-04T15:27:39.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.633+0000 7f05e9887640 1 --2- 172.21.15.19:0/1840635043 >> v2:172.21.15.96:3300/0 conn(0x7f05e40995d0 0x7f05e41412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:39.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.633+0000 7f05e9887640 1 --2- 172.21.15.19:0/1840635043 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05e4098c70 0x7f05e4099090 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:39.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.633+0000 7f05e9887640 1 --2- 172.21.15.19:0/1840635043 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f05e413a680 0x7f05e413aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:39.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.633+0000 7f05e9887640 1 -- 172.21.15.19:0/1840635043 >> 172.21.15.19:0/1840635043 conn(0x7f05e406a090 msgr2=0x7f05e406a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:39.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.633+0000 7f05e9887640 1 -- 172.21.15.19:0/1840635043 shutdown_connections 2023-11-04T15:27:39.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.633+0000 7f05e9887640 1 -- 172.21.15.19:0/1840635043 wait complete. 2023-11-04T15:27:39.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.633+0000 7f05e9887640 1 Processor -- start 2023-11-04T15:27:39.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.634+0000 7f05e9887640 1 -- start start 2023-11-04T15:27:39.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.634+0000 7f05e9887640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f05e4098c70 0x7f05e41cec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:39.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.634+0000 7f05e9887640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05e40995d0 0x7f05e41cf190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:39.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.634+0000 7f05e9887640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05e413a680 0x7f05e41cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:39.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.634+0000 7f05e9887640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e4120ef0 con 0x7f05e40995d0 2023-11-04T15:27:39.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.634+0000 7f05e9887640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e4120c30 con 0x7f05e413a680 2023-11-04T15:27:39.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.634+0000 7f05e9887640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e4120730 con 0x7f05e4098c70 2023-11-04T15:27:39.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.634+0000 7f05e27fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05e40995d0 0x7f05e41cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:39.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.634+0000 7f05e27fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05e40995d0 0x7f05e41cf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46018/0 (socket says 172.21.15.19:46018) 2023-11-04T15:27:39.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.634+0000 7f05e27fc640 1 -- 172.21.15.19:0/1952139820 learned_addr learned my addr 172.21.15.19:0/1952139820 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:39.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.634+0000 7f05e37fe640 1 --2- 172.21.15.19:0/1952139820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05e413a680 0x7f05e41cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:39.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.634+0000 7f05e2ffd640 1 --2- 172.21.15.19:0/1952139820 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f05e4098c70 0x7f05e41cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:39.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.634+0000 7f05e27fc640 1 -- 172.21.15.19:0/1952139820 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f05e4098c70 msgr2=0x7f05e41cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:39.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.635+0000 7f05e27fc640 1 --2- 172.21.15.19:0/1952139820 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f05e4098c70 0x7f05e41cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:39.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.635+0000 7f05e27fc640 1 -- 172.21.15.19:0/1952139820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05e413a680 msgr2=0x7f05e41cf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:39.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.635+0000 7f05e27fc640 1 --2- 172.21.15.19:0/1952139820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05e413a680 0x7f05e41cf6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:39.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.635+0000 7f05e27fc640 1 -- 172.21.15.19:0/1952139820 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05cc0094d0 con 0x7f05e40995d0 2023-11-04T15:27:39.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.635+0000 7f05e37fe640 1 --2- 172.21.15.19:0/1952139820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05e413a680 0x7f05e41cf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T15:27:39.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.635+0000 7f05e2ffd640 1 --2- 172.21.15.19:0/1952139820 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f05e4098c70 0x7f05e41cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T15:27:39.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.635+0000 7f05e27fc640 1 --2- 172.21.15.19:0/1952139820 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05e40995d0 0x7f05e41cf190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f05cc000c00 tx=0x7f05cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:39.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.635+0000 7f05dbfff640 1 -- 172.21.15.19:0/1952139820 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc032880 con 0x7f05e40995d0 2023-11-04T15:27:39.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.635+0000 7f05dbfff640 1 -- 172.21.15.19:0/1952139820 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05cc032a20 con 0x7f05e40995d0 2023-11-04T15:27:39.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.635+0000 7f05e9887640 1 -- 172.21.15.19:0/1952139820 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e411eee0 con 0x7f05e40995d0 2023-11-04T15:27:39.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.635+0000 7f05dbfff640 1 -- 172.21.15.19:0/1952139820 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc032dd0 con 0x7f05e40995d0 2023-11-04T15:27:39.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.635+0000 7f05e9887640 1 -- 172.21.15.19:0/1952139820 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e411fb50 con 0x7f05e40995d0 2023-11-04T15:27:39.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.636+0000 7f05e9887640 1 -- 172.21.15.19:0/1952139820 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e4067d60 con 0x7f05e40995d0 2023-11-04T15:27:39.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.636+0000 7f05dbfff640 1 -- 172.21.15.19:0/1952139820 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f05cc04e450 con 0x7f05e40995d0 2023-11-04T15:27:39.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.637+0000 7f05dbfff640 1 --2- 172.21.15.19:0/1952139820 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f05c406a430 0x7f05c406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:39.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.637+0000 7f05dbfff640 1 -- 172.21.15.19:0/1952139820 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f05cc0aa490 con 0x7f05e40995d0 2023-11-04T15:27:39.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.637+0000 7f05e2ffd640 1 --2- 172.21.15.19:0/1952139820 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f05c406a430 0x7f05c406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:39.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.638+0000 7f05e2ffd640 1 --2- 172.21.15.19:0/1952139820 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f05c406a430 0x7f05c406c8f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f05d4009ed0 tx=0x7f05d400b040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:39.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.641+0000 7f05dbfff640 1 -- 172.21.15.19:0/1952139820 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f05cc076130 con 0x7f05e40995d0 2023-11-04T15:27:39.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.818+0000 7f05e9887640 1 -- 172.21.15.19:0/1952139820 --> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f05e406eb90 con 0x7f05c406a430 2023-11-04T15:27:39.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.825+0000 7f05dbfff640 1 -- 172.21.15.19:0/1952139820 <== mgr.4114 v2:172.21.15.96:6816/83123 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+261519 (secure 0 0 0) 0x7f05d4009ae0 con 0x7f05c406a430 2023-11-04T15:27:39.831 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:27:39.834 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-11-04T15:27:39.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.827+0000 7f05e9887640 1 -- 172.21.15.19:0/1952139820 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f05c406a430 msgr2=0x7f05c406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:39.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.827+0000 7f05e9887640 1 --2- 172.21.15.19:0/1952139820 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f05c406a430 0x7f05c406c8f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f05d4009ed0 tx=0x7f05d400b040 comp rx=0 tx=0).stop 2023-11-04T15:27:39.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.827+0000 7f05e9887640 1 -- 172.21.15.19:0/1952139820 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05e40995d0 msgr2=0x7f05e41cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:39.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.827+0000 7f05e9887640 1 --2- 172.21.15.19:0/1952139820 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05e40995d0 0x7f05e41cf190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f05cc000c00 tx=0x7f05cc0046c0 comp rx=0 tx=0).stop 2023-11-04T15:27:39.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.827+0000 7f05e9887640 1 -- 172.21.15.19:0/1952139820 shutdown_connections 2023-11-04T15:27:39.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.827+0000 7f05e9887640 1 --2- 172.21.15.19:0/1952139820 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f05c406a430 0x7f05c406c8f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:39.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.827+0000 7f05e9887640 1 --2- 172.21.15.19:0/1952139820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05e413a680 0x7f05e41cf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:39.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.827+0000 7f05e9887640 1 --2- 172.21.15.19:0/1952139820 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05e40995d0 0x7f05e41cf190 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:39.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.827+0000 7f05e9887640 1 --2- 172.21.15.19:0/1952139820 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f05e4098c70 0x7f05e41cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:39.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.827+0000 7f05e9887640 1 -- 172.21.15.19:0/1952139820 >> 172.21.15.19:0/1952139820 conn(0x7f05e406a090 msgr2=0x7f05e41c1780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:39.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.828+0000 7f05e9887640 1 -- 172.21.15.19:0/1952139820 shutdown_connections 2023-11-04T15:27:39.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:39.828+0000 7f05e9887640 1 -- 172.21.15.19:0/1952139820 wait complete. 2023-11-04T15:27:39.840 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-11-04T15:27:38.934881+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109488,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":107776,"kb_avail":377377872,"statfs":{"total":386547056640,"available":386434940928,"internally_reserved":0,"allocated":1720320,"data_stored":1349154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110362624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.186690"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751301+0000","last_change":"2023-11-04T15:27:34.751301+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751301+0000","last_undegraded":"2023-11-04T15:27:34.751301+0000","last_fullsized":"2023-11-04T15:27:34.751301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:14:34.175377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.752559+0000","last_change":"2023-11-04T15:27:34.752559+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.752559+0000","last_undegraded":"2023-11-04T15:27:34.752559+0000","last_fullsized":"2023-11-04T15:27:34.752559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:11:01.495068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751681+0000","last_change":"2023-11-04T15:27:34.751681+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751681+0000","last_undegraded":"2023-11-04T15:27:34.751681+0000","last_fullsized":"2023-11-04T15:27:34.751681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:44:09.266115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.752833+0000","last_change":"2023-11-04T15:27:34.752833+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.752833+0000","last_undegraded":"2023-11-04T15:27:34.752833+0000","last_fullsized":"2023-11-04T15:27:34.752833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:02:27.460776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750349+0000","last_change":"2023-11-04T15:27:34.750349+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750349+0000","last_undegraded":"2023-11-04T15:27:34.750349+0000","last_fullsized":"2023-11-04T15:27:34.750349+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:11:01.495068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750465+0000","last_change":"2023-11-04T15:27:34.750465+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750465+0000","last_undegraded":"2023-11-04T15:27:34.750465+0000","last_fullsized":"2023-11-04T15:27:34.750465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:02:11.972760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750140+0000","last_change":"2023-11-04T15:27:34.750140+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750140+0000","last_undegraded":"2023-11-04T15:27:34.750140+0000","last_fullsized":"2023-11-04T15:27:34.750140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:52:13.268866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750531+0000","last_change":"2023-11-04T15:27:34.750531+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750531+0000","last_undegraded":"2023-11-04T15:27:34.750531+0000","last_fullsized":"2023-11-04T15:27:34.750531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:42:49.218866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751147+0000","last_change":"2023-11-04T15:27:34.751147+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751147+0000","last_undegraded":"2023-11-04T15:27:34.751147+0000","last_fullsized":"2023-11-04T15:27:34.751147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:42:49.218866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751324+0000","last_change":"2023-11-04T15:27:34.751324+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751324+0000","last_undegraded":"2023-11-04T15:27:34.751324+0000","last_fullsized":"2023-11-04T15:27:34.751324+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:30:45.293294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750154+0000","last_change":"2023-11-04T15:27:34.750154+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750154+0000","last_undegraded":"2023-11-04T15:27:34.750154+0000","last_fullsized":"2023-11-04T15:27:34.750154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:17:14.527023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751114+0000","last_change":"2023-11-04T15:27:34.751114+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751114+0000","last_undegraded":"2023-11-04T15:27:34.751114+0000","last_fullsized":"2023-11-04T15:27:34.751114+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:01:29.923726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":164,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-11-04T15:27:32.618980+0000","last_change":"2023-11-04T15:27:26.267129+0000","last_active":"2023-11-04T15:27:32.618980+0000","last_peered":"2023-11-04T15:27:32.618980+0000","last_clean":"2023-11-04T15:27:32.618980+0000","last_became_active":"2023-11-04T15:27:26.266242+0000","last_became_peered":"2023-11-04T15:27:26.266242+0000","last_unstale":"2023-11-04T15:27:32.618980+0000","last_undegraded":"2023-11-04T15:27:32.618980+0000","last_fullsized":"2023-11-04T15:27:32.618980+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:25.163848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:25.163848+0000","last_clean_scrub_stamp":"2023-11-04T15:27:25.163848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:54:55.231471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-04T15:27:34.753914+0000","last_change":"2023-11-04T15:27:31.620178+0000","last_active":"2023-11-04T15:27:34.753914+0000","last_peered":"2023-11-04T15:27:34.753914+0000","last_clean":"2023-11-04T15:27:34.753914+0000","last_became_active":"2023-11-04T15:27:31.619798+0000","last_became_peered":"2023-11-04T15:27:31.619798+0000","last_unstale":"2023-11-04T15:27:34.753914+0000","last_undegraded":"2023-11-04T15:27:34.753914+0000","last_fullsized":"2023-11-04T15:27:34.753914+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:50:31.717109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750413+0000","last_change":"2023-11-04T15:27:34.750413+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750413+0000","last_undegraded":"2023-11-04T15:27:34.750413+0000","last_fullsized":"2023-11-04T15:27:34.750413+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:15:19.151223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-04T15:27:34.754064+0000","last_change":"2023-11-04T15:27:31.622106+0000","last_active":"2023-11-04T15:27:34.754064+0000","last_peered":"2023-11-04T15:27:34.754064+0000","last_clean":"2023-11-04T15:27:34.754064+0000","last_became_active":"2023-11-04T15:27:31.621889+0000","last_became_peered":"2023-11-04T15:27:31.621889+0000","last_unstale":"2023-11-04T15:27:34.754064+0000","last_undegraded":"2023-11-04T15:27:34.754064+0000","last_fullsized":"2023-11-04T15:27:34.754064+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:11:00.327441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.752728+0000","last_change":"2023-11-04T15:27:34.752728+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.752728+0000","last_undegraded":"2023-11-04T15:27:34.752728+0000","last_fullsized":"2023-11-04T15:27:34.752728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:23:45.371175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-04T15:27:34.749776+0000","last_change":"2023-11-04T15:27:31.622710+0000","last_active":"2023-11-04T15:27:34.749776+0000","last_peered":"2023-11-04T15:27:34.749776+0000","last_clean":"2023-11-04T15:27:34.749776+0000","last_became_active":"2023-11-04T15:27:31.622378+0000","last_became_peered":"2023-11-04T15:27:31.622378+0000","last_unstale":"2023-11-04T15:27:34.749776+0000","last_undegraded":"2023-11-04T15:27:34.749776+0000","last_fullsized":"2023-11-04T15:27:34.749776+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:49:04.803105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750394+0000","last_change":"2023-11-04T15:27:34.750394+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750394+0000","last_undegraded":"2023-11-04T15:27:34.750394+0000","last_fullsized":"2023-11-04T15:27:34.750394+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:44:38.690122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-04T15:27:34.753879+0000","last_change":"2023-11-04T15:27:31.622105+0000","last_active":"2023-11-04T15:27:34.753879+0000","last_peered":"2023-11-04T15:27:34.753879+0000","last_clean":"2023-11-04T15:27:34.753879+0000","last_became_active":"2023-11-04T15:27:31.621849+0000","last_became_peered":"2023-11-04T15:27:31.621849+0000","last_unstale":"2023-11-04T15:27:34.753879+0000","last_undegraded":"2023-11-04T15:27:34.753879+0000","last_fullsized":"2023-11-04T15:27:34.753879+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:20:41.777316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750556+0000","last_change":"2023-11-04T15:27:34.750556+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750556+0000","last_undegraded":"2023-11-04T15:27:34.750556+0000","last_fullsized":"2023-11-04T15:27:34.750556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:08:22.991334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750286+0000","last_change":"2023-11-04T15:27:34.750286+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750286+0000","last_undegraded":"2023-11-04T15:27:34.750286+0000","last_fullsized":"2023-11-04T15:27:34.750286+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:00:20.246822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-04T15:27:34.749830+0000","last_change":"2023-11-04T15:27:31.622663+0000","last_active":"2023-11-04T15:27:34.749830+0000","last_peered":"2023-11-04T15:27:34.749830+0000","last_clean":"2023-11-04T15:27:34.749830+0000","last_became_active":"2023-11-04T15:27:31.622350+0000","last_became_peered":"2023-11-04T15:27:31.622350+0000","last_unstale":"2023-11-04T15:27:34.749830+0000","last_undegraded":"2023-11-04T15:27:34.749830+0000","last_fullsized":"2023-11-04T15:27:34.749830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:31:02.273249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750413+0000","last_change":"2023-11-04T15:27:34.750413+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750413+0000","last_undegraded":"2023-11-04T15:27:34.750413+0000","last_fullsized":"2023-11-04T15:27:34.750413+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T22:02:04.025848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-04T15:27:34.754163+0000","last_change":"2023-11-04T15:27:31.619973+0000","last_active":"2023-11-04T15:27:34.754163+0000","last_peered":"2023-11-04T15:27:34.754163+0000","last_clean":"2023-11-04T15:27:34.754163+0000","last_became_active":"2023-11-04T15:27:31.619702+0000","last_became_peered":"2023-11-04T15:27:31.619702+0000","last_unstale":"2023-11-04T15:27:34.754163+0000","last_undegraded":"2023-11-04T15:27:34.754163+0000","last_fullsized":"2023-11-04T15:27:34.754163+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:24:34.782619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750459+0000","last_change":"2023-11-04T15:27:34.750459+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750459+0000","last_undegraded":"2023-11-04T15:27:34.750459+0000","last_fullsized":"2023-11-04T15:27:34.750459+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:14:58.601545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-04T15:27:34.749800+0000","last_change":"2023-11-04T15:27:31.624625+0000","last_active":"2023-11-04T15:27:34.749800+0000","last_peered":"2023-11-04T15:27:34.749800+0000","last_clean":"2023-11-04T15:27:34.749800+0000","last_became_active":"2023-11-04T15:27:31.624347+0000","last_became_peered":"2023-11-04T15:27:31.624347+0000","last_unstale":"2023-11-04T15:27:34.749800+0000","last_undegraded":"2023-11-04T15:27:34.749800+0000","last_fullsized":"2023-11-04T15:27:34.749800+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:53:45.131692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.752693+0000","last_change":"2023-11-04T15:27:34.752693+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.752693+0000","last_undegraded":"2023-11-04T15:27:34.752693+0000","last_fullsized":"2023-11-04T15:27:34.752693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:58:09.475936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-04T15:27:34.754149+0000","last_change":"2023-11-04T15:27:31.620235+0000","last_active":"2023-11-04T15:27:34.754149+0000","last_peered":"2023-11-04T15:27:34.754149+0000","last_clean":"2023-11-04T15:27:34.754149+0000","last_became_active":"2023-11-04T15:27:31.619831+0000","last_became_peered":"2023-11-04T15:27:31.619831+0000","last_unstale":"2023-11-04T15:27:34.754149+0000","last_undegraded":"2023-11-04T15:27:34.754149+0000","last_fullsized":"2023-11-04T15:27:34.754149+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:44:07.412379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751515+0000","last_change":"2023-11-04T15:27:34.751515+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751515+0000","last_undegraded":"2023-11-04T15:27:34.751515+0000","last_fullsized":"2023-11-04T15:27:34.751515+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:36:12.941030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751488+0000","last_change":"2023-11-04T15:27:34.751488+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751488+0000","last_undegraded":"2023-11-04T15:27:34.751488+0000","last_fullsized":"2023-11-04T15:27:34.751488+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:58:09.475936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751729+0000","last_change":"2023-11-04T15:27:34.751729+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751729+0000","last_undegraded":"2023-11-04T15:27:34.751729+0000","last_fullsized":"2023-11-04T15:27:34.751729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:23:45.371175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.752775+0000","last_change":"2023-11-04T15:27:34.752775+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.752775+0000","last_undegraded":"2023-11-04T15:27:34.752775+0000","last_fullsized":"2023-11-04T15:27:34.752775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:14:58.601545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751810+0000","last_change":"2023-11-04T15:27:34.751810+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751810+0000","last_undegraded":"2023-11-04T15:27:34.751810+0000","last_fullsized":"2023-11-04T15:27:34.751810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:03:49.354013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751672+0000","last_change":"2023-11-04T15:27:34.751672+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751672+0000","last_undegraded":"2023-11-04T15:27:34.751672+0000","last_fullsized":"2023-11-04T15:27:34.751672+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:55:22.956180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750521+0000","last_change":"2023-11-04T15:27:34.750521+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750521+0000","last_undegraded":"2023-11-04T15:27:34.750521+0000","last_fullsized":"2023-11-04T15:27:34.750521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:14:58.601545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.752683+0000","last_change":"2023-11-04T15:27:34.752683+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.752683+0000","last_undegraded":"2023-11-04T15:27:34.752683+0000","last_fullsized":"2023-11-04T15:27:34.752683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:00:20.246822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750251+0000","last_change":"2023-11-04T15:27:34.750251+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750251+0000","last_undegraded":"2023-11-04T15:27:34.750251+0000","last_fullsized":"2023-11-04T15:27:34.750251+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:47:47.130490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751865+0000","last_change":"2023-11-04T15:27:34.751865+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751865+0000","last_undegraded":"2023-11-04T15:27:34.751865+0000","last_fullsized":"2023-11-04T15:27:34.751865+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:13:42.865721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.753557+0000","last_change":"2023-11-04T15:27:34.753557+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.753557+0000","last_undegraded":"2023-11-04T15:27:34.753557+0000","last_fullsized":"2023-11-04T15:27:34.753557+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:02:11.972760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.753707+0000","last_change":"2023-11-04T15:27:34.753707+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.753707+0000","last_undegraded":"2023-11-04T15:27:34.753707+0000","last_fullsized":"2023-11-04T15:27:34.753707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:08:22.991334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":716,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":733184,"data_stored":635804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]}]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27080,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344760,"statfs":{"total":96636764160,"available":96609034240,"internally_reserved":0,"allocated":131072,"data_stored":40994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27080,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344760,"statfs":{"total":96636764160,"available":96609034240,"internally_reserved":0,"allocated":131072,"data_stored":40994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":724992,"data_stored":631362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T15:27:39.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2023-11-04T15:27:39.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2023-11-04T15:27:39.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3d is not active+clean 2023-11-04T15:27:39.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2023-11-04T15:27:39.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3b is not active+clean 2023-11-04T15:27:39.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2023-11-04T15:27:39.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2023-11-04T15:27:39.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.38 is not active+clean 2023-11-04T15:27:39.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.37 is not active+clean 2023-11-04T15:27:39.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.36 is not active+clean 2023-11-04T15:27:39.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.35 is not active+clean 2023-11-04T15:27:39.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2023-11-04T15:27:39.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.33 is not active+clean 2023-11-04T15:27:39.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.32 is not active+clean 2023-11-04T15:27:39.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.31 is not active+clean 2023-11-04T15:27:39.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2023-11-04T15:27:39.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.858 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2f is not active+clean 2023-11-04T15:27:39.858 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.859 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2e is not active+clean 2023-11-04T15:27:39.859 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.859 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2023-11-04T15:27:39.859 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.860 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2c is not active+clean 2023-11-04T15:27:39.860 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.861 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2b is not active+clean 2023-11-04T15:27:39.861 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.861 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2a is not active+clean 2023-11-04T15:27:39.862 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.862 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2023-11-04T15:27:39.862 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.863 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.28 is not active+clean 2023-11-04T15:27:39.864 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.864 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.27 is not active+clean 2023-11-04T15:27:39.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.865 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.26 is not active+clean 2023-11-04T15:27:39.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.866 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2023-11-04T15:27:39.866 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.867 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.24 is not active+clean 2023-11-04T15:27:39.867 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.867 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2023-11-04T15:27:39.868 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.868 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.22 is not active+clean 2023-11-04T15:27:39.868 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.869 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2023-11-04T15:27:39.869 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.870 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.20 is not active+clean 2023-11-04T15:27:39.870 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.871 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2023-11-04T15:27:39.871 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.871 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2023-11-04T15:27:39.872 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-04T15:27:34.751301+0000', 'last_change': '2023-11-04T15:27:34.751301+0000', 'last_active': '2023-11-04T15:27:34.743438+0000', 'last_peered': '2023-11-04T15:27:34.743438+0000', 'last_clean': '2023-11-04T15:27:34.743438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:34.751301+0000', 'last_undegraded': '2023-11-04T15:27:34.751301+0000', 'last_fullsized': '2023-11-04T15:27:34.751301+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-05T18:14:34.175377+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-04T15:27:39.872 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2023-11-04T15:27:39.872 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.873 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2023-11-04T15:27:39.873 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-04T15:27:34.752559+0000', 'last_change': '2023-11-04T15:27:34.752559+0000', 'last_active': '2023-11-04T15:27:34.743438+0000', 'last_peered': '2023-11-04T15:27:34.743438+0000', 'last_clean': '2023-11-04T15:27:34.743438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:34.752559+0000', 'last_undegraded': '2023-11-04T15:27:34.752559+0000', 'last_fullsized': '2023-11-04T15:27:34.752559+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-06T00:11:01.495068+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T15:27:39.873 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2023-11-04T15:27:39.874 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.874 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2023-11-04T15:27:39.875 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-04T15:27:34.751681+0000', 'last_change': '2023-11-04T15:27:34.751681+0000', 'last_active': '2023-11-04T15:27:34.743438+0000', 'last_peered': '2023-11-04T15:27:34.743438+0000', 'last_clean': '2023-11-04T15:27:34.743438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:34.751681+0000', 'last_undegraded': '2023-11-04T15:27:34.751681+0000', 'last_fullsized': '2023-11-04T15:27:34.751681+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-05T16:44:09.266115+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-04T15:27:39.875 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2023-11-04T15:27:39.875 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.876 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2023-11-04T15:27:39.876 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-04T15:27:34.752833+0000', 'last_change': '2023-11-04T15:27:34.752833+0000', 'last_active': '2023-11-04T15:27:34.743438+0000', 'last_peered': '2023-11-04T15:27:34.743438+0000', 'last_clean': '2023-11-04T15:27:34.743438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:34.752833+0000', 'last_undegraded': '2023-11-04T15:27:34.752833+0000', 'last_fullsized': '2023-11-04T15:27:34.752833+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-05T21:02:27.460776+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-04T15:27:39.876 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2023-11-04T15:27:39.877 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-04T15:27:34.750349+0000', 'last_change': '2023-11-04T15:27:34.750349+0000', 'last_active': '2023-11-04T15:27:34.743438+0000', 'last_peered': '2023-11-04T15:27:34.743438+0000', 'last_clean': '2023-11-04T15:27:34.743438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:34.750349+0000', 'last_undegraded': '2023-11-04T15:27:34.750349+0000', 'last_fullsized': '2023-11-04T15:27:34.750349+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-06T00:11:01.495068+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T15:27:39.877 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2023-11-04T15:27:39.878 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.878 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2023-11-04T15:27:39.878 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-04T15:27:34.750465+0000', 'last_change': '2023-11-04T15:27:34.750465+0000', 'last_active': '2023-11-04T15:27:34.743438+0000', 'last_peered': '2023-11-04T15:27:34.743438+0000', 'last_clean': '2023-11-04T15:27:34.743438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:34.750465+0000', 'last_undegraded': '2023-11-04T15:27:34.750465+0000', 'last_fullsized': '2023-11-04T15:27:34.750465+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-05T20:02:11.972760+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T15:27:39.879 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2023-11-04T15:27:39.880 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.880 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2023-11-04T15:27:39.881 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-04T15:27:34.750140+0000', 'last_change': '2023-11-04T15:27:34.750140+0000', 'last_active': '2023-11-04T15:27:34.743438+0000', 'last_peered': '2023-11-04T15:27:34.743438+0000', 'last_clean': '2023-11-04T15:27:34.743438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:34.750140+0000', 'last_undegraded': '2023-11-04T15:27:34.750140+0000', 'last_fullsized': '2023-11-04T15:27:34.750140+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-05T19:52:13.268866+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-04T15:27:39.881 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2023-11-04T15:27:39.881 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.882 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2023-11-04T15:27:39.882 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-04T15:27:34.750531+0000', 'last_change': '2023-11-04T15:27:34.750531+0000', 'last_active': '2023-11-04T15:27:34.743438+0000', 'last_peered': '2023-11-04T15:27:34.743438+0000', 'last_clean': '2023-11-04T15:27:34.743438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:34.750531+0000', 'last_undegraded': '2023-11-04T15:27:34.750531+0000', 'last_fullsized': '2023-11-04T15:27:34.750531+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-05T20:42:49.218866+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-04T15:27:39.883 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2023-11-04T15:27:39.883 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.884 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2023-11-04T15:27:39.884 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-04T15:27:34.751147+0000', 'last_change': '2023-11-04T15:27:34.751147+0000', 'last_active': '2023-11-04T15:27:34.743438+0000', 'last_peered': '2023-11-04T15:27:34.743438+0000', 'last_clean': '2023-11-04T15:27:34.743438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:34.751147+0000', 'last_undegraded': '2023-11-04T15:27:34.751147+0000', 'last_fullsized': '2023-11-04T15:27:34.751147+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-05T20:42:49.218866+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T15:27:39.884 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2023-11-04T15:27:39.885 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2023-11-04T15:27:39.885 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-04T15:27:34.751324+0000', 'last_change': '2023-11-04T15:27:34.751324+0000', 'last_active': '2023-11-04T15:27:34.743438+0000', 'last_peered': '2023-11-04T15:27:34.743438+0000', 'last_clean': '2023-11-04T15:27:34.743438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:34.751324+0000', 'last_undegraded': '2023-11-04T15:27:34.751324+0000', 'last_fullsized': '2023-11-04T15:27:34.751324+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-06T00:30:45.293294+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-04T15:27:39.886 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2023-11-04T15:27:39.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2023-11-04T15:27:39.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-04T15:27:34.750154+0000', 'last_change': '2023-11-04T15:27:34.750154+0000', 'last_active': '2023-11-04T15:27:34.743438+0000', 'last_peered': '2023-11-04T15:27:34.743438+0000', 'last_clean': '2023-11-04T15:27:34.743438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:34.750154+0000', 'last_undegraded': '2023-11-04T15:27:34.750154+0000', 'last_fullsized': '2023-11-04T15:27:34.750154+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-05T17:17:14.527023+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-04T15:27:39.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2023-11-04T15:27:39.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2023-11-04T15:27:39.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-04T15:27:34.751114+0000', 'last_change': '2023-11-04T15:27:34.751114+0000', 'last_active': '2023-11-04T15:27:34.743438+0000', 'last_peered': '2023-11-04T15:27:34.743438+0000', 'last_clean': '2023-11-04T15:27:34.743438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:34.751114+0000', 'last_undegraded': '2023-11-04T15:27:34.751114+0000', 'last_fullsized': '2023-11-04T15:27:34.751114+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-05T18:01:29.923726+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T15:27:39.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2023-11-04T15:27:39.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2023-11-04T15:27:39.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-04T15:27:34.750413+0000', 'last_change': '2023-11-04T15:27:34.750413+0000', 'last_active': '2023-11-04T15:27:34.743438+0000', 'last_peered': '2023-11-04T15:27:34.743438+0000', 'last_clean': '2023-11-04T15:27:34.743438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:34.750413+0000', 'last_undegraded': '2023-11-04T15:27:34.750413+0000', 'last_fullsized': '2023-11-04T15:27:34.750413+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-05T19:15:19.151223+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T15:27:39.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2023-11-04T15:27:39.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2023-11-04T15:27:39.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-04T15:27:34.752728+0000', 'last_change': '2023-11-04T15:27:34.752728+0000', 'last_active': '2023-11-04T15:27:34.743438+0000', 'last_peered': '2023-11-04T15:27:34.743438+0000', 'last_clean': '2023-11-04T15:27:34.743438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:34.752728+0000', 'last_undegraded': '2023-11-04T15:27:34.752728+0000', 'last_fullsized': '2023-11-04T15:27:34.752728+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-06T03:23:45.371175+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T15:27:39.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2023-11-04T15:27:39.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.893 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2023-11-04T15:27:39.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-04T15:27:34.750394+0000', 'last_change': '2023-11-04T15:27:34.750394+0000', 'last_active': '2023-11-04T15:27:34.743438+0000', 'last_peered': '2023-11-04T15:27:34.743438+0000', 'last_clean': '2023-11-04T15:27:34.743438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:34.750394+0000', 'last_undegraded': '2023-11-04T15:27:34.750394+0000', 'last_fullsized': '2023-11-04T15:27:34.750394+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-06T00:44:38.690122+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T15:27:39.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2023-11-04T15:27:39.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2023-11-04T15:27:39.895 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-04T15:27:34.750556+0000', 'last_change': '2023-11-04T15:27:34.750556+0000', 'last_active': '2023-11-04T15:27:34.743438+0000', 'last_peered': '2023-11-04T15:27:34.743438+0000', 'last_clean': '2023-11-04T15:27:34.743438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:34.750556+0000', 'last_undegraded': '2023-11-04T15:27:34.750556+0000', 'last_fullsized': '2023-11-04T15:27:34.750556+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-05T16:08:22.991334+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T15:27:39.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2023-11-04T15:27:39.895 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.896 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2023-11-04T15:27:39.896 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-04T15:27:34.750286+0000', 'last_change': '2023-11-04T15:27:34.750286+0000', 'last_active': '2023-11-04T15:27:34.743438+0000', 'last_peered': '2023-11-04T15:27:34.743438+0000', 'last_clean': '2023-11-04T15:27:34.743438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:34.750286+0000', 'last_undegraded': '2023-11-04T15:27:34.750286+0000', 'last_fullsized': '2023-11-04T15:27:34.750286+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-06T02:00:20.246822+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T15:27:39.897 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2023-11-04T15:27:39.897 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.898 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2023-11-04T15:27:39.898 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-04T15:27:34.750413+0000', 'last_change': '2023-11-04T15:27:34.750413+0000', 'last_active': '2023-11-04T15:27:34.743438+0000', 'last_peered': '2023-11-04T15:27:34.743438+0000', 'last_clean': '2023-11-04T15:27:34.743438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:34.750413+0000', 'last_undegraded': '2023-11-04T15:27:34.750413+0000', 'last_fullsized': '2023-11-04T15:27:34.750413+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-05T22:02:04.025848+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T15:27:39.898 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2023-11-04T15:27:39.899 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.899 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2023-11-04T15:27:39.899 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-04T15:27:34.750459+0000', 'last_change': '2023-11-04T15:27:34.750459+0000', 'last_active': '2023-11-04T15:27:34.743438+0000', 'last_peered': '2023-11-04T15:27:34.743438+0000', 'last_clean': '2023-11-04T15:27:34.743438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:34.750459+0000', 'last_undegraded': '2023-11-04T15:27:34.750459+0000', 'last_fullsized': '2023-11-04T15:27:34.750459+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-05T19:14:58.601545+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T15:27:39.900 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2023-11-04T15:27:39.900 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.901 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2023-11-04T15:27:39.901 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-04T15:27:34.752693+0000', 'last_change': '2023-11-04T15:27:34.752693+0000', 'last_active': '2023-11-04T15:27:34.743438+0000', 'last_peered': '2023-11-04T15:27:34.743438+0000', 'last_clean': '2023-11-04T15:27:34.743438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:34.752693+0000', 'last_undegraded': '2023-11-04T15:27:34.752693+0000', 'last_fullsized': '2023-11-04T15:27:34.752693+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-06T01:58:09.475936+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T15:27:39.901 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2023-11-04T15:27:39.902 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.902 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2023-11-04T15:27:39.902 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.903 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2023-11-04T15:27:39.903 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-04T15:27:34.751515+0000', 'last_change': '2023-11-04T15:27:34.751515+0000', 'last_active': '2023-11-04T15:27:34.743438+0000', 'last_peered': '2023-11-04T15:27:34.743438+0000', 'last_clean': '2023-11-04T15:27:34.743438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:34.751515+0000', 'last_undegraded': '2023-11-04T15:27:34.751515+0000', 'last_fullsized': '2023-11-04T15:27:34.751515+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-05T15:36:12.941030+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-04T15:27:39.903 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2023-11-04T15:27:39.904 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.904 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2023-11-04T15:27:39.904 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-04T15:27:34.751488+0000', 'last_change': '2023-11-04T15:27:34.751488+0000', 'last_active': '2023-11-04T15:27:34.743438+0000', 'last_peered': '2023-11-04T15:27:34.743438+0000', 'last_clean': '2023-11-04T15:27:34.743438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:34.751488+0000', 'last_undegraded': '2023-11-04T15:27:34.751488+0000', 'last_fullsized': '2023-11-04T15:27:34.751488+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-06T01:58:09.475936+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T15:27:39.905 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2023-11-04T15:27:39.905 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-04T15:27:34.751729+0000', 'last_change': '2023-11-04T15:27:34.751729+0000', 'last_active': '2023-11-04T15:27:34.743438+0000', 'last_peered': '2023-11-04T15:27:34.743438+0000', 'last_clean': '2023-11-04T15:27:34.743438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:34.751729+0000', 'last_undegraded': '2023-11-04T15:27:34.751729+0000', 'last_fullsized': '2023-11-04T15:27:34.751729+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-06T03:23:45.371175+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T15:27:39.906 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2023-11-04T15:27:39.906 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.906 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2023-11-04T15:27:39.907 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-04T15:27:34.752775+0000', 'last_change': '2023-11-04T15:27:34.752775+0000', 'last_active': '2023-11-04T15:27:34.743438+0000', 'last_peered': '2023-11-04T15:27:34.743438+0000', 'last_clean': '2023-11-04T15:27:34.743438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:34.752775+0000', 'last_undegraded': '2023-11-04T15:27:34.752775+0000', 'last_fullsized': '2023-11-04T15:27:34.752775+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-05T19:14:58.601545+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T15:27:39.907 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2023-11-04T15:27:39.907 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.908 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2023-11-04T15:27:39.908 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.909 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2023-11-04T15:27:39.909 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-04T15:27:34.751810+0000', 'last_change': '2023-11-04T15:27:34.751810+0000', 'last_active': '2023-11-04T15:27:34.743438+0000', 'last_peered': '2023-11-04T15:27:34.743438+0000', 'last_clean': '2023-11-04T15:27:34.743438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:34.751810+0000', 'last_undegraded': '2023-11-04T15:27:34.751810+0000', 'last_fullsized': '2023-11-04T15:27:34.751810+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-05T16:03:49.354013+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T15:27:39.910 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2023-11-04T15:27:39.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.910 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2023-11-04T15:27:39.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-04T15:27:34.751672+0000', 'last_change': '2023-11-04T15:27:34.751672+0000', 'last_active': '2023-11-04T15:27:34.743438+0000', 'last_peered': '2023-11-04T15:27:34.743438+0000', 'last_clean': '2023-11-04T15:27:34.743438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:34.751672+0000', 'last_undegraded': '2023-11-04T15:27:34.751672+0000', 'last_fullsized': '2023-11-04T15:27:34.751672+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-06T01:55:22.956180+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T15:27:39.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2023-11-04T15:27:39.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2023-11-04T15:27:39.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-04T15:27:34.750521+0000', 'last_change': '2023-11-04T15:27:34.750521+0000', 'last_active': '2023-11-04T15:27:34.743438+0000', 'last_peered': '2023-11-04T15:27:34.743438+0000', 'last_clean': '2023-11-04T15:27:34.743438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:34.750521+0000', 'last_undegraded': '2023-11-04T15:27:34.750521+0000', 'last_fullsized': '2023-11-04T15:27:34.750521+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-05T19:14:58.601545+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T15:27:39.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2023-11-04T15:27:39.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2023-11-04T15:27:39.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-04T15:27:34.752683+0000', 'last_change': '2023-11-04T15:27:34.752683+0000', 'last_active': '2023-11-04T15:27:34.743438+0000', 'last_peered': '2023-11-04T15:27:34.743438+0000', 'last_clean': '2023-11-04T15:27:34.743438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:34.752683+0000', 'last_undegraded': '2023-11-04T15:27:34.752683+0000', 'last_fullsized': '2023-11-04T15:27:34.752683+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-06T02:00:20.246822+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T15:27:39.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2023-11-04T15:27:39.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.915 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2023-11-04T15:27:39.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-04T15:27:34.750251+0000', 'last_change': '2023-11-04T15:27:34.750251+0000', 'last_active': '2023-11-04T15:27:34.743438+0000', 'last_peered': '2023-11-04T15:27:34.743438+0000', 'last_clean': '2023-11-04T15:27:34.743438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:34.750251+0000', 'last_undegraded': '2023-11-04T15:27:34.750251+0000', 'last_fullsized': '2023-11-04T15:27:34.750251+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-05T18:47:47.130490+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T15:27:39.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2023-11-04T15:27:39.916 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2023-11-04T15:27:39.917 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-04T15:27:34.751865+0000', 'last_change': '2023-11-04T15:27:34.751865+0000', 'last_active': '2023-11-04T15:27:34.743438+0000', 'last_peered': '2023-11-04T15:27:34.743438+0000', 'last_clean': '2023-11-04T15:27:34.743438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:34.751865+0000', 'last_undegraded': '2023-11-04T15:27:34.751865+0000', 'last_fullsized': '2023-11-04T15:27:34.751865+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-05T16:13:42.865721+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-04T15:27:39.917 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2023-11-04T15:27:39.917 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.918 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2023-11-04T15:27:39.918 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-04T15:27:34.753557+0000', 'last_change': '2023-11-04T15:27:34.753557+0000', 'last_active': '2023-11-04T15:27:34.743438+0000', 'last_peered': '2023-11-04T15:27:34.743438+0000', 'last_clean': '2023-11-04T15:27:34.743438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:34.753557+0000', 'last_undegraded': '2023-11-04T15:27:34.753557+0000', 'last_fullsized': '2023-11-04T15:27:34.753557+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-05T20:02:11.972760+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T15:27:39.918 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2023-11-04T15:27:39.919 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T15:27:35.748092+0000', 'last_change': '2023-11-04T15:27:35.748092+0000', 'last_active': '2023-11-04T15:27:35.748092+0000', 'last_peered': '2023-11-04T15:27:35.748092+0000', 'last_clean': '2023-11-04T15:27:35.748092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:35.748092+0000', 'last_undegraded': '2023-11-04T15:27:35.748092+0000', 'last_fullsized': '2023-11-04T15:27:35.748092+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:35.748092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T15:27:39.919 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2023-11-04T15:27:39.920 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 16, 'state': 'creating+peering', 'last_fresh': '2023-11-04T15:27:34.753707+0000', 'last_change': '2023-11-04T15:27:34.753707+0000', 'last_active': '2023-11-04T15:27:34.743438+0000', 'last_peered': '2023-11-04T15:27:34.743438+0000', 'last_clean': '2023-11-04T15:27:34.743438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T15:27:34.753707+0000', 'last_undegraded': '2023-11-04T15:27:34.753707+0000', 'last_fullsized': '2023-11-04T15:27:34.753707+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'last_clean_scrub_stamp': '2023-11-04T15:27:34.743438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-05T16:08:22.991334+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T15:27:39.920 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-04T15:27:40.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.023+0000 7f36adeca640 1 Processor -- start 2023-11-04T15:27:40.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.023+0000 7f36adeca640 1 -- start start 2023-11-04T15:27:40.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.024+0000 7f36adeca640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f36a80a3e90 0x7f36a80a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:40.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.024+0000 7f36adeca640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a80a4c20 con 0x7f36a8137270 2023-11-04T15:27:40.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.024+0000 7f36adeca640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a813ad80 con 0x7f36a8137650 2023-11-04T15:27:40.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.024+0000 7f36adeca640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a80a3060 con 0x7f36a80a3e90 2023-11-04T15:27:40.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.024+0000 7f36a6ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f36a80a3e90 0x7f36a80a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:40.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.024+0000 7f36a77fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f36a8137270 0x7f36a8139f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60824/0 (socket says 172.21.15.19:60824) 2023-11-04T15:27:40.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.024+0000 7f36a77fe640 1 -- 172.21.15.19:0/1892046366 learned_addr learned my addr 172.21.15.19:0/1892046366 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:40.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.024+0000 7f36a6ffd640 1 -- 172.21.15.19:0/1892046366 >> v1:172.21.15.96:6789/0 conn(0x7f36a8137650 legacy=0x7f36a813a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:40.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.024+0000 7f36a6ffd640 1 -- 172.21.15.19:0/1892046366 >> v1:172.21.15.19:6789/0 conn(0x7f36a8137270 legacy=0x7f36a8139f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:40.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.024+0000 7f36a67fc640 1 -- 172.21.15.19:0/1892046366 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 909295198 0 0) 0x7f36a80a4c20 con 0x7f36a8137270 2023-11-04T15:27:40.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.024+0000 7f36a6ffd640 1 -- 172.21.15.19:0/1892046366 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a80a5080 con 0x7f36a80a3e90 2023-11-04T15:27:40.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.025+0000 7f36a6ffd640 1 --2- 172.21.15.19:0/1892046366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36a80a3e90 0x7f36a80a6200 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f369c0097a0 tx=0x7f369c02b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bf8e02b90a7bf7a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:40.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.025+0000 7f36a67fc640 1 -- 172.21.15.19:0/1892046366 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c02f050 con 0x7f36a80a3e90 2023-11-04T15:27:40.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.025+0000 7f36a67fc640 1 -- 172.21.15.19:0/1892046366 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369c031700 con 0x7f36a80a3e90 2023-11-04T15:27:40.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.025+0000 7f36a67fc640 1 -- 172.21.15.19:0/1892046366 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c031a90 con 0x7f36a80a3e90 2023-11-04T15:27:40.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.026+0000 7f36adeca640 1 -- 172.21.15.19:0/1892046366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36a80a3e90 msgr2=0x7f36a80a6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:40.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.026+0000 7f36adeca640 1 --2- 172.21.15.19:0/1892046366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36a80a3e90 0x7f36a80a6200 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f369c0097a0 tx=0x7f369c02b7a0 comp rx=0 tx=0).stop 2023-11-04T15:27:40.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.026+0000 7f36adeca640 1 -- 172.21.15.19:0/1892046366 shutdown_connections 2023-11-04T15:27:40.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.026+0000 7f36adeca640 1 --2- 172.21.15.19:0/1892046366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36a80a3e90 0x7f36a80a6200 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:40.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.026+0000 7f36adeca640 1 -- 172.21.15.19:0/1892046366 >> 172.21.15.19:0/1892046366 conn(0x7f36a80a8d70 msgr2=0x7f36a80a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:40.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.026+0000 7f36adeca640 1 -- 172.21.15.19:0/1892046366 shutdown_connections 2023-11-04T15:27:40.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.026+0000 7f36adeca640 1 -- 172.21.15.19:0/1892046366 wait complete. 2023-11-04T15:27:40.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.027+0000 7f36adeca640 1 Processor -- start 2023-11-04T15:27:40.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.027+0000 7f36adeca640 1 -- start start 2023-11-04T15:27:40.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.027+0000 7f36adeca640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36a80a3e90 0x7f36a81cef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:40.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.027+0000 7f36adeca640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36a8137270 0x7f36a81cf470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:40.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.027+0000 7f36adeca640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f36a8137650 0x7f36a81cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:40.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.027+0000 7f36adeca640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a809a580 con 0x7f36a80a3e90 2023-11-04T15:27:40.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.027+0000 7f36adeca640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a809b5c0 con 0x7f36a8137270 2023-11-04T15:27:40.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.027+0000 7f36adeca640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a809c6e0 con 0x7f36a8137650 2023-11-04T15:27:40.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.027+0000 7f36a77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36a80a3e90 0x7f36a81cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:40.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.028+0000 7f36a77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36a80a3e90 0x7f36a81cef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53540/0 (socket says 172.21.15.19:53540) 2023-11-04T15:27:40.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.028+0000 7f36a77fe640 1 -- 172.21.15.19:0/1551676763 learned_addr learned my addr 172.21.15.19:0/1551676763 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:40.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.028+0000 7f36a6ffd640 1 --2- 172.21.15.19:0/1551676763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36a8137270 0x7f36a81cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:40.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.028+0000 7f36a7fff640 1 --2- 172.21.15.19:0/1551676763 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f36a8137650 0x7f36a81cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:40.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.028+0000 7f36a77fe640 1 -- 172.21.15.19:0/1551676763 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f36a8137650 msgr2=0x7f36a81cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:40.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.028+0000 7f36a77fe640 1 --2- 172.21.15.19:0/1551676763 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f36a8137650 0x7f36a81cf9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:40.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.028+0000 7f36a77fe640 1 -- 172.21.15.19:0/1551676763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36a8137270 msgr2=0x7f36a81cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:40.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.028+0000 7f36a77fe640 1 --2- 172.21.15.19:0/1551676763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36a8137270 0x7f36a81cf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:40.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.028+0000 7f36a77fe640 1 -- 172.21.15.19:0/1551676763 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369c009400 con 0x7f36a80a3e90 2023-11-04T15:27:40.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.028+0000 7f36a77fe640 1 --2- 172.21.15.19:0/1551676763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36a80a3e90 0x7f36a81cef30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f369800c500 tx=0x7f369800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:40.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.028+0000 7f368ffff640 1 -- 172.21.15.19:0/1551676763 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3698007560 con 0x7f36a80a3e90 2023-11-04T15:27:40.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.028+0000 7f368ffff640 1 -- 172.21.15.19:0/1551676763 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36980047e0 con 0x7f36a80a3e90 2023-11-04T15:27:40.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.028+0000 7f36adeca640 1 -- 172.21.15.19:0/1551676763 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a809ad00 con 0x7f36a80a3e90 2023-11-04T15:27:40.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.028+0000 7f368ffff640 1 -- 172.21.15.19:0/1551676763 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3698004b90 con 0x7f36a80a3e90 2023-11-04T15:27:40.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.028+0000 7f36adeca640 1 -- 172.21.15.19:0/1551676763 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a809cd60 con 0x7f36a80a3e90 2023-11-04T15:27:40.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.029+0000 7f36adeca640 1 -- 172.21.15.19:0/1551676763 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a809d120 con 0x7f36a80a3e90 2023-11-04T15:27:40.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.029+0000 7f368ffff640 1 -- 172.21.15.19:0/1551676763 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3698004cf0 con 0x7f36a80a3e90 2023-11-04T15:27:40.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.030+0000 7f368ffff640 1 --2- 172.21.15.19:0/1551676763 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f369406a430 0x7f369406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:40.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.030+0000 7f368ffff640 1 -- 172.21.15.19:0/1551676763 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f36980878c0 con 0x7f36a80a3e90 2023-11-04T15:27:40.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.030+0000 7f36a6ffd640 1 --2- 172.21.15.19:0/1551676763 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f369406a430 0x7f369406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:40.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.031+0000 7f36a6ffd640 1 --2- 172.21.15.19:0/1551676763 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f369406a430 0x7f369406c8f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f369c035000 tx=0x7f369c008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:40.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.034+0000 7f368ffff640 1 -- 172.21.15.19:0/1551676763 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f36980534a0 con 0x7f36a80a3e90 2023-11-04T15:27:40.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.280+0000 7f36adeca640 1 -- 172.21.15.19:0/1551676763 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f36a8067d60 con 0x7f36a80a3e90 2023-11-04T15:27:40.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.281+0000 7f368ffff640 1 -- 172.21.15.19:0/1551676763 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1107 (secure 0 0 0) 0x7f3698056ac0 con 0x7f36a80a3e90 2023-11-04T15:27:40.283 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:27:40.284 INFO:teuthology.orchestra.run.smithi019.stdout:{"fsid":"e87311d5-496a-4b07-9654-358fe5bbf950","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":25,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":19,"num_osds":4,"num_up_osds":4,"osd_up_since":1699111644,"num_in_osds":4,"osd_in_since":1699111635,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":112115712,"bytes_avail":386434940928,"bytes_total":386547056640,"unknown_pgs_ratio":0.60952383279800415,"inactive_pgs_ratio":0.30476191639900208},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4254}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-11-04T15:27:14.865923+0000","services":{}},"progress_events":{}} 2023-11-04T15:27:40.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.283+0000 7f36adeca640 1 -- 172.21.15.19:0/1551676763 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f369406a430 msgr2=0x7f369406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:40.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.283+0000 7f36adeca640 1 --2- 172.21.15.19:0/1551676763 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f369406a430 0x7f369406c8f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f369c035000 tx=0x7f369c008030 comp rx=0 tx=0).stop 2023-11-04T15:27:40.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.283+0000 7f36adeca640 1 -- 172.21.15.19:0/1551676763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36a80a3e90 msgr2=0x7f36a81cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:40.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.283+0000 7f36adeca640 1 --2- 172.21.15.19:0/1551676763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36a80a3e90 0x7f36a81cef30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f369800c500 tx=0x7f369800c9c0 comp rx=0 tx=0).stop 2023-11-04T15:27:40.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.283+0000 7f36adeca640 1 -- 172.21.15.19:0/1551676763 shutdown_connections 2023-11-04T15:27:40.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.283+0000 7f36adeca640 1 --2- 172.21.15.19:0/1551676763 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f369406a430 0x7f369406c8f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:40.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.283+0000 7f36adeca640 1 --2- 172.21.15.19:0/1551676763 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f36a8137650 0x7f36a81cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:40.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.283+0000 7f36adeca640 1 --2- 172.21.15.19:0/1551676763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36a8137270 0x7f36a81cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:40.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.283+0000 7f36adeca640 1 --2- 172.21.15.19:0/1551676763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36a80a3e90 0x7f36a81cef30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:40.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.283+0000 7f36adeca640 1 -- 172.21.15.19:0/1551676763 >> 172.21.15.19:0/1551676763 conn(0x7f36a80a8d70 msgr2=0x7f36a80aa120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:40.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.283+0000 7f36adeca640 1 -- 172.21.15.19:0/1551676763 shutdown_connections 2023-11-04T15:27:40.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.283+0000 7f36adeca640 1 -- 172.21.15.19:0/1551676763 wait complete. 2023-11-04T15:27:40.295 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-04T15:27:40.296 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T15:27:40.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.399+0000 7f07bd441640 1 Processor -- start 2023-11-04T15:27:40.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.399+0000 7f07bd441640 1 -- start start 2023-11-04T15:27:40.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.399+0000 7f07bd441640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f07b80a3e90 0x7f07b80a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:40.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.399+0000 7f07bd441640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f07b8137650 0x7f07b813a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:40.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.399+0000 7f07bd441640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07b80a4c20 con 0x7f07b8137270 2023-11-04T15:27:40.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.399+0000 7f07bd441640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b80a3060 con 0x7f07b8137650 2023-11-04T15:27:40.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.399+0000 7f07bd441640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b80a5080 con 0x7f07b80a3e90 2023-11-04T15:27:40.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.400+0000 7f07b77fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f07b8137650 0x7f07b813a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:40.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.400+0000 7f07b77fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f07b8137650 0x7f07b813a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53548/0 (socket says 172.21.15.19:53548) 2023-11-04T15:27:40.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.400+0000 7f07b77fe640 1 -- 172.21.15.19:0/3678293038 learned_addr learned my addr 172.21.15.19:0/3678293038 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:40.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.400+0000 7f07b67fc640 1 --2- 172.21.15.19:0/3678293038 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f07b80a3e90 0x7f07b80a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:40.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.400+0000 7f07b77fe640 1 -- 172.21.15.19:0/3678293038 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f07b80a3e90 msgr2=0x7f07b80a6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:40.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.400+0000 7f07b77fe640 1 --2- 172.21.15.19:0/3678293038 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f07b80a3e90 0x7f07b80a6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:40.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.400+0000 7f07b77fe640 1 -- 172.21.15.19:0/3678293038 >> v1:172.21.15.96:6789/0 conn(0x7f07b8137270 legacy=0x7f07b8139f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:40.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.400+0000 7f07b77fe640 1 -- 172.21.15.19:0/3678293038 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b80a3440 con 0x7f07b8137650 2023-11-04T15:27:40.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.401+0000 7f07b77fe640 1 --2- 172.21.15.19:0/3678293038 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07b8137650 0x7f07b813a670 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f07b0009870 tx=0x7f07b002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b24fc6f95de3f4b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:40.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.401+0000 7f07b5ffb640 1 -- 172.21.15.19:0/3678293038 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b00317c0 con 0x7f07b8137650 2023-11-04T15:27:40.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.401+0000 7f07b5ffb640 1 -- 172.21.15.19:0/3678293038 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b0031920 con 0x7f07b8137650 2023-11-04T15:27:40.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.401+0000 7f07b5ffb640 1 -- 172.21.15.19:0/3678293038 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b0031cb0 con 0x7f07b8137650 2023-11-04T15:27:40.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.401+0000 7f07bd441640 1 -- 172.21.15.19:0/3678293038 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07b8137650 msgr2=0x7f07b813a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:40.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.401+0000 7f07bd441640 1 --2- 172.21.15.19:0/3678293038 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07b8137650 0x7f07b813a670 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f07b0009870 tx=0x7f07b002b860 comp rx=0 tx=0).stop 2023-11-04T15:27:40.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.401+0000 7f07bd441640 1 -- 172.21.15.19:0/3678293038 shutdown_connections 2023-11-04T15:27:40.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.401+0000 7f07bd441640 1 --2- 172.21.15.19:0/3678293038 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07b8137650 0x7f07b813a670 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:40.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.401+0000 7f07bd441640 1 --2- 172.21.15.19:0/3678293038 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f07b80a3e90 0x7f07b80a6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:40.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.401+0000 7f07bd441640 1 -- 172.21.15.19:0/3678293038 >> 172.21.15.19:0/3678293038 conn(0x7f07b80a8d70 msgr2=0x7f07b80a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:40.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.402+0000 7f07bd441640 1 -- 172.21.15.19:0/3678293038 shutdown_connections 2023-11-04T15:27:40.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.402+0000 7f07bd441640 1 -- 172.21.15.19:0/3678293038 wait complete. 2023-11-04T15:27:40.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.403+0000 7f07bd441640 1 Processor -- start 2023-11-04T15:27:40.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.403+0000 7f07bd441640 1 -- start start 2023-11-04T15:27:40.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.403+0000 7f07bd441640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f07b80a3e90 0x7f07b81cf040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:40.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.403+0000 7f07bd441640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07b8137270 0x7f07b81cf580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:40.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.403+0000 7f07bd441640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07b8137650 0x7f07b81cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:40.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.403+0000 7f07bd441640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b809b4f0 con 0x7f07b8137650 2023-11-04T15:27:40.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.403+0000 7f07bd441640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b809cc40 con 0x7f07b8137270 2023-11-04T15:27:40.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.403+0000 7f07bd441640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b809a840 con 0x7f07b80a3e90 2023-11-04T15:27:40.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.403+0000 7f07b77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07b8137650 0x7f07b81cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:40.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.403+0000 7f07b77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07b8137650 0x7f07b81cfac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53550/0 (socket says 172.21.15.19:53550) 2023-11-04T15:27:40.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.403+0000 7f07b77fe640 1 -- 172.21.15.19:0/1228587566 learned_addr learned my addr 172.21.15.19:0/1228587566 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:40.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.403+0000 7f07b6ffd640 1 --2- 172.21.15.19:0/1228587566 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f07b80a3e90 0x7f07b81cf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:40.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.403+0000 7f07b67fc640 1 --2- 172.21.15.19:0/1228587566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07b8137270 0x7f07b81cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:40.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.403+0000 7f07b77fe640 1 -- 172.21.15.19:0/1228587566 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f07b80a3e90 msgr2=0x7f07b81cf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:40.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.404+0000 7f07b77fe640 1 --2- 172.21.15.19:0/1228587566 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f07b80a3e90 0x7f07b81cf040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:40.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.404+0000 7f07b77fe640 1 -- 172.21.15.19:0/1228587566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07b8137270 msgr2=0x7f07b81cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:40.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.404+0000 7f07b77fe640 1 --2- 172.21.15.19:0/1228587566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07b8137270 0x7f07b81cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:40.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.404+0000 7f07b77fe640 1 -- 172.21.15.19:0/1228587566 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b00094d0 con 0x7f07b8137650 2023-11-04T15:27:40.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.404+0000 7f07b77fe640 1 --2- 172.21.15.19:0/1228587566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07b8137650 0x7f07b81cfac0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f07b00090b0 tx=0x7f07b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:40.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.404+0000 7f079f7fe640 1 -- 172.21.15.19:0/1228587566 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b0032860 con 0x7f07b8137650 2023-11-04T15:27:40.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.404+0000 7f079f7fe640 1 -- 172.21.15.19:0/1228587566 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b00329e0 con 0x7f07b8137650 2023-11-04T15:27:40.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.404+0000 7f07bd441640 1 -- 172.21.15.19:0/1228587566 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b8099c20 con 0x7f07b8137650 2023-11-04T15:27:40.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.404+0000 7f079f7fe640 1 -- 172.21.15.19:0/1228587566 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b0032d90 con 0x7f07b8137650 2023-11-04T15:27:40.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.404+0000 7f07bd441640 1 -- 172.21.15.19:0/1228587566 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b809b720 con 0x7f07b8137650 2023-11-04T15:27:40.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.405+0000 7f07bd441640 1 -- 172.21.15.19:0/1228587566 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07b80992b0 con 0x7f07b8137650 2023-11-04T15:27:40.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.405+0000 7f079f7fe640 1 -- 172.21.15.19:0/1228587566 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f07b004e450 con 0x7f07b8137650 2023-11-04T15:27:40.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.406+0000 7f079f7fe640 1 --2- 172.21.15.19:0/1228587566 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f07a406a430 0x7f07a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:40.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.406+0000 7f079f7fe640 1 -- 172.21.15.19:0/1228587566 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f07b00aa310 con 0x7f07b8137650 2023-11-04T15:27:40.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.406+0000 7f07b6ffd640 1 --2- 172.21.15.19:0/1228587566 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f07a406a430 0x7f07a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:40.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.406+0000 7f07b6ffd640 1 --2- 172.21.15.19:0/1228587566 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f07a406a430 0x7f07a406c8f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f07a8001f10 tx=0x7f07a8009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:40.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.410+0000 7f079f7fe640 1 -- 172.21.15.19:0/1228587566 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f07b0075fa0 con 0x7f07b8137650 2023-11-04T15:27:40.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.582+0000 7f07bd441640 1 -- 172.21.15.19:0/1228587566 --> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f07b809be10 con 0x7f07a406a430 2023-11-04T15:27:40.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.589+0000 7f079f7fe640 1 -- 172.21.15.19:0/1228587566 <== mgr.4114 v2:172.21.15.96:6816/83123 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+261519 (secure 0 0 0) 0x7f07b809be10 con 0x7f07a406a430 2023-11-04T15:27:40.593 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:27:40.596 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-11-04T15:27:40.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.591+0000 7f07bd441640 1 -- 172.21.15.19:0/1228587566 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f07a406a430 msgr2=0x7f07a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:40.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.591+0000 7f07bd441640 1 --2- 172.21.15.19:0/1228587566 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f07a406a430 0x7f07a406c8f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f07a8001f10 tx=0x7f07a8009040 comp rx=0 tx=0).stop 2023-11-04T15:27:40.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.591+0000 7f07bd441640 1 -- 172.21.15.19:0/1228587566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07b8137650 msgr2=0x7f07b81cfac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:40.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.591+0000 7f07bd441640 1 --2- 172.21.15.19:0/1228587566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07b8137650 0x7f07b81cfac0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f07b00090b0 tx=0x7f07b00046c0 comp rx=0 tx=0).stop 2023-11-04T15:27:40.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.591+0000 7f07bd441640 1 -- 172.21.15.19:0/1228587566 shutdown_connections 2023-11-04T15:27:40.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.591+0000 7f07bd441640 1 --2- 172.21.15.19:0/1228587566 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f07a406a430 0x7f07a406c8f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:40.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.591+0000 7f07bd441640 1 --2- 172.21.15.19:0/1228587566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07b8137650 0x7f07b81cfac0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:40.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.591+0000 7f07bd441640 1 --2- 172.21.15.19:0/1228587566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07b8137270 0x7f07b81cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:40.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.591+0000 7f07bd441640 1 --2- 172.21.15.19:0/1228587566 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f07b80a3e90 0x7f07b81cf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:40.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.591+0000 7f07bd441640 1 -- 172.21.15.19:0/1228587566 >> 172.21.15.19:0/1228587566 conn(0x7f07b80a8d70 msgr2=0x7f07b80aadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:40.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.591+0000 7f07bd441640 1 -- 172.21.15.19:0/1228587566 shutdown_connections 2023-11-04T15:27:40.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:40.591+0000 7f07bd441640 1 -- 172.21.15.19:0/1228587566 wait complete. 2023-11-04T15:27:40.604 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-11-04T15:27:38.934881+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109488,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":107776,"kb_avail":377377872,"statfs":{"total":386547056640,"available":386434940928,"internally_reserved":0,"allocated":1720320,"data_stored":1349154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110362624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.186690"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751301+0000","last_change":"2023-11-04T15:27:34.751301+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751301+0000","last_undegraded":"2023-11-04T15:27:34.751301+0000","last_fullsized":"2023-11-04T15:27:34.751301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:14:34.175377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.752559+0000","last_change":"2023-11-04T15:27:34.752559+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.752559+0000","last_undegraded":"2023-11-04T15:27:34.752559+0000","last_fullsized":"2023-11-04T15:27:34.752559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:11:01.495068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751681+0000","last_change":"2023-11-04T15:27:34.751681+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751681+0000","last_undegraded":"2023-11-04T15:27:34.751681+0000","last_fullsized":"2023-11-04T15:27:34.751681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:44:09.266115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.752833+0000","last_change":"2023-11-04T15:27:34.752833+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.752833+0000","last_undegraded":"2023-11-04T15:27:34.752833+0000","last_fullsized":"2023-11-04T15:27:34.752833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:02:27.460776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750349+0000","last_change":"2023-11-04T15:27:34.750349+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750349+0000","last_undegraded":"2023-11-04T15:27:34.750349+0000","last_fullsized":"2023-11-04T15:27:34.750349+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:11:01.495068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750465+0000","last_change":"2023-11-04T15:27:34.750465+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750465+0000","last_undegraded":"2023-11-04T15:27:34.750465+0000","last_fullsized":"2023-11-04T15:27:34.750465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:02:11.972760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750140+0000","last_change":"2023-11-04T15:27:34.750140+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750140+0000","last_undegraded":"2023-11-04T15:27:34.750140+0000","last_fullsized":"2023-11-04T15:27:34.750140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:52:13.268866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750531+0000","last_change":"2023-11-04T15:27:34.750531+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750531+0000","last_undegraded":"2023-11-04T15:27:34.750531+0000","last_fullsized":"2023-11-04T15:27:34.750531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:42:49.218866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751147+0000","last_change":"2023-11-04T15:27:34.751147+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751147+0000","last_undegraded":"2023-11-04T15:27:34.751147+0000","last_fullsized":"2023-11-04T15:27:34.751147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:42:49.218866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751324+0000","last_change":"2023-11-04T15:27:34.751324+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751324+0000","last_undegraded":"2023-11-04T15:27:34.751324+0000","last_fullsized":"2023-11-04T15:27:34.751324+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:30:45.293294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750154+0000","last_change":"2023-11-04T15:27:34.750154+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750154+0000","last_undegraded":"2023-11-04T15:27:34.750154+0000","last_fullsized":"2023-11-04T15:27:34.750154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:17:14.527023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751114+0000","last_change":"2023-11-04T15:27:34.751114+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751114+0000","last_undegraded":"2023-11-04T15:27:34.751114+0000","last_fullsized":"2023-11-04T15:27:34.751114+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:01:29.923726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":164,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-11-04T15:27:32.618980+0000","last_change":"2023-11-04T15:27:26.267129+0000","last_active":"2023-11-04T15:27:32.618980+0000","last_peered":"2023-11-04T15:27:32.618980+0000","last_clean":"2023-11-04T15:27:32.618980+0000","last_became_active":"2023-11-04T15:27:26.266242+0000","last_became_peered":"2023-11-04T15:27:26.266242+0000","last_unstale":"2023-11-04T15:27:32.618980+0000","last_undegraded":"2023-11-04T15:27:32.618980+0000","last_fullsized":"2023-11-04T15:27:32.618980+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:25.163848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:25.163848+0000","last_clean_scrub_stamp":"2023-11-04T15:27:25.163848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:54:55.231471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-04T15:27:34.753914+0000","last_change":"2023-11-04T15:27:31.620178+0000","last_active":"2023-11-04T15:27:34.753914+0000","last_peered":"2023-11-04T15:27:34.753914+0000","last_clean":"2023-11-04T15:27:34.753914+0000","last_became_active":"2023-11-04T15:27:31.619798+0000","last_became_peered":"2023-11-04T15:27:31.619798+0000","last_unstale":"2023-11-04T15:27:34.753914+0000","last_undegraded":"2023-11-04T15:27:34.753914+0000","last_fullsized":"2023-11-04T15:27:34.753914+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:50:31.717109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750413+0000","last_change":"2023-11-04T15:27:34.750413+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750413+0000","last_undegraded":"2023-11-04T15:27:34.750413+0000","last_fullsized":"2023-11-04T15:27:34.750413+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:15:19.151223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-04T15:27:34.754064+0000","last_change":"2023-11-04T15:27:31.622106+0000","last_active":"2023-11-04T15:27:34.754064+0000","last_peered":"2023-11-04T15:27:34.754064+0000","last_clean":"2023-11-04T15:27:34.754064+0000","last_became_active":"2023-11-04T15:27:31.621889+0000","last_became_peered":"2023-11-04T15:27:31.621889+0000","last_unstale":"2023-11-04T15:27:34.754064+0000","last_undegraded":"2023-11-04T15:27:34.754064+0000","last_fullsized":"2023-11-04T15:27:34.754064+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:11:00.327441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.752728+0000","last_change":"2023-11-04T15:27:34.752728+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.752728+0000","last_undegraded":"2023-11-04T15:27:34.752728+0000","last_fullsized":"2023-11-04T15:27:34.752728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:23:45.371175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-04T15:27:34.749776+0000","last_change":"2023-11-04T15:27:31.622710+0000","last_active":"2023-11-04T15:27:34.749776+0000","last_peered":"2023-11-04T15:27:34.749776+0000","last_clean":"2023-11-04T15:27:34.749776+0000","last_became_active":"2023-11-04T15:27:31.622378+0000","last_became_peered":"2023-11-04T15:27:31.622378+0000","last_unstale":"2023-11-04T15:27:34.749776+0000","last_undegraded":"2023-11-04T15:27:34.749776+0000","last_fullsized":"2023-11-04T15:27:34.749776+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:49:04.803105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750394+0000","last_change":"2023-11-04T15:27:34.750394+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750394+0000","last_undegraded":"2023-11-04T15:27:34.750394+0000","last_fullsized":"2023-11-04T15:27:34.750394+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:44:38.690122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-04T15:27:34.753879+0000","last_change":"2023-11-04T15:27:31.622105+0000","last_active":"2023-11-04T15:27:34.753879+0000","last_peered":"2023-11-04T15:27:34.753879+0000","last_clean":"2023-11-04T15:27:34.753879+0000","last_became_active":"2023-11-04T15:27:31.621849+0000","last_became_peered":"2023-11-04T15:27:31.621849+0000","last_unstale":"2023-11-04T15:27:34.753879+0000","last_undegraded":"2023-11-04T15:27:34.753879+0000","last_fullsized":"2023-11-04T15:27:34.753879+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:20:41.777316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750556+0000","last_change":"2023-11-04T15:27:34.750556+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750556+0000","last_undegraded":"2023-11-04T15:27:34.750556+0000","last_fullsized":"2023-11-04T15:27:34.750556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:08:22.991334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750286+0000","last_change":"2023-11-04T15:27:34.750286+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750286+0000","last_undegraded":"2023-11-04T15:27:34.750286+0000","last_fullsized":"2023-11-04T15:27:34.750286+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:00:20.246822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-04T15:27:34.749830+0000","last_change":"2023-11-04T15:27:31.622663+0000","last_active":"2023-11-04T15:27:34.749830+0000","last_peered":"2023-11-04T15:27:34.749830+0000","last_clean":"2023-11-04T15:27:34.749830+0000","last_became_active":"2023-11-04T15:27:31.622350+0000","last_became_peered":"2023-11-04T15:27:31.622350+0000","last_unstale":"2023-11-04T15:27:34.749830+0000","last_undegraded":"2023-11-04T15:27:34.749830+0000","last_fullsized":"2023-11-04T15:27:34.749830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:31:02.273249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750413+0000","last_change":"2023-11-04T15:27:34.750413+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750413+0000","last_undegraded":"2023-11-04T15:27:34.750413+0000","last_fullsized":"2023-11-04T15:27:34.750413+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T22:02:04.025848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-04T15:27:34.754163+0000","last_change":"2023-11-04T15:27:31.619973+0000","last_active":"2023-11-04T15:27:34.754163+0000","last_peered":"2023-11-04T15:27:34.754163+0000","last_clean":"2023-11-04T15:27:34.754163+0000","last_became_active":"2023-11-04T15:27:31.619702+0000","last_became_peered":"2023-11-04T15:27:31.619702+0000","last_unstale":"2023-11-04T15:27:34.754163+0000","last_undegraded":"2023-11-04T15:27:34.754163+0000","last_fullsized":"2023-11-04T15:27:34.754163+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:24:34.782619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750459+0000","last_change":"2023-11-04T15:27:34.750459+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750459+0000","last_undegraded":"2023-11-04T15:27:34.750459+0000","last_fullsized":"2023-11-04T15:27:34.750459+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:14:58.601545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-04T15:27:34.749800+0000","last_change":"2023-11-04T15:27:31.624625+0000","last_active":"2023-11-04T15:27:34.749800+0000","last_peered":"2023-11-04T15:27:34.749800+0000","last_clean":"2023-11-04T15:27:34.749800+0000","last_became_active":"2023-11-04T15:27:31.624347+0000","last_became_peered":"2023-11-04T15:27:31.624347+0000","last_unstale":"2023-11-04T15:27:34.749800+0000","last_undegraded":"2023-11-04T15:27:34.749800+0000","last_fullsized":"2023-11-04T15:27:34.749800+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:53:45.131692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.752693+0000","last_change":"2023-11-04T15:27:34.752693+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.752693+0000","last_undegraded":"2023-11-04T15:27:34.752693+0000","last_fullsized":"2023-11-04T15:27:34.752693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:58:09.475936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-04T15:27:34.754149+0000","last_change":"2023-11-04T15:27:31.620235+0000","last_active":"2023-11-04T15:27:34.754149+0000","last_peered":"2023-11-04T15:27:34.754149+0000","last_clean":"2023-11-04T15:27:34.754149+0000","last_became_active":"2023-11-04T15:27:31.619831+0000","last_became_peered":"2023-11-04T15:27:31.619831+0000","last_unstale":"2023-11-04T15:27:34.754149+0000","last_undegraded":"2023-11-04T15:27:34.754149+0000","last_fullsized":"2023-11-04T15:27:34.754149+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:44:07.412379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751515+0000","last_change":"2023-11-04T15:27:34.751515+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751515+0000","last_undegraded":"2023-11-04T15:27:34.751515+0000","last_fullsized":"2023-11-04T15:27:34.751515+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:36:12.941030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751488+0000","last_change":"2023-11-04T15:27:34.751488+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751488+0000","last_undegraded":"2023-11-04T15:27:34.751488+0000","last_fullsized":"2023-11-04T15:27:34.751488+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:58:09.475936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751729+0000","last_change":"2023-11-04T15:27:34.751729+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751729+0000","last_undegraded":"2023-11-04T15:27:34.751729+0000","last_fullsized":"2023-11-04T15:27:34.751729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:23:45.371175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.752775+0000","last_change":"2023-11-04T15:27:34.752775+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.752775+0000","last_undegraded":"2023-11-04T15:27:34.752775+0000","last_fullsized":"2023-11-04T15:27:34.752775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:14:58.601545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751810+0000","last_change":"2023-11-04T15:27:34.751810+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751810+0000","last_undegraded":"2023-11-04T15:27:34.751810+0000","last_fullsized":"2023-11-04T15:27:34.751810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:03:49.354013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751672+0000","last_change":"2023-11-04T15:27:34.751672+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751672+0000","last_undegraded":"2023-11-04T15:27:34.751672+0000","last_fullsized":"2023-11-04T15:27:34.751672+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:55:22.956180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750521+0000","last_change":"2023-11-04T15:27:34.750521+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750521+0000","last_undegraded":"2023-11-04T15:27:34.750521+0000","last_fullsized":"2023-11-04T15:27:34.750521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:14:58.601545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.752683+0000","last_change":"2023-11-04T15:27:34.752683+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.752683+0000","last_undegraded":"2023-11-04T15:27:34.752683+0000","last_fullsized":"2023-11-04T15:27:34.752683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:00:20.246822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.750251+0000","last_change":"2023-11-04T15:27:34.750251+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.750251+0000","last_undegraded":"2023-11-04T15:27:34.750251+0000","last_fullsized":"2023-11-04T15:27:34.750251+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:47:47.130490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.751865+0000","last_change":"2023-11-04T15:27:34.751865+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.751865+0000","last_undegraded":"2023-11-04T15:27:34.751865+0000","last_fullsized":"2023-11-04T15:27:34.751865+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:13:42.865721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.753557+0000","last_change":"2023-11-04T15:27:34.753557+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.753557+0000","last_undegraded":"2023-11-04T15:27:34.753557+0000","last_fullsized":"2023-11-04T15:27:34.753557+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:02:11.972760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T15:27:35.748092+0000","last_change":"2023-11-04T15:27:35.748092+0000","last_active":"2023-11-04T15:27:35.748092+0000","last_peered":"2023-11-04T15:27:35.748092+0000","last_clean":"2023-11-04T15:27:35.748092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:35.748092+0000","last_undegraded":"2023-11-04T15:27:35.748092+0000","last_fullsized":"2023-11-04T15:27:35.748092+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2023-11-04T15:27:34.753707+0000","last_change":"2023-11-04T15:27:34.753707+0000","last_active":"2023-11-04T15:27:34.743438+0000","last_peered":"2023-11-04T15:27:34.743438+0000","last_clean":"2023-11-04T15:27:34.743438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T15:27:34.753707+0000","last_undegraded":"2023-11-04T15:27:34.753707+0000","last_fullsized":"2023-11-04T15:27:34.753707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:08:22.991334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":716,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":733184,"data_stored":635804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]}]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27080,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344760,"statfs":{"total":96636764160,"available":96609034240,"internally_reserved":0,"allocated":131072,"data_stored":40994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27080,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344760,"statfs":{"total":96636764160,"available":96609034240,"internally_reserved":0,"allocated":131072,"data_stored":40994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":724992,"data_stored":631362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T15:27:43.611 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T15:27:43.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.727+0000 7f04eb7d0640 1 Processor -- start 2023-11-04T15:27:43.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.728+0000 7f04eb7d0640 1 -- start start 2023-11-04T15:27:43.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.728+0000 7f04eb7d0640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f04e4137270 0x7f04e40a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:43.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.728+0000 7f04eb7d0640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f04e4137650 0x7f04e413a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:43.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.728+0000 7f04eb7d0640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e40a4c20 con 0x7f04e40a3e90 2023-11-04T15:27:43.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.728+0000 7f04eb7d0640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e40a3060 con 0x7f04e4137650 2023-11-04T15:27:43.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.728+0000 7f04eb7d0640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e40a5080 con 0x7f04e4137270 2023-11-04T15:27:43.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.728+0000 7f04e9d6d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f04e4137650 0x7f04e413a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:43.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.728+0000 7f04e8d6b640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f04e40a3e90 0x7f04e4139f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60826/0 (socket says 172.21.15.19:60826) 2023-11-04T15:27:43.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.728+0000 7f04e8d6b640 1 -- 172.21.15.19:0/3667295195 learned_addr learned my addr 172.21.15.19:0/3667295195 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:43.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.729+0000 7f04e956c640 1 --2- 172.21.15.19:0/3667295195 >> v2:172.21.15.96:3300/0 conn(0x7f04e4137270 0x7f04e40a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:43.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.729+0000 7f04e9d6d640 1 -- 172.21.15.19:0/3667295195 >> v2:172.21.15.96:3300/0 conn(0x7f04e4137270 msgr2=0x7f04e40a6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:43.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.729+0000 7f04e9d6d640 1 --2- 172.21.15.19:0/3667295195 >> v2:172.21.15.96:3300/0 conn(0x7f04e4137270 0x7f04e40a6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:43.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.729+0000 7f04e9d6d640 1 -- 172.21.15.19:0/3667295195 >> v1:172.21.15.19:6789/0 conn(0x7f04e40a3e90 legacy=0x7f04e4139f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:43.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.729+0000 7f04dbfff640 1 -- 172.21.15.19:0/3667295195 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2081125178 0 0) 0x7f04e40a4c20 con 0x7f04e40a3e90 2023-11-04T15:27:43.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.729+0000 7f04e9d6d640 1 -- 172.21.15.19:0/3667295195 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e40a3440 con 0x7f04e4137650 2023-11-04T15:27:43.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.729+0000 7f04e956c640 1 --2- 172.21.15.19:0/3667295195 >> v2:172.21.15.96:3300/0 conn(0x7f04e4137270 0x7f04e40a6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:27:43.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.729+0000 7f04e9d6d640 1 --2- 172.21.15.19:0/3667295195 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04e4137650 0x7f04e413a670 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f04e40ad2d0 tx=0x7f04dc02bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e36e0d9b0ec9b9a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:43.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.730+0000 7f04dbfff640 1 -- 172.21.15.19:0/3667295195 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04dc02cb70 con 0x7f04e4137650 2023-11-04T15:27:43.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.730+0000 7f04dbfff640 1 -- 172.21.15.19:0/3667295195 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04dc02ccd0 con 0x7f04e4137650 2023-11-04T15:27:43.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.730+0000 7f04dbfff640 1 -- 172.21.15.19:0/3667295195 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04dc034660 con 0x7f04e4137650 2023-11-04T15:27:43.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.730+0000 7f04eb7d0640 1 -- 172.21.15.19:0/3667295195 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04e4137650 msgr2=0x7f04e413a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:43.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.730+0000 7f04eb7d0640 1 --2- 172.21.15.19:0/3667295195 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04e4137650 0x7f04e413a670 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f04e40ad2d0 tx=0x7f04dc02bdc0 comp rx=0 tx=0).stop 2023-11-04T15:27:43.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.730+0000 7f04eb7d0640 1 -- 172.21.15.19:0/3667295195 shutdown_connections 2023-11-04T15:27:43.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.730+0000 7f04eb7d0640 1 --2- 172.21.15.19:0/3667295195 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04e4137650 0x7f04e413a670 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:43.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.730+0000 7f04eb7d0640 1 --2- 172.21.15.19:0/3667295195 >> v2:172.21.15.96:3300/0 conn(0x7f04e4137270 0x7f04e40a6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:43.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.730+0000 7f04eb7d0640 1 -- 172.21.15.19:0/3667295195 >> 172.21.15.19:0/3667295195 conn(0x7f04e40a8d70 msgr2=0x7f04e40a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:43.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.730+0000 7f04eb7d0640 1 -- 172.21.15.19:0/3667295195 shutdown_connections 2023-11-04T15:27:43.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.730+0000 7f04eb7d0640 1 -- 172.21.15.19:0/3667295195 wait complete. 2023-11-04T15:27:43.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.731+0000 7f04eb7d0640 1 Processor -- start 2023-11-04T15:27:43.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.731+0000 7f04eb7d0640 1 -- start start 2023-11-04T15:27:43.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.732+0000 7f04eb7d0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04e40a3e90 0x7f04e4131df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:43.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.732+0000 7f04eb7d0640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f04e4137270 0x7f04e4132330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:43.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.732+0000 7f04eb7d0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04e4137650 0x7f04e4097a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:43.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.732+0000 7f04eb7d0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e409b650 con 0x7f04e4137650 2023-11-04T15:27:43.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.732+0000 7f04eb7d0640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e409b020 con 0x7f04e40a3e90 2023-11-04T15:27:43.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.732+0000 7f04eb7d0640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e4099b70 con 0x7f04e4137270 2023-11-04T15:27:43.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.732+0000 7f04e9d6d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04e4137650 0x7f04e4097a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:43.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.732+0000 7f04e9d6d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04e4137650 0x7f04e4097a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53564/0 (socket says 172.21.15.19:53564) 2023-11-04T15:27:43.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.732+0000 7f04e9d6d640 1 -- 172.21.15.19:0/1023304485 learned_addr learned my addr 172.21.15.19:0/1023304485 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:43.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.732+0000 7f04e956c640 1 --2- 172.21.15.19:0/1023304485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04e40a3e90 0x7f04e4131df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:43.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.732+0000 7f04e8d6b640 1 --2- 172.21.15.19:0/1023304485 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f04e4137270 0x7f04e4132330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:43.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.732+0000 7f04e9d6d640 1 -- 172.21.15.19:0/1023304485 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f04e4137270 msgr2=0x7f04e4132330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:43.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.732+0000 7f04e9d6d640 1 --2- 172.21.15.19:0/1023304485 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f04e4137270 0x7f04e4132330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:43.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.732+0000 7f04e9d6d640 1 -- 172.21.15.19:0/1023304485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04e40a3e90 msgr2=0x7f04e4131df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:43.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.732+0000 7f04e9d6d640 1 --2- 172.21.15.19:0/1023304485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04e40a3e90 0x7f04e4131df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:43.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.732+0000 7f04e9d6d640 1 -- 172.21.15.19:0/1023304485 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04dc009a70 con 0x7f04e4137650 2023-11-04T15:27:43.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.733+0000 7f04e9d6d640 1 --2- 172.21.15.19:0/1023304485 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04e4137650 0x7f04e4097a00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f04dc009e80 tx=0x7f04dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:43.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.733+0000 7f04d9ffb640 1 -- 172.21.15.19:0/1023304485 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04dc040650 con 0x7f04e4137650 2023-11-04T15:27:43.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.733+0000 7f04d9ffb640 1 -- 172.21.15.19:0/1023304485 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04dc0407b0 con 0x7f04e4137650 2023-11-04T15:27:43.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.733+0000 7f04eb7d0640 1 -- 172.21.15.19:0/1023304485 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e409aa10 con 0x7f04e4137650 2023-11-04T15:27:43.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.733+0000 7f04d9ffb640 1 -- 172.21.15.19:0/1023304485 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04dc040b20 con 0x7f04e4137650 2023-11-04T15:27:43.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.733+0000 7f04eb7d0640 1 -- 172.21.15.19:0/1023304485 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e4099240 con 0x7f04e4137650 2023-11-04T15:27:43.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.734+0000 7f04eb7d0640 1 -- 172.21.15.19:0/1023304485 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04e40a26e0 con 0x7f04e4137650 2023-11-04T15:27:43.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.735+0000 7f04d9ffb640 1 -- 172.21.15.19:0/1023304485 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f04dc040c80 con 0x7f04e4137650 2023-11-04T15:27:43.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.735+0000 7f04d9ffb640 1 --2- 172.21.15.19:0/1023304485 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f04c806a430 0x7f04c806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:43.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.735+0000 7f04d9ffb640 1 -- 172.21.15.19:0/1023304485 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f04dc02ce40 con 0x7f04e4137650 2023-11-04T15:27:43.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.735+0000 7f04e956c640 1 --2- 172.21.15.19:0/1023304485 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f04c806a430 0x7f04c806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:43.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.736+0000 7f04e956c640 1 --2- 172.21.15.19:0/1023304485 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f04c806a430 0x7f04c806c8f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f04e40999b0 tx=0x7f04e0008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:43.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.739+0000 7f04d9ffb640 1 -- 172.21.15.19:0/1023304485 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f04dc076df0 con 0x7f04e4137650 2023-11-04T15:27:43.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.915+0000 7f04eb7d0640 1 -- 172.21.15.19:0/1023304485 --> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f04e40a5340 con 0x7f04c806a430 2023-11-04T15:27:43.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.923+0000 7f04d9ffb640 1 -- 172.21.15.19:0/1023304485 <== mgr.4114 v2:172.21.15.96:6816/83123 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271359 (secure 0 0 0) 0x7f04e0009e60 con 0x7f04c806a430 2023-11-04T15:27:43.927 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:27:43.928 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-11-04T15:27:43.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.926+0000 7f04eb7d0640 1 -- 172.21.15.19:0/1023304485 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f04c806a430 msgr2=0x7f04c806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:43.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.926+0000 7f04eb7d0640 1 --2- 172.21.15.19:0/1023304485 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f04c806a430 0x7f04c806c8f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f04e40999b0 tx=0x7f04e0008040 comp rx=0 tx=0).stop 2023-11-04T15:27:43.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.926+0000 7f04eb7d0640 1 -- 172.21.15.19:0/1023304485 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04e4137650 msgr2=0x7f04e4097a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:43.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.926+0000 7f04eb7d0640 1 --2- 172.21.15.19:0/1023304485 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04e4137650 0x7f04e4097a00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f04dc009e80 tx=0x7f04dc004a40 comp rx=0 tx=0).stop 2023-11-04T15:27:43.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.926+0000 7f04eb7d0640 1 -- 172.21.15.19:0/1023304485 shutdown_connections 2023-11-04T15:27:43.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.926+0000 7f04eb7d0640 1 --2- 172.21.15.19:0/1023304485 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f04c806a430 0x7f04c806c8f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:43.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.926+0000 7f04eb7d0640 1 --2- 172.21.15.19:0/1023304485 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04e4137650 0x7f04e4097a00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:43.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.926+0000 7f04eb7d0640 1 --2- 172.21.15.19:0/1023304485 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f04e4137270 0x7f04e4132330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:43.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.926+0000 7f04eb7d0640 1 --2- 172.21.15.19:0/1023304485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04e40a3e90 0x7f04e4131df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:43.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.926+0000 7f04eb7d0640 1 -- 172.21.15.19:0/1023304485 >> 172.21.15.19:0/1023304485 conn(0x7f04e40a8d70 msgr2=0x7f04e4134220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:43.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.926+0000 7f04eb7d0640 1 -- 172.21.15.19:0/1023304485 shutdown_connections 2023-11-04T15:27:43.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:43.926+0000 7f04eb7d0640 1 -- 172.21.15.19:0/1023304485 wait complete. 2023-11-04T15:27:43.937 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-04T15:27:42.935818+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":163,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109720,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":107776,"kb_avail":377377640,"statfs":{"total":386547056640,"available":386434703360,"internally_reserved":0,"allocated":1957888,"data_stored":1427848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110362624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.178577"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199676+0000","last_change":"2023-11-04T15:27:36.150532+0000","last_active":"2023-11-04T15:27:38.199676+0000","last_peered":"2023-11-04T15:27:38.199676+0000","last_clean":"2023-11-04T15:27:38.199676+0000","last_became_active":"2023-11-04T15:27:36.150296+0000","last_became_peered":"2023-11-04T15:27:36.150296+0000","last_unstale":"2023-11-04T15:27:38.199676+0000","last_undegraded":"2023-11-04T15:27:38.199676+0000","last_fullsized":"2023-11-04T15:27:38.199676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:41:32.995261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.139353+0000","last_change":"2023-11-04T15:27:36.149233+0000","last_active":"2023-11-04T15:27:37.139353+0000","last_peered":"2023-11-04T15:27:37.139353+0000","last_clean":"2023-11-04T15:27:37.139353+0000","last_became_active":"2023-11-04T15:27:36.148939+0000","last_became_peered":"2023-11-04T15:27:36.148939+0000","last_unstale":"2023-11-04T15:27:37.139353+0000","last_undegraded":"2023-11-04T15:27:37.139353+0000","last_fullsized":"2023-11-04T15:27:37.139353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:52:55.975636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138201+0000","last_change":"2023-11-04T15:27:36.149978+0000","last_active":"2023-11-04T15:27:37.138201+0000","last_peered":"2023-11-04T15:27:37.138201+0000","last_clean":"2023-11-04T15:27:37.138201+0000","last_became_active":"2023-11-04T15:27:36.149748+0000","last_became_peered":"2023-11-04T15:27:36.149748+0000","last_unstale":"2023-11-04T15:27:37.138201+0000","last_undegraded":"2023-11-04T15:27:37.138201+0000","last_fullsized":"2023-11-04T15:27:37.138201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:49:04.091063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.139643+0000","last_change":"2023-11-04T15:27:36.140158+0000","last_active":"2023-11-04T15:27:37.139643+0000","last_peered":"2023-11-04T15:27:37.139643+0000","last_clean":"2023-11-04T15:27:37.139643+0000","last_became_active":"2023-11-04T15:27:36.139761+0000","last_became_peered":"2023-11-04T15:27:36.139761+0000","last_unstale":"2023-11-04T15:27:37.139643+0000","last_undegraded":"2023-11-04T15:27:37.139643+0000","last_fullsized":"2023-11-04T15:27:37.139643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:38:30.379384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199913+0000","last_change":"2023-11-04T15:27:36.150520+0000","last_active":"2023-11-04T15:27:38.199913+0000","last_peered":"2023-11-04T15:27:38.199913+0000","last_clean":"2023-11-04T15:27:38.199913+0000","last_became_active":"2023-11-04T15:27:36.150017+0000","last_became_peered":"2023-11-04T15:27:36.150017+0000","last_unstale":"2023-11-04T15:27:38.199913+0000","last_undegraded":"2023-11-04T15:27:38.199913+0000","last_fullsized":"2023-11-04T15:27:38.199913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:47:40.350777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.137815+0000","last_change":"2023-11-04T15:27:36.139858+0000","last_active":"2023-11-04T15:27:37.137815+0000","last_peered":"2023-11-04T15:27:37.137815+0000","last_clean":"2023-11-04T15:27:37.137815+0000","last_became_active":"2023-11-04T15:27:36.139036+0000","last_became_peered":"2023-11-04T15:27:36.139036+0000","last_unstale":"2023-11-04T15:27:37.137815+0000","last_undegraded":"2023-11-04T15:27:37.137815+0000","last_fullsized":"2023-11-04T15:27:37.137815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:05:44.093984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.137514+0000","last_change":"2023-11-04T15:27:36.140003+0000","last_active":"2023-11-04T15:27:37.137514+0000","last_peered":"2023-11-04T15:27:37.137514+0000","last_clean":"2023-11-04T15:27:37.137514+0000","last_became_active":"2023-11-04T15:27:36.139121+0000","last_became_peered":"2023-11-04T15:27:36.139121+0000","last_unstale":"2023-11-04T15:27:37.137514+0000","last_undegraded":"2023-11-04T15:27:37.137514+0000","last_fullsized":"2023-11-04T15:27:37.137514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:57:05.896392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.137457+0000","last_change":"2023-11-04T15:27:36.148199+0000","last_active":"2023-11-04T15:27:37.137457+0000","last_peered":"2023-11-04T15:27:37.137457+0000","last_clean":"2023-11-04T15:27:37.137457+0000","last_became_active":"2023-11-04T15:27:36.147050+0000","last_became_peered":"2023-11-04T15:27:36.147050+0000","last_unstale":"2023-11-04T15:27:37.137457+0000","last_undegraded":"2023-11-04T15:27:37.137457+0000","last_fullsized":"2023-11-04T15:27:37.137457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:40:36.811342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199451+0000","last_change":"2023-11-04T15:27:36.146562+0000","last_active":"2023-11-04T15:27:38.199451+0000","last_peered":"2023-11-04T15:27:38.199451+0000","last_clean":"2023-11-04T15:27:38.199451+0000","last_became_active":"2023-11-04T15:27:36.145825+0000","last_became_peered":"2023-11-04T15:27:36.145825+0000","last_unstale":"2023-11-04T15:27:38.199451+0000","last_undegraded":"2023-11-04T15:27:38.199451+0000","last_fullsized":"2023-11-04T15:27:38.199451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:52:55.975636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138448+0000","last_change":"2023-11-04T15:27:36.150567+0000","last_active":"2023-11-04T15:27:37.138448+0000","last_peered":"2023-11-04T15:27:37.138448+0000","last_clean":"2023-11-04T15:27:37.138448+0000","last_became_active":"2023-11-04T15:27:36.150307+0000","last_became_peered":"2023-11-04T15:27:36.150307+0000","last_unstale":"2023-11-04T15:27:37.138448+0000","last_undegraded":"2023-11-04T15:27:37.138448+0000","last_fullsized":"2023-11-04T15:27:37.138448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:38:23.440792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.139590+0000","last_change":"2023-11-04T15:27:36.145307+0000","last_active":"2023-11-04T15:27:37.139590+0000","last_peered":"2023-11-04T15:27:37.139590+0000","last_clean":"2023-11-04T15:27:37.139590+0000","last_became_active":"2023-11-04T15:27:36.144988+0000","last_became_peered":"2023-11-04T15:27:36.144988+0000","last_unstale":"2023-11-04T15:27:37.139590+0000","last_undegraded":"2023-11-04T15:27:37.139590+0000","last_fullsized":"2023-11-04T15:27:37.139590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:41.544754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.131453+0000","last_change":"2023-11-04T15:27:36.149560+0000","last_active":"2023-11-04T15:27:37.131453+0000","last_peered":"2023-11-04T15:27:37.131453+0000","last_clean":"2023-11-04T15:27:37.131453+0000","last_became_active":"2023-11-04T15:27:36.149156+0000","last_became_peered":"2023-11-04T15:27:36.149156+0000","last_unstale":"2023-11-04T15:27:37.131453+0000","last_undegraded":"2023-11-04T15:27:37.131453+0000","last_fullsized":"2023-11-04T15:27:37.131453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:22:17.580120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199582+0000","last_change":"2023-11-04T15:27:36.140079+0000","last_active":"2023-11-04T15:27:38.199582+0000","last_peered":"2023-11-04T15:27:38.199582+0000","last_clean":"2023-11-04T15:27:38.199582+0000","last_became_active":"2023-11-04T15:27:36.139824+0000","last_became_peered":"2023-11-04T15:27:36.139824+0000","last_unstale":"2023-11-04T15:27:38.199582+0000","last_undegraded":"2023-11-04T15:27:38.199582+0000","last_fullsized":"2023-11-04T15:27:38.199582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:28.095802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.139484+0000","last_change":"2023-11-04T15:27:36.147533+0000","last_active":"2023-11-04T15:27:37.139484+0000","last_peered":"2023-11-04T15:27:37.139484+0000","last_clean":"2023-11-04T15:27:37.139484+0000","last_became_active":"2023-11-04T15:27:36.147273+0000","last_became_peered":"2023-11-04T15:27:36.147273+0000","last_unstale":"2023-11-04T15:27:37.139484+0000","last_undegraded":"2023-11-04T15:27:37.139484+0000","last_fullsized":"2023-11-04T15:27:37.139484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:22:17.580120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.139612+0000","last_change":"2023-11-04T15:27:36.149641+0000","last_active":"2023-11-04T15:27:37.139612+0000","last_peered":"2023-11-04T15:27:37.139612+0000","last_clean":"2023-11-04T15:27:37.139612+0000","last_became_active":"2023-11-04T15:27:36.148932+0000","last_became_peered":"2023-11-04T15:27:36.148932+0000","last_unstale":"2023-11-04T15:27:37.139612+0000","last_undegraded":"2023-11-04T15:27:37.139612+0000","last_fullsized":"2023-11-04T15:27:37.139612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:12:07.727740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.137533+0000","last_change":"2023-11-04T15:27:36.151936+0000","last_active":"2023-11-04T15:27:37.137533+0000","last_peered":"2023-11-04T15:27:37.137533+0000","last_clean":"2023-11-04T15:27:37.137533+0000","last_became_active":"2023-11-04T15:27:36.150856+0000","last_became_peered":"2023-11-04T15:27:36.150856+0000","last_unstale":"2023-11-04T15:27:37.137533+0000","last_undegraded":"2023-11-04T15:27:37.137533+0000","last_fullsized":"2023-11-04T15:27:37.137533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:51:31.442634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199500+0000","last_change":"2023-11-04T15:27:36.145257+0000","last_active":"2023-11-04T15:27:38.199500+0000","last_peered":"2023-11-04T15:27:38.199500+0000","last_clean":"2023-11-04T15:27:38.199500+0000","last_became_active":"2023-11-04T15:27:36.144997+0000","last_became_peered":"2023-11-04T15:27:36.144997+0000","last_unstale":"2023-11-04T15:27:38.199500+0000","last_undegraded":"2023-11-04T15:27:38.199500+0000","last_fullsized":"2023-11-04T15:27:38.199500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:22:17.580120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138606+0000","last_change":"2023-11-04T15:27:36.150820+0000","last_active":"2023-11-04T15:27:37.138606+0000","last_peered":"2023-11-04T15:27:37.138606+0000","last_clean":"2023-11-04T15:27:37.138606+0000","last_became_active":"2023-11-04T15:27:36.150555+0000","last_became_peered":"2023-11-04T15:27:36.150555+0000","last_unstale":"2023-11-04T15:27:37.138606+0000","last_undegraded":"2023-11-04T15:27:37.138606+0000","last_fullsized":"2023-11-04T15:27:37.138606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:32:27.370984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199406+0000","last_change":"2023-11-04T15:27:36.148306+0000","last_active":"2023-11-04T15:27:38.199406+0000","last_peered":"2023-11-04T15:27:38.199406+0000","last_clean":"2023-11-04T15:27:38.199406+0000","last_became_active":"2023-11-04T15:27:36.147745+0000","last_became_peered":"2023-11-04T15:27:36.147745+0000","last_unstale":"2023-11-04T15:27:38.199406+0000","last_undegraded":"2023-11-04T15:27:38.199406+0000","last_fullsized":"2023-11-04T15:27:38.199406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:41:10.315016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138359+0000","last_change":"2023-11-04T15:27:36.151647+0000","last_active":"2023-11-04T15:27:37.138359+0000","last_peered":"2023-11-04T15:27:37.138359+0000","last_clean":"2023-11-04T15:27:37.138359+0000","last_became_active":"2023-11-04T15:27:36.150687+0000","last_became_peered":"2023-11-04T15:27:36.150687+0000","last_unstale":"2023-11-04T15:27:37.138359+0000","last_undegraded":"2023-11-04T15:27:37.138359+0000","last_fullsized":"2023-11-04T15:27:37.138359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:56:24.790444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.139334+0000","last_change":"2023-11-04T15:27:36.144207+0000","last_active":"2023-11-04T15:27:37.139334+0000","last_peered":"2023-11-04T15:27:37.139334+0000","last_clean":"2023-11-04T15:27:37.139334+0000","last_became_active":"2023-11-04T15:27:36.143551+0000","last_became_peered":"2023-11-04T15:27:36.143551+0000","last_unstale":"2023-11-04T15:27:37.139334+0000","last_undegraded":"2023-11-04T15:27:37.139334+0000","last_fullsized":"2023-11-04T15:27:37.139334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:36:21.960547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199072+0000","last_change":"2023-11-04T15:27:36.146251+0000","last_active":"2023-11-04T15:27:38.199072+0000","last_peered":"2023-11-04T15:27:38.199072+0000","last_clean":"2023-11-04T15:27:38.199072+0000","last_became_active":"2023-11-04T15:27:36.145943+0000","last_became_peered":"2023-11-04T15:27:36.145943+0000","last_unstale":"2023-11-04T15:27:38.199072+0000","last_undegraded":"2023-11-04T15:27:38.199072+0000","last_fullsized":"2023-11-04T15:27:38.199072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:48:58.102459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.130771+0000","last_change":"2023-11-04T15:27:36.146784+0000","last_active":"2023-11-04T15:27:37.130771+0000","last_peered":"2023-11-04T15:27:37.130771+0000","last_clean":"2023-11-04T15:27:37.130771+0000","last_became_active":"2023-11-04T15:27:36.144083+0000","last_became_peered":"2023-11-04T15:27:36.144083+0000","last_unstale":"2023-11-04T15:27:37.130771+0000","last_undegraded":"2023-11-04T15:27:37.130771+0000","last_fullsized":"2023-11-04T15:27:37.130771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:32:27.370984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.137581+0000","last_change":"2023-11-04T15:27:36.147265+0000","last_active":"2023-11-04T15:27:37.137581+0000","last_peered":"2023-11-04T15:27:37.137581+0000","last_clean":"2023-11-04T15:27:37.137581+0000","last_became_active":"2023-11-04T15:27:36.146546+0000","last_became_peered":"2023-11-04T15:27:36.146546+0000","last_unstale":"2023-11-04T15:27:37.137581+0000","last_undegraded":"2023-11-04T15:27:37.137581+0000","last_fullsized":"2023-11-04T15:27:37.137581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:41:10.315016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.131630+0000","last_change":"2023-11-04T15:27:36.144341+0000","last_active":"2023-11-04T15:27:37.131630+0000","last_peered":"2023-11-04T15:27:37.131630+0000","last_clean":"2023-11-04T15:27:37.131630+0000","last_became_active":"2023-11-04T15:27:36.144047+0000","last_became_peered":"2023-11-04T15:27:36.144047+0000","last_unstale":"2023-11-04T15:27:37.131630+0000","last_undegraded":"2023-11-04T15:27:37.131630+0000","last_fullsized":"2023-11-04T15:27:37.131630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:36:21.960547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.131685+0000","last_change":"2023-11-04T15:27:36.146439+0000","last_active":"2023-11-04T15:27:37.131685+0000","last_peered":"2023-11-04T15:27:37.131685+0000","last_clean":"2023-11-04T15:27:37.131685+0000","last_became_active":"2023-11-04T15:27:36.144458+0000","last_became_peered":"2023-11-04T15:27:36.144458+0000","last_unstale":"2023-11-04T15:27:37.131685+0000","last_undegraded":"2023-11-04T15:27:37.131685+0000","last_fullsized":"2023-11-04T15:27:37.131685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:52:55.975636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138690+0000","last_change":"2023-11-04T15:27:36.151339+0000","last_active":"2023-11-04T15:27:37.138690+0000","last_peered":"2023-11-04T15:27:37.138690+0000","last_clean":"2023-11-04T15:27:37.138690+0000","last_became_active":"2023-11-04T15:27:36.150270+0000","last_became_peered":"2023-11-04T15:27:36.150270+0000","last_unstale":"2023-11-04T15:27:37.138690+0000","last_undegraded":"2023-11-04T15:27:37.138690+0000","last_fullsized":"2023-11-04T15:27:37.138690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:18:00.808576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.131656+0000","last_change":"2023-11-04T15:27:36.149388+0000","last_active":"2023-11-04T15:27:37.131656+0000","last_peered":"2023-11-04T15:27:37.131656+0000","last_clean":"2023-11-04T15:27:37.131656+0000","last_became_active":"2023-11-04T15:27:36.148825+0000","last_became_peered":"2023-11-04T15:27:36.148825+0000","last_unstale":"2023-11-04T15:27:37.131656+0000","last_undegraded":"2023-11-04T15:27:37.131656+0000","last_fullsized":"2023-11-04T15:27:37.131656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:27:25.258046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199860+0000","last_change":"2023-11-04T15:27:36.145651+0000","last_active":"2023-11-04T15:27:38.199860+0000","last_peered":"2023-11-04T15:27:38.199860+0000","last_clean":"2023-11-04T15:27:38.199860+0000","last_became_active":"2023-11-04T15:27:36.145392+0000","last_became_peered":"2023-11-04T15:27:36.145392+0000","last_unstale":"2023-11-04T15:27:38.199860+0000","last_undegraded":"2023-11-04T15:27:38.199860+0000","last_fullsized":"2023-11-04T15:27:38.199860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:12:07.727740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.137860+0000","last_change":"2023-11-04T15:27:36.145527+0000","last_active":"2023-11-04T15:27:37.137860+0000","last_peered":"2023-11-04T15:27:37.137860+0000","last_clean":"2023-11-04T15:27:37.137860+0000","last_became_active":"2023-11-04T15:27:36.145273+0000","last_became_peered":"2023-11-04T15:27:36.145273+0000","last_unstale":"2023-11-04T15:27:37.137860+0000","last_undegraded":"2023-11-04T15:27:37.137860+0000","last_fullsized":"2023-11-04T15:27:37.137860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:27:25.258046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.130831+0000","last_change":"2023-11-04T15:27:36.146680+0000","last_active":"2023-11-04T15:27:37.130831+0000","last_peered":"2023-11-04T15:27:37.130831+0000","last_clean":"2023-11-04T15:27:37.130831+0000","last_became_active":"2023-11-04T15:27:36.144053+0000","last_became_peered":"2023-11-04T15:27:36.144053+0000","last_unstale":"2023-11-04T15:27:37.130831+0000","last_undegraded":"2023-11-04T15:27:37.130831+0000","last_fullsized":"2023-11-04T15:27:37.130831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:41:10.315016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138844+0000","last_change":"2023-11-04T15:27:36.148707+0000","last_active":"2023-11-04T15:27:37.138844+0000","last_peered":"2023-11-04T15:27:37.138844+0000","last_clean":"2023-11-04T15:27:37.138844+0000","last_became_active":"2023-11-04T15:27:36.148342+0000","last_became_peered":"2023-11-04T15:27:36.148342+0000","last_unstale":"2023-11-04T15:27:37.138844+0000","last_undegraded":"2023-11-04T15:27:37.138844+0000","last_fullsized":"2023-11-04T15:27:37.138844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:47:40.350777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.131523+0000","last_change":"2023-11-04T15:27:36.149431+0000","last_active":"2023-11-04T15:27:37.131523+0000","last_peered":"2023-11-04T15:27:37.131523+0000","last_clean":"2023-11-04T15:27:37.131523+0000","last_became_active":"2023-11-04T15:27:36.148951+0000","last_became_peered":"2023-11-04T15:27:36.148951+0000","last_unstale":"2023-11-04T15:27:37.131523+0000","last_undegraded":"2023-11-04T15:27:37.131523+0000","last_fullsized":"2023-11-04T15:27:37.131523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:58:32.190696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.149532+0000","last_change":"2023-11-04T15:27:35.775931+0000","last_active":"2023-11-04T15:27:36.149532+0000","last_peered":"2023-11-04T15:27:36.149532+0000","last_clean":"2023-11-04T15:27:36.149532+0000","last_became_active":"2023-11-04T15:27:35.775616+0000","last_became_peered":"2023-11-04T15:27:35.775616+0000","last_unstale":"2023-11-04T15:27:36.149532+0000","last_undegraded":"2023-11-04T15:27:36.149532+0000","last_fullsized":"2023-11-04T15:27:36.149532+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:14:34.175377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138328+0000","last_change":"2023-11-04T15:27:36.150592+0000","last_active":"2023-11-04T15:27:37.138328+0000","last_peered":"2023-11-04T15:27:37.138328+0000","last_clean":"2023-11-04T15:27:37.138328+0000","last_became_active":"2023-11-04T15:27:36.150276+0000","last_became_peered":"2023-11-04T15:27:36.150276+0000","last_unstale":"2023-11-04T15:27:37.138328+0000","last_undegraded":"2023-11-04T15:27:37.138328+0000","last_fullsized":"2023-11-04T15:27:37.138328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T22:54:18.576814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.129297+0000","last_change":"2023-11-04T15:27:35.776610+0000","last_active":"2023-11-04T15:27:36.129297+0000","last_peered":"2023-11-04T15:27:36.129297+0000","last_clean":"2023-11-04T15:27:36.129297+0000","last_became_active":"2023-11-04T15:27:35.776297+0000","last_became_peered":"2023-11-04T15:27:35.776297+0000","last_unstale":"2023-11-04T15:27:36.129297+0000","last_undegraded":"2023-11-04T15:27:36.129297+0000","last_fullsized":"2023-11-04T15:27:36.129297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:11:01.495068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199760+0000","last_change":"2023-11-04T15:27:36.139847+0000","last_active":"2023-11-04T15:27:38.199760+0000","last_peered":"2023-11-04T15:27:38.199760+0000","last_clean":"2023-11-04T15:27:38.199760+0000","last_became_active":"2023-11-04T15:27:36.139580+0000","last_became_peered":"2023-11-04T15:27:36.139580+0000","last_unstale":"2023-11-04T15:27:38.199760+0000","last_undegraded":"2023-11-04T15:27:38.199760+0000","last_fullsized":"2023-11-04T15:27:38.199760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:38:30.379384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.132950+0000","last_change":"2023-11-04T15:27:35.775977+0000","last_active":"2023-11-04T15:27:36.132950+0000","last_peered":"2023-11-04T15:27:36.132950+0000","last_clean":"2023-11-04T15:27:36.132950+0000","last_became_active":"2023-11-04T15:27:35.775486+0000","last_became_peered":"2023-11-04T15:27:35.775486+0000","last_unstale":"2023-11-04T15:27:36.132950+0000","last_undegraded":"2023-11-04T15:27:36.132950+0000","last_fullsized":"2023-11-04T15:27:36.132950+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:44:09.266115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199570+0000","last_change":"2023-11-04T15:27:36.140633+0000","last_active":"2023-11-04T15:27:38.199570+0000","last_peered":"2023-11-04T15:27:38.199570+0000","last_clean":"2023-11-04T15:27:38.199570+0000","last_became_active":"2023-11-04T15:27:36.139789+0000","last_became_peered":"2023-11-04T15:27:36.139789+0000","last_unstale":"2023-11-04T15:27:38.199570+0000","last_undegraded":"2023-11-04T15:27:38.199570+0000","last_fullsized":"2023-11-04T15:27:38.199570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:55:13.470788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.153862+0000","last_change":"2023-11-04T15:27:35.776168+0000","last_active":"2023-11-04T15:27:36.153862+0000","last_peered":"2023-11-04T15:27:36.153862+0000","last_clean":"2023-11-04T15:27:36.153862+0000","last_became_active":"2023-11-04T15:27:35.775895+0000","last_became_peered":"2023-11-04T15:27:35.775895+0000","last_unstale":"2023-11-04T15:27:36.153862+0000","last_undegraded":"2023-11-04T15:27:36.153862+0000","last_fullsized":"2023-11-04T15:27:36.153862+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:02:27.460776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.143449+0000","last_change":"2023-11-04T15:27:35.767890+0000","last_active":"2023-11-04T15:27:36.143449+0000","last_peered":"2023-11-04T15:27:36.143449+0000","last_clean":"2023-11-04T15:27:36.143449+0000","last_became_active":"2023-11-04T15:27:35.767594+0000","last_became_peered":"2023-11-04T15:27:35.767594+0000","last_unstale":"2023-11-04T15:27:36.143449+0000","last_undegraded":"2023-11-04T15:27:36.143449+0000","last_fullsized":"2023-11-04T15:27:36.143449+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:11:01.495068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138172+0000","last_change":"2023-11-04T15:27:36.148637+0000","last_active":"2023-11-04T15:27:37.138172+0000","last_peered":"2023-11-04T15:27:37.138172+0000","last_clean":"2023-11-04T15:27:37.138172+0000","last_became_active":"2023-11-04T15:27:36.148282+0000","last_became_peered":"2023-11-04T15:27:36.148282+0000","last_unstale":"2023-11-04T15:27:37.138172+0000","last_undegraded":"2023-11-04T15:27:37.138172+0000","last_fullsized":"2023-11-04T15:27:37.138172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:28:21.024990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.148423+0000","last_change":"2023-11-04T15:27:35.771839+0000","last_active":"2023-11-04T15:27:36.148423+0000","last_peered":"2023-11-04T15:27:36.148423+0000","last_clean":"2023-11-04T15:27:36.148423+0000","last_became_active":"2023-11-04T15:27:35.771554+0000","last_became_peered":"2023-11-04T15:27:35.771554+0000","last_unstale":"2023-11-04T15:27:36.148423+0000","last_undegraded":"2023-11-04T15:27:36.148423+0000","last_fullsized":"2023-11-04T15:27:36.148423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:02:11.972760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.139120+0000","last_change":"2023-11-04T15:27:36.149455+0000","last_active":"2023-11-04T15:27:37.139120+0000","last_peered":"2023-11-04T15:27:37.139120+0000","last_clean":"2023-11-04T15:27:37.139120+0000","last_became_active":"2023-11-04T15:27:36.149146+0000","last_became_peered":"2023-11-04T15:27:36.149146+0000","last_unstale":"2023-11-04T15:27:37.139120+0000","last_undegraded":"2023-11-04T15:27:37.139120+0000","last_fullsized":"2023-11-04T15:27:37.139120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:14:54.847413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.153434+0000","last_change":"2023-11-04T15:27:35.773978+0000","last_active":"2023-11-04T15:27:36.153434+0000","last_peered":"2023-11-04T15:27:36.153434+0000","last_clean":"2023-11-04T15:27:36.153434+0000","last_became_active":"2023-11-04T15:27:35.773689+0000","last_became_peered":"2023-11-04T15:27:35.773689+0000","last_unstale":"2023-11-04T15:27:36.153434+0000","last_undegraded":"2023-11-04T15:27:36.153434+0000","last_fullsized":"2023-11-04T15:27:36.153434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:52:13.268866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.139684+0000","last_change":"2023-11-04T15:27:36.141984+0000","last_active":"2023-11-04T15:27:37.139684+0000","last_peered":"2023-11-04T15:27:37.139684+0000","last_clean":"2023-11-04T15:27:37.139684+0000","last_became_active":"2023-11-04T15:27:36.141695+0000","last_became_peered":"2023-11-04T15:27:36.141695+0000","last_unstale":"2023-11-04T15:27:37.139684+0000","last_undegraded":"2023-11-04T15:27:37.139684+0000","last_fullsized":"2023-11-04T15:27:37.139684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:45:22.367523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.132473+0000","last_change":"2023-11-04T15:27:35.774108+0000","last_active":"2023-11-04T15:27:36.132473+0000","last_peered":"2023-11-04T15:27:36.132473+0000","last_clean":"2023-11-04T15:27:36.132473+0000","last_became_active":"2023-11-04T15:27:35.773818+0000","last_became_peered":"2023-11-04T15:27:35.773818+0000","last_unstale":"2023-11-04T15:27:36.132473+0000","last_undegraded":"2023-11-04T15:27:36.132473+0000","last_fullsized":"2023-11-04T15:27:36.132473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:42:49.218866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199659+0000","last_change":"2023-11-04T15:27:36.150909+0000","last_active":"2023-11-04T15:27:38.199659+0000","last_peered":"2023-11-04T15:27:38.199659+0000","last_clean":"2023-11-04T15:27:38.199659+0000","last_became_active":"2023-11-04T15:27:36.150653+0000","last_became_peered":"2023-11-04T15:27:36.150653+0000","last_unstale":"2023-11-04T15:27:38.199659+0000","last_undegraded":"2023-11-04T15:27:38.199659+0000","last_fullsized":"2023-11-04T15:27:38.199659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:36:21.960547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.152189+0000","last_change":"2023-11-04T15:27:35.773128+0000","last_active":"2023-11-04T15:27:36.152189+0000","last_peered":"2023-11-04T15:27:36.152189+0000","last_clean":"2023-11-04T15:27:36.152189+0000","last_became_active":"2023-11-04T15:27:35.772815+0000","last_became_peered":"2023-11-04T15:27:35.772815+0000","last_unstale":"2023-11-04T15:27:36.152189+0000","last_undegraded":"2023-11-04T15:27:36.152189+0000","last_fullsized":"2023-11-04T15:27:36.152189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:42:49.218866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138405+0000","last_change":"2023-11-04T15:27:36.151451+0000","last_active":"2023-11-04T15:27:37.138405+0000","last_peered":"2023-11-04T15:27:37.138405+0000","last_clean":"2023-11-04T15:27:37.138405+0000","last_became_active":"2023-11-04T15:27:36.150667+0000","last_became_peered":"2023-11-04T15:27:36.150667+0000","last_unstale":"2023-11-04T15:27:37.138405+0000","last_undegraded":"2023-11-04T15:27:37.138405+0000","last_fullsized":"2023-11-04T15:27:37.138405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:55:13.470788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.131250+0000","last_change":"2023-11-04T15:27:35.775559+0000","last_active":"2023-11-04T15:27:36.131250+0000","last_peered":"2023-11-04T15:27:36.131250+0000","last_clean":"2023-11-04T15:27:36.131250+0000","last_became_active":"2023-11-04T15:27:35.775063+0000","last_became_peered":"2023-11-04T15:27:35.775063+0000","last_unstale":"2023-11-04T15:27:36.131250+0000","last_undegraded":"2023-11-04T15:27:36.131250+0000","last_fullsized":"2023-11-04T15:27:36.131250+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:30:45.293294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138337+0000","last_change":"2023-11-04T15:27:36.140390+0000","last_active":"2023-11-04T15:27:37.138337+0000","last_peered":"2023-11-04T15:27:37.138337+0000","last_clean":"2023-11-04T15:27:37.138337+0000","last_became_active":"2023-11-04T15:27:36.139103+0000","last_became_peered":"2023-11-04T15:27:36.139103+0000","last_unstale":"2023-11-04T15:27:37.138337+0000","last_undegraded":"2023-11-04T15:27:37.138337+0000","last_fullsized":"2023-11-04T15:27:37.138337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:59:35.340281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.133063+0000","last_change":"2023-11-04T15:27:35.773686+0000","last_active":"2023-11-04T15:27:36.133063+0000","last_peered":"2023-11-04T15:27:36.133063+0000","last_clean":"2023-11-04T15:27:36.133063+0000","last_became_active":"2023-11-04T15:27:35.773449+0000","last_became_peered":"2023-11-04T15:27:35.773449+0000","last_unstale":"2023-11-04T15:27:36.133063+0000","last_undegraded":"2023-11-04T15:27:36.133063+0000","last_fullsized":"2023-11-04T15:27:36.133063+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:17:14.527023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.139466+0000","last_change":"2023-11-04T15:27:36.141355+0000","last_active":"2023-11-04T15:27:37.139466+0000","last_peered":"2023-11-04T15:27:37.139466+0000","last_clean":"2023-11-04T15:27:37.139466+0000","last_became_active":"2023-11-04T15:27:36.141086+0000","last_became_peered":"2023-11-04T15:27:36.141086+0000","last_unstale":"2023-11-04T15:27:37.139466+0000","last_undegraded":"2023-11-04T15:27:37.139466+0000","last_fullsized":"2023-11-04T15:27:37.139466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:28:45.715407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.141205+0000","last_change":"2023-11-04T15:27:35.770858+0000","last_active":"2023-11-04T15:27:36.141205+0000","last_peered":"2023-11-04T15:27:36.141205+0000","last_clean":"2023-11-04T15:27:36.141205+0000","last_became_active":"2023-11-04T15:27:35.769001+0000","last_became_peered":"2023-11-04T15:27:35.769001+0000","last_unstale":"2023-11-04T15:27:36.141205+0000","last_undegraded":"2023-11-04T15:27:36.141205+0000","last_fullsized":"2023-11-04T15:27:36.141205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:01:29.923726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.131681+0000","last_change":"2023-11-04T15:27:36.148390+0000","last_active":"2023-11-04T15:27:37.131681+0000","last_peered":"2023-11-04T15:27:37.131681+0000","last_clean":"2023-11-04T15:27:37.131681+0000","last_became_active":"2023-11-04T15:27:36.147034+0000","last_became_peered":"2023-11-04T15:27:36.147034+0000","last_unstale":"2023-11-04T15:27:37.131681+0000","last_undegraded":"2023-11-04T15:27:37.131681+0000","last_fullsized":"2023-11-04T15:27:37.131681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:14:54.847413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":167,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.136344+0000","last_change":"2023-11-04T15:27:26.267129+0000","last_active":"2023-11-04T15:27:36.136344+0000","last_peered":"2023-11-04T15:27:36.136344+0000","last_clean":"2023-11-04T15:27:36.136344+0000","last_became_active":"2023-11-04T15:27:26.266242+0000","last_became_peered":"2023-11-04T15:27:26.266242+0000","last_unstale":"2023-11-04T15:27:36.136344+0000","last_undegraded":"2023-11-04T15:27:36.136344+0000","last_fullsized":"2023-11-04T15:27:36.136344+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:25.163848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:25.163848+0000","last_clean_scrub_stamp":"2023-11-04T15:27:25.163848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:54:55.231471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.130334+0000","last_change":"2023-11-04T15:27:31.620178+0000","last_active":"2023-11-04T15:27:36.130334+0000","last_peered":"2023-11-04T15:27:36.130334+0000","last_clean":"2023-11-04T15:27:36.130334+0000","last_became_active":"2023-11-04T15:27:31.619798+0000","last_became_peered":"2023-11-04T15:27:31.619798+0000","last_unstale":"2023-11-04T15:27:36.130334+0000","last_undegraded":"2023-11-04T15:27:36.130334+0000","last_fullsized":"2023-11-04T15:27:36.130334+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:50:31.717109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.141439+0000","last_change":"2023-11-04T15:27:35.769689+0000","last_active":"2023-11-04T15:27:36.141439+0000","last_peered":"2023-11-04T15:27:36.141439+0000","last_clean":"2023-11-04T15:27:36.141439+0000","last_became_active":"2023-11-04T15:27:35.769150+0000","last_became_peered":"2023-11-04T15:27:35.769150+0000","last_unstale":"2023-11-04T15:27:36.141439+0000","last_undegraded":"2023-11-04T15:27:36.141439+0000","last_fullsized":"2023-11-04T15:27:36.141439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:15:19.151223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138508+0000","last_change":"2023-11-04T15:27:36.140877+0000","last_active":"2023-11-04T15:27:37.138508+0000","last_peered":"2023-11-04T15:27:37.138508+0000","last_clean":"2023-11-04T15:27:37.138508+0000","last_became_active":"2023-11-04T15:27:36.140619+0000","last_became_peered":"2023-11-04T15:27:36.140619+0000","last_unstale":"2023-11-04T15:27:37.138508+0000","last_undegraded":"2023-11-04T15:27:37.138508+0000","last_fullsized":"2023-11-04T15:27:37.138508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:42:12.902707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.138612+0000","last_change":"2023-11-04T15:27:31.622106+0000","last_active":"2023-11-04T15:27:36.138612+0000","last_peered":"2023-11-04T15:27:36.138612+0000","last_clean":"2023-11-04T15:27:36.138612+0000","last_became_active":"2023-11-04T15:27:31.621889+0000","last_became_peered":"2023-11-04T15:27:31.621889+0000","last_unstale":"2023-11-04T15:27:36.138612+0000","last_undegraded":"2023-11-04T15:27:36.138612+0000","last_fullsized":"2023-11-04T15:27:36.138612+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:11:00.327441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.129140+0000","last_change":"2023-11-04T15:27:35.771207+0000","last_active":"2023-11-04T15:27:36.129140+0000","last_peered":"2023-11-04T15:27:36.129140+0000","last_clean":"2023-11-04T15:27:36.129140+0000","last_became_active":"2023-11-04T15:27:35.770364+0000","last_became_peered":"2023-11-04T15:27:35.770364+0000","last_unstale":"2023-11-04T15:27:36.129140+0000","last_undegraded":"2023-11-04T15:27:36.129140+0000","last_fullsized":"2023-11-04T15:27:36.129140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:23:45.371175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199640+0000","last_change":"2023-11-04T15:27:36.144731+0000","last_active":"2023-11-04T15:27:38.199640+0000","last_peered":"2023-11-04T15:27:38.199640+0000","last_clean":"2023-11-04T15:27:38.199640+0000","last_became_active":"2023-11-04T15:27:36.144459+0000","last_became_peered":"2023-11-04T15:27:36.144459+0000","last_unstale":"2023-11-04T15:27:38.199640+0000","last_undegraded":"2023-11-04T15:27:38.199640+0000","last_fullsized":"2023-11-04T15:27:38.199640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:28:45.715407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.142013+0000","last_change":"2023-11-04T15:27:31.622710+0000","last_active":"2023-11-04T15:27:36.142013+0000","last_peered":"2023-11-04T15:27:36.142013+0000","last_clean":"2023-11-04T15:27:36.142013+0000","last_became_active":"2023-11-04T15:27:31.622378+0000","last_became_peered":"2023-11-04T15:27:31.622378+0000","last_unstale":"2023-11-04T15:27:36.142013+0000","last_undegraded":"2023-11-04T15:27:36.142013+0000","last_fullsized":"2023-11-04T15:27:36.142013+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:49:04.803105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.141277+0000","last_change":"2023-11-04T15:27:35.774630+0000","last_active":"2023-11-04T15:27:36.141277+0000","last_peered":"2023-11-04T15:27:36.141277+0000","last_clean":"2023-11-04T15:27:36.141277+0000","last_became_active":"2023-11-04T15:27:35.774339+0000","last_became_peered":"2023-11-04T15:27:35.774339+0000","last_unstale":"2023-11-04T15:27:36.141277+0000","last_undegraded":"2023-11-04T15:27:36.141277+0000","last_fullsized":"2023-11-04T15:27:36.141277+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:44:38.690122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.131722+0000","last_change":"2023-11-04T15:27:36.148319+0000","last_active":"2023-11-04T15:27:37.131722+0000","last_peered":"2023-11-04T15:27:37.131722+0000","last_clean":"2023-11-04T15:27:37.131722+0000","last_became_active":"2023-11-04T15:27:36.146930+0000","last_became_peered":"2023-11-04T15:27:36.146930+0000","last_unstale":"2023-11-04T15:27:37.131722+0000","last_undegraded":"2023-11-04T15:27:37.131722+0000","last_fullsized":"2023-11-04T15:27:37.131722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:28:45.715407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.131327+0000","last_change":"2023-11-04T15:27:31.622105+0000","last_active":"2023-11-04T15:27:36.131327+0000","last_peered":"2023-11-04T15:27:36.131327+0000","last_clean":"2023-11-04T15:27:36.131327+0000","last_became_active":"2023-11-04T15:27:31.621849+0000","last_became_peered":"2023-11-04T15:27:31.621849+0000","last_unstale":"2023-11-04T15:27:36.131327+0000","last_undegraded":"2023-11-04T15:27:36.131327+0000","last_fullsized":"2023-11-04T15:27:36.131327+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:20:41.777316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.134218+0000","last_change":"2023-11-04T15:27:35.770188+0000","last_active":"2023-11-04T15:27:36.134218+0000","last_peered":"2023-11-04T15:27:36.134218+0000","last_clean":"2023-11-04T15:27:36.134218+0000","last_became_active":"2023-11-04T15:27:35.769730+0000","last_became_peered":"2023-11-04T15:27:35.769730+0000","last_unstale":"2023-11-04T15:27:36.134218+0000","last_undegraded":"2023-11-04T15:27:36.134218+0000","last_fullsized":"2023-11-04T15:27:36.134218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:08:22.991334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.131556+0000","last_change":"2023-11-04T15:27:36.149225+0000","last_active":"2023-11-04T15:27:37.131556+0000","last_peered":"2023-11-04T15:27:37.131556+0000","last_clean":"2023-11-04T15:27:37.131556+0000","last_became_active":"2023-11-04T15:27:36.144417+0000","last_became_peered":"2023-11-04T15:27:36.144417+0000","last_unstale":"2023-11-04T15:27:37.131556+0000","last_undegraded":"2023-11-04T15:27:37.131556+0000","last_fullsized":"2023-11-04T15:27:37.131556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:41:32.995261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.131447+0000","last_change":"2023-11-04T15:27:35.770033+0000","last_active":"2023-11-04T15:27:36.131447+0000","last_peered":"2023-11-04T15:27:36.131447+0000","last_clean":"2023-11-04T15:27:36.131447+0000","last_became_active":"2023-11-04T15:27:35.769772+0000","last_became_peered":"2023-11-04T15:27:35.769772+0000","last_unstale":"2023-11-04T15:27:36.131447+0000","last_undegraded":"2023-11-04T15:27:36.131447+0000","last_fullsized":"2023-11-04T15:27:36.131447+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:00:20.246822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.142511+0000","last_change":"2023-11-04T15:27:31.622663+0000","last_active":"2023-11-04T15:27:36.142511+0000","last_peered":"2023-11-04T15:27:36.142511+0000","last_clean":"2023-11-04T15:27:36.142511+0000","last_became_active":"2023-11-04T15:27:31.622350+0000","last_became_peered":"2023-11-04T15:27:31.622350+0000","last_unstale":"2023-11-04T15:27:36.142511+0000","last_undegraded":"2023-11-04T15:27:36.142511+0000","last_fullsized":"2023-11-04T15:27:36.142511+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:31:02.273249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.131048+0000","last_change":"2023-11-04T15:27:36.144275+0000","last_active":"2023-11-04T15:27:37.131048+0000","last_peered":"2023-11-04T15:27:37.131048+0000","last_clean":"2023-11-04T15:27:37.131048+0000","last_became_active":"2023-11-04T15:27:36.143991+0000","last_became_peered":"2023-11-04T15:27:36.143991+0000","last_unstale":"2023-11-04T15:27:37.131048+0000","last_undegraded":"2023-11-04T15:27:37.131048+0000","last_fullsized":"2023-11-04T15:27:37.131048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:48:58.102459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.142118+0000","last_change":"2023-11-04T15:27:35.769416+0000","last_active":"2023-11-04T15:27:36.142118+0000","last_peered":"2023-11-04T15:27:36.142118+0000","last_clean":"2023-11-04T15:27:36.142118+0000","last_became_active":"2023-11-04T15:27:35.769095+0000","last_became_peered":"2023-11-04T15:27:35.769095+0000","last_unstale":"2023-11-04T15:27:36.142118+0000","last_undegraded":"2023-11-04T15:27:36.142118+0000","last_fullsized":"2023-11-04T15:27:36.142118+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T22:02:04.025848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.137396+0000","last_change":"2023-11-04T15:27:31.619973+0000","last_active":"2023-11-04T15:27:36.137396+0000","last_peered":"2023-11-04T15:27:36.137396+0000","last_clean":"2023-11-04T15:27:36.137396+0000","last_became_active":"2023-11-04T15:27:31.619702+0000","last_became_peered":"2023-11-04T15:27:31.619702+0000","last_unstale":"2023-11-04T15:27:36.137396+0000","last_undegraded":"2023-11-04T15:27:36.137396+0000","last_fullsized":"2023-11-04T15:27:36.137396+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:24:34.782619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199835+0000","last_change":"2023-11-04T15:27:36.139955+0000","last_active":"2023-11-04T15:27:38.199835+0000","last_peered":"2023-11-04T15:27:38.199835+0000","last_clean":"2023-11-04T15:27:38.199835+0000","last_became_active":"2023-11-04T15:27:36.139707+0000","last_became_peered":"2023-11-04T15:27:36.139707+0000","last_unstale":"2023-11-04T15:27:38.199835+0000","last_undegraded":"2023-11-04T15:27:38.199835+0000","last_fullsized":"2023-11-04T15:27:38.199835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:58:32.190696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.151891+0000","last_change":"2023-11-04T15:27:35.768818+0000","last_active":"2023-11-04T15:27:36.151891+0000","last_peered":"2023-11-04T15:27:36.151891+0000","last_clean":"2023-11-04T15:27:36.151891+0000","last_became_active":"2023-11-04T15:27:35.768320+0000","last_became_peered":"2023-11-04T15:27:35.768320+0000","last_unstale":"2023-11-04T15:27:36.151891+0000","last_undegraded":"2023-11-04T15:27:36.151891+0000","last_fullsized":"2023-11-04T15:27:36.151891+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:14:58.601545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.142320+0000","last_change":"2023-11-04T15:27:31.624625+0000","last_active":"2023-11-04T15:27:36.142320+0000","last_peered":"2023-11-04T15:27:36.142320+0000","last_clean":"2023-11-04T15:27:36.142320+0000","last_became_active":"2023-11-04T15:27:31.624347+0000","last_became_peered":"2023-11-04T15:27:31.624347+0000","last_unstale":"2023-11-04T15:27:36.142320+0000","last_undegraded":"2023-11-04T15:27:36.142320+0000","last_fullsized":"2023-11-04T15:27:36.142320+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:53:45.131692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199126+0000","last_change":"2023-11-04T15:27:36.138145+0000","last_active":"2023-11-04T15:27:38.199126+0000","last_peered":"2023-11-04T15:27:38.199126+0000","last_clean":"2023-11-04T15:27:38.199126+0000","last_became_active":"2023-11-04T15:27:36.137897+0000","last_became_peered":"2023-11-04T15:27:36.137897+0000","last_unstale":"2023-11-04T15:27:38.199126+0000","last_undegraded":"2023-11-04T15:27:38.199126+0000","last_fullsized":"2023-11-04T15:27:38.199126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:53:25.907251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.130871+0000","last_change":"2023-11-04T15:27:35.772416+0000","last_active":"2023-11-04T15:27:36.130871+0000","last_peered":"2023-11-04T15:27:36.130871+0000","last_clean":"2023-11-04T15:27:36.130871+0000","last_became_active":"2023-11-04T15:27:35.772121+0000","last_became_peered":"2023-11-04T15:27:35.772121+0000","last_unstale":"2023-11-04T15:27:36.130871+0000","last_undegraded":"2023-11-04T15:27:36.130871+0000","last_fullsized":"2023-11-04T15:27:36.130871+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:58:09.475936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.132771+0000","last_change":"2023-11-04T15:27:31.620235+0000","last_active":"2023-11-04T15:27:36.132771+0000","last_peered":"2023-11-04T15:27:36.132771+0000","last_clean":"2023-11-04T15:27:36.132771+0000","last_became_active":"2023-11-04T15:27:31.619831+0000","last_became_peered":"2023-11-04T15:27:31.619831+0000","last_unstale":"2023-11-04T15:27:36.132771+0000","last_undegraded":"2023-11-04T15:27:36.132771+0000","last_fullsized":"2023-11-04T15:27:36.132771+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:44:07.412379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138914+0000","last_change":"2023-11-04T15:27:36.141133+0000","last_active":"2023-11-04T15:27:37.138914+0000","last_peered":"2023-11-04T15:27:37.138914+0000","last_clean":"2023-11-04T15:27:37.138914+0000","last_became_active":"2023-11-04T15:27:36.140871+0000","last_became_peered":"2023-11-04T15:27:36.140871+0000","last_unstale":"2023-11-04T15:27:37.138914+0000","last_undegraded":"2023-11-04T15:27:37.138914+0000","last_fullsized":"2023-11-04T15:27:37.138914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:28.095802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.139653+0000","last_change":"2023-11-04T15:27:36.139723+0000","last_active":"2023-11-04T15:27:37.139653+0000","last_peered":"2023-11-04T15:27:37.139653+0000","last_clean":"2023-11-04T15:27:37.139653+0000","last_became_active":"2023-11-04T15:27:36.139487+0000","last_became_peered":"2023-11-04T15:27:36.139487+0000","last_unstale":"2023-11-04T15:27:37.139653+0000","last_undegraded":"2023-11-04T15:27:37.139653+0000","last_fullsized":"2023-11-04T15:27:37.139653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:47:58.380308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.158730+0000","last_change":"2023-11-04T15:27:35.775665+0000","last_active":"2023-11-04T15:27:36.158730+0000","last_peered":"2023-11-04T15:27:36.158730+0000","last_clean":"2023-11-04T15:27:36.158730+0000","last_became_active":"2023-11-04T15:27:35.775356+0000","last_became_peered":"2023-11-04T15:27:35.775356+0000","last_unstale":"2023-11-04T15:27:36.158730+0000","last_undegraded":"2023-11-04T15:27:36.158730+0000","last_fullsized":"2023-11-04T15:27:36.158730+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:36:12.941030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.130995+0000","last_change":"2023-11-04T15:27:36.146737+0000","last_active":"2023-11-04T15:27:37.130995+0000","last_peered":"2023-11-04T15:27:37.130995+0000","last_clean":"2023-11-04T15:27:37.130995+0000","last_became_active":"2023-11-04T15:27:36.146464+0000","last_became_peered":"2023-11-04T15:27:36.146464+0000","last_unstale":"2023-11-04T15:27:37.130995+0000","last_undegraded":"2023-11-04T15:27:37.130995+0000","last_fullsized":"2023-11-04T15:27:37.130995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:47:40.350777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.142014+0000","last_change":"2023-11-04T15:27:35.770401+0000","last_active":"2023-11-04T15:27:36.142014+0000","last_peered":"2023-11-04T15:27:36.142014+0000","last_clean":"2023-11-04T15:27:36.142014+0000","last_became_active":"2023-11-04T15:27:35.769904+0000","last_became_peered":"2023-11-04T15:27:35.769904+0000","last_unstale":"2023-11-04T15:27:36.142014+0000","last_undegraded":"2023-11-04T15:27:36.142014+0000","last_fullsized":"2023-11-04T15:27:36.142014+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:58:09.475936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.133447+0000","last_change":"2023-11-04T15:27:35.768689+0000","last_active":"2023-11-04T15:27:36.133447+0000","last_peered":"2023-11-04T15:27:36.133447+0000","last_clean":"2023-11-04T15:27:36.133447+0000","last_became_active":"2023-11-04T15:27:35.768413+0000","last_became_peered":"2023-11-04T15:27:35.768413+0000","last_unstale":"2023-11-04T15:27:36.133447+0000","last_undegraded":"2023-11-04T15:27:36.133447+0000","last_fullsized":"2023-11-04T15:27:36.133447+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:23:45.371175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199123+0000","last_change":"2023-11-04T15:27:36.139778+0000","last_active":"2023-11-04T15:27:38.199123+0000","last_peered":"2023-11-04T15:27:38.199123+0000","last_clean":"2023-11-04T15:27:38.199123+0000","last_became_active":"2023-11-04T15:27:36.139524+0000","last_became_peered":"2023-11-04T15:27:36.139524+0000","last_unstale":"2023-11-04T15:27:38.199123+0000","last_undegraded":"2023-11-04T15:27:38.199123+0000","last_fullsized":"2023-11-04T15:27:38.199123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:27:25.258046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.132100+0000","last_change":"2023-11-04T15:27:35.776242+0000","last_active":"2023-11-04T15:27:36.132100+0000","last_peered":"2023-11-04T15:27:36.132100+0000","last_clean":"2023-11-04T15:27:36.132100+0000","last_became_active":"2023-11-04T15:27:35.775917+0000","last_became_peered":"2023-11-04T15:27:35.775917+0000","last_unstale":"2023-11-04T15:27:36.132100+0000","last_undegraded":"2023-11-04T15:27:36.132100+0000","last_fullsized":"2023-11-04T15:27:36.132100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:14:58.601545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.130771+0000","last_change":"2023-11-04T15:27:36.151371+0000","last_active":"2023-11-04T15:27:37.130771+0000","last_peered":"2023-11-04T15:27:37.130771+0000","last_clean":"2023-11-04T15:27:37.130771+0000","last_became_active":"2023-11-04T15:27:36.150557+0000","last_became_peered":"2023-11-04T15:27:36.150557+0000","last_unstale":"2023-11-04T15:27:37.130771+0000","last_undegraded":"2023-11-04T15:27:37.130771+0000","last_fullsized":"2023-11-04T15:27:37.130771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:12:07.727740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138851+0000","last_change":"2023-11-04T15:27:36.150111+0000","last_active":"2023-11-04T15:27:37.138851+0000","last_peered":"2023-11-04T15:27:37.138851+0000","last_clean":"2023-11-04T15:27:37.138851+0000","last_became_active":"2023-11-04T15:27:36.149831+0000","last_became_peered":"2023-11-04T15:27:36.149831+0000","last_unstale":"2023-11-04T15:27:37.138851+0000","last_undegraded":"2023-11-04T15:27:37.138851+0000","last_fullsized":"2023-11-04T15:27:37.138851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:16:09.862958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.141100+0000","last_change":"2023-11-04T15:27:35.770634+0000","last_active":"2023-11-04T15:27:36.141100+0000","last_peered":"2023-11-04T15:27:36.141100+0000","last_clean":"2023-11-04T15:27:36.141100+0000","last_became_active":"2023-11-04T15:27:35.770022+0000","last_became_peered":"2023-11-04T15:27:35.770022+0000","last_unstale":"2023-11-04T15:27:36.141100+0000","last_undegraded":"2023-11-04T15:27:36.141100+0000","last_fullsized":"2023-11-04T15:27:36.141100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:03:49.354013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199639+0000","last_change":"2023-11-04T15:27:36.139190+0000","last_active":"2023-11-04T15:27:38.199639+0000","last_peered":"2023-11-04T15:27:38.199639+0000","last_clean":"2023-11-04T15:27:38.199639+0000","last_became_active":"2023-11-04T15:27:36.138908+0000","last_became_peered":"2023-11-04T15:27:36.138908+0000","last_unstale":"2023-11-04T15:27:38.199639+0000","last_undegraded":"2023-11-04T15:27:38.199639+0000","last_fullsized":"2023-11-04T15:27:38.199639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:32:27.370984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.141402+0000","last_change":"2023-11-04T15:27:35.768190+0000","last_active":"2023-11-04T15:27:36.141402+0000","last_peered":"2023-11-04T15:27:36.141402+0000","last_clean":"2023-11-04T15:27:36.141402+0000","last_became_active":"2023-11-04T15:27:35.767858+0000","last_became_peered":"2023-11-04T15:27:35.767858+0000","last_unstale":"2023-11-04T15:27:36.141402+0000","last_undegraded":"2023-11-04T15:27:36.141402+0000","last_fullsized":"2023-11-04T15:27:36.141402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:55:22.956180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199427+0000","last_change":"2023-11-04T15:27:36.143718+0000","last_active":"2023-11-04T15:27:38.199427+0000","last_peered":"2023-11-04T15:27:38.199427+0000","last_clean":"2023-11-04T15:27:38.199427+0000","last_became_active":"2023-11-04T15:27:36.143442+0000","last_became_peered":"2023-11-04T15:27:36.143442+0000","last_unstale":"2023-11-04T15:27:38.199427+0000","last_undegraded":"2023-11-04T15:27:38.199427+0000","last_fullsized":"2023-11-04T15:27:38.199427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:45:22.367523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.148708+0000","last_change":"2023-11-04T15:27:35.771653+0000","last_active":"2023-11-04T15:27:36.148708+0000","last_peered":"2023-11-04T15:27:36.148708+0000","last_clean":"2023-11-04T15:27:36.148708+0000","last_became_active":"2023-11-04T15:27:35.770539+0000","last_became_peered":"2023-11-04T15:27:35.770539+0000","last_unstale":"2023-11-04T15:27:36.148708+0000","last_undegraded":"2023-11-04T15:27:36.148708+0000","last_fullsized":"2023-11-04T15:27:36.148708+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:14:58.601545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.131407+0000","last_change":"2023-11-04T15:27:36.148481+0000","last_active":"2023-11-04T15:27:37.131407+0000","last_peered":"2023-11-04T15:27:37.131407+0000","last_clean":"2023-11-04T15:27:37.131407+0000","last_became_active":"2023-11-04T15:27:36.146477+0000","last_became_peered":"2023-11-04T15:27:36.146477+0000","last_unstale":"2023-11-04T15:27:37.131407+0000","last_undegraded":"2023-11-04T15:27:37.131407+0000","last_fullsized":"2023-11-04T15:27:37.131407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:53:25.907251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.140802+0000","last_change":"2023-11-04T15:27:35.772092+0000","last_active":"2023-11-04T15:27:36.140802+0000","last_peered":"2023-11-04T15:27:36.140802+0000","last_clean":"2023-11-04T15:27:36.140802+0000","last_became_active":"2023-11-04T15:27:35.771316+0000","last_became_peered":"2023-11-04T15:27:35.771316+0000","last_unstale":"2023-11-04T15:27:36.140802+0000","last_undegraded":"2023-11-04T15:27:36.140802+0000","last_fullsized":"2023-11-04T15:27:36.140802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:00:20.246822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.139555+0000","last_change":"2023-11-04T15:27:36.144382+0000","last_active":"2023-11-04T15:27:37.139555+0000","last_peered":"2023-11-04T15:27:37.139555+0000","last_clean":"2023-11-04T15:27:37.139555+0000","last_became_active":"2023-11-04T15:27:36.144066+0000","last_became_peered":"2023-11-04T15:27:36.144066+0000","last_unstale":"2023-11-04T15:27:37.139555+0000","last_undegraded":"2023-11-04T15:27:37.139555+0000","last_fullsized":"2023-11-04T15:27:37.139555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:41:32.995261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.143653+0000","last_change":"2023-11-04T15:27:35.768679+0000","last_active":"2023-11-04T15:27:36.143653+0000","last_peered":"2023-11-04T15:27:36.143653+0000","last_clean":"2023-11-04T15:27:36.143653+0000","last_became_active":"2023-11-04T15:27:35.767852+0000","last_became_peered":"2023-11-04T15:27:35.767852+0000","last_unstale":"2023-11-04T15:27:36.143653+0000","last_undegraded":"2023-11-04T15:27:36.143653+0000","last_fullsized":"2023-11-04T15:27:36.143653+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:47:47.130490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.139704+0000","last_change":"2023-11-04T15:27:36.141439+0000","last_active":"2023-11-04T15:27:37.139704+0000","last_peered":"2023-11-04T15:27:37.139704+0000","last_clean":"2023-11-04T15:27:37.139704+0000","last_became_active":"2023-11-04T15:27:36.141167+0000","last_became_peered":"2023-11-04T15:27:36.141167+0000","last_unstale":"2023-11-04T15:27:37.139704+0000","last_undegraded":"2023-11-04T15:27:37.139704+0000","last_fullsized":"2023-11-04T15:27:37.139704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:22:21.262360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.148043+0000","last_change":"2023-11-04T15:27:35.775629+0000","last_active":"2023-11-04T15:27:36.148043+0000","last_peered":"2023-11-04T15:27:36.148043+0000","last_clean":"2023-11-04T15:27:36.148043+0000","last_became_active":"2023-11-04T15:27:35.775171+0000","last_became_peered":"2023-11-04T15:27:35.775171+0000","last_unstale":"2023-11-04T15:27:36.148043+0000","last_undegraded":"2023-11-04T15:27:36.148043+0000","last_fullsized":"2023-11-04T15:27:36.148043+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:13:42.865721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199233+0000","last_change":"2023-11-04T15:27:36.146049+0000","last_active":"2023-11-04T15:27:38.199233+0000","last_peered":"2023-11-04T15:27:38.199233+0000","last_clean":"2023-11-04T15:27:38.199233+0000","last_became_active":"2023-11-04T15:27:36.145560+0000","last_became_peered":"2023-11-04T15:27:36.145560+0000","last_unstale":"2023-11-04T15:27:38.199233+0000","last_undegraded":"2023-11-04T15:27:38.199233+0000","last_fullsized":"2023-11-04T15:27:38.199233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:14:54.847413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.140784+0000","last_change":"2023-11-04T15:27:35.771225+0000","last_active":"2023-11-04T15:27:36.140784+0000","last_peered":"2023-11-04T15:27:36.140784+0000","last_clean":"2023-11-04T15:27:36.140784+0000","last_became_active":"2023-11-04T15:27:35.770873+0000","last_became_peered":"2023-11-04T15:27:35.770873+0000","last_unstale":"2023-11-04T15:27:36.140784+0000","last_undegraded":"2023-11-04T15:27:36.140784+0000","last_fullsized":"2023-11-04T15:27:36.140784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:02:11.972760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138996+0000","last_change":"2023-11-04T15:27:36.148228+0000","last_active":"2023-11-04T15:27:37.138996+0000","last_peered":"2023-11-04T15:27:37.138996+0000","last_clean":"2023-11-04T15:27:37.138996+0000","last_became_active":"2023-11-04T15:27:36.147535+0000","last_became_peered":"2023-11-04T15:27:36.147535+0000","last_unstale":"2023-11-04T15:27:37.138996+0000","last_undegraded":"2023-11-04T15:27:37.138996+0000","last_fullsized":"2023-11-04T15:27:37.138996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:48:58.102459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.147803+0000","last_change":"2023-11-04T15:27:35.776315+0000","last_active":"2023-11-04T15:27:36.147803+0000","last_peered":"2023-11-04T15:27:36.147803+0000","last_clean":"2023-11-04T15:27:36.147803+0000","last_became_active":"2023-11-04T15:27:35.775918+0000","last_became_peered":"2023-11-04T15:27:35.775918+0000","last_unstale":"2023-11-04T15:27:36.147803+0000","last_undegraded":"2023-11-04T15:27:36.147803+0000","last_fullsized":"2023-11-04T15:27:36.147803+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:08:22.991334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":798720,"data_stored":653237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":200704,"data_stored":62307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":176128,"data_stored":60597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":782336,"data_stored":651707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T15:27:43.943 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T15:27:43.943 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-04T15:27:43.944 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-04T15:27:43.944 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-04T15:27:43.945 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-04T15:27:44.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.083+0000 7f4b1f4d5640 1 Processor -- start 2023-11-04T15:27:44.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.083+0000 7f4b1f4d5640 1 -- start start 2023-11-04T15:27:44.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.084+0000 7f4b1f4d5640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4b18133cb0 0x7f4b18134090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:44.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.084+0000 7f4b1f4d5640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b180a0730 0x7f4b18136c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:44.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.084+0000 7f4b1f4d5640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4b18137150 0x7f4b18137570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:44.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.084+0000 7f4b1f4d5640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b1809fd20 con 0x7f4b18137150 2023-11-04T15:27:44.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.084+0000 7f4b1f4d5640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b18137ab0 con 0x7f4b18133cb0 2023-11-04T15:27:44.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.084+0000 7f4b1f4d5640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b180a0df0 con 0x7f4b180a0730 2023-11-04T15:27:44.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.084+0000 7f4b1da72640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4b18137150 0x7f4b18137570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:44.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.084+0000 7f4b1da72640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4b18137150 0x7f4b18137570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53574/0 (socket says 172.21.15.19:53574) 2023-11-04T15:27:44.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.084+0000 7f4b1da72640 1 -- 172.21.15.19:0/3128979216 learned_addr learned my addr 172.21.15.19:0/3128979216 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:44.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.084+0000 7f4b1ca70640 1 --2- 172.21.15.19:0/3128979216 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b180a0730 0x7f4b18136c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:44.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.084+0000 7f4b1d271640 1 --2- 172.21.15.19:0/3128979216 >> v2:172.21.15.96:3300/0 conn(0x7f4b18133cb0 0x7f4b18134090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:44.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.084+0000 7f4b1da72640 1 -- 172.21.15.19:0/3128979216 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b180a0730 msgr2=0x7f4b18136c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:44.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.084+0000 7f4b1da72640 1 --2- 172.21.15.19:0/3128979216 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b180a0730 0x7f4b18136c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:44.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.084+0000 7f4b1da72640 1 -- 172.21.15.19:0/3128979216 >> v2:172.21.15.96:3300/0 conn(0x7f4b18133cb0 msgr2=0x7f4b18134090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:44.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.084+0000 7f4b1da72640 1 --2- 172.21.15.19:0/3128979216 >> v2:172.21.15.96:3300/0 conn(0x7f4b18133cb0 0x7f4b18134090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:44.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.084+0000 7f4b1da72640 1 -- 172.21.15.19:0/3128979216 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b180a13b0 con 0x7f4b18137150 2023-11-04T15:27:44.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.085+0000 7f4b1da72640 1 --2- 172.21.15.19:0/3128979216 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b18137150 0x7f4b18137570 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4b180a58e0 tx=0x7f4b0802bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2dddac9fb1a052d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:44.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.085+0000 7f4b17fff640 1 -- 172.21.15.19:0/3128979216 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0802c950 con 0x7f4b18137150 2023-11-04T15:27:44.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.085+0000 7f4b17fff640 1 -- 172.21.15.19:0/3128979216 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0802cab0 con 0x7f4b18137150 2023-11-04T15:27:44.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.085+0000 7f4b17fff640 1 -- 172.21.15.19:0/3128979216 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0802ce40 con 0x7f4b18137150 2023-11-04T15:27:44.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.086+0000 7f4b1f4d5640 1 -- 172.21.15.19:0/3128979216 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b18137150 msgr2=0x7f4b18137570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:44.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.086+0000 7f4b1f4d5640 1 --2- 172.21.15.19:0/3128979216 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b18137150 0x7f4b18137570 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4b180a58e0 tx=0x7f4b0802bdb0 comp rx=0 tx=0).stop 2023-11-04T15:27:44.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.086+0000 7f4b1f4d5640 1 -- 172.21.15.19:0/3128979216 shutdown_connections 2023-11-04T15:27:44.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.086+0000 7f4b1f4d5640 1 --2- 172.21.15.19:0/3128979216 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b18137150 0x7f4b18137570 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:44.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.086+0000 7f4b1f4d5640 1 --2- 172.21.15.19:0/3128979216 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b180a0730 0x7f4b18136c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:44.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.086+0000 7f4b1f4d5640 1 --2- 172.21.15.19:0/3128979216 >> v2:172.21.15.96:3300/0 conn(0x7f4b18133cb0 0x7f4b18134090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:44.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.086+0000 7f4b1f4d5640 1 -- 172.21.15.19:0/3128979216 >> 172.21.15.19:0/3128979216 conn(0x7f4b180a9060 msgr2=0x7f4b180a9470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:44.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.086+0000 7f4b1f4d5640 1 -- 172.21.15.19:0/3128979216 shutdown_connections 2023-11-04T15:27:44.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.086+0000 7f4b1f4d5640 1 -- 172.21.15.19:0/3128979216 wait complete. 2023-11-04T15:27:44.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.087+0000 7f4b1f4d5640 1 Processor -- start 2023-11-04T15:27:44.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.087+0000 7f4b1f4d5640 1 -- start start 2023-11-04T15:27:44.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.087+0000 7f4b1f4d5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b180a0730 0x7f4b1809b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:44.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.087+0000 7f4b1f4d5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b18133cb0 0x7f4b1809be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:44.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.087+0000 7f4b1f4d5640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b18137150 0x7f4b1809c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:44.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.087+0000 7f4b1f4d5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b18131c20 con 0x7f4b18133cb0 2023-11-04T15:27:44.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.087+0000 7f4b1f4d5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1806a8c0 con 0x7f4b180a0730 2023-11-04T15:27:44.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.087+0000 7f4b1f4d5640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1809d1d0 con 0x7f4b18137150 2023-11-04T15:27:44.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.087+0000 7f4b1ca70640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b18133cb0 0x7f4b1809be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:44.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.087+0000 7f4b1ca70640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b18133cb0 0x7f4b1809be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53588/0 (socket says 172.21.15.19:53588) 2023-11-04T15:27:44.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.087+0000 7f4b1ca70640 1 -- 172.21.15.19:0/292126127 learned_addr learned my addr 172.21.15.19:0/292126127 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:44.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.088+0000 7f4b1d271640 1 --2- 172.21.15.19:0/292126127 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b180a0730 0x7f4b1809b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:44.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.088+0000 7f4b1da72640 1 --2- 172.21.15.19:0/292126127 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b18137150 0x7f4b1809c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:44.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.088+0000 7f4b1ca70640 1 -- 172.21.15.19:0/292126127 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b18137150 msgr2=0x7f4b1809c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:44.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.088+0000 7f4b1ca70640 1 --2- 172.21.15.19:0/292126127 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b18137150 0x7f4b1809c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:44.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.088+0000 7f4b1ca70640 1 -- 172.21.15.19:0/292126127 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b180a0730 msgr2=0x7f4b1809b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:44.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.088+0000 7f4b1ca70640 1 --2- 172.21.15.19:0/292126127 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b180a0730 0x7f4b1809b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:44.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.088+0000 7f4b1ca70640 1 -- 172.21.15.19:0/292126127 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b08009b30 con 0x7f4b18133cb0 2023-11-04T15:27:44.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.088+0000 7f4b1ca70640 1 --2- 172.21.15.19:0/292126127 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b18133cb0 0x7f4b1809be60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c00d830 tx=0x7f4b0c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:44.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.088+0000 7f4b15ffb640 1 -- 172.21.15.19:0/292126127 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c00b6c0 con 0x7f4b18133cb0 2023-11-04T15:27:44.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.088+0000 7f4b15ffb640 1 -- 172.21.15.19:0/292126127 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0c00b820 con 0x7f4b18133cb0 2023-11-04T15:27:44.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.088+0000 7f4b1f4d5640 1 -- 172.21.15.19:0/292126127 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b1809e560 con 0x7f4b18133cb0 2023-11-04T15:27:44.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.088+0000 7f4b15ffb640 1 -- 172.21.15.19:0/292126127 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c00bbb0 con 0x7f4b18133cb0 2023-11-04T15:27:44.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.088+0000 7f4b1f4d5640 1 -- 172.21.15.19:0/292126127 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b1809db00 con 0x7f4b18133cb0 2023-11-04T15:27:44.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.089+0000 7f4b1f4d5640 1 -- 172.21.15.19:0/292126127 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b18067d60 con 0x7f4b18133cb0 2023-11-04T15:27:44.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.090+0000 7f4b15ffb640 1 -- 172.21.15.19:0/292126127 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4b0c01e460 con 0x7f4b18133cb0 2023-11-04T15:27:44.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.090+0000 7f4b15ffb640 1 --2- 172.21.15.19:0/292126127 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f4b0406a430 0x7f4b0406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:44.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.090+0000 7f4b15ffb640 1 -- 172.21.15.19:0/292126127 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f4b0c088940 con 0x7f4b18133cb0 2023-11-04T15:27:44.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.090+0000 7f4b1d271640 1 --2- 172.21.15.19:0/292126127 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f4b0406a430 0x7f4b0406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:44.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.091+0000 7f4b1d271640 1 --2- 172.21.15.19:0/292126127 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f4b0406a430 0x7f4b0406c8f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4b10006fd0 tx=0x7f4b10008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:44.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.094+0000 7f4b15ffb640 1 -- 172.21.15.19:0/292126127 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4b0c0545d0 con 0x7f4b18133cb0 2023-11-04T15:27:44.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.318+0000 7f4b1f4d5640 1 -- 172.21.15.19:0/292126127 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f4b180a0bd0 con 0x7f4b18133cb0 2023-11-04T15:27:44.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.321+0000 7f4b15ffb640 1 -- 172.21.15.19:0/292126127 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+169962 (secure 0 0 0) 0x7f4b0c057bf0 con 0x7f4b18133cb0 2023-11-04T15:27:44.324 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:27:44.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.323+0000 7f4b1f4d5640 1 -- 172.21.15.19:0/292126127 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f4b0406a430 msgr2=0x7f4b0406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:44.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.323+0000 7f4b1f4d5640 1 --2- 172.21.15.19:0/292126127 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f4b0406a430 0x7f4b0406c8f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4b10006fd0 tx=0x7f4b10008040 comp rx=0 tx=0).stop 2023-11-04T15:27:44.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.323+0000 7f4b1f4d5640 1 -- 172.21.15.19:0/292126127 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b18133cb0 msgr2=0x7f4b1809be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:44.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.323+0000 7f4b1f4d5640 1 --2- 172.21.15.19:0/292126127 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b18133cb0 0x7f4b1809be60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c00d830 tx=0x7f4b0c00dcf0 comp rx=0 tx=0).stop 2023-11-04T15:27:44.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.323+0000 7f4b1f4d5640 1 -- 172.21.15.19:0/292126127 shutdown_connections 2023-11-04T15:27:44.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.323+0000 7f4b1f4d5640 1 --2- 172.21.15.19:0/292126127 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f4b0406a430 0x7f4b0406c8f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:44.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.323+0000 7f4b1f4d5640 1 --2- 172.21.15.19:0/292126127 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b18137150 0x7f4b1809c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:44.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.323+0000 7f4b1f4d5640 1 --2- 172.21.15.19:0/292126127 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b18133cb0 0x7f4b1809be60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:44.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.323+0000 7f4b1f4d5640 1 --2- 172.21.15.19:0/292126127 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b180a0730 0x7f4b1809b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:44.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.323+0000 7f4b1f4d5640 1 -- 172.21.15.19:0/292126127 >> 172.21.15.19:0/292126127 conn(0x7f4b180a9060 msgr2=0x7f4b1806e770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:44.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.323+0000 7f4b1f4d5640 1 -- 172.21.15.19:0/292126127 shutdown_connections 2023-11-04T15:27:44.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.323+0000 7f4b1f4d5640 1 -- 172.21.15.19:0/292126127 wait complete. 2023-11-04T15:27:44.334 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":5,"active_gid":4114,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":83123},{"type":"v1","addr":"172.21.15.96:6817","nonce":83123}]},"active_addr":"172.21.15.96:6817/83123","active_change":"2023-11-04T15:27:18.926649+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4107,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":1348780121}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":2846176281}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":954510046}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":2037359582}]}]} 2023-11-04T15:27:44.339 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-04T15:27:44.339 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-04T15:27:44.339 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T15:27:44.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.443+0000 7f9ec25eb640 1 Processor -- start 2023-11-04T15:27:44.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.444+0000 7f9ec25eb640 1 -- start start 2023-11-04T15:27:44.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.444+0000 7f9ec25eb640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9ebc1377d0 0x7f9ebc142bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:44.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.444+0000 7f9ec25eb640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ebc06cac0 con 0x7f9ebc070090 2023-11-04T15:27:44.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.444+0000 7f9ec25eb640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ebc136e00 con 0x7f9ebc06c4b0 2023-11-04T15:27:44.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.444+0000 7f9ec25eb640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ebc137c10 con 0x7f9ebc1377d0 2023-11-04T15:27:44.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.444+0000 7f9ebbfff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9ebc070090 0x7f9ebc1370c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60832/0 (socket says 172.21.15.19:60832) 2023-11-04T15:27:44.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.444+0000 7f9ebbfff640 1 -- 172.21.15.19:0/1565833065 learned_addr learned my addr 172.21.15.19:0/1565833065 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:44.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.444+0000 7f9ec0b88640 1 --2- 172.21.15.19:0/1565833065 >> v2:172.21.15.96:3300/0 conn(0x7f9ebc1377d0 0x7f9ebc142bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:44.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.444+0000 7f9ebaffd640 1 -- 172.21.15.19:0/1565833065 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4189929948 0 0) 0x7f9ebc06cac0 con 0x7f9ebc070090 2023-11-04T15:27:44.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.444+0000 7f9ebaffd640 1 -- 172.21.15.19:0/1565833065 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ea4003520 con 0x7f9ebc070090 2023-11-04T15:27:44.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.445+0000 7f9ebaffd640 1 -- 172.21.15.19:0/1565833065 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2587797620 0 0) 0x7f9ea4003520 con 0x7f9ebc070090 2023-11-04T15:27:44.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.445+0000 7f9ec0b88640 1 -- 172.21.15.19:0/1565833065 >> v1:172.21.15.96:6789/0 conn(0x7f9ebc06c4b0 legacy=0x7f9ebc13f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:44.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.445+0000 7f9ec0b88640 1 -- 172.21.15.19:0/1565833065 >> v1:172.21.15.19:6789/0 conn(0x7f9ebc070090 legacy=0x7f9ebc1370c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:44.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.445+0000 7f9ec0b88640 1 -- 172.21.15.19:0/1565833065 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ebc06c250 con 0x7f9ebc1377d0 2023-11-04T15:27:44.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.445+0000 7f9ec0b88640 1 --2- 172.21.15.19:0/1565833065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ebc1377d0 0x7f9ebc142bd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4009d90 tx=0x7f9eb402bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77ef88923e23bf1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:44.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.446+0000 7f9ebaffd640 1 -- 172.21.15.19:0/1565833065 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eac001670 con 0x7f9ebc1377d0 2023-11-04T15:27:44.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.446+0000 7f9ebaffd640 1 -- 172.21.15.19:0/1565833065 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb402c8b0 con 0x7f9ebc1377d0 2023-11-04T15:27:44.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.446+0000 7f9ebaffd640 1 -- 172.21.15.19:0/1565833065 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb402cc40 con 0x7f9ebc1377d0 2023-11-04T15:27:44.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.446+0000 7f9ec25eb640 1 -- 172.21.15.19:0/1565833065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ebc1377d0 msgr2=0x7f9ebc142bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:44.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.446+0000 7f9ec25eb640 1 --2- 172.21.15.19:0/1565833065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ebc1377d0 0x7f9ebc142bd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4009d90 tx=0x7f9eb402bd80 comp rx=0 tx=0).stop 2023-11-04T15:27:44.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.446+0000 7f9ec25eb640 1 -- 172.21.15.19:0/1565833065 shutdown_connections 2023-11-04T15:27:44.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.446+0000 7f9ec25eb640 1 --2- 172.21.15.19:0/1565833065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ebc1377d0 0x7f9ebc142bd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:44.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.446+0000 7f9ec25eb640 1 -- 172.21.15.19:0/1565833065 >> 172.21.15.19:0/1565833065 conn(0x7f9ebc0aa2c0 msgr2=0x7f9ebc0aa6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:44.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.446+0000 7f9ec25eb640 1 -- 172.21.15.19:0/1565833065 shutdown_connections 2023-11-04T15:27:44.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.446+0000 7f9ec25eb640 1 -- 172.21.15.19:0/1565833065 wait complete. 2023-11-04T15:27:44.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.447+0000 7f9ec25eb640 1 Processor -- start 2023-11-04T15:27:44.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.447+0000 7f9ec25eb640 1 -- start start 2023-11-04T15:27:44.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.448+0000 7f9ec25eb640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ebc06c4b0 0x7f9ebc0a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:44.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.448+0000 7f9ec25eb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ebc070090 0x7f9ebc0a2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:44.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.448+0000 7f9ec25eb640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9ebc1377d0 0x7f9ebc0a3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:44.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.448+0000 7f9ec25eb640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc0a36b0 con 0x7f9ebc070090 2023-11-04T15:27:44.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.448+0000 7f9ec25eb640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc09cd20 con 0x7f9ebc06c4b0 2023-11-04T15:27:44.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.448+0000 7f9ec25eb640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc09dd10 con 0x7f9ebc1377d0 2023-11-04T15:27:44.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.448+0000 7f9ebb7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ebc070090 0x7f9ebc0a2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:44.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.448+0000 7f9ebb7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ebc070090 0x7f9ebc0a2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53590/0 (socket says 172.21.15.19:53590) 2023-11-04T15:27:44.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.448+0000 7f9ebb7fe640 1 -- 172.21.15.19:0/105934242 learned_addr learned my addr 172.21.15.19:0/105934242 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:44.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.448+0000 7f9ebbfff640 1 --2- 172.21.15.19:0/105934242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ebc06c4b0 0x7f9ebc0a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:44.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.448+0000 7f9ec0b88640 1 --2- 172.21.15.19:0/105934242 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9ebc1377d0 0x7f9ebc0a3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:44.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.448+0000 7f9ebb7fe640 1 -- 172.21.15.19:0/105934242 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9ebc1377d0 msgr2=0x7f9ebc0a3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:44.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.448+0000 7f9ebb7fe640 1 --2- 172.21.15.19:0/105934242 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9ebc1377d0 0x7f9ebc0a3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:44.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.448+0000 7f9ebb7fe640 1 -- 172.21.15.19:0/105934242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ebc06c4b0 msgr2=0x7f9ebc0a2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:44.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.448+0000 7f9ebb7fe640 1 --2- 172.21.15.19:0/105934242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ebc06c4b0 0x7f9ebc0a2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:44.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.448+0000 7f9ebb7fe640 1 -- 172.21.15.19:0/105934242 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb4009a70 con 0x7f9ebc070090 2023-11-04T15:27:44.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.448+0000 7f9ebb7fe640 1 --2- 172.21.15.19:0/105934242 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ebc070090 0x7f9ebc0a2b40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9eb000c400 tx=0x7f9eb000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:44.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.448+0000 7f9eb8ff9640 1 -- 172.21.15.19:0/105934242 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb00052d0 con 0x7f9ebc070090 2023-11-04T15:27:44.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.448+0000 7f9eb8ff9640 1 -- 172.21.15.19:0/105934242 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb0005430 con 0x7f9ebc070090 2023-11-04T15:27:44.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.448+0000 7f9eb8ff9640 1 -- 172.21.15.19:0/105934242 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb0003830 con 0x7f9ebc070090 2023-11-04T15:27:44.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.449+0000 7f9ec25eb640 1 -- 172.21.15.19:0/105934242 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ebc09daa0 con 0x7f9ebc070090 2023-11-04T15:27:44.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.449+0000 7f9ec25eb640 1 -- 172.21.15.19:0/105934242 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ebc09c290 con 0x7f9ebc070090 2023-11-04T15:27:44.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.450+0000 7f9ec25eb640 1 -- 172.21.15.19:0/105934242 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ebc09c740 con 0x7f9ebc070090 2023-11-04T15:27:44.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.450+0000 7f9eb8ff9640 1 -- 172.21.15.19:0/105934242 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9eb0003990 con 0x7f9ebc070090 2023-11-04T15:27:44.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.450+0000 7f9eb8ff9640 1 --2- 172.21.15.19:0/105934242 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f9ea806a430 0x7f9ea806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:44.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.450+0000 7f9eb8ff9640 1 -- 172.21.15.19:0/105934242 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f9eb0087820 con 0x7f9ebc070090 2023-11-04T15:27:44.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.450+0000 7f9ebbfff640 1 --2- 172.21.15.19:0/105934242 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f9ea806a430 0x7f9ea806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:44.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.451+0000 7f9ebbfff640 1 --2- 172.21.15.19:0/105934242 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f9ea806a430 0x7f9ea806c8f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9eac000f60 tx=0x7f9eac001e00 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:44.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.455+0000 7f9eb8ff9640 1 -- 172.21.15.19:0/105934242 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9eb00534b0 con 0x7f9ebc070090 2023-11-04T15:27:44.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.630+0000 7f9ec25eb640 1 -- 172.21.15.19:0/105934242 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ebc067d60 con 0x7f9ebc070090 2023-11-04T15:27:44.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.631+0000 7f9eb8ff9640 1 -- 172.21.15.19:0/105934242 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+13180 (secure 0 0 0) 0x7f9eb0056ad0 con 0x7f9ebc070090 2023-11-04T15:27:44.633 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:27:44.633 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":19,"fsid":"e87311d5-496a-4b07-9654-358fe5bbf950","created":"2023-11-04T15:27:14.865121+0000","modified":"2023-11-04T15:27:37.127226+0000","last_up_change":"2023-11-04T15:27:24.162282+0000","last_in_change":"2023-11-04T15:27:15.971035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T15:27:24.987312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-04T15:27:30.500235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-04T15:27:34.476271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-04T15:27:35.096759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"34818469-ebf2-4dd4-8119-af19a0121036","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":82879},{"type":"v1","addr":"172.21.15.19:6801","nonce":82879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":82879},{"type":"v1","addr":"172.21.15.19:6803","nonce":82879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":82879},{"type":"v1","addr":"172.21.15.19:6807","nonce":82879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":82879},{"type":"v1","addr":"172.21.15.19:6805","nonce":82879}]},"public_addr":"172.21.15.19:6801/82879","cluster_addr":"172.21.15.19:6803/82879","heartbeat_back_addr":"172.21.15.19:6807/82879","heartbeat_front_addr":"172.21.15.19:6805/82879","state":["exists","up"]},{"osd":1,"uuid":"92dab290-7912-4eea-b6f6-c754c2480721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":82880},{"type":"v1","addr":"172.21.15.19:6809","nonce":82880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":82880},{"type":"v1","addr":"172.21.15.19:6811","nonce":82880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":82880},{"type":"v1","addr":"172.21.15.19:6815","nonce":82880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":82880},{"type":"v1","addr":"172.21.15.19:6813","nonce":82880}]},"public_addr":"172.21.15.19:6809/82880","cluster_addr":"172.21.15.19:6811/82880","heartbeat_back_addr":"172.21.15.19:6815/82880","heartbeat_front_addr":"172.21.15.19:6813/82880","state":["exists","up"]},{"osd":2,"uuid":"1be47db4-6dd1-4ce5-832b-bc6ad30c78c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":83458},{"type":"v1","addr":"172.21.15.96:6808","nonce":83458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":83458},{"type":"v1","addr":"172.21.15.96:6811","nonce":83458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":83458},{"type":"v1","addr":"172.21.15.96:6815","nonce":83458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":83458},{"type":"v1","addr":"172.21.15.96:6813","nonce":83458}]},"public_addr":"172.21.15.96:6808/83458","cluster_addr":"172.21.15.96:6811/83458","heartbeat_back_addr":"172.21.15.96:6815/83458","heartbeat_front_addr":"172.21.15.96:6813/83458","state":["exists","up"]},{"osd":3,"uuid":"46505800-d64f-49ef-b811-5b5979f48252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":83459},{"type":"v1","addr":"172.21.15.96:6801","nonce":83459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":83459},{"type":"v1","addr":"172.21.15.96:6803","nonce":83459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6807","nonce":83459},{"type":"v1","addr":"172.21.15.96:6809","nonce":83459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":83459},{"type":"v1","addr":"172.21.15.96:6805","nonce":83459}]},"public_addr":"172.21.15.96:6801/83459","cluster_addr":"172.21.15.96:6803/83459","heartbeat_back_addr":"172.21.15.96:6809/83459","heartbeat_front_addr":"172.21.15.96:6805/83459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.081547+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.132075+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.094919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.074106+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T15:27:44.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.633+0000 7f9ec25eb640 1 -- 172.21.15.19:0/105934242 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f9ea806a430 msgr2=0x7f9ea806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:44.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.633+0000 7f9ec25eb640 1 --2- 172.21.15.19:0/105934242 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f9ea806a430 0x7f9ea806c8f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9eac000f60 tx=0x7f9eac001e00 comp rx=0 tx=0).stop 2023-11-04T15:27:44.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.633+0000 7f9ec25eb640 1 -- 172.21.15.19:0/105934242 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ebc070090 msgr2=0x7f9ebc0a2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:44.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.633+0000 7f9ec25eb640 1 --2- 172.21.15.19:0/105934242 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ebc070090 0x7f9ebc0a2b40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9eb000c400 tx=0x7f9eb000c8c0 comp rx=0 tx=0).stop 2023-11-04T15:27:44.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.633+0000 7f9ec25eb640 1 -- 172.21.15.19:0/105934242 shutdown_connections 2023-11-04T15:27:44.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.633+0000 7f9ec25eb640 1 --2- 172.21.15.19:0/105934242 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f9ea806a430 0x7f9ea806c8f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:44.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.633+0000 7f9ec25eb640 1 --2- 172.21.15.19:0/105934242 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9ebc1377d0 0x7f9ebc0a3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:44.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.633+0000 7f9ec25eb640 1 --2- 172.21.15.19:0/105934242 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ebc070090 0x7f9ebc0a2b40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:44.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.633+0000 7f9ec25eb640 1 --2- 172.21.15.19:0/105934242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ebc06c4b0 0x7f9ebc0a2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:44.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.633+0000 7f9ec25eb640 1 -- 172.21.15.19:0/105934242 >> 172.21.15.19:0/105934242 conn(0x7f9ebc0aa2c0 msgr2=0x7f9ebc12ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:44.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.633+0000 7f9ec25eb640 1 -- 172.21.15.19:0/105934242 shutdown_connections 2023-11-04T15:27:44.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.633+0000 7f9ec25eb640 1 -- 172.21.15.19:0/105934242 wait complete. 2023-11-04T15:27:44.645 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-04T15:27:44.646 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T15:27:44.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.750+0000 7fa60bfdd640 1 Processor -- start 2023-11-04T15:27:44.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.750+0000 7fa60bfdd640 1 -- start start 2023-11-04T15:27:44.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.750+0000 7fa60bfdd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa604137270 0x7fa6040a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:44.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.751+0000 7fa60bfdd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa604137650 0x7fa60413a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:44.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.751+0000 7fa60bfdd640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6040a4c20 con 0x7fa6040a3e90 2023-11-04T15:27:44.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.751+0000 7fa60bfdd640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6040a3060 con 0x7fa604137650 2023-11-04T15:27:44.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.751+0000 7fa60bfdd640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6040a5080 con 0x7fa604137270 2023-11-04T15:27:44.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.751+0000 7fa60a57a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa604137650 0x7fa60413a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:44.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.751+0000 7fa609d79640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa604137270 0x7fa6040a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:44.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.751+0000 7fa60a57a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa604137650 0x7fa60413a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.19:54740/0 (socket says 172.21.15.19:54740) 2023-11-04T15:27:44.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.751+0000 7fa609d79640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa604137270 0x7fa6040a6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.19:49150/0 (socket says 172.21.15.19:49150) 2023-11-04T15:27:44.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.751+0000 7fa60a57a640 1 -- 172.21.15.19:0/2939747686 learned_addr learned my addr 172.21.15.19:0/2939747686 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:44.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.751+0000 7fa609d79640 1 -- 172.21.15.19:0/2939747686 >> v2:172.21.15.96:3300/0 conn(0x7fa604137650 msgr2=0x7fa60413a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:44.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.751+0000 7fa609d79640 1 --2- 172.21.15.19:0/2939747686 >> v2:172.21.15.96:3300/0 conn(0x7fa604137650 0x7fa60413a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:44.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.751+0000 7fa609d79640 1 -- 172.21.15.19:0/2939747686 >> v1:172.21.15.96:6789/0 conn(0x7fa6040a3e90 legacy=0x7fa604139f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:44.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.751+0000 7fa609d79640 1 -- 172.21.15.19:0/2939747686 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6040a3440 con 0x7fa604137270 2023-11-04T15:27:44.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.751+0000 7fa60a57a640 1 --2- 172.21.15.19:0/2939747686 >> v2:172.21.15.96:3300/0 conn(0x7fa604137650 0x7fa60413a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T15:27:44.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.752+0000 7fa609d79640 1 --2- 172.21.15.19:0/2939747686 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa604137270 0x7fa6040a6200 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa6000097a0 tx=0x7fa60002b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b628be0b8109db9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:44.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.752+0000 7fa608d77640 1 -- 172.21.15.19:0/2939747686 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60002f050 con 0x7fa604137270 2023-11-04T15:27:44.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.752+0000 7fa608d77640 1 -- 172.21.15.19:0/2939747686 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa600031700 con 0x7fa604137270 2023-11-04T15:27:44.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.752+0000 7fa608d77640 1 -- 172.21.15.19:0/2939747686 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa600031a90 con 0x7fa604137270 2023-11-04T15:27:44.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.753+0000 7fa60bfdd640 1 -- 172.21.15.19:0/2939747686 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa604137270 msgr2=0x7fa6040a6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:44.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.753+0000 7fa60bfdd640 1 --2- 172.21.15.19:0/2939747686 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa604137270 0x7fa6040a6200 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa6000097a0 tx=0x7fa60002b7a0 comp rx=0 tx=0).stop 2023-11-04T15:27:44.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.753+0000 7fa60bfdd640 1 -- 172.21.15.19:0/2939747686 shutdown_connections 2023-11-04T15:27:44.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.753+0000 7fa60bfdd640 1 --2- 172.21.15.19:0/2939747686 >> v2:172.21.15.96:3300/0 conn(0x7fa604137650 0x7fa60413a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:44.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.753+0000 7fa60bfdd640 1 --2- 172.21.15.19:0/2939747686 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa604137270 0x7fa6040a6200 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:44.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.753+0000 7fa60bfdd640 1 -- 172.21.15.19:0/2939747686 >> 172.21.15.19:0/2939747686 conn(0x7fa6040a8d70 msgr2=0x7fa6040a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:44.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.753+0000 7fa60bfdd640 1 -- 172.21.15.19:0/2939747686 shutdown_connections 2023-11-04T15:27:44.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.753+0000 7fa60bfdd640 1 -- 172.21.15.19:0/2939747686 wait complete. 2023-11-04T15:27:44.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.754+0000 7fa60bfdd640 1 Processor -- start 2023-11-04T15:27:44.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.754+0000 7fa60bfdd640 1 -- start start 2023-11-04T15:27:44.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.754+0000 7fa60bfdd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6040a3e90 0x7fa6041cf030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:44.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.754+0000 7fa60bfdd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa604137270 0x7fa6041cf570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:44.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.754+0000 7fa60bfdd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa604137650 0x7fa6041cfab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:44.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.754+0000 7fa60bfdd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6041363c0 con 0x7fa604137270 2023-11-04T15:27:44.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.754+0000 7fa60bfdd640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60409d080 con 0x7fa6040a3e90 2023-11-04T15:27:44.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.754+0000 7fa60bfdd640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6040a2730 con 0x7fa604137650 2023-11-04T15:27:44.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.754+0000 7fa609578640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa604137270 0x7fa6041cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:44.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.754+0000 7fa609578640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa604137270 0x7fa6041cf570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53594/0 (socket says 172.21.15.19:53594) 2023-11-04T15:27:44.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.754+0000 7fa609578640 1 -- 172.21.15.19:0/349816748 learned_addr learned my addr 172.21.15.19:0/349816748 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:44.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.754+0000 7fa60a57a640 1 --2- 172.21.15.19:0/349816748 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa604137650 0x7fa6041cfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:44.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.754+0000 7fa609d79640 1 --2- 172.21.15.19:0/349816748 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6040a3e90 0x7fa6041cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:44.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.755+0000 7fa609578640 1 -- 172.21.15.19:0/349816748 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa604137650 msgr2=0x7fa6041cfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:44.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.755+0000 7fa609578640 1 --2- 172.21.15.19:0/349816748 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa604137650 0x7fa6041cfab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:44.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.755+0000 7fa609578640 1 -- 172.21.15.19:0/349816748 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6040a3e90 msgr2=0x7fa6041cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:44.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.755+0000 7fa609578640 1 --2- 172.21.15.19:0/349816748 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6040a3e90 0x7fa6041cf030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:44.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.755+0000 7fa609578640 1 -- 172.21.15.19:0/349816748 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5fc009b30 con 0x7fa604137270 2023-11-04T15:27:44.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.755+0000 7fa609578640 1 --2- 172.21.15.19:0/349816748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa604137270 0x7fa6041cf570 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa5f400c390 tx=0x7fa5f400c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:44.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.755+0000 7fa5fa7fc640 1 -- 172.21.15.19:0/349816748 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f40052d0 con 0x7fa604137270 2023-11-04T15:27:44.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.755+0000 7fa5fa7fc640 1 -- 172.21.15.19:0/349816748 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f4005430 con 0x7fa604137270 2023-11-04T15:27:44.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.755+0000 7fa60bfdd640 1 -- 172.21.15.19:0/349816748 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa600009400 con 0x7fa604137270 2023-11-04T15:27:44.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.755+0000 7fa5fa7fc640 1 -- 172.21.15.19:0/349816748 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f4007260 con 0x7fa604137270 2023-11-04T15:27:44.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.755+0000 7fa60bfdd640 1 -- 172.21.15.19:0/349816748 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa60409b920 con 0x7fa604137270 2023-11-04T15:27:44.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.756+0000 7fa60bfdd640 1 -- 172.21.15.19:0/349816748 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa60409ccc0 con 0x7fa604137270 2023-11-04T15:27:44.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.756+0000 7fa5fa7fc640 1 -- 172.21.15.19:0/349816748 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa5f40073c0 con 0x7fa604137270 2023-11-04T15:27:44.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.757+0000 7fa5fa7fc640 1 --2- 172.21.15.19:0/349816748 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa5e806a430 0x7fa5e806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:44.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.757+0000 7fa5fa7fc640 1 -- 172.21.15.19:0/349816748 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7fa5f40875f0 con 0x7fa604137270 2023-11-04T15:27:44.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.757+0000 7fa609d79640 1 --2- 172.21.15.19:0/349816748 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa5e806a430 0x7fa5e806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:44.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.757+0000 7fa609d79640 1 --2- 172.21.15.19:0/349816748 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa5e806a430 0x7fa5e806c8f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa600035000 tx=0x7fa600008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:44.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.761+0000 7fa5fa7fc640 1 -- 172.21.15.19:0/349816748 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa5f40531d0 con 0x7fa604137270 2023-11-04T15:27:44.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.939+0000 7fa60bfdd640 1 -- 172.21.15.19:0/349816748 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa604067d60 con 0x7fa604137270 2023-11-04T15:27:44.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.940+0000 7fa5fa7fc640 1 -- 172.21.15.19:0/349816748 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+13180 (secure 0 0 0) 0x7fa5f40567f0 con 0x7fa604137270 2023-11-04T15:27:44.941 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:27:44.942 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":19,"fsid":"e87311d5-496a-4b07-9654-358fe5bbf950","created":"2023-11-04T15:27:14.865121+0000","modified":"2023-11-04T15:27:37.127226+0000","last_up_change":"2023-11-04T15:27:24.162282+0000","last_in_change":"2023-11-04T15:27:15.971035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T15:27:24.987312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-04T15:27:30.500235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-04T15:27:34.476271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-04T15:27:35.096759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"34818469-ebf2-4dd4-8119-af19a0121036","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":82879},{"type":"v1","addr":"172.21.15.19:6801","nonce":82879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":82879},{"type":"v1","addr":"172.21.15.19:6803","nonce":82879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":82879},{"type":"v1","addr":"172.21.15.19:6807","nonce":82879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":82879},{"type":"v1","addr":"172.21.15.19:6805","nonce":82879}]},"public_addr":"172.21.15.19:6801/82879","cluster_addr":"172.21.15.19:6803/82879","heartbeat_back_addr":"172.21.15.19:6807/82879","heartbeat_front_addr":"172.21.15.19:6805/82879","state":["exists","up"]},{"osd":1,"uuid":"92dab290-7912-4eea-b6f6-c754c2480721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":82880},{"type":"v1","addr":"172.21.15.19:6809","nonce":82880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":82880},{"type":"v1","addr":"172.21.15.19:6811","nonce":82880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":82880},{"type":"v1","addr":"172.21.15.19:6815","nonce":82880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":82880},{"type":"v1","addr":"172.21.15.19:6813","nonce":82880}]},"public_addr":"172.21.15.19:6809/82880","cluster_addr":"172.21.15.19:6811/82880","heartbeat_back_addr":"172.21.15.19:6815/82880","heartbeat_front_addr":"172.21.15.19:6813/82880","state":["exists","up"]},{"osd":2,"uuid":"1be47db4-6dd1-4ce5-832b-bc6ad30c78c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":83458},{"type":"v1","addr":"172.21.15.96:6808","nonce":83458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":83458},{"type":"v1","addr":"172.21.15.96:6811","nonce":83458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":83458},{"type":"v1","addr":"172.21.15.96:6815","nonce":83458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":83458},{"type":"v1","addr":"172.21.15.96:6813","nonce":83458}]},"public_addr":"172.21.15.96:6808/83458","cluster_addr":"172.21.15.96:6811/83458","heartbeat_back_addr":"172.21.15.96:6815/83458","heartbeat_front_addr":"172.21.15.96:6813/83458","state":["exists","up"]},{"osd":3,"uuid":"46505800-d64f-49ef-b811-5b5979f48252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":83459},{"type":"v1","addr":"172.21.15.96:6801","nonce":83459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":83459},{"type":"v1","addr":"172.21.15.96:6803","nonce":83459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6807","nonce":83459},{"type":"v1","addr":"172.21.15.96:6809","nonce":83459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":83459},{"type":"v1","addr":"172.21.15.96:6805","nonce":83459}]},"public_addr":"172.21.15.96:6801/83459","cluster_addr":"172.21.15.96:6803/83459","heartbeat_back_addr":"172.21.15.96:6809/83459","heartbeat_front_addr":"172.21.15.96:6805/83459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.081547+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.132075+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.094919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.074106+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T15:27:44.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.942+0000 7fa60bfdd640 1 -- 172.21.15.19:0/349816748 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa5e806a430 msgr2=0x7fa5e806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:44.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.942+0000 7fa60bfdd640 1 --2- 172.21.15.19:0/349816748 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa5e806a430 0x7fa5e806c8f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa600035000 tx=0x7fa600008030 comp rx=0 tx=0).stop 2023-11-04T15:27:44.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.942+0000 7fa60bfdd640 1 -- 172.21.15.19:0/349816748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa604137270 msgr2=0x7fa6041cf570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:44.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.942+0000 7fa60bfdd640 1 --2- 172.21.15.19:0/349816748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa604137270 0x7fa6041cf570 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa5f400c390 tx=0x7fa5f400c790 comp rx=0 tx=0).stop 2023-11-04T15:27:44.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.942+0000 7fa60bfdd640 1 -- 172.21.15.19:0/349816748 shutdown_connections 2023-11-04T15:27:44.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.942+0000 7fa60bfdd640 1 --2- 172.21.15.19:0/349816748 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa5e806a430 0x7fa5e806c8f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:44.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.942+0000 7fa60bfdd640 1 --2- 172.21.15.19:0/349816748 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa604137650 0x7fa6041cfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:44.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.942+0000 7fa60bfdd640 1 --2- 172.21.15.19:0/349816748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa604137270 0x7fa6041cf570 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:44.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.942+0000 7fa60bfdd640 1 --2- 172.21.15.19:0/349816748 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6040a3e90 0x7fa6041cf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:44.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.942+0000 7fa60bfdd640 1 -- 172.21.15.19:0/349816748 >> 172.21.15.19:0/349816748 conn(0x7fa6040a8d70 msgr2=0x7fa604134ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:44.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.942+0000 7fa60bfdd640 1 -- 172.21.15.19:0/349816748 shutdown_connections 2023-11-04T15:27:44.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:44.942+0000 7fa60bfdd640 1 -- 172.21.15.19:0/349816748 wait complete. 2023-11-04T15:27:44.954 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-04T15:27:44.955 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-04T15:27:44.955 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-04T15:27:44.956 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-04T15:27:45.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.067+0000 7f1e0d02d640 1 Processor -- start 2023-11-04T15:27:45.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.067+0000 7f1e0d02d640 1 -- start start 2023-11-04T15:27:45.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.067+0000 7f6bc2300640 1 Processor -- start 2023-11-04T15:27:45.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.067+0000 7f780608f640 1 Processor -- start 2023-11-04T15:27:45.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.067+0000 7f6bc2300640 1 -- start start 2023-11-04T15:27:45.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.067+0000 7f780608f640 1 -- start start 2023-11-04T15:27:45.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.067+0000 7f25c70d2640 1 Processor -- start 2023-11-04T15:27:45.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.067+0000 7f25c70d2640 1 -- start start 2023-11-04T15:27:45.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.068+0000 7f1e0d02d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1e080a0cd0 0x7f1e081341e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.068+0000 7f6bc2300640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6bbc138550 0x7f6bbc138930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.068+0000 7f1e0d02d640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e080a2300 con 0x7f1e08137320 2023-11-04T15:27:45.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.068+0000 7f1e0d02d640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e080a0240 con 0x7f1e08133e00 2023-11-04T15:27:45.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.068+0000 7f6bc2300640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6bbc06a800 0x7f6bbc140180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.068+0000 7f1e0759e640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1e08137320 0x7f1e0813ef70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60836/0 (socket says 172.21.15.19:60836) 2023-11-04T15:27:45.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.068+0000 7f780608f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7800138930 0x7f780006a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.068+0000 7f780608f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f780013e170 0x7f7800140560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.068+0000 7f6bc2300640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bbc0a5690 con 0x7f6bbc069c70 2023-11-04T15:27:45.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.068+0000 7f780608f640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78000a5690 con 0x7f7800138550 2023-11-04T15:27:45.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.068+0000 7f1e0759e640 1 -- 172.21.15.19:0/1414393376 learned_addr learned my addr 172.21.15.19:0/1414393376 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:45.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.068+0000 7f1e0659c640 1 --2- 172.21.15.19:0/1414393376 >> v2:172.21.15.19:3300/0 conn(0x7f1e080a0cd0 0x7f1e081341e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.068+0000 7f6bc2300640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bbc06ef40 con 0x7f6bbc06a800 2023-11-04T15:27:45.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.068+0000 7f1e0d02d640 1 -- 172.21.15.19:0/1414393376 --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e080a5760 con 0x7f1e080a0cd0 2023-11-04T15:27:45.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.068+0000 7f6bc2300640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc137ee0 con 0x7f6bbc138550 2023-11-04T15:27:45.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.068+0000 7f6bbb7fe640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f6bbc069c70 0x7f6bbc06a0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.19:33942/0 (socket says 172.21.15.19:33942) 2023-11-04T15:27:45.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.068+0000 7f6bbb7fe640 1 -- 172.21.15.19:0/3402739273 learned_addr learned my addr 172.21.15.19:0/3402739273 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:45.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.068+0000 7f6bc089d640 1 --2- 172.21.15.19:0/3402739273 >> v2:172.21.15.96:3300/0 conn(0x7f6bbc06a800 0x7f6bbc140180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.068+0000 7f25c70d2640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f25c0069c70 0x7f25c006a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.068+0000 7f25c70d2640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c00a0df0 con 0x7f25c00a0730 2023-11-04T15:27:45.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.068+0000 7f780608f640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7800138db0 con 0x7f780013e170 2023-11-04T15:27:45.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.068+0000 7f780608f640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780006ef40 con 0x7f7800138930 2023-11-04T15:27:45.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.068+0000 7f77fffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f780013e170 0x7f7800140560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.068+0000 7f77fffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f780013e170 0x7f7800140560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.19:54778/0 (socket says 172.21.15.19:54778) 2023-11-04T15:27:45.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.068+0000 7f6bbbfff640 1 --2- 172.21.15.19:0/3402739273 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6bbc138550 0x7f6bbc138930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.068+0000 7f77fffff640 1 -- 172.21.15.19:0/2487030585 learned_addr learned my addr 172.21.15.19:0/2487030585 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:45.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.069+0000 7f77feffd640 1 --2- 172.21.15.19:0/2487030585 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7800138930 0x7f780006a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.068+0000 7f25c70d2640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c00a13b0 con 0x7f25c0133cb0 2023-11-04T15:27:45.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.068+0000 7f25c70d2640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c009fd20 con 0x7f25c0069c70 2023-11-04T15:27:45.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.069+0000 7f1e05d9b640 1 -- 172.21.15.19:0/1414393376 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3973376150 0 0) 0x7f1e080a0240 con 0x7f1e08133e00 2023-11-04T15:27:45.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.068+0000 7f25c4e6e640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f25c0133cb0 0x7f25c0134090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.19:33964/0 (socket says 172.21.15.19:33964) 2023-11-04T15:27:45.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.069+0000 7f25c4e6e640 1 -- 172.21.15.19:0/391583051 learned_addr learned my addr 172.21.15.19:0/391583051 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:45.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.069+0000 7f25c566f640 1 --2- 172.21.15.19:0/391583051 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f25c0069c70 0x7f25c006a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.069+0000 7f6bbaffd640 1 -- 172.21.15.19:0/3402739273 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2587694551 0 0) 0x7f6bbc0a5690 con 0x7f6bbc069c70 2023-11-04T15:27:45.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.069+0000 7f6bbaffd640 1 -- 172.21.15.19:0/3402739273 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ba4003520 con 0x7f6bbc069c70 2023-11-04T15:27:45.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.069+0000 7f1e05d9b640 1 -- 172.21.15.19:0/1414393376 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1df0003520 con 0x7f1e08133e00 2023-11-04T15:27:45.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.069+0000 7f77fffff640 1 -- 172.21.15.19:0/2487030585 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7800138930 msgr2=0x7f780006a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:45.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.069+0000 7f77fffff640 1 --2- 172.21.15.19:0/2487030585 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7800138930 0x7f780006a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.069+0000 7f1e05d9b640 1 -- 172.21.15.19:0/1414393376 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3548539799 0 0) 0x7f1e080a2300 con 0x7f1e08137320 2023-11-04T15:27:45.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.069+0000 7f6bc089d640 1 -- 172.21.15.19:0/3402739273 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6bbc138550 msgr2=0x7f6bbc138930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:45.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.069+0000 7f6bc089d640 1 --2- 172.21.15.19:0/3402739273 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6bbc138550 0x7f6bbc138930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.069+0000 7f6bc089d640 1 -- 172.21.15.19:0/3402739273 >> v1:172.21.15.96:6789/0 conn(0x7f6bbc069c70 legacy=0x7f6bbc06a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.069+0000 7f6bc089d640 1 -- 172.21.15.19:0/3402739273 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bbc0a53d0 con 0x7f6bbc06a800 2023-11-04T15:27:45.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.069+0000 7f6bbbfff640 1 --2- 172.21.15.19:0/3402739273 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6bbc138550 0x7f6bbc138930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T15:27:45.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.069+0000 7f1e05d9b640 1 -- 172.21.15.19:0/1414393376 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e080a0240 con 0x7f1e08137320 2023-11-04T15:27:45.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.069+0000 7f25c566f640 1 -- 172.21.15.19:0/391583051 >> v1:172.21.15.96:6789/0 conn(0x7f25c0133cb0 legacy=0x7f25c0134090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.069+0000 7f25c566f640 1 -- 172.21.15.19:0/391583051 >> v1:172.21.15.19:6789/0 conn(0x7f25c00a0730 legacy=0x7f25c013bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.069+0000 7f25c566f640 1 -- 172.21.15.19:0/391583051 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c00a0180 con 0x7f25c0069c70 2023-11-04T15:27:45.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.069+0000 7f1e05d9b640 1 -- 172.21.15.19:0/1414393376 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2203408321 0 0) 0x7f1e080a0240 con 0x7f1e08137320 2023-11-04T15:27:45.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.069+0000 7f1e0659c640 1 -- 172.21.15.19:0/1414393376 >> v1:172.21.15.96:6789/0 conn(0x7f1e08133e00 legacy=0x7f1e08136c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.069+0000 7f1e0659c640 1 -- 172.21.15.19:0/1414393376 >> v1:172.21.15.19:6789/0 conn(0x7f1e08137320 legacy=0x7f1e0813ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.069+0000 7f1e0659c640 1 -- 172.21.15.19:0/1414393376 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e080a2040 con 0x7f1e080a0cd0 2023-11-04T15:27:45.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.069+0000 7f77fffff640 1 -- 172.21.15.19:0/2487030585 >> v1:172.21.15.96:6789/0 conn(0x7f7800138550 legacy=0x7f7800069c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.069+0000 7f77fffff640 1 -- 172.21.15.19:0/2487030585 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7800137ee0 con 0x7f780013e170 2023-11-04T15:27:45.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.070+0000 7f77feffd640 1 --2- 172.21.15.19:0/2487030585 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7800138930 0x7f780006a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:27:45.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.070+0000 7f1e0659c640 1 --2- 172.21.15.19:0/1414393376 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e080a0cd0 0x7f1e081341e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc0097a0 tx=0x7f1dfc02b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e87f3f38523d882 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:45.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.070+0000 7f25c566f640 1 --2- 172.21.15.19:0/391583051 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f25c0069c70 0x7f25c006a0b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f25b8009dc0 tx=0x7f25b802bdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bd793055c8cae4d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:45.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.070+0000 7f6bc089d640 1 --2- 172.21.15.19:0/3402739273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bbc06a800 0x7f6bbc140180 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4009d90 tx=0x7f6bb402be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aaf1e6f3b31e196c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:45.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.070+0000 7f1e05d9b640 1 -- 172.21.15.19:0/1414393376 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e00001970 con 0x7f1e080a0cd0 2023-11-04T15:27:45.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.070+0000 7f77fffff640 1 --2- 172.21.15.19:0/2487030585 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f780013e170 0x7f7800140560 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f77f8009870 tx=0x7f77f802b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0c6f435a87d5e9b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:45.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.070+0000 7f25bf7fe640 1 -- 172.21.15.19:0/391583051 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b802cba0 con 0x7f25c0069c70 2023-11-04T15:27:45.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.070+0000 7f1e05d9b640 1 -- 172.21.15.19:0/1414393376 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dfc02e050 con 0x7f1e080a0cd0 2023-11-04T15:27:45.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.070+0000 7f1e05d9b640 1 -- 172.21.15.19:0/1414393376 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc030730 con 0x7f1e080a0cd0 2023-11-04T15:27:45.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.070+0000 7f25bf7fe640 1 -- 172.21.15.19:0/391583051 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b802cd00 con 0x7f25c0069c70 2023-11-04T15:27:45.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.070+0000 7f25bf7fe640 1 -- 172.21.15.19:0/391583051 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b802cba0 con 0x7f25c0069c70 2023-11-04T15:27:45.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.070+0000 7f77fe7fc640 1 -- 172.21.15.19:0/2487030585 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f8031640 con 0x7f780013e170 2023-11-04T15:27:45.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.070+0000 7f6bbaffd640 1 -- 172.21.15.19:0/3402739273 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb402cbc0 con 0x7f6bbc06a800 2023-11-04T15:27:45.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.070+0000 7f77fe7fc640 1 -- 172.21.15.19:0/2487030585 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f80317a0 con 0x7f780013e170 2023-11-04T15:27:45.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.070+0000 7f77fe7fc640 1 -- 172.21.15.19:0/2487030585 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f8031b30 con 0x7f780013e170 2023-11-04T15:27:45.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.071+0000 7f1e0d02d640 1 -- 172.21.15.19:0/1414393376 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e080a0cd0 msgr2=0x7f1e081341e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.070+0000 7f6bbaffd640 1 -- 172.21.15.19:0/3402739273 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb402cd20 con 0x7f6bbc06a800 2023-11-04T15:27:45.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.070+0000 7f6bbaffd640 1 -- 172.21.15.19:0/3402739273 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4034640 con 0x7f6bbc06a800 2023-11-04T15:27:45.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.071+0000 7f1e0d02d640 1 --2- 172.21.15.19:0/1414393376 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e080a0cd0 0x7f1e081341e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc0097a0 tx=0x7f1dfc02b710 comp rx=0 tx=0).stop 2023-11-04T15:27:45.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.071+0000 7f6bc2300640 1 -- 172.21.15.19:0/3402739273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bbc06a800 msgr2=0x7f6bbc140180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.071+0000 7f1e0d02d640 1 -- 172.21.15.19:0/1414393376 shutdown_connections 2023-11-04T15:27:45.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.071+0000 7f6bc2300640 1 --2- 172.21.15.19:0/3402739273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bbc06a800 0x7f6bbc140180 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4009d90 tx=0x7f6bb402be10 comp rx=0 tx=0).stop 2023-11-04T15:27:45.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.071+0000 7f1e0d02d640 1 --2- 172.21.15.19:0/1414393376 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e080a0cd0 0x7f1e081341e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.071+0000 7f25c70d2640 1 -- 172.21.15.19:0/391583051 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f25c0069c70 msgr2=0x7f25c006a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.071+0000 7f25c70d2640 1 --2- 172.21.15.19:0/391583051 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f25c0069c70 0x7f25c006a0b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f25b8009dc0 tx=0x7f25b802bdf0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.071+0000 7f25c70d2640 1 -- 172.21.15.19:0/391583051 shutdown_connections 2023-11-04T15:27:45.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.071+0000 7f25c70d2640 1 --2- 172.21.15.19:0/391583051 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f25c0069c70 0x7f25c006a0b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.071+0000 7f25c70d2640 1 -- 172.21.15.19:0/391583051 >> 172.21.15.19:0/391583051 conn(0x7f25c00a9060 msgr2=0x7f25c00a9470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:45.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.071+0000 7f6bc2300640 1 -- 172.21.15.19:0/3402739273 shutdown_connections 2023-11-04T15:27:45.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.071+0000 7f6bc2300640 1 --2- 172.21.15.19:0/3402739273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bbc06a800 0x7f6bbc140180 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.071+0000 7f6bc2300640 1 --2- 172.21.15.19:0/3402739273 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6bbc138550 0x7f6bbc138930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.071+0000 7f6bc2300640 1 -- 172.21.15.19:0/3402739273 >> 172.21.15.19:0/3402739273 conn(0x7f6bbc0a8f80 msgr2=0x7f6bbc0a9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:45.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.071+0000 7f780608f640 1 -- 172.21.15.19:0/2487030585 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f780013e170 msgr2=0x7f7800140560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.071+0000 7f780608f640 1 --2- 172.21.15.19:0/2487030585 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f780013e170 0x7f7800140560 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f77f8009870 tx=0x7f77f802b8f0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.071+0000 7f25c70d2640 1 -- 172.21.15.19:0/391583051 shutdown_connections 2023-11-04T15:27:45.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.071+0000 7f1e0d02d640 1 -- 172.21.15.19:0/1414393376 >> 172.21.15.19:0/1414393376 conn(0x7f1e080a8ff0 msgr2=0x7f1e080a9400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:45.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.071+0000 7f25c70d2640 1 -- 172.21.15.19:0/391583051 wait complete. 2023-11-04T15:27:45.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.071+0000 7f6bc2300640 1 -- 172.21.15.19:0/3402739273 shutdown_connections 2023-11-04T15:27:45.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.071+0000 7f6bc2300640 1 -- 172.21.15.19:0/3402739273 wait complete. 2023-11-04T15:27:45.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.072+0000 7f780608f640 1 -- 172.21.15.19:0/2487030585 shutdown_connections 2023-11-04T15:27:45.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.072+0000 7f780608f640 1 --2- 172.21.15.19:0/2487030585 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f780013e170 0x7f7800140560 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.072+0000 7f780608f640 1 --2- 172.21.15.19:0/2487030585 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7800138930 0x7f780006a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.072+0000 7f1e0d02d640 1 -- 172.21.15.19:0/1414393376 shutdown_connections 2023-11-04T15:27:45.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.072+0000 7f780608f640 1 -- 172.21.15.19:0/2487030585 >> 172.21.15.19:0/2487030585 conn(0x7f78000a8f80 msgr2=0x7f78000a9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:45.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.072+0000 7f1e0d02d640 1 -- 172.21.15.19:0/1414393376 wait complete. 2023-11-04T15:27:45.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.072+0000 7f780608f640 1 -- 172.21.15.19:0/2487030585 shutdown_connections 2023-11-04T15:27:45.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.072+0000 7f780608f640 1 -- 172.21.15.19:0/2487030585 wait complete. 2023-11-04T15:27:45.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.073+0000 7f780608f640 1 Processor -- start 2023-11-04T15:27:45.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.073+0000 7f6bc2300640 1 Processor -- start 2023-11-04T15:27:45.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.073+0000 7f25c70d2640 1 Processor -- start 2023-11-04T15:27:45.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.073+0000 7f25c70d2640 1 -- start start 2023-11-04T15:27:45.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.073+0000 7f780608f640 1 -- start start 2023-11-04T15:27:45.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.073+0000 7f6bc2300640 1 -- start start 2023-11-04T15:27:45.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.073+0000 7f1e0d02d640 1 Processor -- start 2023-11-04T15:27:45.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.073+0000 7f1e0d02d640 1 -- start start 2023-11-04T15:27:45.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.073+0000 7f780608f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7800138550 0x7f780012dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.073+0000 7f780608f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7800138930 0x7f780012dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.073+0000 7f25c70d2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25c0069c70 0x7f25c0122fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.073+0000 7f780608f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f780013e170 0x7f7800136c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.073+0000 7f780608f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780013dcc0 con 0x7f7800138550 2023-11-04T15:27:45.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.073+0000 7f780608f640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780006f250 con 0x7f780013e170 2023-11-04T15:27:45.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.073+0000 7f780608f640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7800135a30 con 0x7f7800138930 2023-11-04T15:27:45.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.073+0000 7f6bc2300640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bbc069c70 0x7f6bbc133890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.073+0000 7f77ff7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7800138550 0x7f780012dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.073+0000 7f25c70d2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25c00a0730 0x7f25c011f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.073+0000 7f25c70d2640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f25c0133cb0 0x7f25c011fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.073+0000 7f25c70d2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c0131950 con 0x7f25c0069c70 2023-11-04T15:27:45.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.073+0000 7f25c70d2640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c0071640 con 0x7f25c00a0730 2023-11-04T15:27:45.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.073+0000 7f25c70d2640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c0123510 con 0x7f25c0133cb0 2023-11-04T15:27:45.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f6bc2300640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bbc06a800 0x7f6bbc133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.073+0000 7f77ff7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7800138550 0x7f780012dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53608/0 (socket says 172.21.15.19:53608) 2023-11-04T15:27:45.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.073+0000 7f77ff7fe640 1 -- 172.21.15.19:0/1559909124 learned_addr learned my addr 172.21.15.19:0/1559909124 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:45.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.073+0000 7f77feffd640 1 --2- 172.21.15.19:0/1559909124 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7800138930 0x7f780012dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f77fffff640 1 --2- 172.21.15.19:0/1559909124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f780013e170 0x7f7800136c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f25c566f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f25c0133cb0 0x7f25c011fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f25c566f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f25c0133cb0 0x7f25c011fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.19:49220/0 (socket says 172.21.15.19:49220) 2023-11-04T15:27:45.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f25c566f640 1 -- 172.21.15.19:0/1372118617 learned_addr learned my addr 172.21.15.19:0/1372118617 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:45.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f25bffff640 1 --2- 172.21.15.19:0/1372118617 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25c00a0730 0x7f25c011f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f6bc2300640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6bbc138550 0x7f6bbc134310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f6bc2300640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc0a1c70 con 0x7f6bbc069c70 2023-11-04T15:27:45.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f6bc2300640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc0a2510 con 0x7f6bbc06a800 2023-11-04T15:27:45.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f6bc2300640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc0a0d70 con 0x7f6bbc138550 2023-11-04T15:27:45.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f6bbbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bbc069c70 0x7f6bbc133890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f6bbbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bbc069c70 0x7f6bbc133890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53612/0 (socket says 172.21.15.19:53612) 2023-11-04T15:27:45.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f6bbbfff640 1 -- 172.21.15.19:0/3551066642 learned_addr learned my addr 172.21.15.19:0/3551066642 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:45.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f25c4e6e640 1 --2- 172.21.15.19:0/1372118617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25c0069c70 0x7f25c0122fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f1e0d02d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e080a0cd0 0x7f1e081cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f6bbb7fe640 1 --2- 172.21.15.19:0/3551066642 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bbc06a800 0x7f6bbc133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f77ff7fe640 1 -- 172.21.15.19:0/1559909124 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7800138930 msgr2=0x7f780012dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f77ff7fe640 1 --2- 172.21.15.19:0/1559909124 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7800138930 0x7f780012dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f77ff7fe640 1 -- 172.21.15.19:0/1559909124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f780013e170 msgr2=0x7f7800136c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f77ff7fe640 1 --2- 172.21.15.19:0/1559909124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f780013e170 0x7f7800136c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f77ff7fe640 1 -- 172.21.15.19:0/1559909124 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f80094d0 con 0x7f7800138550 2023-11-04T15:27:45.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f25c566f640 1 -- 172.21.15.19:0/1372118617 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25c00a0730 msgr2=0x7f25c011f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f25c566f640 1 --2- 172.21.15.19:0/1372118617 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25c00a0730 0x7f25c011f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f1e0d02d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e08133e00 0x7f1e081ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f77fffff640 1 --2- 172.21.15.19:0/1559909124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f780013e170 0x7f7800136c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T15:27:45.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f6bc089d640 1 --2- 172.21.15.19:0/3551066642 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6bbc138550 0x7f6bbc134310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f1e0d02d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1e08137320 0x7f1e081cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f1e0d02d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0809f140 con 0x7f1e080a0cd0 2023-11-04T15:27:45.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f1e0d02d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0809f5a0 con 0x7f1e08133e00 2023-11-04T15:27:45.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f1e0d02d640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0809f860 con 0x7f1e08137320 2023-11-04T15:27:45.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f1e06d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e080a0cd0 0x7f1e081cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f25c566f640 1 -- 172.21.15.19:0/1372118617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25c0069c70 msgr2=0x7f25c0122fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f25c566f640 1 --2- 172.21.15.19:0/1372118617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25c0069c70 0x7f25c0122fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f25c566f640 1 -- 172.21.15.19:0/1372118617 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b8009a70 con 0x7f25c0133cb0 2023-11-04T15:27:45.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f6bbbfff640 1 -- 172.21.15.19:0/3551066642 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6bbc138550 msgr2=0x7f6bbc134310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f1e06d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e080a0cd0 0x7f1e081cc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53628/0 (socket says 172.21.15.19:53628) 2023-11-04T15:27:45.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f1e06d9d640 1 -- 172.21.15.19:0/1680519508 learned_addr learned my addr 172.21.15.19:0/1680519508 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:45.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f1e0659c640 1 --2- 172.21.15.19:0/1680519508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e08133e00 0x7f1e081ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f6bbbfff640 1 --2- 172.21.15.19:0/3551066642 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6bbc138550 0x7f6bbc134310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f6bbbfff640 1 -- 172.21.15.19:0/3551066642 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bbc06a800 msgr2=0x7f6bbc133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f6bbbfff640 1 --2- 172.21.15.19:0/3551066642 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bbc06a800 0x7f6bbc133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f1e0759e640 1 --2- 172.21.15.19:0/1680519508 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1e08137320 0x7f1e081cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f6bbbfff640 1 -- 172.21.15.19:0/3551066642 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bac009400 con 0x7f6bbc069c70 2023-11-04T15:27:45.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f6bc089d640 1 --2- 172.21.15.19:0/3551066642 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6bbc138550 0x7f6bbc134310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T15:27:45.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.074+0000 7f77ff7fe640 1 --2- 172.21.15.19:0/1559909124 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7800138550 0x7f780012dab0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f77f000c730 tx=0x7f77f000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:45.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.075+0000 7f25c566f640 1 --2- 172.21.15.19:0/1372118617 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f25c0133cb0 0x7f25c011fbf0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f25b802c400 tx=0x7f25b8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:45.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.075+0000 7f6bbbfff640 1 --2- 172.21.15.19:0/3551066642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bbc069c70 0x7f6bbc133890 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00e990 tx=0x7f6bac00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:45.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.075+0000 7f25bd7fa640 1 -- 172.21.15.19:0/1372118617 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b8004800 con 0x7f25c0133cb0 2023-11-04T15:27:45.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.075+0000 7f25bd7fa640 1 -- 172.21.15.19:0/1372118617 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b8034440 con 0x7f25c0133cb0 2023-11-04T15:27:45.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.075+0000 7f1e0759e640 1 -- 172.21.15.19:0/1680519508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e08133e00 msgr2=0x7f1e081ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.075+0000 7f1e0759e640 1 --2- 172.21.15.19:0/1680519508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e08133e00 0x7f1e081ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.075+0000 7f1e0759e640 1 -- 172.21.15.19:0/1680519508 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e080a0cd0 msgr2=0x7f1e081cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.075+0000 7f1e0759e640 1 --2- 172.21.15.19:0/1680519508 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e080a0cd0 0x7f1e081cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.075+0000 7f1e0759e640 1 -- 172.21.15.19:0/1680519508 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dfc009400 con 0x7f1e08137320 2023-11-04T15:27:45.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.075+0000 7f25bd7fa640 1 -- 172.21.15.19:0/1372118617 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b80347f0 con 0x7f25c0133cb0 2023-11-04T15:27:45.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.075+0000 7f1e06d9d640 1 --2- 172.21.15.19:0/1680519508 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e080a0cd0 0x7f1e081cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T15:27:45.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.075+0000 7f25c70d2640 1 -- 172.21.15.19:0/1372118617 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c00a24d0 con 0x7f25c0133cb0 2023-11-04T15:27:45.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.075+0000 7f6bb8ff9640 1 -- 172.21.15.19:0/3551066642 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac00c9e0 con 0x7f6bbc069c70 2023-11-04T15:27:45.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.075+0000 7f6bb8ff9640 1 -- 172.21.15.19:0/3551066642 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bac00cb40 con 0x7f6bbc069c70 2023-11-04T15:27:45.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.075+0000 7f77e7fff640 1 -- 172.21.15.19:0/1559909124 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f0006d50 con 0x7f7800138550 2023-11-04T15:27:45.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.075+0000 7f6bc2300640 1 -- 172.21.15.19:0/3551066642 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb4009a70 con 0x7f6bbc069c70 2023-11-04T15:27:45.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.075+0000 7f25c70d2640 1 -- 172.21.15.19:0/1372118617 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c0124d90 con 0x7f25c0133cb0 2023-11-04T15:27:45.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.075+0000 7f77e7fff640 1 -- 172.21.15.19:0/1559909124 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f000ce40 con 0x7f7800138550 2023-11-04T15:27:45.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.075+0000 7f77e7fff640 1 -- 172.21.15.19:0/1559909124 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f0003bb0 con 0x7f7800138550 2023-11-04T15:27:45.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.075+0000 7f1e0759e640 1 --2- 172.21.15.19:0/1680519508 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1e08137320 0x7f1e081cd2f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1e00001680 tx=0x7f1e0000a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:45.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.075+0000 7f6bb8ff9640 1 -- 172.21.15.19:0/3551066642 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac00ced0 con 0x7f6bbc069c70 2023-11-04T15:27:45.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.075+0000 7f780608f640 1 -- 172.21.15.19:0/1559909124 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f780013a530 con 0x7f7800138550 2023-11-04T15:27:45.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.075+0000 7f780608f640 1 -- 172.21.15.19:0/1559909124 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780012e530 con 0x7f7800138550 2023-11-04T15:27:45.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.075+0000 7f6bc2300640 1 -- 172.21.15.19:0/3551066642 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bbc06f250 con 0x7f6bbc069c70 2023-11-04T15:27:45.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.075+0000 7f1def7fe640 1 -- 172.21.15.19:0/1680519508 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0000ad40 con 0x7f1e08137320 2023-11-04T15:27:45.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.076+0000 7f1e0d02d640 1 -- 172.21.15.19:0/1680519508 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e0809e130 con 0x7f1e08137320 2023-11-04T15:27:45.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.076+0000 7f1e0d02d640 1 -- 172.21.15.19:0/1680519508 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e0809e450 con 0x7f1e08137320 2023-11-04T15:27:45.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.076+0000 7f1def7fe640 1 -- 172.21.15.19:0/1680519508 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e00012400 con 0x7f1e08137320 2023-11-04T15:27:45.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.076+0000 7f1def7fe640 1 -- 172.21.15.19:0/1680519508 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0000aea0 con 0x7f1e08137320 2023-11-04T15:27:45.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.076+0000 7f25c70d2640 1 -- 172.21.15.19:0/1372118617 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f25c00a1b50 con 0x7f25c0133cb0 2023-11-04T15:27:45.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.077+0000 7f1e0d02d640 1 -- 172.21.15.19:0/1680519508 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1e0809fc90 con 0x7f1e08137320 2023-11-04T15:27:45.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.077+0000 7f780608f640 1 -- 172.21.15.19:0/1559909124 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f780009fe20 con 0x7f7800138550 2023-11-04T15:27:45.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.077+0000 7f6bc2300640 1 -- 172.21.15.19:0/3551066642 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6bbc0a45b0 con 0x7f6bbc069c70 2023-11-04T15:27:45.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.077+0000 7f6bb8ff9640 1 -- 172.21.15.19:0/3551066642 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6bac013470 con 0x7f6bbc069c70 2023-11-04T15:27:45.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.077+0000 7f25bd7fa640 1 -- 172.21.15.19:0/1372118617 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f25b803b030 con 0x7f25c0133cb0 2023-11-04T15:27:45.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.077+0000 7f77e7fff640 1 -- 172.21.15.19:0/1559909124 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f77f0003d10 con 0x7f7800138550 2023-11-04T15:27:45.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.077+0000 7f1def7fe640 1 -- 172.21.15.19:0/1680519508 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1e00035be0 con 0x7f1e08137320 2023-11-04T15:27:45.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.078+0000 7f6bb8ff9640 1 --2- 172.21.15.19:0/3551066642 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f6ba806a430 0x7f6ba806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.078+0000 7f6bb8ff9640 1 -- 172.21.15.19:0/3551066642 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f6bac088520 con 0x7f6bbc069c70 2023-11-04T15:27:45.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.078+0000 7f1def7fe640 1 --2- 172.21.15.19:0/1680519508 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f1df406a430 0x7f1df406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.078+0000 7f25bd7fa640 1 --2- 172.21.15.19:0/1372118617 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f25ac06a430 0x7f25ac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.078+0000 7f77e7fff640 1 --2- 172.21.15.19:0/1559909124 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f77ec06a480 0x7f77ec06c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.078+0000 7f6bb8ff9640 1 --2- 172.21.15.19:0/3551066642 >> [v2:172.21.15.96:6800/83459,v1:172.21.15.96:6801/83459] conn(0x7f6ba8071eb0 0x7f6ba80742f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.078+0000 7f6bb8ff9640 1 -- 172.21.15.19:0/3551066642 --> [v2:172.21.15.96:6800/83459,v1:172.21.15.96:6801/83459] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6ba80749c0 con 0x7f6ba8071eb0 2023-11-04T15:27:45.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.078+0000 7f6bb8ff9640 1 -- 172.21.15.19:0/3551066642 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6bac08abe0 con 0x7f6bbc069c70 2023-11-04T15:27:45.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.078+0000 7f25bd7fa640 1 -- 172.21.15.19:0/1372118617 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f25b80aad90 con 0x7f25c0133cb0 2023-11-04T15:27:45.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.078+0000 7f1def7fe640 1 -- 172.21.15.19:0/1680519508 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f1e000884a0 con 0x7f1e08137320 2023-11-04T15:27:45.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.078+0000 7f6bbb7fe640 1 --2- 172.21.15.19:0/3551066642 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f6ba806a430 0x7f6ba806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.078+0000 7f77e7fff640 1 -- 172.21.15.19:0/1559909124 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f77f0087dc0 con 0x7f7800138550 2023-11-04T15:27:45.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.078+0000 7f25bd7fa640 1 --2- 172.21.15.19:0/1372118617 >> [v2:172.21.15.19:6808/82880,v1:172.21.15.19:6809/82880] conn(0x7f25ac072020 0x7f25ac074460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.078+0000 7f77e7fff640 1 --2- 172.21.15.19:0/1559909124 >> [v2:172.21.15.96:6806/83458,v1:172.21.15.96:6808/83458] conn(0x7f77ec0720f0 0x7f77ec074530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.078+0000 7f77e7fff640 1 -- 172.21.15.19:0/1559909124 --> [v2:172.21.15.96:6806/83458,v1:172.21.15.96:6808/83458] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f77ec074c00 con 0x7f77ec0720f0 2023-11-04T15:27:45.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.078+0000 7f1def7fe640 1 --2- 172.21.15.19:0/1680519508 >> [v2:172.21.15.19:6800/82879,v1:172.21.15.19:6801/82879] conn(0x7f1df4072020 0x7f1df4074460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.078+0000 7f1def7fe640 1 -- 172.21.15.19:0/1680519508 --> [v2:172.21.15.19:6800/82879,v1:172.21.15.19:6801/82879] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1df4074b30 con 0x7f1df4072020 2023-11-04T15:27:45.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.078+0000 7f1def7fe640 1 -- 172.21.15.19:0/1680519508 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e000888f0 con 0x7f1e08137320 2023-11-04T15:27:45.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.078+0000 7f25bd7fa640 1 -- 172.21.15.19:0/1372118617 --> [v2:172.21.15.19:6808/82880,v1:172.21.15.19:6809/82880] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f25ac074b30 con 0x7f25ac072020 2023-11-04T15:27:45.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.078+0000 7f25bd7fa640 1 -- 172.21.15.19:0/1372118617 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25b80ad3f0 con 0x7f25c0133cb0 2023-11-04T15:27:45.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.078+0000 7f77e7fff640 1 -- 172.21.15.19:0/1559909124 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77f008a3a0 con 0x7f7800138550 2023-11-04T15:27:45.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.078+0000 7f77feffd640 1 --2- 172.21.15.19:0/1559909124 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f77ec06a480 0x7f77ec06c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.078+0000 7f6bc089d640 1 --2- 172.21.15.19:0/3551066642 >> [v2:172.21.15.96:6800/83459,v1:172.21.15.96:6801/83459] conn(0x7f6ba8071eb0 0x7f6ba80742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.078+0000 7f25bffff640 1 --2- 172.21.15.19:0/1372118617 >> [v2:172.21.15.19:6808/82880,v1:172.21.15.19:6809/82880] conn(0x7f25ac072020 0x7f25ac074460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.078+0000 7f1e0659c640 1 --2- 172.21.15.19:0/1680519508 >> [v2:172.21.15.19:6800/82879,v1:172.21.15.19:6801/82879] conn(0x7f1df4072020 0x7f1df4074460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.078+0000 7f77fffff640 1 --2- 172.21.15.19:0/1559909124 >> [v2:172.21.15.96:6806/83458,v1:172.21.15.96:6808/83458] conn(0x7f77ec0720f0 0x7f77ec074530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.079+0000 7f77feffd640 1 --2- 172.21.15.19:0/1559909124 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f77ec06a480 0x7f77ec06c940 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7800133970 tx=0x7f77f4008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:45.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.079+0000 7f6bc089d640 1 --2- 172.21.15.19:0/3551066642 >> [v2:172.21.15.96:6800/83459,v1:172.21.15.96:6801/83459] conn(0x7f6ba8071eb0 0x7f6ba80742f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:45.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.079+0000 7f77fffff640 1 --2- 172.21.15.19:0/1559909124 >> [v2:172.21.15.96:6806/83458,v1:172.21.15.96:6808/83458] conn(0x7f77ec0720f0 0x7f77ec074530 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:45.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.079+0000 7f25bffff640 1 --2- 172.21.15.19:0/1372118617 >> [v2:172.21.15.19:6808/82880,v1:172.21.15.19:6809/82880] conn(0x7f25ac072020 0x7f25ac074460 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:45.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.079+0000 7f1e0659c640 1 --2- 172.21.15.19:0/1680519508 >> [v2:172.21.15.19:6800/82879,v1:172.21.15.19:6801/82879] conn(0x7f1df4072020 0x7f1df4074460 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:45.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.080+0000 7f25bd7fa640 1 -- 172.21.15.19:0/1372118617 <== osd.1 v2:172.21.15.19:6808/82880 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f25ac074b30 con 0x7f25ac072020 2023-11-04T15:27:45.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.080+0000 7f1def7fe640 1 -- 172.21.15.19:0/1680519508 <== osd.0 v2:172.21.15.19:6800/82879 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1df4074b30 con 0x7f1df4072020 2023-11-04T15:27:45.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.080+0000 7f6bb8ff9640 1 -- 172.21.15.19:0/3551066642 <== osd.3 v2:172.21.15.96:6800/83459 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6ba80749c0 con 0x7f6ba8071eb0 2023-11-04T15:27:45.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.080+0000 7f77e7fff640 1 -- 172.21.15.19:0/1559909124 <== osd.2 v2:172.21.15.96:6806/83458 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f77ec074c00 con 0x7f77ec0720f0 2023-11-04T15:27:45.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.085+0000 7f25c4e6e640 1 --2- 172.21.15.19:0/1372118617 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f25ac06a430 0x7f25ac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.085+0000 7f1e06d9d640 1 --2- 172.21.15.19:0/1680519508 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f1df406a430 0x7f1df406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.085+0000 7f1e06d9d640 1 --2- 172.21.15.19:0/1680519508 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f1df406a430 0x7f1df406c8f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1df8001010 tx=0x7f1df8009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.085+0000 7f6bbb7fe640 1 --2- 172.21.15.19:0/3551066642 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f6ba806a430 0x7f6ba806c8f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc1308d0 tx=0x7f6bb0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.085+0000 7f25c4e6e640 1 --2- 172.21.15.19:0/1372118617 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f25ac06a430 0x7f25ac06c8f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f25b0005880 tx=0x7f25b0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.094+0000 7f25c70d2640 1 -- 172.21.15.19:0/1372118617 --> [v2:172.21.15.19:6808/82880,v1:172.21.15.19:6809/82880] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f25c00a32e0 con 0x7f25ac072020 2023-11-04T15:27:45.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.094+0000 7f780608f640 1 -- 172.21.15.19:0/1559909124 --> [v2:172.21.15.96:6806/83458,v1:172.21.15.96:6808/83458] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f78000a53d0 con 0x7f77ec0720f0 2023-11-04T15:27:45.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.094+0000 7f25bd7fa640 1 -- 172.21.15.19:0/1372118617 <== osd.1 v2:172.21.15.19:6808/82880 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f25b4001420 con 0x7f25ac072020 2023-11-04T15:27:45.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.094+0000 7f77e7fff640 1 -- 172.21.15.19:0/1559909124 <== osd.2 v2:172.21.15.96:6806/83458 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f77f8031440 con 0x7f77ec0720f0 2023-11-04T15:27:45.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.094+0000 7f25c70d2640 1 -- 172.21.15.19:0/1372118617 >> [v2:172.21.15.19:6808/82880,v1:172.21.15.19:6809/82880] conn(0x7f25ac072020 msgr2=0x7f25ac074460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.094+0000 7f25c70d2640 1 --2- 172.21.15.19:0/1372118617 >> [v2:172.21.15.19:6808/82880,v1:172.21.15.19:6809/82880] conn(0x7f25ac072020 0x7f25ac074460 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.095+0000 7f25c70d2640 1 -- 172.21.15.19:0/1372118617 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f25ac06a430 msgr2=0x7f25ac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.095+0000 7f25c70d2640 1 --2- 172.21.15.19:0/1372118617 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f25ac06a430 0x7f25ac06c8f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f25b0005880 tx=0x7f25b0009040 comp rx=0 tx=0).stop 2023-11-04T15:27:45.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.095+0000 7f25c70d2640 1 -- 172.21.15.19:0/1372118617 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f25c0133cb0 msgr2=0x7f25c011fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.095+0000 7f25c70d2640 1 --2- 172.21.15.19:0/1372118617 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f25c0133cb0 0x7f25c011fbf0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f25b802c400 tx=0x7f25b8004a40 comp rx=0 tx=0).stop 2023-11-04T15:27:45.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.095+0000 7f25c566f640 1 -- 172.21.15.19:0/1372118617 reap_dead start 2023-11-04T15:27:45.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.095+0000 7f25c70d2640 1 -- 172.21.15.19:0/1372118617 shutdown_connections 2023-11-04T15:27:45.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.095+0000 7f25c70d2640 1 -- 172.21.15.19:0/1372118617 >> 172.21.15.19:0/1372118617 conn(0x7f25c00a9060 msgr2=0x7f25c0127b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:45.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.095+0000 7f25c70d2640 1 -- 172.21.15.19:0/1372118617 shutdown_connections 2023-11-04T15:27:45.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.095+0000 7f25c70d2640 1 -- 172.21.15.19:0/1372118617 wait complete. 2023-11-04T15:27:45.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.095+0000 7f780608f640 1 -- 172.21.15.19:0/1559909124 >> [v2:172.21.15.96:6806/83458,v1:172.21.15.96:6808/83458] conn(0x7f77ec0720f0 msgr2=0x7f77ec074530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.095+0000 7f780608f640 1 --2- 172.21.15.19:0/1559909124 >> [v2:172.21.15.96:6806/83458,v1:172.21.15.96:6808/83458] conn(0x7f77ec0720f0 0x7f77ec074530 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.095+0000 7f780608f640 1 -- 172.21.15.19:0/1559909124 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f77ec06a480 msgr2=0x7f77ec06c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.095+0000 7f780608f640 1 --2- 172.21.15.19:0/1559909124 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f77ec06a480 0x7f77ec06c940 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7800133970 tx=0x7f77f4008040 comp rx=0 tx=0).stop 2023-11-04T15:27:45.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.095+0000 7f780608f640 1 -- 172.21.15.19:0/1559909124 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7800138550 msgr2=0x7f780012dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.095+0000 7f780608f640 1 --2- 172.21.15.19:0/1559909124 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7800138550 0x7f780012dab0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f77f000c730 tx=0x7f77f000cbf0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.095+0000 7f77fffff640 1 -- 172.21.15.19:0/1559909124 reap_dead start 2023-11-04T15:27:45.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.095+0000 7f780608f640 1 -- 172.21.15.19:0/1559909124 shutdown_connections 2023-11-04T15:27:45.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.095+0000 7f780608f640 1 -- 172.21.15.19:0/1559909124 >> 172.21.15.19:0/1559909124 conn(0x7f78000a8f80 msgr2=0x7f7800131f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:45.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.095+0000 7f780608f640 1 -- 172.21.15.19:0/1559909124 shutdown_connections 2023-11-04T15:27:45.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.095+0000 7f780608f640 1 -- 172.21.15.19:0/1559909124 wait complete. 2023-11-04T15:27:45.172 INFO:teuthology.orchestra.run.smithi019.stdout:38654705670 2023-11-04T15:27:45.173 INFO:teuthology.orchestra.run.smithi019.stdout:38654705671 2023-11-04T15:27:45.174 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-04T15:27:45.174 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-04T15:27:45.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.112+0000 7f1e0d02d640 1 -- 172.21.15.19:0/1680519508 --> [v2:172.21.15.19:6800/82879,v1:172.21.15.19:6801/82879] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1e0806aa40 con 0x7f1df4072020 2023-11-04T15:27:45.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.112+0000 7f6bc2300640 1 -- 172.21.15.19:0/3551066642 --> [v2:172.21.15.96:6800/83459,v1:172.21.15.96:6801/83459] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6bbc09fe20 con 0x7f6ba8071eb0 2023-11-04T15:27:45.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.112+0000 7f1def7fe640 1 -- 172.21.15.19:0/1680519508 <== osd.0 v2:172.21.15.19:6800/82879 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1e0806aa40 con 0x7f1df4072020 2023-11-04T15:27:45.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.112+0000 7f6bb8ff9640 1 -- 172.21.15.19:0/3551066642 <== osd.3 v2:172.21.15.96:6800/83459 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6bb402ce90 con 0x7f6ba8071eb0 2023-11-04T15:27:45.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.113+0000 7f1e0d02d640 1 -- 172.21.15.19:0/1680519508 >> [v2:172.21.15.19:6800/82879,v1:172.21.15.19:6801/82879] conn(0x7f1df4072020 msgr2=0x7f1df4074460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.113+0000 7f1e0d02d640 1 --2- 172.21.15.19:0/1680519508 >> [v2:172.21.15.19:6800/82879,v1:172.21.15.19:6801/82879] conn(0x7f1df4072020 0x7f1df4074460 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.113+0000 7f1e0d02d640 1 -- 172.21.15.19:0/1680519508 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f1df406a430 msgr2=0x7f1df406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.113+0000 7f1e0d02d640 1 --2- 172.21.15.19:0/1680519508 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f1df406a430 0x7f1df406c8f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1df8001010 tx=0x7f1df8009040 comp rx=0 tx=0).stop 2023-11-04T15:27:45.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.113+0000 7f1e0d02d640 1 -- 172.21.15.19:0/1680519508 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1e08137320 msgr2=0x7f1e081cd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.113+0000 7f1e0d02d640 1 --2- 172.21.15.19:0/1680519508 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1e08137320 0x7f1e081cd2f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1e00001680 tx=0x7f1e0000a430 comp rx=0 tx=0).stop 2023-11-04T15:27:45.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.113+0000 7f1e0759e640 1 -- 172.21.15.19:0/1680519508 reap_dead start 2023-11-04T15:27:45.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.113+0000 7f1e0d02d640 1 -- 172.21.15.19:0/1680519508 shutdown_connections 2023-11-04T15:27:45.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.113+0000 7f1e0d02d640 1 -- 172.21.15.19:0/1680519508 >> 172.21.15.19:0/1680519508 conn(0x7f1e080a8ff0 msgr2=0x7f1e080a6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:45.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.113+0000 7f6bc2300640 1 -- 172.21.15.19:0/3551066642 >> [v2:172.21.15.96:6800/83459,v1:172.21.15.96:6801/83459] conn(0x7f6ba8071eb0 msgr2=0x7f6ba80742f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.113+0000 7f6bc2300640 1 --2- 172.21.15.19:0/3551066642 >> [v2:172.21.15.96:6800/83459,v1:172.21.15.96:6801/83459] conn(0x7f6ba8071eb0 0x7f6ba80742f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.113+0000 7f1e0d02d640 1 -- 172.21.15.19:0/1680519508 shutdown_connections 2023-11-04T15:27:45.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.113+0000 7f6bc2300640 1 -- 172.21.15.19:0/3551066642 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f6ba806a430 msgr2=0x7f6ba806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.113+0000 7f6bc2300640 1 --2- 172.21.15.19:0/3551066642 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f6ba806a430 0x7f6ba806c8f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc1308d0 tx=0x7f6bb0009040 comp rx=0 tx=0).stop 2023-11-04T15:27:45.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.113+0000 7f6bc2300640 1 -- 172.21.15.19:0/3551066642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bbc069c70 msgr2=0x7f6bbc133890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.113+0000 7f6bc2300640 1 --2- 172.21.15.19:0/3551066642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bbc069c70 0x7f6bbc133890 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00e990 tx=0x7f6bac00ee50 comp rx=0 tx=0).stop 2023-11-04T15:27:45.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.113+0000 7f6bc089d640 1 -- 172.21.15.19:0/3551066642 reap_dead start 2023-11-04T15:27:45.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.113+0000 7f1e0d02d640 1 -- 172.21.15.19:0/1680519508 wait complete. 2023-11-04T15:27:45.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.113+0000 7f6bc2300640 1 -- 172.21.15.19:0/3551066642 shutdown_connections 2023-11-04T15:27:45.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.113+0000 7f6bc2300640 1 -- 172.21.15.19:0/3551066642 >> 172.21.15.19:0/3551066642 conn(0x7f6bbc0a8f80 msgr2=0x7f6bbc0702f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:45.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.113+0000 7f6bc2300640 1 -- 172.21.15.19:0/3551066642 shutdown_connections 2023-11-04T15:27:45.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.113+0000 7f6bc2300640 1 -- 172.21.15.19:0/3551066642 wait complete. 2023-11-04T15:27:45.184 INFO:teuthology.orchestra.run.smithi019.stdout:38654705672 2023-11-04T15:27:45.184 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-04T15:27:45.185 INFO:teuthology.orchestra.run.smithi019.stdout:38654705671 2023-11-04T15:27:45.186 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-04T15:27:45.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.333+0000 7effd9441640 1 Processor -- start 2023-11-04T15:27:45.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.333+0000 7effd9441640 1 -- start start 2023-11-04T15:27:45.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.333+0000 7fc5beb6e640 1 Processor -- start 2023-11-04T15:27:45.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.333+0000 7fc5beb6e640 1 -- start start 2023-11-04T15:27:45.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.333+0000 7fa81db81640 1 Processor -- start 2023-11-04T15:27:45.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.333+0000 7fa81db81640 1 -- start start 2023-11-04T15:27:45.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.334+0000 7effd9441640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7effd4135480 0x7effd41384e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.334+0000 7effd9441640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7effd413e100 0x7effd41404f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.334+0000 7effd9441640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effd40710a0 con 0x7effd41350a0 2023-11-04T15:27:45.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.334+0000 7effd9441640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effd40a4610 con 0x7effd413e100 2023-11-04T15:27:45.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.334+0000 7effd9441640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd40a6810 con 0x7effd4135480 2023-11-04T15:27:45.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.334+0000 7fa81db81640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa818133f70 0x7fa8180a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.334+0000 7fa81db81640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa818140260 0x7fa818142650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.334+0000 7fc5beb6e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc5b806c4b0 0x7fc5b81377d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.334+0000 7fc5beb6e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b806cac0 con 0x7fc5b813f4a0 2023-11-04T15:27:45.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.334+0000 7fc5beb6e640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b8136e00 con 0x7fc5b8070090 2023-11-04T15:27:45.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.334+0000 7fc5beb6e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b806c250 con 0x7fc5b806c4b0 2023-11-04T15:27:45.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.334+0000 7fa81db81640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8180a0ba0 con 0x7fa818134350 2023-11-04T15:27:45.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.334+0000 7fa816ffd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa818134350 0x7fa8180a3fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60862/0 (socket says 172.21.15.19:60862) 2023-11-04T15:27:45.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.334+0000 7fa816ffd640 1 -- 172.21.15.19:0/4277709486 learned_addr learned my addr 172.21.15.19:0/4277709486 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:45.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.334+0000 7fa81db81640 1 -- 172.21.15.19:0/4277709486 --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa81806aac0 con 0x7fa818133f70 2023-11-04T15:27:45.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.334+0000 7fa81db81640 1 -- 172.21.15.19:0/4277709486 --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8180a1070 con 0x7fa818140260 2023-11-04T15:27:45.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.334+0000 7fa8177fe640 1 --2- 172.21.15.19:0/4277709486 >> v2:172.21.15.19:3300/0 conn(0x7fa818133f70 0x7fa8180a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.334+0000 7effd37fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7effd413e100 0x7effd41404f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.334+0000 7effd37fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7effd413e100 0x7effd41404f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53630/0 (socket says 172.21.15.19:53630) 2023-11-04T15:27:45.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.334+0000 7effd37fe640 1 -- 172.21.15.19:0/1680983688 learned_addr learned my addr 172.21.15.19:0/1680983688 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:45.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.334+0000 7effd27fc640 1 --2- 172.21.15.19:0/1680983688 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7effd4135480 0x7effd41384e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.334+0000 7fa817fff640 1 --2- 172.21.15.19:0/4277709486 >> v2:172.21.15.96:3300/0 conn(0x7fa818140260 0x7fa818142650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.334+0000 7fc5bc90a640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fc5b8070090 0x7fc5b81370c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.19:33970/0 (socket says 172.21.15.19:33970) 2023-11-04T15:27:45.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.334+0000 7fc5bc90a640 1 -- 172.21.15.19:0/1238981032 learned_addr learned my addr 172.21.15.19:0/1238981032 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:45.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.334+0000 7fc5b7fff640 1 --2- 172.21.15.19:0/1238981032 >> v2:172.21.15.19:3300/0 conn(0x7fc5b806c4b0 0x7fc5b81377d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.334+0000 7effd37fe640 1 -- 172.21.15.19:0/1680983688 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7effd4135480 msgr2=0x7effd41384e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:45.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.334+0000 7effd37fe640 1 --2- 172.21.15.19:0/1680983688 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7effd4135480 0x7effd41384e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.334+0000 7effd37fe640 1 -- 172.21.15.19:0/1680983688 >> v1:172.21.15.19:6789/0 conn(0x7effd41350a0 legacy=0x7effd4137dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.334+0000 7effd37fe640 1 -- 172.21.15.19:0/1680983688 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd4070420 con 0x7effd413e100 2023-11-04T15:27:45.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.335+0000 7fc5b77fe640 1 -- 172.21.15.19:0/1238981032 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1770796898 0 0) 0x7fc5b8136e00 con 0x7fc5b8070090 2023-11-04T15:27:45.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.335+0000 7fc5b77fe640 1 -- 172.21.15.19:0/1238981032 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5a8003520 con 0x7fc5b8070090 2023-11-04T15:27:45.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.335+0000 7fa8177fe640 1 -- 172.21.15.19:0/4277709486 >> v2:172.21.15.96:3300/0 conn(0x7fa818140260 msgr2=0x7fa818142650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:45.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.335+0000 7fa8177fe640 1 --2- 172.21.15.19:0/4277709486 >> v2:172.21.15.96:3300/0 conn(0x7fa818140260 0x7fa818142650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.335+0000 7fa8177fe640 1 -- 172.21.15.19:0/4277709486 >> v1:172.21.15.19:6789/0 conn(0x7fa818134350 legacy=0x7fa8180a3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.335+0000 7fa8177fe640 1 -- 172.21.15.19:0/4277709486 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8180a0670 con 0x7fa818133f70 2023-11-04T15:27:45.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.335+0000 7fc5b7fff640 1 -- 172.21.15.19:0/1238981032 >> v1:172.21.15.96:6789/0 conn(0x7fc5b8070090 legacy=0x7fc5b81370c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.335+0000 7fc5b7fff640 1 -- 172.21.15.19:0/1238981032 >> v1:172.21.15.19:6789/0 conn(0x7fc5b813f4a0 legacy=0x7fc5b8141890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.335+0000 7fc5b7fff640 1 -- 172.21.15.19:0/1238981032 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b806be90 con 0x7fc5b806c4b0 2023-11-04T15:27:45.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.336+0000 7effd37fe640 1 --2- 172.21.15.19:0/1680983688 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effd413e100 0x7effd41404f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7effcc009e50 tx=0x7effcc02bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1436e0f4ecfabc35 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:45.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.336+0000 7fc5b7fff640 1 --2- 172.21.15.19:0/1238981032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5b806c4b0 0x7fc5b81377d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc5a40097a0 tx=0x7fc5a402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7397e53625cda8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:45.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.336+0000 7effd1ffb640 1 -- 172.21.15.19:0/1680983688 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effcc02ca60 con 0x7effd413e100 2023-11-04T15:27:45.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.336+0000 7fa8177fe640 1 --2- 172.21.15.19:0/4277709486 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa818133f70 0x7fa8180a3a60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa81813afd0 tx=0x7fa80802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cce4d792548534b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:45.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.336+0000 7effd1ffb640 1 -- 172.21.15.19:0/1680983688 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effcc02cbc0 con 0x7effd413e100 2023-11-04T15:27:45.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.336+0000 7effd1ffb640 1 -- 172.21.15.19:0/1680983688 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effcc0343f0 con 0x7effd413e100 2023-11-04T15:27:45.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.336+0000 7fc5b77fe640 1 -- 172.21.15.19:0/1238981032 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4031830 con 0x7fc5b806c4b0 2023-11-04T15:27:45.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.336+0000 7fc5b77fe640 1 -- 172.21.15.19:0/1238981032 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a4031990 con 0x7fc5b806c4b0 2023-11-04T15:27:45.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.336+0000 7fc5b77fe640 1 -- 172.21.15.19:0/1238981032 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4031d20 con 0x7fc5b806c4b0 2023-11-04T15:27:45.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.336+0000 7fa8167fc640 1 -- 172.21.15.19:0/4277709486 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80802e070 con 0x7fa818133f70 2023-11-04T15:27:45.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.336+0000 7fa8167fc640 1 -- 172.21.15.19:0/4277709486 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8080315a0 con 0x7fa818133f70 2023-11-04T15:27:45.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.336+0000 7fa8167fc640 1 -- 172.21.15.19:0/4277709486 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa808031930 con 0x7fa818133f70 2023-11-04T15:27:45.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.337+0000 7fa81db81640 1 -- 172.21.15.19:0/4277709486 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa818133f70 msgr2=0x7fa8180a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.337+0000 7fa81db81640 1 --2- 172.21.15.19:0/4277709486 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa818133f70 0x7fa8180a3a60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa81813afd0 tx=0x7fa80802b840 comp rx=0 tx=0).stop 2023-11-04T15:27:45.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.337+0000 7fa81db81640 1 -- 172.21.15.19:0/4277709486 shutdown_connections 2023-11-04T15:27:45.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.337+0000 7fa81db81640 1 --2- 172.21.15.19:0/4277709486 >> v2:172.21.15.96:3300/0 conn(0x7fa818140260 0x7fa818142650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.337+0000 7fa81db81640 1 --2- 172.21.15.19:0/4277709486 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa818133f70 0x7fa8180a3a60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.337+0000 7fa81db81640 1 -- 172.21.15.19:0/4277709486 >> 172.21.15.19:0/4277709486 conn(0x7fa8180a9060 msgr2=0x7fa8180a9470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:45.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.337+0000 7effd9441640 1 -- 172.21.15.19:0/1680983688 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effd413e100 msgr2=0x7effd41404f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.337+0000 7effd9441640 1 --2- 172.21.15.19:0/1680983688 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effd413e100 0x7effd41404f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7effcc009e50 tx=0x7effcc02bec0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.337+0000 7fa81db81640 1 -- 172.21.15.19:0/4277709486 shutdown_connections 2023-11-04T15:27:45.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.337+0000 7fa81db81640 1 -- 172.21.15.19:0/4277709486 wait complete. 2023-11-04T15:27:45.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.337+0000 7fc5beb6e640 1 -- 172.21.15.19:0/1238981032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5b806c4b0 msgr2=0x7fc5b81377d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.337+0000 7fc5beb6e640 1 --2- 172.21.15.19:0/1238981032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5b806c4b0 0x7fc5b81377d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc5a40097a0 tx=0x7fc5a402b8d0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.337+0000 7effd9441640 1 -- 172.21.15.19:0/1680983688 shutdown_connections 2023-11-04T15:27:45.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.337+0000 7fc5beb6e640 1 -- 172.21.15.19:0/1238981032 shutdown_connections 2023-11-04T15:27:45.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.337+0000 7fc5beb6e640 1 --2- 172.21.15.19:0/1238981032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5b806c4b0 0x7fc5b81377d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.337+0000 7effd9441640 1 --2- 172.21.15.19:0/1680983688 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effd413e100 0x7effd41404f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.337+0000 7effd9441640 1 --2- 172.21.15.19:0/1680983688 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7effd4135480 0x7effd41384e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.337+0000 7effd9441640 1 -- 172.21.15.19:0/1680983688 >> 172.21.15.19:0/1680983688 conn(0x7effd40a6b70 msgr2=0x7effd40a6f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:45.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.337+0000 7fc5beb6e640 1 -- 172.21.15.19:0/1238981032 >> 172.21.15.19:0/1238981032 conn(0x7fc5b80aa2c0 msgr2=0x7fc5b80aa6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:45.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.337+0000 7effd9441640 1 -- 172.21.15.19:0/1680983688 shutdown_connections 2023-11-04T15:27:45.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.337+0000 7fc5beb6e640 1 -- 172.21.15.19:0/1238981032 shutdown_connections 2023-11-04T15:27:45.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.337+0000 7effd9441640 1 -- 172.21.15.19:0/1680983688 wait complete. 2023-11-04T15:27:45.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.337+0000 7fc5beb6e640 1 -- 172.21.15.19:0/1238981032 wait complete. 2023-11-04T15:27:45.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.338+0000 7fa81db81640 1 Processor -- start 2023-11-04T15:27:45.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.338+0000 7fc5beb6e640 1 Processor -- start 2023-11-04T15:27:45.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.339+0000 7fc5beb6e640 1 -- start start 2023-11-04T15:27:45.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.339+0000 7effd9441640 1 Processor -- start 2023-11-04T15:27:45.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.339+0000 7fa81db81640 1 -- start start 2023-11-04T15:27:45.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.339+0000 7effd9441640 1 -- start start 2023-11-04T15:27:45.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.339+0000 7effd9441640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7effd41350a0 0x7effd412fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.339+0000 7fc5beb6e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5b806c4b0 0x7fc5b8133ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.339+0000 7effd9441640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effd4135480 0x7effd41302a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7fc5beb6e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc5b8070090 0x7fc5b8134420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7fc5beb6e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5b813f4a0 0x7fc5b809be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7fa81db81640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa818133f70 0x7fa81809de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7fc5beb6e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b809f6a0 con 0x7fc5b813f4a0 2023-11-04T15:27:45.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7effd9441640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effd413e100 0x7effd406ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7fc5beb6e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b809eb70 con 0x7fc5b806c4b0 2023-11-04T15:27:45.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7fc5beb6e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b80a0b20 con 0x7fc5b8070090 2023-11-04T15:27:45.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7fa81db81640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa818134350 0x7fa81809e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7effd9441640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd406c800 con 0x7effd413e100 2023-11-04T15:27:45.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7effd9441640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd4097fb0 con 0x7effd4135480 2023-11-04T15:27:45.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7effd9441640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd406c540 con 0x7effd41350a0 2023-11-04T15:27:45.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7effd37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effd413e100 0x7effd406ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7effd37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effd413e100 0x7effd406ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53664/0 (socket says 172.21.15.19:53664) 2023-11-04T15:27:45.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7effd37fe640 1 -- 172.21.15.19:0/3526604687 learned_addr learned my addr 172.21.15.19:0/3526604687 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:45.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7fc5b7fff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc5b8070090 0x7fc5b8134420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7effd2ffd640 1 --2- 172.21.15.19:0/3526604687 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7effd41350a0 0x7effd412fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7fc5b7fff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc5b8070090 0x7fc5b8134420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.19:49256/0 (socket says 172.21.15.19:49256) 2023-11-04T15:27:45.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7fc5b7fff640 1 -- 172.21.15.19:0/2790483768 learned_addr learned my addr 172.21.15.19:0/2790483768 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:45.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7fa816ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa818134350 0x7fa81809e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7fa816ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa818134350 0x7fa81809e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53678/0 (socket says 172.21.15.19:53678) 2023-11-04T15:27:45.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7fa8177fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa818133f70 0x7fa81809de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7effd27fc640 1 --2- 172.21.15.19:0/3526604687 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effd4135480 0x7effd41302a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7fc5bd10b640 1 --2- 172.21.15.19:0/2790483768 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5b813f4a0 0x7fc5b809be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7fa81db81640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa818140260 0x7fa81809e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7fa8177fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa818133f70 0x7fa81809de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.19:54848/0 (socket says 172.21.15.19:54848) 2023-11-04T15:27:45.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7fa816ffd640 1 -- 172.21.15.19:0/293223270 learned_addr learned my addr 172.21.15.19:0/293223270 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:45.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7fa81db81640 1 -- 172.21.15.19:0/293223270 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81809d090 con 0x7fa818134350 2023-11-04T15:27:45.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7fc5bc90a640 1 --2- 172.21.15.19:0/2790483768 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5b806c4b0 0x7fc5b8133ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7fa81db81640 1 -- 172.21.15.19:0/293223270 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81809caf0 con 0x7fa818133f70 2023-11-04T15:27:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7fa81db81640 1 -- 172.21.15.19:0/293223270 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa818137770 con 0x7fa818140260 2023-11-04T15:27:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7fa817fff640 1 --2- 172.21.15.19:0/293223270 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa818140260 0x7fa81809e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.341+0000 7effd2ffd640 1 -- 172.21.15.19:0/3526604687 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effd4135480 msgr2=0x7effd41302a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.341+0000 7effd2ffd640 1 --2- 172.21.15.19:0/3526604687 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effd4135480 0x7effd41302a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.341+0000 7effd2ffd640 1 -- 172.21.15.19:0/3526604687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effd413e100 msgr2=0x7effd406ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.341+0000 7effd2ffd640 1 --2- 172.21.15.19:0/3526604687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effd413e100 0x7effd406ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7fc5b7fff640 1 -- 172.21.15.19:0/2790483768 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5b806c4b0 msgr2=0x7fc5b8133ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7fc5b7fff640 1 --2- 172.21.15.19:0/2790483768 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5b806c4b0 0x7fc5b8133ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7fc5b7fff640 1 -- 172.21.15.19:0/2790483768 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5b813f4a0 msgr2=0x7fc5b809be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7fc5b7fff640 1 --2- 172.21.15.19:0/2790483768 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5b813f4a0 0x7fc5b809be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7fc5b7fff640 1 -- 172.21.15.19:0/2790483768 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a4009400 con 0x7fc5b8070090 2023-11-04T15:27:45.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.340+0000 7fc5bd10b640 1 --2- 172.21.15.19:0/2790483768 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5b813f4a0 0x7fc5b809be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T15:27:45.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.341+0000 7effd2ffd640 1 -- 172.21.15.19:0/3526604687 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effcc009b30 con 0x7effd41350a0 2023-11-04T15:27:45.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.341+0000 7effd37fe640 1 --2- 172.21.15.19:0/3526604687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effd413e100 0x7effd406ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T15:27:45.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.341+0000 7fa816ffd640 1 -- 172.21.15.19:0/293223270 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa818140260 msgr2=0x7fa81809e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.341+0000 7fc5b7fff640 1 --2- 172.21.15.19:0/2790483768 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc5b8070090 0x7fc5b8134420 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4034040 tx=0x7fc5a40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:45.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.341+0000 7fa816ffd640 1 --2- 172.21.15.19:0/293223270 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa818140260 0x7fa81809e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.341+0000 7fa816ffd640 1 -- 172.21.15.19:0/293223270 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa818133f70 msgr2=0x7fa81809de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.341+0000 7fa816ffd640 1 --2- 172.21.15.19:0/293223270 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa818133f70 0x7fa81809de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.341+0000 7fa816ffd640 1 -- 172.21.15.19:0/293223270 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa808009400 con 0x7fa818134350 2023-11-04T15:27:45.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.341+0000 7fc5b57fa640 1 -- 172.21.15.19:0/2790483768 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a403a9e0 con 0x7fc5b8070090 2023-11-04T15:27:45.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.341+0000 7effd2ffd640 1 --2- 172.21.15.19:0/3526604687 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7effd41350a0 0x7effd412fd60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7effc400c390 tx=0x7effc400c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:45.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.341+0000 7fa816ffd640 1 --2- 172.21.15.19:0/293223270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa818134350 0x7fa81809e3d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00c4a0 tx=0x7fa80c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:45.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.341+0000 7fc5b57fa640 1 -- 172.21.15.19:0/2790483768 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a403ab60 con 0x7fc5b8070090 2023-11-04T15:27:45.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.341+0000 7fc5b57fa640 1 -- 172.21.15.19:0/2790483768 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4044400 con 0x7fc5b8070090 2023-11-04T15:27:45.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.341+0000 7fc5beb6e640 1 -- 172.21.15.19:0/2790483768 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b809e1d0 con 0x7fc5b8070090 2023-11-04T15:27:45.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.341+0000 7fc5beb6e640 1 -- 172.21.15.19:0/2790483768 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b8134960 con 0x7fc5b8070090 2023-11-04T15:27:45.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.341+0000 7fa7fffff640 1 -- 172.21.15.19:0/293223270 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c005ce0 con 0x7fa818134350 2023-11-04T15:27:45.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.341+0000 7fa7fffff640 1 -- 172.21.15.19:0/293223270 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80c005e40 con 0x7fa818134350 2023-11-04T15:27:45.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.341+0000 7fa7fffff640 1 -- 172.21.15.19:0/293223270 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c007270 con 0x7fa818134350 2023-11-04T15:27:45.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.341+0000 7fa81db81640 1 -- 172.21.15.19:0/293223270 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8181367a0 con 0x7fa818134350 2023-11-04T15:27:45.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.341+0000 7fa81db81640 1 -- 172.21.15.19:0/293223270 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa81809c020 con 0x7fa818134350 2023-11-04T15:27:45.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.342+0000 7effbb7fe640 1 -- 172.21.15.19:0/3526604687 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc40052d0 con 0x7effd41350a0 2023-11-04T15:27:45.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.342+0000 7effbb7fe640 1 -- 172.21.15.19:0/3526604687 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc4005430 con 0x7effd41350a0 2023-11-04T15:27:45.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.342+0000 7effbb7fe640 1 -- 172.21.15.19:0/3526604687 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc4003830 con 0x7effd41350a0 2023-11-04T15:27:45.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.342+0000 7effd9441640 1 -- 172.21.15.19:0/3526604687 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd4098270 con 0x7effd41350a0 2023-11-04T15:27:45.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.342+0000 7effd9441640 1 -- 172.21.15.19:0/3526604687 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd406c230 con 0x7effd41350a0 2023-11-04T15:27:45.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.342+0000 7fc5beb6e640 1 -- 172.21.15.19:0/2790483768 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b8067d60 con 0x7fc5b8070090 2023-11-04T15:27:45.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.343+0000 7fa81db81640 1 -- 172.21.15.19:0/293223270 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa81809d1e0 con 0x7fa818134350 2023-11-04T15:27:45.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.343+0000 7fc5b57fa640 1 -- 172.21.15.19:0/2790483768 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc5a404d440 con 0x7fc5b8070090 2023-11-04T15:27:45.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.343+0000 7effd9441640 1 -- 172.21.15.19:0/3526604687 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effd4067d60 con 0x7effd41350a0 2023-11-04T15:27:45.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.343+0000 7fa7fffff640 1 -- 172.21.15.19:0/293223270 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa80c0073d0 con 0x7fa818134350 2023-11-04T15:27:45.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.344+0000 7fc5b57fa640 1 --2- 172.21.15.19:0/2790483768 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc59c06a430 0x7fc59c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.344+0000 7fc5b57fa640 1 -- 172.21.15.19:0/2790483768 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7fc5a40aa3f0 con 0x7fc5b8070090 2023-11-04T15:27:45.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.344+0000 7fc5bc90a640 1 --2- 172.21.15.19:0/2790483768 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc59c06a430 0x7fc59c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.344+0000 7fa7fffff640 1 --2- 172.21.15.19:0/293223270 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa80406a460 0x7fa80406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.344+0000 7effbb7fe640 1 -- 172.21.15.19:0/3526604687 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7effc4003990 con 0x7effd41350a0 2023-11-04T15:27:45.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.344+0000 7fa7fffff640 1 -- 172.21.15.19:0/293223270 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7fa80c0878d0 con 0x7fa818134350 2023-11-04T15:27:45.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.344+0000 7fa8177fe640 1 --2- 172.21.15.19:0/293223270 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa80406a460 0x7fa80406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.344+0000 7fc5bc90a640 1 --2- 172.21.15.19:0/2790483768 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc59c06a430 0x7fc59c06c8f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac0011e0 tx=0x7fc5ac007d30 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:45.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.344+0000 7effbb7fe640 1 --2- 172.21.15.19:0/3526604687 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7effc006a480 0x7effc006c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.345+0000 7effbb7fe640 1 -- 172.21.15.19:0/3526604687 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7effc4054e20 con 0x7effd41350a0 2023-11-04T15:27:45.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.345+0000 7effd27fc640 1 --2- 172.21.15.19:0/3526604687 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7effc006a480 0x7effc006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.345+0000 7fa8177fe640 1 --2- 172.21.15.19:0/293223270 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa80406a460 0x7fa80406c920 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa808036000 tx=0x7fa80803d040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:45.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.345+0000 7effd27fc640 1 --2- 172.21.15.19:0/3526604687 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7effc006a480 0x7effc006c940 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7effd40a0d90 tx=0x7effc8009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:45.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.348+0000 7fa7fffff640 1 -- 172.21.15.19:0/293223270 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa80c053440 con 0x7fa818134350 2023-11-04T15:27:45.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.348+0000 7fc5b57fa640 1 -- 172.21.15.19:0/2790483768 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc5a4076100 con 0x7fc5b8070090 2023-11-04T15:27:45.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.353+0000 7effbb7fe640 1 -- 172.21.15.19:0/3526604687 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7effc4053450 con 0x7effd41350a0 2023-11-04T15:27:45.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.381+0000 7f93b30f7640 1 Processor -- start 2023-11-04T15:27:45.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.381+0000 7f93b30f7640 1 -- start start 2023-11-04T15:27:45.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.381+0000 7f93b30f7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f93ac1350a0 0x7f93ac135480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.381+0000 7f93b30f7640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f93ac138930 0x7f93ac140110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.381+0000 7f93b30f7640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93ac0710a0 con 0x7f93ac137dd0 2023-11-04T15:27:45.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.381+0000 7f93b30f7640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93ac0a4610 con 0x7f93ac1350a0 2023-11-04T15:27:45.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.381+0000 7f93b30f7640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac0a6810 con 0x7f93ac138930 2023-11-04T15:27:45.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.381+0000 7f93abfff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f93ac137dd0 0x7f93ac138220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60888/0 (socket says 172.21.15.19:60888) 2023-11-04T15:27:45.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.381+0000 7f93abfff640 1 -- 172.21.15.19:0/1026147359 learned_addr learned my addr 172.21.15.19:0/1026147359 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:45.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.382+0000 7f93b0e93640 1 --2- 172.21.15.19:0/1026147359 >> v2:172.21.15.19:3300/0 conn(0x7f93ac1350a0 0x7f93ac135480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.382+0000 7f93b1694640 1 --2- 172.21.15.19:0/1026147359 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f93ac138930 0x7f93ac140110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.382+0000 7f93ab7fe640 1 -- 172.21.15.19:0/1026147359 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4046128427 0 0) 0x7f93ac0710a0 con 0x7f93ac137dd0 2023-11-04T15:27:45.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.382+0000 7f93ab7fe640 1 -- 172.21.15.19:0/1026147359 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f939c003520 con 0x7f93ac137dd0 2023-11-04T15:27:45.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.382+0000 7f93b0e93640 1 -- 172.21.15.19:0/1026147359 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f93ac138930 msgr2=0x7f93ac140110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:45.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.382+0000 7f93b0e93640 1 --2- 172.21.15.19:0/1026147359 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f93ac138930 0x7f93ac140110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.382+0000 7f93b0e93640 1 -- 172.21.15.19:0/1026147359 >> v1:172.21.15.19:6789/0 conn(0x7f93ac137dd0 legacy=0x7f93ac138220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.382+0000 7f93b0e93640 1 -- 172.21.15.19:0/1026147359 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac070420 con 0x7f93ac1350a0 2023-11-04T15:27:45.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.382+0000 7f93b1694640 1 --2- 172.21.15.19:0/1026147359 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f93ac138930 0x7f93ac140110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T15:27:45.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.383+0000 7f93b0e93640 1 --2- 172.21.15.19:0/1026147359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93ac1350a0 0x7f93ac135480 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f93a00097a0 tx=0x7f93a002b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f1c93611e0867 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:45.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.383+0000 7f93ab7fe640 1 -- 172.21.15.19:0/1026147359 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a0031780 con 0x7f93ac1350a0 2023-11-04T15:27:45.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.383+0000 7f93ab7fe640 1 -- 172.21.15.19:0/1026147359 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a00318e0 con 0x7f93ac1350a0 2023-11-04T15:27:45.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.383+0000 7f93ab7fe640 1 -- 172.21.15.19:0/1026147359 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a0031c70 con 0x7f93ac1350a0 2023-11-04T15:27:45.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.384+0000 7f93b30f7640 1 -- 172.21.15.19:0/1026147359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93ac1350a0 msgr2=0x7f93ac135480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.384+0000 7f93b30f7640 1 --2- 172.21.15.19:0/1026147359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93ac1350a0 0x7f93ac135480 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f93a00097a0 tx=0x7f93a002b820 comp rx=0 tx=0).stop 2023-11-04T15:27:45.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.384+0000 7f93b30f7640 1 -- 172.21.15.19:0/1026147359 shutdown_connections 2023-11-04T15:27:45.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.384+0000 7f93b30f7640 1 --2- 172.21.15.19:0/1026147359 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f93ac138930 0x7f93ac140110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.384+0000 7f93b30f7640 1 --2- 172.21.15.19:0/1026147359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93ac1350a0 0x7f93ac135480 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.384+0000 7f93b30f7640 1 -- 172.21.15.19:0/1026147359 >> 172.21.15.19:0/1026147359 conn(0x7f93ac0a6b70 msgr2=0x7f93ac0a6f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:45.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.384+0000 7f93b30f7640 1 -- 172.21.15.19:0/1026147359 shutdown_connections 2023-11-04T15:27:45.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.384+0000 7f93b30f7640 1 -- 172.21.15.19:0/1026147359 wait complete. 2023-11-04T15:27:45.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.386+0000 7f93b30f7640 1 Processor -- start 2023-11-04T15:27:45.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.386+0000 7f93b30f7640 1 -- start start 2023-11-04T15:27:45.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.387+0000 7f93b30f7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93ac1350a0 0x7f93ac1ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.387+0000 7f93b30f7640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f93ac137dd0 0x7f93ac1cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.387+0000 7f93b30f7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93ac138930 0x7f93ac1c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.387+0000 7f93b30f7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac099270 con 0x7f93ac138930 2023-11-04T15:27:45.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.387+0000 7f93b30f7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac1cc860 con 0x7f93ac1350a0 2023-11-04T15:27:45.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.388+0000 7f93b30f7640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac09a2f0 con 0x7f93ac137dd0 2023-11-04T15:27:45.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.388+0000 7f93b1694640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93ac138930 0x7f93ac1c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.388+0000 7f93b1694640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93ac138930 0x7f93ac1c92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53692/0 (socket says 172.21.15.19:53692) 2023-11-04T15:27:45.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.388+0000 7f93b1694640 1 -- 172.21.15.19:0/3364438944 learned_addr learned my addr 172.21.15.19:0/3364438944 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:45.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.388+0000 7f93abfff640 1 --2- 172.21.15.19:0/3364438944 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f93ac137dd0 0x7f93ac1cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.388+0000 7f93b0e93640 1 --2- 172.21.15.19:0/3364438944 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93ac1350a0 0x7f93ac1ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.388+0000 7f93b1694640 1 -- 172.21.15.19:0/3364438944 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f93ac137dd0 msgr2=0x7f93ac1cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.388+0000 7f93b1694640 1 --2- 172.21.15.19:0/3364438944 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f93ac137dd0 0x7f93ac1cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.388+0000 7f93b1694640 1 -- 172.21.15.19:0/3364438944 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93ac1350a0 msgr2=0x7f93ac1ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.388+0000 7f93b1694640 1 --2- 172.21.15.19:0/3364438944 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93ac1350a0 0x7f93ac1ccc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.388+0000 7f93b1694640 1 -- 172.21.15.19:0/3364438944 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a4009a70 con 0x7f93ac138930 2023-11-04T15:27:45.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.388+0000 7f93b1694640 1 --2- 172.21.15.19:0/3364438944 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93ac138930 0x7f93ac1c92c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f93a400efc0 tx=0x7f93a400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:45.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.388+0000 7f93a97fa640 1 -- 172.21.15.19:0/3364438944 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a4009cd0 con 0x7f93ac138930 2023-11-04T15:27:45.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.388+0000 7f93a97fa640 1 -- 172.21.15.19:0/3364438944 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a400f040 con 0x7f93ac138930 2023-11-04T15:27:45.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.388+0000 7f93a97fa640 1 -- 172.21.15.19:0/3364438944 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a4003990 con 0x7f93ac138930 2023-11-04T15:27:45.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.389+0000 7f93b30f7640 1 -- 172.21.15.19:0/3364438944 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93a0009400 con 0x7f93ac138930 2023-11-04T15:27:45.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.389+0000 7f93b30f7640 1 -- 172.21.15.19:0/3364438944 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93ac0996b0 con 0x7f93ac138930 2023-11-04T15:27:45.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.390+0000 7f93b30f7640 1 -- 172.21.15.19:0/3364438944 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93ac067d60 con 0x7f93ac138930 2023-11-04T15:27:45.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.391+0000 7f93a97fa640 1 -- 172.21.15.19:0/3364438944 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f93a4014480 con 0x7f93ac138930 2023-11-04T15:27:45.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.391+0000 7f93a97fa640 1 --2- 172.21.15.19:0/3364438944 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f939006e870 0x7f9390070d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:45.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.392+0000 7f93a97fa640 1 -- 172.21.15.19:0/3364438944 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f93a4088e40 con 0x7f93ac138930 2023-11-04T15:27:45.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.392+0000 7f93b0e93640 1 --2- 172.21.15.19:0/3364438944 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f939006e870 0x7f9390070d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:45.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.392+0000 7f93b0e93640 1 --2- 172.21.15.19:0/3364438944 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f939006e870 0x7f9390070d30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f93a0036000 tx=0x7f93a003d040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:45.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.400+0000 7f93a97fa640 1 -- 172.21.15.19:0/3364438944 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f93a4054a30 con 0x7f93ac138930 2023-11-04T15:27:45.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.534+0000 7fa81db81640 1 -- 172.21.15.19:0/293223270 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa81806ad00 con 0x7fa818134350 2023-11-04T15:27:45.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.534+0000 7effd9441640 1 -- 172.21.15.19:0/3526604687 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7effd413c9b0 con 0x7effd41350a0 2023-11-04T15:27:45.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.534+0000 7fc5beb6e640 1 -- 172.21.15.19:0/2790483768 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc5b80a96e0 con 0x7fc5b8070090 2023-11-04T15:27:45.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.534+0000 7fa7fffff640 1 -- 172.21.15.19:0/293223270 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa80c056a60 con 0x7fa818134350 2023-11-04T15:27:45.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.534+0000 7effbb7fe640 1 -- 172.21.15.19:0/3526604687 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7effc405dd40 con 0x7effd41350a0 2023-11-04T15:27:45.537 INFO:teuthology.orchestra.run.smithi019.stdout:38654705669 2023-11-04T15:27:45.537 INFO:teuthology.orchestra.run.smithi019.stdout:38654705668 2023-11-04T15:27:45.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.534+0000 7fc5b57fa640 1 -- 172.21.15.19:0/2790483768 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc5a4035020 con 0x7fc5b8070090 2023-11-04T15:27:45.538 INFO:teuthology.orchestra.run.smithi019.stdout:38654705670 2023-11-04T15:27:45.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.536+0000 7effd9441640 1 -- 172.21.15.19:0/3526604687 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7effc006a480 msgr2=0x7effc006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.536+0000 7effd9441640 1 --2- 172.21.15.19:0/3526604687 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7effc006a480 0x7effc006c940 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7effd40a0d90 tx=0x7effc8009190 comp rx=0 tx=0).stop 2023-11-04T15:27:45.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.536+0000 7effd9441640 1 -- 172.21.15.19:0/3526604687 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7effd41350a0 msgr2=0x7effd412fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.536+0000 7effd9441640 1 --2- 172.21.15.19:0/3526604687 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7effd41350a0 0x7effd412fd60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7effc400c390 tx=0x7effc400c850 comp rx=0 tx=0).stop 2023-11-04T15:27:45.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.536+0000 7effd9441640 1 -- 172.21.15.19:0/3526604687 shutdown_connections 2023-11-04T15:27:45.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.536+0000 7effd9441640 1 --2- 172.21.15.19:0/3526604687 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7effc006a480 0x7effc006c940 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.536+0000 7effd9441640 1 --2- 172.21.15.19:0/3526604687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effd413e100 0x7effd406ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.536+0000 7effd9441640 1 --2- 172.21.15.19:0/3526604687 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effd4135480 0x7effd41302a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.536+0000 7effd9441640 1 --2- 172.21.15.19:0/3526604687 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7effd41350a0 0x7effd412fd60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.536+0000 7effd9441640 1 -- 172.21.15.19:0/3526604687 >> 172.21.15.19:0/3526604687 conn(0x7effd40a6b70 msgr2=0x7effd4134140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:45.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.536+0000 7effd9441640 1 -- 172.21.15.19:0/3526604687 shutdown_connections 2023-11-04T15:27:45.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.536+0000 7effd9441640 1 -- 172.21.15.19:0/3526604687 wait complete. 2023-11-04T15:27:45.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.537+0000 7fa81db81640 1 -- 172.21.15.19:0/293223270 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa80406a460 msgr2=0x7fa80406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.537+0000 7fa81db81640 1 --2- 172.21.15.19:0/293223270 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa80406a460 0x7fa80406c920 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa808036000 tx=0x7fa80803d040 comp rx=0 tx=0).stop 2023-11-04T15:27:45.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.537+0000 7fa81db81640 1 -- 172.21.15.19:0/293223270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa818134350 msgr2=0x7fa81809e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.537+0000 7fa81db81640 1 --2- 172.21.15.19:0/293223270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa818134350 0x7fa81809e3d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00c4a0 tx=0x7fa80c00c960 comp rx=0 tx=0).stop 2023-11-04T15:27:45.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.537+0000 7fa81db81640 1 -- 172.21.15.19:0/293223270 shutdown_connections 2023-11-04T15:27:45.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.537+0000 7fa81db81640 1 --2- 172.21.15.19:0/293223270 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa80406a460 0x7fa80406c920 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.537+0000 7fa81db81640 1 --2- 172.21.15.19:0/293223270 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa818140260 0x7fa81809e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.537+0000 7fa81db81640 1 --2- 172.21.15.19:0/293223270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa818134350 0x7fa81809e3d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.537+0000 7fa81db81640 1 --2- 172.21.15.19:0/293223270 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa818133f70 0x7fa81809de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.537+0000 7fa81db81640 1 -- 172.21.15.19:0/293223270 >> 172.21.15.19:0/293223270 conn(0x7fa8180a9060 msgr2=0x7fa8180a59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:45.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.537+0000 7fc5beb6e640 1 -- 172.21.15.19:0/2790483768 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc59c06a430 msgr2=0x7fc59c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.537+0000 7fc5beb6e640 1 --2- 172.21.15.19:0/2790483768 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc59c06a430 0x7fc59c06c8f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac0011e0 tx=0x7fc5ac007d30 comp rx=0 tx=0).stop 2023-11-04T15:27:45.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.537+0000 7fc5beb6e640 1 -- 172.21.15.19:0/2790483768 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc5b8070090 msgr2=0x7fc5b8134420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.537+0000 7fc5beb6e640 1 --2- 172.21.15.19:0/2790483768 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc5b8070090 0x7fc5b8134420 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4034040 tx=0x7fc5a40046c0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.537+0000 7fa81db81640 1 -- 172.21.15.19:0/293223270 shutdown_connections 2023-11-04T15:27:45.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.538+0000 7fa81db81640 1 -- 172.21.15.19:0/293223270 wait complete. 2023-11-04T15:27:45.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.538+0000 7fc5beb6e640 1 -- 172.21.15.19:0/2790483768 shutdown_connections 2023-11-04T15:27:45.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.538+0000 7fc5beb6e640 1 --2- 172.21.15.19:0/2790483768 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc59c06a430 0x7fc59c06c8f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.538+0000 7fc5beb6e640 1 --2- 172.21.15.19:0/2790483768 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5b813f4a0 0x7fc5b809be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.538+0000 7fc5beb6e640 1 --2- 172.21.15.19:0/2790483768 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc5b8070090 0x7fc5b8134420 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.538+0000 7fc5beb6e640 1 --2- 172.21.15.19:0/2790483768 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5b806c4b0 0x7fc5b8133ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.538+0000 7fc5beb6e640 1 -- 172.21.15.19:0/2790483768 >> 172.21.15.19:0/2790483768 conn(0x7fc5b80aa2c0 msgr2=0x7fc5b80a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:45.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.538+0000 7fc5beb6e640 1 -- 172.21.15.19:0/2790483768 shutdown_connections 2023-11-04T15:27:45.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.538+0000 7fc5beb6e640 1 -- 172.21.15.19:0/2790483768 wait complete. 2023-11-04T15:27:45.551 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705668 for osd.1 2023-11-04T15:27:45.552 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705670 for osd.3 2023-11-04T15:27:45.552 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705669 for osd.2 2023-11-04T15:27:45.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.580+0000 7f93b30f7640 1 -- 172.21.15.19:0/3364438944 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f93ac09a640 con 0x7f93ac138930 2023-11-04T15:27:45.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.580+0000 7f93a97fa640 1 -- 172.21.15.19:0/3364438944 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f93a4018090 con 0x7f93ac138930 2023-11-04T15:27:45.582 INFO:teuthology.orchestra.run.smithi019.stdout:38654705669 2023-11-04T15:27:45.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.582+0000 7f93b30f7640 1 -- 172.21.15.19:0/3364438944 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f939006e870 msgr2=0x7f9390070d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.582+0000 7f93b30f7640 1 --2- 172.21.15.19:0/3364438944 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f939006e870 0x7f9390070d30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f93a0036000 tx=0x7f93a003d040 comp rx=0 tx=0).stop 2023-11-04T15:27:45.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.582+0000 7f93b30f7640 1 -- 172.21.15.19:0/3364438944 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93ac138930 msgr2=0x7f93ac1c92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:45.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.582+0000 7f93b30f7640 1 --2- 172.21.15.19:0/3364438944 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93ac138930 0x7f93ac1c92c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f93a400efc0 tx=0x7f93a400c490 comp rx=0 tx=0).stop 2023-11-04T15:27:45.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.582+0000 7f93b30f7640 1 -- 172.21.15.19:0/3364438944 shutdown_connections 2023-11-04T15:27:45.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.582+0000 7f93b30f7640 1 --2- 172.21.15.19:0/3364438944 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f939006e870 0x7f9390070d30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.582+0000 7f93b30f7640 1 --2- 172.21.15.19:0/3364438944 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93ac138930 0x7f93ac1c92c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.582+0000 7f93b30f7640 1 --2- 172.21.15.19:0/3364438944 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f93ac137dd0 0x7f93ac1cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.582+0000 7f93b30f7640 1 --2- 172.21.15.19:0/3364438944 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93ac1350a0 0x7f93ac1ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:45.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.582+0000 7f93b30f7640 1 -- 172.21.15.19:0/3364438944 >> 172.21.15.19:0/3364438944 conn(0x7f93ac0a6b70 msgr2=0x7f93ac0a2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:45.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.582+0000 7f93b30f7640 1 -- 172.21.15.19:0/3364438944 shutdown_connections 2023-11-04T15:27:45.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:45.582+0000 7f93b30f7640 1 -- 172.21.15.19:0/3364438944 wait complete. 2023-11-04T15:27:45.593 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705669 for osd.0 2023-11-04T15:27:46.552 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-04T15:27:46.553 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-04T15:27:46.554 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-04T15:27:46.595 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-04T15:27:46.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.677+0000 7feabc750640 1 Processor -- start 2023-11-04T15:27:46.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.677+0000 7feabc750640 1 -- start start 2023-11-04T15:27:46.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.677+0000 7f4f2a684640 1 Processor -- start 2023-11-04T15:27:46.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.677+0000 7f4f2a684640 1 -- start start 2023-11-04T15:27:46.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.677+0000 7efc35a81640 1 Processor -- start 2023-11-04T15:27:46.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.677+0000 7efc35a81640 1 -- start start 2023-11-04T15:27:46.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.678+0000 7f4f2a684640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4f241340b0 0x7f4f240a4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:46.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.678+0000 7f4f2a684640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4f24140280 0x7f4f24142670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:46.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.678+0000 7feabc750640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feab4137270 0x7feab40a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:46.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.678+0000 7f4f2a684640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f240a0f50 con 0x7f4f24133cd0 2023-11-04T15:27:46.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.678+0000 7f4f2a684640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f240a5370 con 0x7f4f24140280 2023-11-04T15:27:46.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.678+0000 7f4f2a684640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f240a04f0 con 0x7f4f241340b0 2023-11-04T15:27:46.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.678+0000 7feabc750640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7feab4137650 0x7feab413a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:46.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.678+0000 7feabc750640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab40a4c20 con 0x7feab40a3e90 2023-11-04T15:27:46.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.678+0000 7f4f23fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4f24133cd0 0x7f4f240a39f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60902/0 (socket says 172.21.15.19:60902) 2023-11-04T15:27:46.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.678+0000 7f4f28c21640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4f24140280 0x7f4f24142670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:46.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.678+0000 7efc35a81640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efc300a0730 0x7efc3013bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:46.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.678+0000 7f4f23fff640 1 -- 172.21.15.19:0/1016555250 learned_addr learned my addr 172.21.15.19:0/1016555250 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:46.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.678+0000 7feab9ceb640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7feab40a3e90 0x7feab4139f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60910/0 (socket says 172.21.15.19:60910) 2023-11-04T15:27:46.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.678+0000 7feab9ceb640 1 -- 172.21.15.19:0/4186370659 learned_addr learned my addr 172.21.15.19:0/4186370659 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:46.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.678+0000 7feabc750640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feab40a3060 con 0x7feab4137650 2023-11-04T15:27:46.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.678+0000 7feabc750640 1 -- 172.21.15.19:0/4186370659 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab40a5080 con 0x7feab4137270 2023-11-04T15:27:46.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.678+0000 7f4f237fe640 1 --2- 172.21.15.19:0/1016555250 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4f241340b0 0x7f4f240a4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:46.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.678+0000 7efc2f7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7efc30133cb0 0x7efc30134090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60912/0 (socket says 172.21.15.19:60912) 2023-11-04T15:27:46.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.678+0000 7feabaced640 1 --2- 172.21.15.19:0/4186370659 >> v2:172.21.15.96:3300/0 conn(0x7feab4137650 0x7feab413a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:46.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.678+0000 7efc35a81640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7efc3013c470 0x7efc3013e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:46.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.678+0000 7efc2f7fe640 1 -- 172.21.15.19:0/3655875226 learned_addr learned my addr 172.21.15.19:0/3655875226 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:46.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.678+0000 7feaba4ec640 1 --2- 172.21.15.19:0/4186370659 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feab4137270 0x7feab40a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:46.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.678+0000 7efc35a81640 1 -- 172.21.15.19:0/3655875226 --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc300a0df0 con 0x7efc30133cb0 2023-11-04T15:27:46.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.678+0000 7efc35a81640 1 -- 172.21.15.19:0/3655875226 --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc3009fd20 con 0x7efc300a0730 2023-11-04T15:27:46.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.678+0000 7efc35a81640 1 -- 172.21.15.19:0/3655875226 --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc300a13b0 con 0x7efc3013c470 2023-11-04T15:27:46.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.678+0000 7efc2effd640 1 --2- 172.21.15.19:0/3655875226 >> v2:172.21.15.19:3300/0 conn(0x7efc300a0730 0x7efc3013bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:46.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.679+0000 7efc2ffff640 1 --2- 172.21.15.19:0/3655875226 >> v2:172.21.15.96:3300/0 conn(0x7efc3013c470 0x7efc3013e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:46.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.679+0000 7f4f237fe640 1 -- 172.21.15.19:0/1016555250 >> v2:172.21.15.19:3300/0 conn(0x7f4f24140280 msgr2=0x7f4f24142670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:46.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.679+0000 7f4f237fe640 1 --2- 172.21.15.19:0/1016555250 >> v2:172.21.15.19:3300/0 conn(0x7f4f24140280 0x7f4f24142670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.679+0000 7f4f237fe640 1 -- 172.21.15.19:0/1016555250 >> v1:172.21.15.19:6789/0 conn(0x7f4f24133cd0 legacy=0x7f4f240a39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:46.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.679+0000 7feab94ea640 1 -- 172.21.15.19:0/4186370659 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1211496522 0 0) 0x7feab40a4c20 con 0x7feab40a3e90 2023-11-04T15:27:46.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.679+0000 7f4f237fe640 1 -- 172.21.15.19:0/1016555250 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f240a0c10 con 0x7f4f241340b0 2023-11-04T15:27:46.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.679+0000 7feab94ea640 1 -- 172.21.15.19:0/4186370659 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feaa0003520 con 0x7feab40a3e90 2023-11-04T15:27:46.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.679+0000 7feabaced640 1 -- 172.21.15.19:0/4186370659 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feab4137270 msgr2=0x7feab40a6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:46.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.679+0000 7feabaced640 1 --2- 172.21.15.19:0/4186370659 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feab4137270 0x7feab40a6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.679+0000 7feabaced640 1 -- 172.21.15.19:0/4186370659 >> v1:172.21.15.19:6789/0 conn(0x7feab40a3e90 legacy=0x7feab4139f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:46.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.679+0000 7feabaced640 1 -- 172.21.15.19:0/4186370659 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab40a3440 con 0x7feab4137650 2023-11-04T15:27:46.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.679+0000 7efc2effd640 1 -- 172.21.15.19:0/3655875226 >> v2:172.21.15.96:3300/0 conn(0x7efc3013c470 msgr2=0x7efc3013e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:46.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.679+0000 7efc2effd640 1 --2- 172.21.15.19:0/3655875226 >> v2:172.21.15.96:3300/0 conn(0x7efc3013c470 0x7efc3013e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.679+0000 7efc2effd640 1 -- 172.21.15.19:0/3655875226 >> v1:172.21.15.19:6789/0 conn(0x7efc30133cb0 legacy=0x7efc30134090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:46.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.679+0000 7efc2effd640 1 -- 172.21.15.19:0/3655875226 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc300a0180 con 0x7efc300a0730 2023-11-04T15:27:46.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.680+0000 7feabaced640 1 --2- 172.21.15.19:0/4186370659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feab4137650 0x7feab413a670 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feaac009d90 tx=0x7feaac02bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=980ea5a77303006f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:46.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.680+0000 7efc2effd640 1 --2- 172.21.15.19:0/3655875226 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc300a0730 0x7efc3013bf30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efc300a6ef0 tx=0x7efc2402b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd94f940889fe464 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:46.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.680+0000 7f4f237fe640 1 --2- 172.21.15.19:0/1016555250 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4f241340b0 0x7f4f240a4100 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4f240a0e00 tx=0x7f4f1802b780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db4b9a0e93b3a6c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:46.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.680+0000 7feab94ea640 1 -- 172.21.15.19:0/4186370659 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac02cb30 con 0x7feab4137650 2023-11-04T15:27:46.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.680+0000 7feab94ea640 1 -- 172.21.15.19:0/4186370659 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaac02cc90 con 0x7feab4137650 2023-11-04T15:27:46.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.680+0000 7efc2e7fc640 1 -- 172.21.15.19:0/3655875226 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc24031710 con 0x7efc300a0730 2023-11-04T15:27:46.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.680+0000 7feab94ea640 1 -- 172.21.15.19:0/4186370659 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac034440 con 0x7feab4137650 2023-11-04T15:27:46.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.680+0000 7efc2e7fc640 1 -- 172.21.15.19:0/3655875226 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2402f050 con 0x7efc300a0730 2023-11-04T15:27:46.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.680+0000 7efc2e7fc640 1 -- 172.21.15.19:0/3655875226 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc24031a90 con 0x7efc300a0730 2023-11-04T15:27:46.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.680+0000 7f4f22ffd640 1 -- 172.21.15.19:0/1016555250 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f18030710 con 0x7f4f241340b0 2023-11-04T15:27:46.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.680+0000 7f4f22ffd640 1 -- 172.21.15.19:0/1016555250 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1802e050 con 0x7f4f241340b0 2023-11-04T15:27:46.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.680+0000 7f4f22ffd640 1 -- 172.21.15.19:0/1016555250 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f18030a90 con 0x7f4f241340b0 2023-11-04T15:27:46.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.681+0000 7efc35a81640 1 -- 172.21.15.19:0/3655875226 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc300a0730 msgr2=0x7efc3013bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:46.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.681+0000 7efc35a81640 1 --2- 172.21.15.19:0/3655875226 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc300a0730 0x7efc3013bf30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efc300a6ef0 tx=0x7efc2402b7b0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.681+0000 7f4f2a684640 1 -- 172.21.15.19:0/1016555250 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4f241340b0 msgr2=0x7f4f240a4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:46.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.681+0000 7f4f2a684640 1 --2- 172.21.15.19:0/1016555250 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4f241340b0 0x7f4f240a4100 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4f240a0e00 tx=0x7f4f1802b780 comp rx=0 tx=0).stop 2023-11-04T15:27:46.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.681+0000 7efc35a81640 1 -- 172.21.15.19:0/3655875226 shutdown_connections 2023-11-04T15:27:46.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.681+0000 7efc35a81640 1 --2- 172.21.15.19:0/3655875226 >> v2:172.21.15.96:3300/0 conn(0x7efc3013c470 0x7efc3013e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.681+0000 7efc35a81640 1 --2- 172.21.15.19:0/3655875226 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc300a0730 0x7efc3013bf30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.681+0000 7efc35a81640 1 -- 172.21.15.19:0/3655875226 >> 172.21.15.19:0/3655875226 conn(0x7efc300a9060 msgr2=0x7efc300a9470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:46.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.681+0000 7f4f2a684640 1 -- 172.21.15.19:0/1016555250 shutdown_connections 2023-11-04T15:27:46.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.681+0000 7f4f2a684640 1 --2- 172.21.15.19:0/1016555250 >> v2:172.21.15.19:3300/0 conn(0x7f4f24140280 0x7f4f24142670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.681+0000 7f4f2a684640 1 --2- 172.21.15.19:0/1016555250 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4f241340b0 0x7f4f240a4100 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.681+0000 7f4f2a684640 1 -- 172.21.15.19:0/1016555250 >> 172.21.15.19:0/1016555250 conn(0x7f4f240a8ff0 msgr2=0x7f4f240a9400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:46.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.681+0000 7efc35a81640 1 -- 172.21.15.19:0/3655875226 shutdown_connections 2023-11-04T15:27:46.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.681+0000 7f4f2a684640 1 -- 172.21.15.19:0/1016555250 shutdown_connections 2023-11-04T15:27:46.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.681+0000 7efc35a81640 1 -- 172.21.15.19:0/3655875226 wait complete. 2023-11-04T15:27:46.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.681+0000 7f4f2a684640 1 -- 172.21.15.19:0/1016555250 wait complete. 2023-11-04T15:27:46.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.681+0000 7feabc750640 1 -- 172.21.15.19:0/4186370659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feab4137650 msgr2=0x7feab413a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:46.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.681+0000 7feabc750640 1 --2- 172.21.15.19:0/4186370659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feab4137650 0x7feab413a670 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feaac009d90 tx=0x7feaac02bd80 comp rx=0 tx=0).stop 2023-11-04T15:27:46.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.681+0000 7feabc750640 1 -- 172.21.15.19:0/4186370659 shutdown_connections 2023-11-04T15:27:46.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.681+0000 7feabc750640 1 --2- 172.21.15.19:0/4186370659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feab4137650 0x7feab413a670 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.681+0000 7feabc750640 1 --2- 172.21.15.19:0/4186370659 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feab4137270 0x7feab40a6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.681+0000 7feabc750640 1 -- 172.21.15.19:0/4186370659 >> 172.21.15.19:0/4186370659 conn(0x7feab40a8d70 msgr2=0x7feab40a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:46.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.681+0000 7feabc750640 1 -- 172.21.15.19:0/4186370659 shutdown_connections 2023-11-04T15:27:46.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.682+0000 7feabc750640 1 -- 172.21.15.19:0/4186370659 wait complete. 2023-11-04T15:27:46.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.682+0000 7f4f2a684640 1 Processor -- start 2023-11-04T15:27:46.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.682+0000 7efc35a81640 1 Processor -- start 2023-11-04T15:27:46.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.682+0000 7f4f2a684640 1 -- start start 2023-11-04T15:27:46.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.682+0000 7efc35a81640 1 -- start start 2023-11-04T15:27:46.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.683+0000 7f4f2a684640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4f24133cd0 0x7f4f241cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:46.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.683+0000 7f4f2a684640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f241340b0 0x7f4f241cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:46.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.683+0000 7f4f2a684640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f24140280 0x7f4f241ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:46.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.683+0000 7f4f2a684640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f241cc4f0 con 0x7f4f241340b0 2023-11-04T15:27:46.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.683+0000 7f4f2a684640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f24070420 con 0x7f4f24140280 2023-11-04T15:27:46.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.683+0000 7f4f2a684640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2409c460 con 0x7f4f24133cd0 2023-11-04T15:27:46.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.683+0000 7f4f237fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f241340b0 0x7f4f241cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:46.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.683+0000 7f4f237fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f241340b0 0x7f4f241cbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53728/0 (socket says 172.21.15.19:53728) 2023-11-04T15:27:46.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.683+0000 7f4f237fe640 1 -- 172.21.15.19:0/2520435965 learned_addr learned my addr 172.21.15.19:0/2520435965 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:46.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.683+0000 7f4f23fff640 1 --2- 172.21.15.19:0/2520435965 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4f24133cd0 0x7f4f241cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:46.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.683+0000 7f4f28c21640 1 --2- 172.21.15.19:0/2520435965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f24140280 0x7f4f241ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:46.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.683+0000 7efc35a81640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc300a0730 0x7efc3012dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:46.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.683+0000 7efc35a81640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc30133cb0 0x7efc3012e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:46.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.683+0000 7f4f237fe640 1 -- 172.21.15.19:0/2520435965 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4f24133cd0 msgr2=0x7f4f241cba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:46.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.683+0000 7f4f237fe640 1 --2- 172.21.15.19:0/2520435965 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4f24133cd0 0x7f4f241cba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.683+0000 7f4f237fe640 1 -- 172.21.15.19:0/2520435965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f24140280 msgr2=0x7f4f241ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:46.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.683+0000 7feabc750640 1 Processor -- start 2023-11-04T15:27:46.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.683+0000 7f4f237fe640 1 --2- 172.21.15.19:0/2520435965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f24140280 0x7f4f241ceab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.683+0000 7f4f237fe640 1 -- 172.21.15.19:0/2520435965 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f18009400 con 0x7f4f241340b0 2023-11-04T15:27:46.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.683+0000 7efc35a81640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efc3013c470 0x7efc301ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:46.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.683+0000 7efc35a81640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc30139060 con 0x7efc30133cb0 2023-11-04T15:27:46.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.683+0000 7efc35a81640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3012e760 con 0x7efc300a0730 2023-11-04T15:27:46.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.683+0000 7efc35a81640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc30134890 con 0x7efc3013c470 2023-11-04T15:27:46.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.683+0000 7efc2effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc30133cb0 0x7efc3012e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:46.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.684+0000 7efc2effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc30133cb0 0x7efc3012e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53744/0 (socket says 172.21.15.19:53744) 2023-11-04T15:27:46.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.684+0000 7efc2effd640 1 -- 172.21.15.19:0/2054894386 learned_addr learned my addr 172.21.15.19:0/2054894386 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:46.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.684+0000 7feabc750640 1 -- start start 2023-11-04T15:27:46.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.684+0000 7efc2f7fe640 1 --2- 172.21.15.19:0/2054894386 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc300a0730 0x7efc3012dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:46.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.684+0000 7efc2ffff640 1 --2- 172.21.15.19:0/2054894386 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efc3013c470 0x7efc301ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:46.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.684+0000 7f4f237fe640 1 --2- 172.21.15.19:0/2520435965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f241340b0 0x7f4f241cbfb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4f18035040 tx=0x7f4f180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:46.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.684+0000 7efc2effd640 1 -- 172.21.15.19:0/2054894386 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efc3013c470 msgr2=0x7efc301ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:46.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.684+0000 7efc2effd640 1 --2- 172.21.15.19:0/2054894386 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efc3013c470 0x7efc301ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.684+0000 7efc2effd640 1 -- 172.21.15.19:0/2054894386 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc300a0730 msgr2=0x7efc3012dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:46.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.684+0000 7efc2effd640 1 --2- 172.21.15.19:0/2054894386 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc300a0730 0x7efc3012dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.684+0000 7efc2effd640 1 -- 172.21.15.19:0/2054894386 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc24009400 con 0x7efc30133cb0 2023-11-04T15:27:46.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.684+0000 7efc2ffff640 1 --2- 172.21.15.19:0/2054894386 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efc3013c470 0x7efc301ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:27:46.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.684+0000 7f4f20ff9640 1 -- 172.21.15.19:0/2520435965 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f18032bc0 con 0x7f4f241340b0 2023-11-04T15:27:46.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.684+0000 7efc2effd640 1 --2- 172.21.15.19:0/2054894386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc30133cb0 0x7efc3012e220 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efc2402bdc0 tx=0x7efc240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:46.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.684+0000 7f4f20ff9640 1 -- 172.21.15.19:0/2520435965 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f18032d40 con 0x7f4f241340b0 2023-11-04T15:27:46.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.684+0000 7f4f20ff9640 1 -- 172.21.15.19:0/2520435965 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1803b640 con 0x7f4f241340b0 2023-11-04T15:27:46.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.684+0000 7f4f2a684640 1 -- 172.21.15.19:0/2520435965 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f24070f10 con 0x7f4f241340b0 2023-11-04T15:27:46.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.684+0000 7efc17fff640 1 -- 172.21.15.19:0/2054894386 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc24033910 con 0x7efc30133cb0 2023-11-04T15:27:46.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.684+0000 7efc17fff640 1 -- 172.21.15.19:0/2054894386 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc24033a70 con 0x7efc30133cb0 2023-11-04T15:27:46.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.684+0000 7f4f2a684640 1 -- 172.21.15.19:0/2520435965 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f24137ae0 con 0x7f4f241340b0 2023-11-04T15:27:46.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.684+0000 7efc17fff640 1 -- 172.21.15.19:0/2054894386 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc24033e20 con 0x7efc30133cb0 2023-11-04T15:27:46.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.685+0000 7feabc750640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feab40a3e90 0x7feab4132de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:46.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.685+0000 7feabc750640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feab4137270 0x7feab4133320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:46.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.685+0000 7efc35a81640 1 -- 172.21.15.19:0/2054894386 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc30139460 con 0x7efc30133cb0 2023-11-04T15:27:46.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.685+0000 7efc35a81640 1 -- 172.21.15.19:0/2054894386 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc3013bc10 con 0x7efc30133cb0 2023-11-04T15:27:46.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.685+0000 7feaba4ec640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feab40a3e90 0x7feab4132de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:46.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.685+0000 7feaba4ec640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feab40a3e90 0x7feab4132de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53754/0 (socket says 172.21.15.19:53754) 2023-11-04T15:27:46.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.685+0000 7feab9ceb640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feab4137270 0x7feab4133320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:46.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.685+0000 7feab9ceb640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feab4137270 0x7feab4133320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.19:54872/0 (socket says 172.21.15.19:54872) 2023-11-04T15:27:46.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.685+0000 7feaba4ec640 1 -- 172.21.15.19:0/3337758062 learned_addr learned my addr 172.21.15.19:0/3337758062 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:46.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.685+0000 7feabc750640 1 --2- 172.21.15.19:0/3337758062 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feab4137650 0x7feab4097a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:46.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.685+0000 7feabc750640 1 -- 172.21.15.19:0/3337758062 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab409a5d0 con 0x7feab40a3e90 2023-11-04T15:27:46.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.685+0000 7feabc750640 1 -- 172.21.15.19:0/3337758062 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab40a1f40 con 0x7feab4137270 2023-11-04T15:27:46.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.686+0000 7feabc750640 1 -- 172.21.15.19:0/3337758062 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab4133860 con 0x7feab4137650 2023-11-04T15:27:46.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.686+0000 7feabaced640 1 --2- 172.21.15.19:0/3337758062 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feab4137650 0x7feab4097a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:46.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.686+0000 7efc35a81640 1 -- 172.21.15.19:0/2054894386 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc30138e30 con 0x7efc30133cb0 2023-11-04T15:27:46.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.686+0000 7f4f2a684640 1 -- 172.21.15.19:0/2520435965 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f241344d0 con 0x7f4f241340b0 2023-11-04T15:27:46.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.686+0000 7feaba4ec640 1 -- 172.21.15.19:0/3337758062 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feab4137650 msgr2=0x7feab4097a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:46.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.686+0000 7feaba4ec640 1 --2- 172.21.15.19:0/3337758062 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feab4137650 0x7feab4097a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.686+0000 7feaba4ec640 1 -- 172.21.15.19:0/3337758062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feab4137270 msgr2=0x7feab4133320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:46.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.686+0000 7feaba4ec640 1 --2- 172.21.15.19:0/3337758062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feab4137270 0x7feab4133320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.686+0000 7feaba4ec640 1 -- 172.21.15.19:0/3337758062 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaac009a70 con 0x7feab40a3e90 2023-11-04T15:27:46.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.686+0000 7feab9ceb640 1 --2- 172.21.15.19:0/3337758062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feab4137270 0x7feab4133320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T15:27:46.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.686+0000 7f4f20ff9640 1 -- 172.21.15.19:0/2520435965 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4f18039040 con 0x7f4f241340b0 2023-11-04T15:27:46.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.687+0000 7feaba4ec640 1 --2- 172.21.15.19:0/3337758062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feab40a3e90 0x7feab4132de0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7feab000d830 tx=0x7feab000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:46.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.687+0000 7feaaaffd640 1 -- 172.21.15.19:0/3337758062 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab000b6c0 con 0x7feab40a3e90 2023-11-04T15:27:46.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.687+0000 7feaaaffd640 1 -- 172.21.15.19:0/3337758062 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab000b820 con 0x7feab40a3e90 2023-11-04T15:27:46.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.687+0000 7feaaaffd640 1 -- 172.21.15.19:0/3337758062 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab000bbb0 con 0x7feab40a3e90 2023-11-04T15:27:46.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.687+0000 7efc17fff640 1 -- 172.21.15.19:0/2054894386 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efc2403a040 con 0x7efc30133cb0 2023-11-04T15:27:46.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.687+0000 7feabc750640 1 -- 172.21.15.19:0/3337758062 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab409a350 con 0x7feab40a3e90 2023-11-04T15:27:46.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.687+0000 7feabc750640 1 -- 172.21.15.19:0/3337758062 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab409a810 con 0x7feab40a3e90 2023-11-04T15:27:46.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.687+0000 7f4f20ff9640 1 --2- 172.21.15.19:0/2520435965 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f4f1006a460 0x7f4f1006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:46.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.687+0000 7f4f23fff640 1 --2- 172.21.15.19:0/2520435965 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f4f1006a460 0x7f4f1006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:46.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.687+0000 7f4f20ff9640 1 -- 172.21.15.19:0/2520435965 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f4f180a9e80 con 0x7f4f241340b0 2023-11-04T15:27:46.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.688+0000 7f4f23fff640 1 --2- 172.21.15.19:0/2520435965 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f4f1006a460 0x7f4f1006c920 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4f14005880 tx=0x7f4f14009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:46.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.688+0000 7efc17fff640 1 --2- 172.21.15.19:0/2054894386 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7efc1c06a430 0x7efc1c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:46.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.688+0000 7efc17fff640 1 -- 172.21.15.19:0/2054894386 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7efc240a93f0 con 0x7efc30133cb0 2023-11-04T15:27:46.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.688+0000 7efc2f7fe640 1 --2- 172.21.15.19:0/2054894386 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7efc1c06a430 0x7efc1c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:46.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.688+0000 7feabc750640 1 -- 172.21.15.19:0/3337758062 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab4067d60 con 0x7feab40a3e90 2023-11-04T15:27:46.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.688+0000 7efc2f7fe640 1 --2- 172.21.15.19:0/2054894386 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7efc1c06a430 0x7efc1c06c8f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efc20005880 tx=0x7efc20009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:46.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.692+0000 7f4f20ff9640 1 -- 172.21.15.19:0/2520435965 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4f180759e0 con 0x7f4f241340b0 2023-11-04T15:27:46.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.697+0000 7efc17fff640 1 -- 172.21.15.19:0/2054894386 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efc24074f30 con 0x7efc30133cb0 2023-11-04T15:27:46.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.698+0000 7feaaaffd640 1 -- 172.21.15.19:0/3337758062 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7feab001e460 con 0x7feab40a3e90 2023-11-04T15:27:46.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.698+0000 7feaaaffd640 1 --2- 172.21.15.19:0/3337758062 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fea9806a430 0x7fea9806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:46.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.698+0000 7feaaaffd640 1 -- 172.21.15.19:0/3337758062 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7feab00894a0 con 0x7feab40a3e90 2023-11-04T15:27:46.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.699+0000 7feab9ceb640 1 --2- 172.21.15.19:0/3337758062 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fea9806a430 0x7fea9806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:46.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.699+0000 7feab9ceb640 1 --2- 172.21.15.19:0/3337758062 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fea9806a430 0x7fea9806c8f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feab4136280 tx=0x7feaa4007d30 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:46.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.701+0000 7feaaaffd640 1 -- 172.21.15.19:0/3337758062 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7feab0055110 con 0x7feab40a3e90 2023-11-04T15:27:46.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.718+0000 7f06604db640 1 Processor -- start 2023-11-04T15:27:46.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.718+0000 7f06604db640 1 -- start start 2023-11-04T15:27:46.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.719+0000 7f06604db640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f06580a3e90 0x7f06580a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:46.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.719+0000 7f06604db640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0658137650 0x7f065813a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:46.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.719+0000 7f06604db640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06580a4c20 con 0x7f0658137270 2023-11-04T15:27:46.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.719+0000 7f065da76640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f06580a3e90 0x7f06580a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:46.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.719+0000 7f06604db640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06580a3060 con 0x7f06580a3e90 2023-11-04T15:27:46.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.719+0000 7f06604db640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06580a5080 con 0x7f0658137650 2023-11-04T15:27:46.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.719+0000 7f065da76640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f06580a3e90 0x7f06580a6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53764/0 (socket says 172.21.15.19:53764) 2023-11-04T15:27:46.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.719+0000 7f065da76640 1 -- 172.21.15.19:0/44462868 learned_addr learned my addr 172.21.15.19:0/44462868 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:46.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.719+0000 7f065ea78640 1 --2- 172.21.15.19:0/44462868 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0658137650 0x7f065813a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:46.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.719+0000 7f065da76640 1 -- 172.21.15.19:0/44462868 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0658137650 msgr2=0x7f065813a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:46.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.719+0000 7f065da76640 1 --2- 172.21.15.19:0/44462868 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0658137650 0x7f065813a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.719+0000 7f065da76640 1 -- 172.21.15.19:0/44462868 >> v1:172.21.15.96:6789/0 conn(0x7f0658137270 legacy=0x7f0658139f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:46.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.719+0000 7f065da76640 1 -- 172.21.15.19:0/44462868 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06580a3440 con 0x7f06580a3e90 2023-11-04T15:27:46.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.720+0000 7f065da76640 1 --2- 172.21.15.19:0/44462868 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06580a3e90 0x7f06580a6200 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0648009870 tx=0x7f064802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab69619ff96dd544 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:46.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.720+0000 7f065d275640 1 -- 172.21.15.19:0/44462868 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06480317c0 con 0x7f06580a3e90 2023-11-04T15:27:46.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.720+0000 7f065d275640 1 -- 172.21.15.19:0/44462868 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0648031920 con 0x7f06580a3e90 2023-11-04T15:27:46.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.720+0000 7f065d275640 1 -- 172.21.15.19:0/44462868 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0648031cb0 con 0x7f06580a3e90 2023-11-04T15:27:46.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.721+0000 7f06604db640 1 -- 172.21.15.19:0/44462868 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06580a3e90 msgr2=0x7f06580a6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:46.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.721+0000 7f06604db640 1 --2- 172.21.15.19:0/44462868 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06580a3e90 0x7f06580a6200 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0648009870 tx=0x7f064802b860 comp rx=0 tx=0).stop 2023-11-04T15:27:46.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.721+0000 7f06604db640 1 -- 172.21.15.19:0/44462868 shutdown_connections 2023-11-04T15:27:46.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.721+0000 7f06604db640 1 --2- 172.21.15.19:0/44462868 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0658137650 0x7f065813a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.721+0000 7f06604db640 1 --2- 172.21.15.19:0/44462868 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06580a3e90 0x7f06580a6200 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.721+0000 7f06604db640 1 -- 172.21.15.19:0/44462868 >> 172.21.15.19:0/44462868 conn(0x7f06580a8d70 msgr2=0x7f06580a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:46.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.721+0000 7f06604db640 1 -- 172.21.15.19:0/44462868 shutdown_connections 2023-11-04T15:27:46.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.721+0000 7f06604db640 1 -- 172.21.15.19:0/44462868 wait complete. 2023-11-04T15:27:46.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.722+0000 7f06604db640 1 Processor -- start 2023-11-04T15:27:46.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.722+0000 7f06604db640 1 -- start start 2023-11-04T15:27:46.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.723+0000 7f06604db640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06580a3e90 0x7f06581cee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:46.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.723+0000 7f06604db640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0658137270 0x7f06581cf370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:46.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.723+0000 7f06604db640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0658137650 0x7f06581cf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:46.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.723+0000 7f06604db640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0658098370 con 0x7f0658137650 2023-11-04T15:27:46.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.723+0000 7f06604db640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0658137b50 con 0x7f06580a3e90 2023-11-04T15:27:46.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.723+0000 7f06604db640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06580a2110 con 0x7f0658137270 2023-11-04T15:27:46.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.723+0000 7f065ea78640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0658137650 0x7f06581cf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:46.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.723+0000 7f065ea78640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0658137650 0x7f06581cf8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53768/0 (socket says 172.21.15.19:53768) 2023-11-04T15:27:46.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.723+0000 7f065ea78640 1 -- 172.21.15.19:0/2506592959 learned_addr learned my addr 172.21.15.19:0/2506592959 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:46.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.723+0000 7f065da76640 1 --2- 172.21.15.19:0/2506592959 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0658137270 0x7f06581cf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:46.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.723+0000 7f065e277640 1 --2- 172.21.15.19:0/2506592959 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06580a3e90 0x7f06581cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:46.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.723+0000 7f065ea78640 1 -- 172.21.15.19:0/2506592959 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0658137270 msgr2=0x7f06581cf370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:46.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.723+0000 7f065ea78640 1 --2- 172.21.15.19:0/2506592959 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0658137270 0x7f06581cf370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.723+0000 7f065ea78640 1 -- 172.21.15.19:0/2506592959 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06580a3e90 msgr2=0x7f06581cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:46.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.723+0000 7f065ea78640 1 --2- 172.21.15.19:0/2506592959 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06580a3e90 0x7f06581cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.723+0000 7f065ea78640 1 -- 172.21.15.19:0/2506592959 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06480094d0 con 0x7f0658137650 2023-11-04T15:27:46.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.723+0000 7f065ea78640 1 --2- 172.21.15.19:0/2506592959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0658137650 0x7f06581cf8b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f065000efc0 tx=0x7f065000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:46.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.724+0000 7f064effd640 1 -- 172.21.15.19:0/2506592959 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0650014480 con 0x7f0658137650 2023-11-04T15:27:46.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.724+0000 7f06604db640 1 -- 172.21.15.19:0/2506592959 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0658099850 con 0x7f0658137650 2023-11-04T15:27:46.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.724+0000 7f064effd640 1 -- 172.21.15.19:0/2506592959 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f065000f040 con 0x7f0658137650 2023-11-04T15:27:46.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.724+0000 7f064effd640 1 -- 172.21.15.19:0/2506592959 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0650014820 con 0x7f0658137650 2023-11-04T15:27:46.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.724+0000 7f06604db640 1 -- 172.21.15.19:0/2506592959 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0658099b10 con 0x7f0658137650 2023-11-04T15:27:46.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.725+0000 7f06604db640 1 -- 172.21.15.19:0/2506592959 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0658067d60 con 0x7f0658137650 2023-11-04T15:27:46.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.726+0000 7f064effd640 1 -- 172.21.15.19:0/2506592959 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0650014980 con 0x7f0658137650 2023-11-04T15:27:46.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.726+0000 7f064effd640 1 --2- 172.21.15.19:0/2506592959 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f063c06a430 0x7f063c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:46.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.726+0000 7f064effd640 1 -- 172.21.15.19:0/2506592959 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f0650089080 con 0x7f0658137650 2023-11-04T15:27:46.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.726+0000 7f065e277640 1 --2- 172.21.15.19:0/2506592959 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f063c06a430 0x7f063c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:46.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.727+0000 7f065e277640 1 --2- 172.21.15.19:0/2506592959 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f063c06a430 0x7f063c06c8f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0654000f60 tx=0x7f0654009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:46.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.730+0000 7f064effd640 1 -- 172.21.15.19:0/2506592959 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0650054d10 con 0x7f0658137650 2023-11-04T15:27:46.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.884+0000 7feabc750640 1 -- 172.21.15.19:0/3337758062 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7feab40aac70 con 0x7feab40a3e90 2023-11-04T15:27:46.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.884+0000 7feaaaffd640 1 -- 172.21.15.19:0/3337758062 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feab0058730 con 0x7feab40a3e90 2023-11-04T15:27:46.885 INFO:teuthology.orchestra.run.smithi019.stdout:38654705668 2023-11-04T15:27:46.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.886+0000 7feabc750640 1 -- 172.21.15.19:0/3337758062 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fea9806a430 msgr2=0x7fea9806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:46.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.886+0000 7feabc750640 1 --2- 172.21.15.19:0/3337758062 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fea9806a430 0x7fea9806c8f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feab4136280 tx=0x7feaa4007d30 comp rx=0 tx=0).stop 2023-11-04T15:27:46.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.886+0000 7feabc750640 1 -- 172.21.15.19:0/3337758062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feab40a3e90 msgr2=0x7feab4132de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:46.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.886+0000 7feabc750640 1 --2- 172.21.15.19:0/3337758062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feab40a3e90 0x7feab4132de0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7feab000d830 tx=0x7feab000dcf0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.886+0000 7feabc750640 1 -- 172.21.15.19:0/3337758062 shutdown_connections 2023-11-04T15:27:46.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.886+0000 7feabc750640 1 --2- 172.21.15.19:0/3337758062 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fea9806a430 0x7fea9806c8f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.886+0000 7feabc750640 1 --2- 172.21.15.19:0/3337758062 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feab4137650 0x7feab4097a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.886+0000 7feabc750640 1 --2- 172.21.15.19:0/3337758062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feab4137270 0x7feab4133320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.886+0000 7feabc750640 1 --2- 172.21.15.19:0/3337758062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feab40a3e90 0x7feab4132de0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.886+0000 7feabc750640 1 -- 172.21.15.19:0/3337758062 >> 172.21.15.19:0/3337758062 conn(0x7feab40a8d70 msgr2=0x7feab4134ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:46.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.886+0000 7feabc750640 1 -- 172.21.15.19:0/3337758062 shutdown_connections 2023-11-04T15:27:46.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.886+0000 7feabc750640 1 -- 172.21.15.19:0/3337758062 wait complete. 2023-11-04T15:27:46.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705668 for osd.1 2023-11-04T15:27:46.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.909+0000 7f06604db640 1 -- 172.21.15.19:0/2506592959 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f06580a3af0 con 0x7f0658137650 2023-11-04T15:27:46.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.909+0000 7f064effd640 1 -- 172.21.15.19:0/2506592959 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0650018020 con 0x7f0658137650 2023-11-04T15:27:46.911 INFO:teuthology.orchestra.run.smithi019.stdout:38654705669 2023-11-04T15:27:46.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.912+0000 7f4f2a684640 1 -- 172.21.15.19:0/2520435965 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4f24067d60 con 0x7f4f241340b0 2023-11-04T15:27:46.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.912+0000 7f06604db640 1 -- 172.21.15.19:0/2506592959 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f063c06a430 msgr2=0x7f063c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:46.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.912+0000 7f06604db640 1 --2- 172.21.15.19:0/2506592959 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f063c06a430 0x7f063c06c8f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0654000f60 tx=0x7f0654009040 comp rx=0 tx=0).stop 2023-11-04T15:27:46.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.912+0000 7f06604db640 1 -- 172.21.15.19:0/2506592959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0658137650 msgr2=0x7f06581cf8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:46.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.912+0000 7f06604db640 1 --2- 172.21.15.19:0/2506592959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0658137650 0x7f06581cf8b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f065000efc0 tx=0x7f065000c490 comp rx=0 tx=0).stop 2023-11-04T15:27:46.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.912+0000 7f06604db640 1 -- 172.21.15.19:0/2506592959 shutdown_connections 2023-11-04T15:27:46.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.912+0000 7f06604db640 1 --2- 172.21.15.19:0/2506592959 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f063c06a430 0x7f063c06c8f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.912+0000 7f06604db640 1 --2- 172.21.15.19:0/2506592959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0658137650 0x7f06581cf8b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.912+0000 7f06604db640 1 --2- 172.21.15.19:0/2506592959 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0658137270 0x7f06581cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.912+0000 7f06604db640 1 --2- 172.21.15.19:0/2506592959 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06580a3e90 0x7f06581cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.912+0000 7f06604db640 1 -- 172.21.15.19:0/2506592959 >> 172.21.15.19:0/2506592959 conn(0x7f06580a8d70 msgr2=0x7f06580aaef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:46.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.912+0000 7f06604db640 1 -- 172.21.15.19:0/2506592959 shutdown_connections 2023-11-04T15:27:46.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.912+0000 7f06604db640 1 -- 172.21.15.19:0/2506592959 wait complete. 2023-11-04T15:27:46.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.912+0000 7f4f20ff9640 1 -- 172.21.15.19:0/2520435965 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4f18079000 con 0x7f4f241340b0 2023-11-04T15:27:46.917 INFO:teuthology.orchestra.run.smithi019.stdout:38654705669 2023-11-04T15:27:46.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.914+0000 7f4f2a684640 1 -- 172.21.15.19:0/2520435965 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f4f1006a460 msgr2=0x7f4f1006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:46.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.914+0000 7f4f2a684640 1 --2- 172.21.15.19:0/2520435965 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f4f1006a460 0x7f4f1006c920 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4f14005880 tx=0x7f4f14009040 comp rx=0 tx=0).stop 2023-11-04T15:27:46.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.914+0000 7f4f2a684640 1 -- 172.21.15.19:0/2520435965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f241340b0 msgr2=0x7f4f241cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:46.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.914+0000 7f4f2a684640 1 --2- 172.21.15.19:0/2520435965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f241340b0 0x7f4f241cbfb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4f18035040 tx=0x7f4f180046c0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.914+0000 7f4f2a684640 1 -- 172.21.15.19:0/2520435965 shutdown_connections 2023-11-04T15:27:46.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.914+0000 7f4f2a684640 1 --2- 172.21.15.19:0/2520435965 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f4f1006a460 0x7f4f1006c920 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.914+0000 7f4f2a684640 1 --2- 172.21.15.19:0/2520435965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f24140280 0x7f4f241ceab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.914+0000 7f4f2a684640 1 --2- 172.21.15.19:0/2520435965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f241340b0 0x7f4f241cbfb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.914+0000 7f4f2a684640 1 --2- 172.21.15.19:0/2520435965 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4f24133cd0 0x7f4f241cba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.914+0000 7f4f2a684640 1 -- 172.21.15.19:0/2520435965 >> 172.21.15.19:0/2520435965 conn(0x7f4f240a8ff0 msgr2=0x7f4f240a29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:46.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.915+0000 7f4f2a684640 1 -- 172.21.15.19:0/2520435965 shutdown_connections 2023-11-04T15:27:46.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.915+0000 7f4f2a684640 1 -- 172.21.15.19:0/2520435965 wait complete. 2023-11-04T15:27:46.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.919+0000 7efc35a81640 1 -- 172.21.15.19:0/2054894386 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efc30139460 con 0x7efc30133cb0 2023-11-04T15:27:46.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.920+0000 7efc17fff640 1 -- 172.21.15.19:0/2054894386 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efc30139460 con 0x7efc30133cb0 2023-11-04T15:27:46.922 INFO:teuthology.orchestra.run.smithi019.stdout:38654705670 2023-11-04T15:27:46.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.923+0000 7efc35a81640 1 -- 172.21.15.19:0/2054894386 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7efc1c06a430 msgr2=0x7efc1c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:46.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.923+0000 7efc35a81640 1 --2- 172.21.15.19:0/2054894386 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7efc1c06a430 0x7efc1c06c8f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efc20005880 tx=0x7efc20009040 comp rx=0 tx=0).stop 2023-11-04T15:27:46.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.923+0000 7efc35a81640 1 -- 172.21.15.19:0/2054894386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc30133cb0 msgr2=0x7efc3012e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:46.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.923+0000 7efc35a81640 1 --2- 172.21.15.19:0/2054894386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc30133cb0 0x7efc3012e220 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efc2402bdc0 tx=0x7efc240046c0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.923+0000 7efc35a81640 1 -- 172.21.15.19:0/2054894386 shutdown_connections 2023-11-04T15:27:46.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.923+0000 7efc35a81640 1 --2- 172.21.15.19:0/2054894386 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7efc1c06a430 0x7efc1c06c8f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.923+0000 7efc35a81640 1 --2- 172.21.15.19:0/2054894386 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efc3013c470 0x7efc301ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.923+0000 7efc35a81640 1 --2- 172.21.15.19:0/2054894386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc30133cb0 0x7efc3012e220 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.923+0000 7efc35a81640 1 --2- 172.21.15.19:0/2054894386 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc300a0730 0x7efc3012dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:46.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.923+0000 7efc35a81640 1 -- 172.21.15.19:0/2054894386 >> 172.21.15.19:0/2054894386 conn(0x7efc300a9060 msgr2=0x7efc30130c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:46.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.923+0000 7efc35a81640 1 -- 172.21.15.19:0/2054894386 shutdown_connections 2023-11-04T15:27:46.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:46.923+0000 7efc35a81640 1 -- 172.21.15.19:0/2054894386 wait complete. 2023-11-04T15:27:46.927 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705669 for osd.2 2023-11-04T15:27:46.928 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705669 for osd.0 2023-11-04T15:27:46.935 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705670 for osd.3 2023-11-04T15:27:47.900 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-04T15:27:47.928 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-04T15:27:47.929 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-04T15:27:47.937 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-04T15:27:48.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.021+0000 7fa8abc23640 1 Processor -- start 2023-11-04T15:27:48.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.022+0000 7fa8abc23640 1 -- start start 2023-11-04T15:27:48.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.022+0000 7fa8abc23640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa8a4137270 0x7fa8a40a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:48.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.022+0000 7fa8abc23640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa8a4137650 0x7fa8a413a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:48.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.022+0000 7fa8abc23640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a40a4c20 con 0x7fa8a40a3e90 2023-11-04T15:27:48.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.022+0000 7fa8abc23640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8a40a3060 con 0x7fa8a4137650 2023-11-04T15:27:48.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.022+0000 7fa8abc23640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a40a5080 con 0x7fa8a4137270 2023-11-04T15:27:48.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.022+0000 7fa8a91be640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa8a40a3e90 0x7fa8a4139f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60926/0 (socket says 172.21.15.19:60926) 2023-11-04T15:27:48.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.022+0000 7fa8a91be640 1 -- 172.21.15.19:0/734597830 learned_addr learned my addr 172.21.15.19:0/734597830 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:48.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.022+0000 7fa8aa1c0640 1 --2- 172.21.15.19:0/734597830 >> v2:172.21.15.19:3300/0 conn(0x7fa8a4137650 0x7fa8a413a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:48.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.023+0000 7fa8a99bf640 1 --2- 172.21.15.19:0/734597830 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa8a4137270 0x7fa8a40a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:48.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.023+0000 7fa8aa1c0640 1 -- 172.21.15.19:0/734597830 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa8a4137270 msgr2=0x7fa8a40a6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:48.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.023+0000 7fa8aa1c0640 1 --2- 172.21.15.19:0/734597830 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa8a4137270 0x7fa8a40a6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.023+0000 7fa8aa1c0640 1 -- 172.21.15.19:0/734597830 >> v1:172.21.15.19:6789/0 conn(0x7fa8a40a3e90 legacy=0x7fa8a4139f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.023+0000 7fa8aa1c0640 1 -- 172.21.15.19:0/734597830 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a40a3440 con 0x7fa8a4137650 2023-11-04T15:27:48.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.023+0000 7fa8a89bd640 1 -- 172.21.15.19:0/734597830 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3477986697 0 0) 0x7fa8a40a4c20 con 0x7fa8a40a3e90 2023-11-04T15:27:48.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.024+0000 7fa8aa1c0640 1 --2- 172.21.15.19:0/734597830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8a4137650 0x7fa8a413a670 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa89c009d90 tx=0x7fa89c02bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb21f00fb5e4fa7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:48.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.024+0000 7fa8a89bd640 1 -- 172.21.15.19:0/734597830 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c02cb60 con 0x7fa8a4137650 2023-11-04T15:27:48.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.024+0000 7fa8a89bd640 1 -- 172.21.15.19:0/734597830 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89c02ccc0 con 0x7fa8a4137650 2023-11-04T15:27:48.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.024+0000 7fa8a89bd640 1 -- 172.21.15.19:0/734597830 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c034660 con 0x7fa8a4137650 2023-11-04T15:27:48.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.025+0000 7fa8abc23640 1 -- 172.21.15.19:0/734597830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8a4137650 msgr2=0x7fa8a413a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.025+0000 7fa8abc23640 1 --2- 172.21.15.19:0/734597830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8a4137650 0x7fa8a413a670 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa89c009d90 tx=0x7fa89c02bdb0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.025+0000 7fa8abc23640 1 -- 172.21.15.19:0/734597830 shutdown_connections 2023-11-04T15:27:48.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.025+0000 7fa8abc23640 1 --2- 172.21.15.19:0/734597830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8a4137650 0x7fa8a413a670 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.025+0000 7fa8abc23640 1 --2- 172.21.15.19:0/734597830 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa8a4137270 0x7fa8a40a6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.025+0000 7fa8abc23640 1 -- 172.21.15.19:0/734597830 >> 172.21.15.19:0/734597830 conn(0x7fa8a40a8d70 msgr2=0x7fa8a40a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:48.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.025+0000 7fa8abc23640 1 -- 172.21.15.19:0/734597830 shutdown_connections 2023-11-04T15:27:48.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.025+0000 7fa8abc23640 1 -- 172.21.15.19:0/734597830 wait complete. 2023-11-04T15:27:48.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.027+0000 7fa8abc23640 1 Processor -- start 2023-11-04T15:27:48.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.027+0000 7fa8abc23640 1 -- start start 2023-11-04T15:27:48.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.028+0000 7fa8abc23640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8a40a3e90 0x7fa8a409bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:48.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.028+0000 7fa8abc23640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8a4137270 0x7fa8a41cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:48.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.028+0000 7fa8abc23640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa8a4137650 0x7fa8a41cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:48.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.028+0000 7fa8abc23640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a409b210 con 0x7fa8a4137270 2023-11-04T15:27:48.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.028+0000 7fa8abc23640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a41cb6d0 con 0x7fa8a40a3e90 2023-11-04T15:27:48.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.028+0000 7fa8abc23640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a409c0a0 con 0x7fa8a4137650 2023-11-04T15:27:48.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.028+0000 7fa8a91be640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8a4137270 0x7fa8a41cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:48.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.028+0000 7fa8a91be640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8a4137270 0x7fa8a41cbb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53778/0 (socket says 172.21.15.19:53778) 2023-11-04T15:27:48.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.028+0000 7fa8a91be640 1 -- 172.21.15.19:0/998298635 learned_addr learned my addr 172.21.15.19:0/998298635 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:48.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.028+0000 7fa8a99bf640 1 --2- 172.21.15.19:0/998298635 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8a40a3e90 0x7fa8a409bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:48.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.028+0000 7fa8aa1c0640 1 --2- 172.21.15.19:0/998298635 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa8a4137650 0x7fa8a41cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:48.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.028+0000 7fa8a91be640 1 -- 172.21.15.19:0/998298635 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa8a4137650 msgr2=0x7fa8a41cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.028+0000 7fa8a91be640 1 --2- 172.21.15.19:0/998298635 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa8a4137650 0x7fa8a41cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.028+0000 7fa8a91be640 1 -- 172.21.15.19:0/998298635 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8a40a3e90 msgr2=0x7fa8a409bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.028+0000 7fa8a91be640 1 --2- 172.21.15.19:0/998298635 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8a40a3e90 0x7fa8a409bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.028+0000 7fa8a91be640 1 -- 172.21.15.19:0/998298635 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89c009a70 con 0x7fa8a4137270 2023-11-04T15:27:48.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.028+0000 7fa8aa1c0640 1 --2- 172.21.15.19:0/998298635 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa8a4137650 0x7fa8a41cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:27:48.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.028+0000 7fa8a99bf640 1 --2- 172.21.15.19:0/998298635 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8a40a3e90 0x7fa8a409bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:27:48.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.028+0000 7fa8a91be640 1 --2- 172.21.15.19:0/998298635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8a4137270 0x7fa8a41cbb80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa89400c450 tx=0x7fa89400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:48.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.029+0000 7fa89a7fc640 1 -- 172.21.15.19:0/998298635 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8940074e0 con 0x7fa8a4137270 2023-11-04T15:27:48.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.029+0000 7fa89a7fc640 1 -- 172.21.15.19:0/998298635 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa894007660 con 0x7fa8a4137270 2023-11-04T15:27:48.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.029+0000 7fa8abc23640 1 -- 172.21.15.19:0/998298635 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a4099e60 con 0x7fa8a4137270 2023-11-04T15:27:48.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.029+0000 7fa89a7fc640 1 -- 172.21.15.19:0/998298635 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa894004a20 con 0x7fa8a4137270 2023-11-04T15:27:48.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.029+0000 7fa8abc23640 1 -- 172.21.15.19:0/998298635 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a409a7c0 con 0x7fa8a4137270 2023-11-04T15:27:48.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.030+0000 7fa8abc23640 1 -- 172.21.15.19:0/998298635 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8a40a2a40 con 0x7fa8a4137270 2023-11-04T15:27:48.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.031+0000 7fa89a7fc640 1 -- 172.21.15.19:0/998298635 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa894004b80 con 0x7fa8a4137270 2023-11-04T15:27:48.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.031+0000 7fa89a7fc640 1 --2- 172.21.15.19:0/998298635 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa88806a430 0x7fa88806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:48.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.031+0000 7fa89a7fc640 1 -- 172.21.15.19:0/998298635 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7fa8940877c0 con 0x7fa8a4137270 2023-11-04T15:27:48.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.032+0000 7fa8a99bf640 1 --2- 172.21.15.19:0/998298635 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa88806a430 0x7fa88806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:48.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.032+0000 7fa8a99bf640 1 --2- 172.21.15.19:0/998298635 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa88806a430 0x7fa88806c8f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0009b90 tx=0x7fa8a0008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:48.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.040+0000 7fa89a7fc640 1 -- 172.21.15.19:0/998298635 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa8a40a2a40 con 0x7fa8a4137270 2023-11-04T15:27:48.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.060+0000 7ff063349640 1 Processor -- start 2023-11-04T15:27:48.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.061+0000 7ff063349640 1 -- start start 2023-11-04T15:27:48.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.061+0000 7fdd8e549640 1 Processor -- start 2023-11-04T15:27:48.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.061+0000 7fdd8e549640 1 -- start start 2023-11-04T15:27:48.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.061+0000 7ff063349640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff05c135480 0x7ff05c1384e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:48.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.061+0000 7ff063349640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff05c13e100 0x7ff05c1404f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:48.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.062+0000 7fdd8e549640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fdd88134350 0x7fdd880704c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:48.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.062+0000 7ff063349640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff05c0710a0 con 0x7ff05c1350a0 2023-11-04T15:27:48.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.062+0000 7ff063349640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff05c0a4610 con 0x7ff05c13e100 2023-11-04T15:27:48.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.062+0000 7ff0618e6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff05c13e100 0x7ff05c1404f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:48.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.062+0000 7ff0618e6640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff05c13e100 0x7ff05c1404f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53790/0 (socket says 172.21.15.19:53790) 2023-11-04T15:27:48.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.062+0000 7ff0618e6640 1 -- 172.21.15.19:0/906417498 learned_addr learned my addr 172.21.15.19:0/906417498 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:48.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.062+0000 7ff0608e4640 1 --2- 172.21.15.19:0/906417498 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff05c135480 0x7ff05c1384e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:48.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.062+0000 7ff063349640 1 -- 172.21.15.19:0/906417498 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c0a6810 con 0x7ff05c135480 2023-11-04T15:27:48.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.062+0000 7fdd8e549640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd88070030 con 0x7fdd88133f70 2023-11-04T15:27:48.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.062+0000 7fdd8e549640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd881338a0 con 0x7fdd8809a230 2023-11-04T15:27:48.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.062+0000 7fdd8e549640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd88134760 con 0x7fdd88134350 2023-11-04T15:27:48.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.062+0000 7fdd8cae6640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fdd8809a230 0x7fdd8813f120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.19:33986/0 (socket says 172.21.15.19:33986) 2023-11-04T15:27:48.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.062+0000 7fdd8cae6640 1 -- 172.21.15.19:0/229749960 learned_addr learned my addr 172.21.15.19:0/229749960 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:48.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.062+0000 7fdd877fe640 1 --2- 172.21.15.19:0/229749960 >> v2:172.21.15.96:3300/0 conn(0x7fdd88134350 0x7fdd880704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:48.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.062+0000 7fdd877fe640 1 -- 172.21.15.19:0/229749960 >> v1:172.21.15.96:6789/0 conn(0x7fdd8809a230 legacy=0x7fdd8813f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.062+0000 7fdd877fe640 1 -- 172.21.15.19:0/229749960 >> v1:172.21.15.19:6789/0 conn(0x7fdd88133f70 legacy=0x7fdd88099b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.062+0000 7fdd877fe640 1 -- 172.21.15.19:0/229749960 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd88133b40 con 0x7fdd88134350 2023-11-04T15:27:48.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.062+0000 7ff0608e4640 1 -- 172.21.15.19:0/906417498 >> v2:172.21.15.19:3300/0 conn(0x7ff05c13e100 msgr2=0x7ff05c1404f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:48.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.062+0000 7ff0608e4640 1 --2- 172.21.15.19:0/906417498 >> v2:172.21.15.19:3300/0 conn(0x7ff05c13e100 0x7ff05c1404f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.062+0000 7ff0608e4640 1 -- 172.21.15.19:0/906417498 >> v1:172.21.15.96:6789/0 conn(0x7ff05c1350a0 legacy=0x7ff05c137dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.062+0000 7ff0608e4640 1 -- 172.21.15.19:0/906417498 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff05c070420 con 0x7ff05c135480 2023-11-04T15:27:48.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.062+0000 7ff0618e6640 1 --2- 172.21.15.19:0/906417498 >> v2:172.21.15.19:3300/0 conn(0x7ff05c13e100 0x7ff05c1404f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T15:27:48.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.063+0000 7fdd877fe640 1 --2- 172.21.15.19:0/229749960 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd88134350 0x7fdd880704c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c00b9c0 tx=0x7fdd7c02ddf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97d120aa662d180e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:48.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.063+0000 7fdd86ffd640 1 -- 172.21.15.19:0/229749960 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c02eba0 con 0x7fdd88134350 2023-11-04T15:27:48.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.063+0000 7ff0608e4640 1 --2- 172.21.15.19:0/906417498 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff05c135480 0x7ff05c1384e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff04c0097a0 tx=0x7ff04c02b660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84150f4df4eda993 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:48.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.063+0000 7fdd86ffd640 1 -- 172.21.15.19:0/229749960 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7c02ed00 con 0x7fdd88134350 2023-11-04T15:27:48.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.063+0000 7fdd86ffd640 1 -- 172.21.15.19:0/229749960 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c036660 con 0x7fdd88134350 2023-11-04T15:27:48.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.064+0000 7fdd8e549640 1 -- 172.21.15.19:0/229749960 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd88134350 msgr2=0x7fdd880704c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.064+0000 7fdd8e549640 1 --2- 172.21.15.19:0/229749960 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd88134350 0x7fdd880704c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c00b9c0 tx=0x7fdd7c02ddf0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.064+0000 7fdd8e549640 1 -- 172.21.15.19:0/229749960 shutdown_connections 2023-11-04T15:27:48.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.064+0000 7fdd8e549640 1 --2- 172.21.15.19:0/229749960 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd88134350 0x7fdd880704c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.064+0000 7ff053fff640 1 -- 172.21.15.19:0/906417498 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c030710 con 0x7ff05c135480 2023-11-04T15:27:48.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.064+0000 7fdd8e549640 1 -- 172.21.15.19:0/229749960 >> 172.21.15.19:0/229749960 conn(0x7fdd880a8920 msgr2=0x7fdd880a8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:48.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.064+0000 7ff053fff640 1 -- 172.21.15.19:0/906417498 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04c02e050 con 0x7ff05c135480 2023-11-04T15:27:48.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.064+0000 7ff053fff640 1 -- 172.21.15.19:0/906417498 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c030a90 con 0x7ff05c135480 2023-11-04T15:27:48.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.064+0000 7fdd8e549640 1 -- 172.21.15.19:0/229749960 shutdown_connections 2023-11-04T15:27:48.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.064+0000 7fdd8e549640 1 -- 172.21.15.19:0/229749960 wait complete. 2023-11-04T15:27:48.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.064+0000 7fc956e8f640 1 Processor -- start 2023-11-04T15:27:48.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.065+0000 7ff063349640 1 -- 172.21.15.19:0/906417498 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff05c135480 msgr2=0x7ff05c1384e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.065+0000 7ff063349640 1 --2- 172.21.15.19:0/906417498 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff05c135480 0x7ff05c1384e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff04c0097a0 tx=0x7ff04c02b660 comp rx=0 tx=0).stop 2023-11-04T15:27:48.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.065+0000 7fc956e8f640 1 -- start start 2023-11-04T15:27:48.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.065+0000 7ff063349640 1 -- 172.21.15.19:0/906417498 shutdown_connections 2023-11-04T15:27:48.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.065+0000 7ff063349640 1 --2- 172.21.15.19:0/906417498 >> v2:172.21.15.19:3300/0 conn(0x7ff05c13e100 0x7ff05c1404f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.065+0000 7ff063349640 1 --2- 172.21.15.19:0/906417498 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff05c135480 0x7ff05c1384e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.065+0000 7ff063349640 1 -- 172.21.15.19:0/906417498 >> 172.21.15.19:0/906417498 conn(0x7ff05c0a6b70 msgr2=0x7ff05c0a6f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:48.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.066+0000 7ff063349640 1 -- 172.21.15.19:0/906417498 shutdown_connections 2023-11-04T15:27:48.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.066+0000 7ff063349640 1 -- 172.21.15.19:0/906417498 wait complete. 2023-11-04T15:27:48.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.066+0000 7fc956e8f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc950134210 0x7fc95013a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:48.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.066+0000 7fc956e8f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc950140420 0x7fc950142810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:48.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.066+0000 7fc956e8f640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9500a1530 con 0x7fc950133e30 2023-11-04T15:27:48.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.066+0000 7fc956e8f640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc950136b80 con 0x7fc950134210 2023-11-04T15:27:48.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.066+0000 7fc956e8f640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc950134680 con 0x7fc950140420 2023-11-04T15:27:48.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.066+0000 7fdd8e549640 1 Processor -- start 2023-11-04T15:27:48.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.066+0000 7fc954c2b640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc950133e30 0x7fc95013a0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60934/0 (socket says 172.21.15.19:60934) 2023-11-04T15:27:48.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.066+0000 7fc954c2b640 1 -- 172.21.15.19:0/710325855 learned_addr learned my addr 172.21.15.19:0/710325855 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:48.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.066+0000 7fc94ffff640 1 --2- 172.21.15.19:0/710325855 >> v2:172.21.15.96:3300/0 conn(0x7fc950134210 0x7fc95013a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:48.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.066+0000 7fc95542c640 1 --2- 172.21.15.19:0/710325855 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc950140420 0x7fc950142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:48.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.066+0000 7fdd8e549640 1 -- start start 2023-11-04T15:27:48.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.066+0000 7fc94f7fe640 1 -- 172.21.15.19:0/710325855 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 220143261 0 0) 0x7fc9500a1530 con 0x7fc950133e30 2023-11-04T15:27:48.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.066+0000 7fc94f7fe640 1 -- 172.21.15.19:0/710325855 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc940003520 con 0x7fc950133e30 2023-11-04T15:27:48.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.067+0000 7fc94ffff640 1 -- 172.21.15.19:0/710325855 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc950140420 msgr2=0x7fc950142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:48.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.067+0000 7fc94ffff640 1 --2- 172.21.15.19:0/710325855 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc950140420 0x7fc950142810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.067+0000 7fc94ffff640 1 -- 172.21.15.19:0/710325855 >> v1:172.21.15.19:6789/0 conn(0x7fc950133e30 legacy=0x7fc95013a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.067+0000 7fc94ffff640 1 -- 172.21.15.19:0/710325855 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9500a0b30 con 0x7fc950134210 2023-11-04T15:27:48.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.067+0000 7fc95542c640 1 --2- 172.21.15.19:0/710325855 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc950140420 0x7fc950142810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T15:27:48.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.067+0000 7fdd8e549640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd8809a230 0x7fdd881cad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:48.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.067+0000 7fc94ffff640 1 --2- 172.21.15.19:0/710325855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc950134210 0x7fc95013a800 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc93c0097a0 tx=0x7fc93c02b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ee6853b44d253d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:48.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.067+0000 7fdd8e549640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd88133f70 0x7fdd881cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:48.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.067+0000 7fdd8e549640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdd88134350 0x7fdd881cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:48.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.067+0000 7ff063349640 1 Processor -- start 2023-11-04T15:27:48.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.068+0000 7ff063349640 1 -- start start 2023-11-04T15:27:48.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.068+0000 7fdd8e549640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd880a5d90 con 0x7fdd8809a230 2023-11-04T15:27:48.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.068+0000 7fdd8e549640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd88071a00 con 0x7fdd88133f70 2023-11-04T15:27:48.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.068+0000 7fdd877fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd88133f70 0x7fdd881cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:48.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.068+0000 7fdd87fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd8809a230 0x7fdd881cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:48.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.068+0000 7fdd877fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd88133f70 0x7fdd881cb2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.19:54914/0 (socket says 172.21.15.19:54914) 2023-11-04T15:27:48.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.068+0000 7fdd877fe640 1 -- 172.21.15.19:0/1609857035 learned_addr learned my addr 172.21.15.19:0/1609857035 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:48.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.068+0000 7fc94f7fe640 1 -- 172.21.15.19:0/710325855 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c0316f0 con 0x7fc950134210 2023-11-04T15:27:48.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.068+0000 7fdd8e549640 1 -- 172.21.15.19:0/1609857035 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8809edb0 con 0x7fdd88134350 2023-11-04T15:27:48.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.068+0000 7fc94f7fe640 1 -- 172.21.15.19:0/710325855 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93c031850 con 0x7fc950134210 2023-11-04T15:27:48.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.068+0000 7fc94f7fe640 1 -- 172.21.15.19:0/710325855 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c031be0 con 0x7fc950134210 2023-11-04T15:27:48.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.068+0000 7fdd8cae6640 1 --2- 172.21.15.19:0/1609857035 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdd88134350 0x7fdd881cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:48.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.068+0000 7fdd877fe640 1 -- 172.21.15.19:0/1609857035 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdd88134350 msgr2=0x7fdd881cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.068+0000 7fdd877fe640 1 --2- 172.21.15.19:0/1609857035 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdd88134350 0x7fdd881cb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.068+0000 7fdd877fe640 1 -- 172.21.15.19:0/1609857035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd8809a230 msgr2=0x7fdd881cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.068+0000 7fdd877fe640 1 --2- 172.21.15.19:0/1609857035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd8809a230 0x7fdd881cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.068+0000 7fdd877fe640 1 -- 172.21.15.19:0/1609857035 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd7c00b6a0 con 0x7fdd88133f70 2023-11-04T15:27:48.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.068+0000 7ff063349640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff05c1350a0 0x7ff05c137c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:48.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.068+0000 7ff063349640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff05c135480 0x7ff05c1c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:48.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.068+0000 7ff063349640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff05c13e100 0x7ff05c1c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:48.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.068+0000 7fc956e8f640 1 -- 172.21.15.19:0/710325855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc950134210 msgr2=0x7fc95013a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.068+0000 7fc956e8f640 1 --2- 172.21.15.19:0/710325855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc950134210 0x7fc95013a800 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc93c0097a0 tx=0x7fc93c02b790 comp rx=0 tx=0).stop 2023-11-04T15:27:48.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.068+0000 7ff063349640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c1377e0 con 0x7ff05c1350a0 2023-11-04T15:27:48.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.068+0000 7fc956e8f640 1 -- 172.21.15.19:0/710325855 shutdown_connections 2023-11-04T15:27:48.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.068+0000 7fc956e8f640 1 --2- 172.21.15.19:0/710325855 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc950140420 0x7fc950142810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.068+0000 7fc956e8f640 1 --2- 172.21.15.19:0/710325855 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc950134210 0x7fc95013a800 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.068+0000 7fc956e8f640 1 -- 172.21.15.19:0/710325855 >> 172.21.15.19:0/710325855 conn(0x7fc9500a5af0 msgr2=0x7fc9500a5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:48.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.068+0000 7ff0610e5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff05c1350a0 0x7ff05c137c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:48.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.068+0000 7fdd877fe640 1 --2- 172.21.15.19:0/1609857035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd88133f70 0x7fdd881cb2a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c039040 tx=0x7fdd7c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:48.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.068+0000 7ff063349640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c1381b0 con 0x7ff05c135480 2023-11-04T15:27:48.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.068+0000 7ff0610e5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff05c1350a0 0x7ff05c137c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53814/0 (socket says 172.21.15.19:53814) 2023-11-04T15:27:48.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.068+0000 7ff0610e5640 1 -- 172.21.15.19:0/3906397292 learned_addr learned my addr 172.21.15.19:0/3906397292 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:48.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.069+0000 7ff063349640 1 -- 172.21.15.19:0/3906397292 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c1ca500 con 0x7ff05c13e100 2023-11-04T15:27:48.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.069+0000 7ff0608e4640 1 --2- 172.21.15.19:0/3906397292 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff05c135480 0x7ff05c1c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:48.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.068+0000 7fdd84ff9640 1 -- 172.21.15.19:0/1609857035 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c042650 con 0x7fdd88133f70 2023-11-04T15:27:48.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.069+0000 7fdd84ff9640 1 -- 172.21.15.19:0/1609857035 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7c0427d0 con 0x7fdd88133f70 2023-11-04T15:27:48.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.069+0000 7fdd84ff9640 1 -- 172.21.15.19:0/1609857035 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c042b80 con 0x7fdd88133f70 2023-11-04T15:27:48.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.069+0000 7fc956e8f640 1 -- 172.21.15.19:0/710325855 shutdown_connections 2023-11-04T15:27:48.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.069+0000 7ff0618e6640 1 --2- 172.21.15.19:0/3906397292 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff05c13e100 0x7ff05c1c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:48.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.069+0000 7fdd8e549640 1 -- 172.21.15.19:0/1609857035 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd8806f600 con 0x7fdd88133f70 2023-11-04T15:27:48.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.069+0000 7fdd8e549640 1 -- 172.21.15.19:0/1609857035 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd8809d300 con 0x7fdd88133f70 2023-11-04T15:27:48.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.069+0000 7ff0610e5640 1 -- 172.21.15.19:0/3906397292 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff05c13e100 msgr2=0x7ff05c1c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.069+0000 7ff0610e5640 1 --2- 172.21.15.19:0/3906397292 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff05c13e100 0x7ff05c1c9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.069+0000 7ff0610e5640 1 -- 172.21.15.19:0/3906397292 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff05c135480 msgr2=0x7ff05c1c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.069+0000 7ff0610e5640 1 --2- 172.21.15.19:0/3906397292 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff05c135480 0x7ff05c1c9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.069+0000 7ff0610e5640 1 -- 172.21.15.19:0/3906397292 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff054009b30 con 0x7ff05c1350a0 2023-11-04T15:27:48.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.069+0000 7ff0618e6640 1 --2- 172.21.15.19:0/3906397292 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff05c13e100 0x7ff05c1c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T15:27:48.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.069+0000 7fc956e8f640 1 -- 172.21.15.19:0/710325855 wait complete. 2023-11-04T15:27:48.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.070+0000 7ff0610e5640 1 --2- 172.21.15.19:0/3906397292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff05c1350a0 0x7ff05c137c70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff05800c780 tx=0x7ff05800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:48.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.070+0000 7fdd8e549640 1 -- 172.21.15.19:0/1609857035 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd8809d300 con 0x7fdd88133f70 2023-11-04T15:27:48.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.070+0000 7ff051ffb640 1 -- 172.21.15.19:0/3906397292 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff058005270 con 0x7ff05c1350a0 2023-11-04T15:27:48.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.070+0000 7ff063349640 1 -- 172.21.15.19:0/3906397292 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff04c009400 con 0x7ff05c1350a0 2023-11-04T15:27:48.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.070+0000 7ff051ffb640 1 -- 172.21.15.19:0/3906397292 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0580053f0 con 0x7ff05c1350a0 2023-11-04T15:27:48.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.070+0000 7ff051ffb640 1 -- 172.21.15.19:0/3906397292 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05800a880 con 0x7ff05c1350a0 2023-11-04T15:27:48.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.070+0000 7ff063349640 1 -- 172.21.15.19:0/3906397292 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff05c137550 con 0x7ff05c1350a0 2023-11-04T15:27:48.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.070+0000 7fdd84ff9640 1 -- 172.21.15.19:0/1609857035 <== mon.1 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdd7c042ce0 con 0x7fdd88133f70 2023-11-04T15:27:48.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.070+0000 7fc956e8f640 1 Processor -- start 2023-11-04T15:27:48.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.071+0000 7fdd84ff9640 1 --2- 172.21.15.19:0/1609857035 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fdd7406a430 0x7fdd7406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:48.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.071+0000 7fdd84ff9640 1 -- 172.21.15.19:0/1609857035 <== mon.1 v2:172.21.15.96:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7fdd7c0ad040 con 0x7fdd88133f70 2023-11-04T15:27:48.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.071+0000 7fc956e8f640 1 -- start start 2023-11-04T15:27:48.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.071+0000 7fdd87fff640 1 --2- 172.21.15.19:0/1609857035 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fdd7406a430 0x7fdd7406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:48.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.071+0000 7ff063349640 1 -- 172.21.15.19:0/3906397292 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff05c067d60 con 0x7ff05c1350a0 2023-11-04T15:27:48.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.071+0000 7fc956e8f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc950133e30 0x7fc9501cee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:48.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.071+0000 7fc956e8f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc950134210 0x7fc9501cf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:48.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.071+0000 7fc956e8f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc950140420 0x7fc9501cf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:48.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.072+0000 7fc954c2b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc950133e30 0x7fc9501cee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:48.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.072+0000 7fc954c2b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc950133e30 0x7fc9501cee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53824/0 (socket says 172.21.15.19:53824) 2023-11-04T15:27:48.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.072+0000 7fc94ffff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc950134210 0x7fc9501cf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:48.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.072+0000 7fc954c2b640 1 -- 172.21.15.19:0/3715768526 learned_addr learned my addr 172.21.15.19:0/3715768526 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:48.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.072+0000 7fc956e8f640 1 -- 172.21.15.19:0/3715768526 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95013ae50 con 0x7fc950133e30 2023-11-04T15:27:48.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.072+0000 7fdd87fff640 1 --2- 172.21.15.19:0/1609857035 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fdd7406a430 0x7fdd7406c8f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdd78000f60 tx=0x7fdd78009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:48.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.072+0000 7ff051ffb640 1 -- 172.21.15.19:0/3906397292 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff05800a9e0 con 0x7ff05c1350a0 2023-11-04T15:27:48.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.072+0000 7fc956e8f640 1 -- 172.21.15.19:0/3715768526 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9501cb8f0 con 0x7fc950140420 2023-11-04T15:27:48.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.072+0000 7fc956e8f640 1 -- 172.21.15.19:0/3715768526 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc950138090 con 0x7fc950134210 2023-11-04T15:27:48.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.072+0000 7fc95542c640 1 --2- 172.21.15.19:0/3715768526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc950140420 0x7fc9501cf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:48.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.072+0000 7fc954c2b640 1 -- 172.21.15.19:0/3715768526 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc950134210 msgr2=0x7fc9501cf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.072+0000 7fc954c2b640 1 --2- 172.21.15.19:0/3715768526 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc950134210 0x7fc9501cf3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.072+0000 7fc954c2b640 1 -- 172.21.15.19:0/3715768526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc950140420 msgr2=0x7fc9501cf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.072+0000 7fc954c2b640 1 --2- 172.21.15.19:0/3715768526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc950140420 0x7fc9501cf8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.072+0000 7ff051ffb640 1 --2- 172.21.15.19:0/3906397292 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7ff04006a430 0x7ff04006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:48.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.072+0000 7fc954c2b640 1 -- 172.21.15.19:0/3715768526 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc948009a70 con 0x7fc950133e30 2023-11-04T15:27:48.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.072+0000 7ff051ffb640 1 -- 172.21.15.19:0/3906397292 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7ff058087a00 con 0x7ff05c1350a0 2023-11-04T15:27:48.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.072+0000 7fc954c2b640 1 --2- 172.21.15.19:0/3715768526 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc950133e30 0x7fc9501cee60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc94400c530 tx=0x7fc94400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:48.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.072+0000 7ff0608e4640 1 --2- 172.21.15.19:0/3906397292 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7ff04006a430 0x7ff04006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:48.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.073+0000 7ff0608e4640 1 --2- 172.21.15.19:0/3906397292 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7ff04006a430 0x7ff04006c8f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff04c034000 tx=0x7ff04c008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:48.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.076+0000 7fdd84ff9640 1 -- 172.21.15.19:0/1609857035 <== mon.1 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdd7c078cd0 con 0x7fdd88133f70 2023-11-04T15:27:48.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.081+0000 7ff051ffb640 1 -- 172.21.15.19:0/3906397292 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff058053610 con 0x7ff05c1350a0 2023-11-04T15:27:48.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.081+0000 7fc94d7fa640 1 -- 172.21.15.19:0/3715768526 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc944005ce0 con 0x7fc950133e30 2023-11-04T15:27:48.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.081+0000 7fc94d7fa640 1 -- 172.21.15.19:0/3715768526 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc944005e40 con 0x7fc950133e30 2023-11-04T15:27:48.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.081+0000 7fc94d7fa640 1 -- 172.21.15.19:0/3715768526 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9440072b0 con 0x7fc950133e30 2023-11-04T15:27:48.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.081+0000 7fc956e8f640 1 -- 172.21.15.19:0/3715768526 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc93c009400 con 0x7fc950133e30 2023-11-04T15:27:48.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.081+0000 7fc956e8f640 1 -- 172.21.15.19:0/3715768526 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9500a9ab0 con 0x7fc950133e30 2023-11-04T15:27:48.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.082+0000 7fc956e8f640 1 -- 172.21.15.19:0/3715768526 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc950067d60 con 0x7fc950133e30 2023-11-04T15:27:48.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.083+0000 7fc94d7fa640 1 -- 172.21.15.19:0/3715768526 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc944007410 con 0x7fc950133e30 2023-11-04T15:27:48.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.085+0000 7fc94d7fa640 1 --2- 172.21.15.19:0/3715768526 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc93406a480 0x7fc93406c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:48.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.085+0000 7fc94d7fa640 1 -- 172.21.15.19:0/3715768526 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7fc9440877b0 con 0x7fc950133e30 2023-11-04T15:27:48.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.085+0000 7fc94ffff640 1 --2- 172.21.15.19:0/3715768526 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc93406a480 0x7fc93406c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:48.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.086+0000 7fc94ffff640 1 --2- 172.21.15.19:0/3715768526 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc93406a480 0x7fc93406c940 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc93c036000 tx=0x7fc93c008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:48.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.093+0000 7fc94d7fa640 1 -- 172.21.15.19:0/3715768526 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc9440535e0 con 0x7fc950133e30 2023-11-04T15:27:48.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.232+0000 7fa8abc23640 1 -- 172.21.15.19:0/998298635 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa8a40a2a40 con 0x7fa8a4137270 2023-11-04T15:27:48.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.232+0000 7fa89a7fc640 1 -- 172.21.15.19:0/998298635 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa8a40a2a40 con 0x7fa8a4137270 2023-11-04T15:27:48.233 INFO:teuthology.orchestra.run.smithi019.stdout:38654705670 2023-11-04T15:27:48.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.235+0000 7fa8abc23640 1 -- 172.21.15.19:0/998298635 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa88806a430 msgr2=0x7fa88806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.235+0000 7fa8abc23640 1 --2- 172.21.15.19:0/998298635 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa88806a430 0x7fa88806c8f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0009b90 tx=0x7fa8a0008040 comp rx=0 tx=0).stop 2023-11-04T15:27:48.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.235+0000 7fa8abc23640 1 -- 172.21.15.19:0/998298635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8a4137270 msgr2=0x7fa8a41cbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.235+0000 7fa8abc23640 1 --2- 172.21.15.19:0/998298635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8a4137270 0x7fa8a41cbb80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa89400c450 tx=0x7fa89400c910 comp rx=0 tx=0).stop 2023-11-04T15:27:48.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.235+0000 7fa8abc23640 1 -- 172.21.15.19:0/998298635 shutdown_connections 2023-11-04T15:27:48.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.235+0000 7fa8abc23640 1 --2- 172.21.15.19:0/998298635 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa88806a430 0x7fa88806c8f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.235+0000 7fa8abc23640 1 --2- 172.21.15.19:0/998298635 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa8a4137650 0x7fa8a41cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.235+0000 7fa8abc23640 1 --2- 172.21.15.19:0/998298635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8a4137270 0x7fa8a41cbb80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.235+0000 7fa8abc23640 1 --2- 172.21.15.19:0/998298635 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8a40a3e90 0x7fa8a409bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.235+0000 7fa8abc23640 1 -- 172.21.15.19:0/998298635 >> 172.21.15.19:0/998298635 conn(0x7fa8a40a8d70 msgr2=0x7fa8a4134100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:48.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.235+0000 7fa8abc23640 1 -- 172.21.15.19:0/998298635 shutdown_connections 2023-11-04T15:27:48.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.235+0000 7fa8abc23640 1 -- 172.21.15.19:0/998298635 wait complete. 2023-11-04T15:27:48.250 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.1 2023-11-04T15:27:48.250 DEBUG:teuthology.parallel:result is None 2023-11-04T15:27:48.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.258+0000 7fdd8e549640 1 -- 172.21.15.19:0/1609857035 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdd8809d300 con 0x7fdd88133f70 2023-11-04T15:27:48.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.258+0000 7fdd84ff9640 1 -- 172.21.15.19:0/1609857035 <== mon.1 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdd7c07c2f0 con 0x7fdd88133f70 2023-11-04T15:27:48.259 INFO:teuthology.orchestra.run.smithi019.stdout:38654705671 2023-11-04T15:27:48.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.260+0000 7fdd8e549640 1 -- 172.21.15.19:0/1609857035 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fdd7406a430 msgr2=0x7fdd7406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.260+0000 7fdd8e549640 1 --2- 172.21.15.19:0/1609857035 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fdd7406a430 0x7fdd7406c8f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdd78000f60 tx=0x7fdd78009040 comp rx=0 tx=0).stop 2023-11-04T15:27:48.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.260+0000 7fdd8e549640 1 -- 172.21.15.19:0/1609857035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd88133f70 msgr2=0x7fdd881cb2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.260+0000 7fdd8e549640 1 --2- 172.21.15.19:0/1609857035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd88133f70 0x7fdd881cb2a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c039040 tx=0x7fdd7c0046c0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.260+0000 7fdd8e549640 1 -- 172.21.15.19:0/1609857035 shutdown_connections 2023-11-04T15:27:48.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.260+0000 7fdd8e549640 1 --2- 172.21.15.19:0/1609857035 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fdd7406a430 0x7fdd7406c8f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.260+0000 7fdd8e549640 1 --2- 172.21.15.19:0/1609857035 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdd88134350 0x7fdd881cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.260+0000 7fdd8e549640 1 --2- 172.21.15.19:0/1609857035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd88133f70 0x7fdd881cb2a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.260+0000 7fdd8e549640 1 --2- 172.21.15.19:0/1609857035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd8809a230 0x7fdd881cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.260+0000 7fdd8e549640 1 -- 172.21.15.19:0/1609857035 >> 172.21.15.19:0/1609857035 conn(0x7fdd880a8920 msgr2=0x7fdd8812e080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:48.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.260+0000 7fdd8e549640 1 -- 172.21.15.19:0/1609857035 shutdown_connections 2023-11-04T15:27:48.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.261+0000 7fdd8e549640 1 -- 172.21.15.19:0/1609857035 wait complete. 2023-11-04T15:27:48.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.269+0000 7ff063349640 1 -- 172.21.15.19:0/3906397292 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff05c137090 con 0x7ff05c1350a0 2023-11-04T15:27:48.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.270+0000 7ff051ffb640 1 -- 172.21.15.19:0/3906397292 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff058017090 con 0x7ff05c1350a0 2023-11-04T15:27:48.271 INFO:teuthology.orchestra.run.smithi019.stdout:38654705672 2023-11-04T15:27:48.272 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.2 2023-11-04T15:27:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.271+0000 7fc956e8f640 1 -- 172.21.15.19:0/3715768526 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc9501366a0 con 0x7fc950133e30 2023-11-04T15:27:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.271+0000 7fc94d7fa640 1 -- 172.21.15.19:0/3715768526 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc944017090 con 0x7fc950133e30 2023-11-04T15:27:48.273 DEBUG:teuthology.parallel:result is None 2023-11-04T15:27:48.274 INFO:teuthology.orchestra.run.smithi019.stdout:38654705671 2023-11-04T15:27:48.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.272+0000 7ff063349640 1 -- 172.21.15.19:0/3906397292 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7ff04006a430 msgr2=0x7ff04006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.272+0000 7ff063349640 1 --2- 172.21.15.19:0/3906397292 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7ff04006a430 0x7ff04006c8f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff04c034000 tx=0x7ff04c008030 comp rx=0 tx=0).stop 2023-11-04T15:27:48.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.272+0000 7ff063349640 1 -- 172.21.15.19:0/3906397292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff05c1350a0 msgr2=0x7ff05c137c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.272+0000 7ff063349640 1 --2- 172.21.15.19:0/3906397292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff05c1350a0 0x7ff05c137c70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff05800c780 tx=0x7ff05800cc40 comp rx=0 tx=0).stop 2023-11-04T15:27:48.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.272+0000 7ff063349640 1 -- 172.21.15.19:0/3906397292 shutdown_connections 2023-11-04T15:27:48.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.272+0000 7ff063349640 1 --2- 172.21.15.19:0/3906397292 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7ff04006a430 0x7ff04006c8f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.272+0000 7ff063349640 1 --2- 172.21.15.19:0/3906397292 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff05c13e100 0x7ff05c1c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.272+0000 7ff063349640 1 --2- 172.21.15.19:0/3906397292 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff05c135480 0x7ff05c1c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.272+0000 7ff063349640 1 --2- 172.21.15.19:0/3906397292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff05c1350a0 0x7ff05c137c70 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.272+0000 7ff063349640 1 -- 172.21.15.19:0/3906397292 >> 172.21.15.19:0/3906397292 conn(0x7ff05c0a6b70 msgr2=0x7ff05c130890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:48.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.272+0000 7ff063349640 1 -- 172.21.15.19:0/3906397292 shutdown_connections 2023-11-04T15:27:48.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.272+0000 7ff063349640 1 -- 172.21.15.19:0/3906397292 wait complete. 2023-11-04T15:27:48.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.273+0000 7fc956e8f640 1 -- 172.21.15.19:0/3715768526 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc93406a480 msgr2=0x7fc93406c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.273+0000 7fc956e8f640 1 --2- 172.21.15.19:0/3715768526 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc93406a480 0x7fc93406c940 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc93c036000 tx=0x7fc93c008030 comp rx=0 tx=0).stop 2023-11-04T15:27:48.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.273+0000 7fc956e8f640 1 -- 172.21.15.19:0/3715768526 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc950133e30 msgr2=0x7fc9501cee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.273+0000 7fc956e8f640 1 --2- 172.21.15.19:0/3715768526 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc950133e30 0x7fc9501cee60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc94400c530 tx=0x7fc94400c9f0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.273+0000 7fc956e8f640 1 -- 172.21.15.19:0/3715768526 shutdown_connections 2023-11-04T15:27:48.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.273+0000 7fc956e8f640 1 --2- 172.21.15.19:0/3715768526 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc93406a480 0x7fc93406c940 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.273+0000 7fc956e8f640 1 --2- 172.21.15.19:0/3715768526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc950140420 0x7fc9501cf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.273+0000 7fc956e8f640 1 --2- 172.21.15.19:0/3715768526 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc950134210 0x7fc9501cf3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.273+0000 7fc956e8f640 1 --2- 172.21.15.19:0/3715768526 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc950133e30 0x7fc9501cee60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.273+0000 7fc956e8f640 1 -- 172.21.15.19:0/3715768526 >> 172.21.15.19:0/3715768526 conn(0x7fc9500a5af0 msgr2=0x7fc950133070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:48.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.273+0000 7fc956e8f640 1 -- 172.21.15.19:0/3715768526 shutdown_connections 2023-11-04T15:27:48.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.273+0000 7fc956e8f640 1 -- 172.21.15.19:0/3715768526 wait complete. 2023-11-04T15:27:48.284 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.3 2023-11-04T15:27:48.285 DEBUG:teuthology.parallel:result is None 2023-11-04T15:27:48.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.0 2023-11-04T15:27:48.286 DEBUG:teuthology.parallel:result is None 2023-11-04T15:27:48.286 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-04T15:27:48.286 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T15:27:48.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.429+0000 7f3456c10640 1 Processor -- start 2023-11-04T15:27:48.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.429+0000 7f3456c10640 1 -- start start 2023-11-04T15:27:48.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.430+0000 7f3456c10640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3450136fe0 0x7f34501373c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:48.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.430+0000 7f3456c10640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f34500a65e0 0x7f345013a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:48.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.430+0000 7f3456c10640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34500a6d70 con 0x7f345013a540 2023-11-04T15:27:48.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.430+0000 7f3456c10640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34500a35f0 con 0x7f34500a65e0 2023-11-04T15:27:48.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.430+0000 7f3456c10640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34500a4c30 con 0x7f3450136fe0 2023-11-04T15:27:48.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.430+0000 7f3447fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f34500a65e0 0x7f345013a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:48.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.430+0000 7f3447fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f34500a65e0 0x7f345013a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53840/0 (socket says 172.21.15.19:53840) 2023-11-04T15:27:48.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.430+0000 7f3447fff640 1 -- 172.21.15.19:0/2632784497 learned_addr learned my addr 172.21.15.19:0/2632784497 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:48.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.430+0000 7f34549ac640 1 --2- 172.21.15.19:0/2632784497 >> v2:172.21.15.96:3300/0 conn(0x7f3450136fe0 0x7f34501373c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:48.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.430+0000 7f3447fff640 1 -- 172.21.15.19:0/2632784497 >> v2:172.21.15.96:3300/0 conn(0x7f3450136fe0 msgr2=0x7f34501373c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:48.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.430+0000 7f3447fff640 1 --2- 172.21.15.19:0/2632784497 >> v2:172.21.15.96:3300/0 conn(0x7f3450136fe0 0x7f34501373c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.430+0000 7f3447fff640 1 -- 172.21.15.19:0/2632784497 >> v1:172.21.15.96:6789/0 conn(0x7f345013a540 legacy=0x7f3450141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.430+0000 7f3447fff640 1 -- 172.21.15.19:0/2632784497 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34500a63c0 con 0x7f34500a65e0 2023-11-04T15:27:48.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.431+0000 7f3447fff640 1 --2- 172.21.15.19:0/2632784497 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34500a65e0 0x7f345013a000 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f34500a6a30 tx=0x7f344002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15ee8d2a6931e5ef server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:48.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.431+0000 7f34477fe640 1 -- 172.21.15.19:0/2632784497 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34400317e0 con 0x7f34500a65e0 2023-11-04T15:27:48.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.431+0000 7f34477fe640 1 -- 172.21.15.19:0/2632784497 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3440031940 con 0x7f34500a65e0 2023-11-04T15:27:48.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.431+0000 7f34477fe640 1 -- 172.21.15.19:0/2632784497 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3440031cd0 con 0x7f34500a65e0 2023-11-04T15:27:48.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.431+0000 7f3456c10640 1 -- 172.21.15.19:0/2632784497 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34500a65e0 msgr2=0x7f345013a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.431+0000 7f3456c10640 1 --2- 172.21.15.19:0/2632784497 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34500a65e0 0x7f345013a000 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f34500a6a30 tx=0x7f344002b880 comp rx=0 tx=0).stop 2023-11-04T15:27:48.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.431+0000 7f3456c10640 1 -- 172.21.15.19:0/2632784497 shutdown_connections 2023-11-04T15:27:48.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.431+0000 7f3456c10640 1 --2- 172.21.15.19:0/2632784497 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34500a65e0 0x7f345013a000 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.431+0000 7f3456c10640 1 --2- 172.21.15.19:0/2632784497 >> v2:172.21.15.96:3300/0 conn(0x7f3450136fe0 0x7f34501373c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.431+0000 7f3456c10640 1 -- 172.21.15.19:0/2632784497 >> 172.21.15.19:0/2632784497 conn(0x7f34500ac370 msgr2=0x7f34500ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:48.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.432+0000 7f3456c10640 1 -- 172.21.15.19:0/2632784497 shutdown_connections 2023-11-04T15:27:48.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.432+0000 7f3456c10640 1 -- 172.21.15.19:0/2632784497 wait complete. 2023-11-04T15:27:48.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.432+0000 7f3456c10640 1 Processor -- start 2023-11-04T15:27:48.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.432+0000 7f3456c10640 1 -- start start 2023-11-04T15:27:48.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.433+0000 7f3456c10640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34500a65e0 0x7f3450099820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.433+0000 7f3456c10640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3450136fe0 0x7f3450132e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.433+0000 7f3456c10640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f345013a540 0x7f3450133350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.433+0000 7f3456c10640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3450137c80 con 0x7f34500a65e0 2023-11-04T15:27:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.433+0000 7f3456c10640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34500a28c0 con 0x7f345013a540 2023-11-04T15:27:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.433+0000 7f3456c10640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3450098c20 con 0x7f3450136fe0 2023-11-04T15:27:48.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.433+0000 7f34549ac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34500a65e0 0x7f3450099820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:48.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.433+0000 7f34549ac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34500a65e0 0x7f3450099820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53854/0 (socket says 172.21.15.19:53854) 2023-11-04T15:27:48.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.433+0000 7f34549ac640 1 -- 172.21.15.19:0/220639022 learned_addr learned my addr 172.21.15.19:0/220639022 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:48.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.433+0000 7f34549ac640 1 -- 172.21.15.19:0/220639022 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3450136fe0 msgr2=0x7f3450132e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.433+0000 7f34549ac640 1 --2- 172.21.15.19:0/220639022 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3450136fe0 0x7f3450132e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.433+0000 7f34549ac640 1 -- 172.21.15.19:0/220639022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f345013a540 msgr2=0x7f3450133350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.433+0000 7f34549ac640 1 --2- 172.21.15.19:0/220639022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f345013a540 0x7f3450133350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.433+0000 7f34549ac640 1 -- 172.21.15.19:0/220639022 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34400094d0 con 0x7f34500a65e0 2023-11-04T15:27:48.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.434+0000 7f34549ac640 1 --2- 172.21.15.19:0/220639022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34500a65e0 0x7f3450099820 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f344c00e9b0 tx=0x7f344c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:48.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.434+0000 7f34457fa640 1 -- 172.21.15.19:0/220639022 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c00c9a0 con 0x7f34500a65e0 2023-11-04T15:27:48.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.434+0000 7f34457fa640 1 -- 172.21.15.19:0/220639022 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344c00cb00 con 0x7f34500a65e0 2023-11-04T15:27:48.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.434+0000 7f34457fa640 1 -- 172.21.15.19:0/220639022 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c013470 con 0x7f34500a65e0 2023-11-04T15:27:48.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.434+0000 7f3456c10640 1 -- 172.21.15.19:0/220639022 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f345009ac20 con 0x7f34500a65e0 2023-11-04T15:27:48.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.434+0000 7f3456c10640 1 -- 172.21.15.19:0/220639022 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f345009bda0 con 0x7f34500a65e0 2023-11-04T15:27:48.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.435+0000 7f3456c10640 1 -- 172.21.15.19:0/220639022 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f345009b030 con 0x7f34500a65e0 2023-11-04T15:27:48.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.435+0000 7f34457fa640 1 -- 172.21.15.19:0/220639022 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f344c0135d0 con 0x7f34500a65e0 2023-11-04T15:27:48.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.436+0000 7f34457fa640 1 --2- 172.21.15.19:0/220639022 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f343c06a430 0x7f343c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:48.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.436+0000 7f34457fa640 1 -- 172.21.15.19:0/220639022 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f344c088600 con 0x7f34500a65e0 2023-11-04T15:27:48.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.436+0000 7f3447fff640 1 --2- 172.21.15.19:0/220639022 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f343c06a430 0x7f343c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:48.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.436+0000 7f3447fff640 1 --2- 172.21.15.19:0/220639022 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f343c06a430 0x7f343c06c8f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3440036000 tx=0x7f3440030000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:48.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.440+0000 7f34457fa640 1 -- 172.21.15.19:0/220639022 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f344c054140 con 0x7f34500a65e0 2023-11-04T15:27:48.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.614+0000 7f3456c10640 1 -- 172.21.15.19:0/220639022 --> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f34500a5240 con 0x7f343c06a430 2023-11-04T15:27:48.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.621+0000 7f34457fa640 1 -- 172.21.15.19:0/220639022 <== mgr.4114 v2:172.21.15.96:6816/83123 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271312 (secure 0 0 0) 0x7f3440031b30 con 0x7f343c06a430 2023-11-04T15:27:48.625 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:27:48.626 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-11-04T15:27:48.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.624+0000 7f3456c10640 1 -- 172.21.15.19:0/220639022 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f343c06a430 msgr2=0x7f343c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.624+0000 7f3456c10640 1 --2- 172.21.15.19:0/220639022 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f343c06a430 0x7f343c06c8f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3440036000 tx=0x7f3440030000 comp rx=0 tx=0).stop 2023-11-04T15:27:48.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.624+0000 7f3456c10640 1 -- 172.21.15.19:0/220639022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34500a65e0 msgr2=0x7f3450099820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.624+0000 7f3456c10640 1 --2- 172.21.15.19:0/220639022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34500a65e0 0x7f3450099820 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f344c00e9b0 tx=0x7f344c00ee70 comp rx=0 tx=0).stop 2023-11-04T15:27:48.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.624+0000 7f3456c10640 1 -- 172.21.15.19:0/220639022 shutdown_connections 2023-11-04T15:27:48.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.624+0000 7f3456c10640 1 --2- 172.21.15.19:0/220639022 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f343c06a430 0x7f343c06c8f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.624+0000 7f3456c10640 1 --2- 172.21.15.19:0/220639022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f345013a540 0x7f3450133350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.624+0000 7f3456c10640 1 --2- 172.21.15.19:0/220639022 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3450136fe0 0x7f3450132e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.624+0000 7f3456c10640 1 --2- 172.21.15.19:0/220639022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34500a65e0 0x7f3450099820 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.624+0000 7f3456c10640 1 -- 172.21.15.19:0/220639022 >> 172.21.15.19:0/220639022 conn(0x7f34500ac370 msgr2=0x7f34500aa4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:48.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.624+0000 7f3456c10640 1 -- 172.21.15.19:0/220639022 shutdown_connections 2023-11-04T15:27:48.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.624+0000 7f3456c10640 1 -- 172.21.15.19:0/220639022 wait complete. 2023-11-04T15:27:48.636 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-11-04T15:27:46.936777+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109720,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":107776,"kb_avail":377377640,"statfs":{"total":386547056640,"available":386434703360,"internally_reserved":0,"allocated":1957888,"data_stored":1427848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110362624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002280"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199676+0000","last_change":"2023-11-04T15:27:36.150532+0000","last_active":"2023-11-04T15:27:38.199676+0000","last_peered":"2023-11-04T15:27:38.199676+0000","last_clean":"2023-11-04T15:27:38.199676+0000","last_became_active":"2023-11-04T15:27:36.150296+0000","last_became_peered":"2023-11-04T15:27:36.150296+0000","last_unstale":"2023-11-04T15:27:38.199676+0000","last_undegraded":"2023-11-04T15:27:38.199676+0000","last_fullsized":"2023-11-04T15:27:38.199676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:41:32.995261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.139353+0000","last_change":"2023-11-04T15:27:36.149233+0000","last_active":"2023-11-04T15:27:37.139353+0000","last_peered":"2023-11-04T15:27:37.139353+0000","last_clean":"2023-11-04T15:27:37.139353+0000","last_became_active":"2023-11-04T15:27:36.148939+0000","last_became_peered":"2023-11-04T15:27:36.148939+0000","last_unstale":"2023-11-04T15:27:37.139353+0000","last_undegraded":"2023-11-04T15:27:37.139353+0000","last_fullsized":"2023-11-04T15:27:37.139353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:52:55.975636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138201+0000","last_change":"2023-11-04T15:27:36.149978+0000","last_active":"2023-11-04T15:27:37.138201+0000","last_peered":"2023-11-04T15:27:37.138201+0000","last_clean":"2023-11-04T15:27:37.138201+0000","last_became_active":"2023-11-04T15:27:36.149748+0000","last_became_peered":"2023-11-04T15:27:36.149748+0000","last_unstale":"2023-11-04T15:27:37.138201+0000","last_undegraded":"2023-11-04T15:27:37.138201+0000","last_fullsized":"2023-11-04T15:27:37.138201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:49:04.091063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.139643+0000","last_change":"2023-11-04T15:27:36.140158+0000","last_active":"2023-11-04T15:27:37.139643+0000","last_peered":"2023-11-04T15:27:37.139643+0000","last_clean":"2023-11-04T15:27:37.139643+0000","last_became_active":"2023-11-04T15:27:36.139761+0000","last_became_peered":"2023-11-04T15:27:36.139761+0000","last_unstale":"2023-11-04T15:27:37.139643+0000","last_undegraded":"2023-11-04T15:27:37.139643+0000","last_fullsized":"2023-11-04T15:27:37.139643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:38:30.379384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199913+0000","last_change":"2023-11-04T15:27:36.150520+0000","last_active":"2023-11-04T15:27:38.199913+0000","last_peered":"2023-11-04T15:27:38.199913+0000","last_clean":"2023-11-04T15:27:38.199913+0000","last_became_active":"2023-11-04T15:27:36.150017+0000","last_became_peered":"2023-11-04T15:27:36.150017+0000","last_unstale":"2023-11-04T15:27:38.199913+0000","last_undegraded":"2023-11-04T15:27:38.199913+0000","last_fullsized":"2023-11-04T15:27:38.199913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:47:40.350777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.137815+0000","last_change":"2023-11-04T15:27:36.139858+0000","last_active":"2023-11-04T15:27:37.137815+0000","last_peered":"2023-11-04T15:27:37.137815+0000","last_clean":"2023-11-04T15:27:37.137815+0000","last_became_active":"2023-11-04T15:27:36.139036+0000","last_became_peered":"2023-11-04T15:27:36.139036+0000","last_unstale":"2023-11-04T15:27:37.137815+0000","last_undegraded":"2023-11-04T15:27:37.137815+0000","last_fullsized":"2023-11-04T15:27:37.137815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:05:44.093984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.137514+0000","last_change":"2023-11-04T15:27:36.140003+0000","last_active":"2023-11-04T15:27:37.137514+0000","last_peered":"2023-11-04T15:27:37.137514+0000","last_clean":"2023-11-04T15:27:37.137514+0000","last_became_active":"2023-11-04T15:27:36.139121+0000","last_became_peered":"2023-11-04T15:27:36.139121+0000","last_unstale":"2023-11-04T15:27:37.137514+0000","last_undegraded":"2023-11-04T15:27:37.137514+0000","last_fullsized":"2023-11-04T15:27:37.137514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:57:05.896392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.137457+0000","last_change":"2023-11-04T15:27:36.148199+0000","last_active":"2023-11-04T15:27:37.137457+0000","last_peered":"2023-11-04T15:27:37.137457+0000","last_clean":"2023-11-04T15:27:37.137457+0000","last_became_active":"2023-11-04T15:27:36.147050+0000","last_became_peered":"2023-11-04T15:27:36.147050+0000","last_unstale":"2023-11-04T15:27:37.137457+0000","last_undegraded":"2023-11-04T15:27:37.137457+0000","last_fullsized":"2023-11-04T15:27:37.137457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:40:36.811342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199451+0000","last_change":"2023-11-04T15:27:36.146562+0000","last_active":"2023-11-04T15:27:38.199451+0000","last_peered":"2023-11-04T15:27:38.199451+0000","last_clean":"2023-11-04T15:27:38.199451+0000","last_became_active":"2023-11-04T15:27:36.145825+0000","last_became_peered":"2023-11-04T15:27:36.145825+0000","last_unstale":"2023-11-04T15:27:38.199451+0000","last_undegraded":"2023-11-04T15:27:38.199451+0000","last_fullsized":"2023-11-04T15:27:38.199451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:52:55.975636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138448+0000","last_change":"2023-11-04T15:27:36.150567+0000","last_active":"2023-11-04T15:27:37.138448+0000","last_peered":"2023-11-04T15:27:37.138448+0000","last_clean":"2023-11-04T15:27:37.138448+0000","last_became_active":"2023-11-04T15:27:36.150307+0000","last_became_peered":"2023-11-04T15:27:36.150307+0000","last_unstale":"2023-11-04T15:27:37.138448+0000","last_undegraded":"2023-11-04T15:27:37.138448+0000","last_fullsized":"2023-11-04T15:27:37.138448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:38:23.440792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.139590+0000","last_change":"2023-11-04T15:27:36.145307+0000","last_active":"2023-11-04T15:27:37.139590+0000","last_peered":"2023-11-04T15:27:37.139590+0000","last_clean":"2023-11-04T15:27:37.139590+0000","last_became_active":"2023-11-04T15:27:36.144988+0000","last_became_peered":"2023-11-04T15:27:36.144988+0000","last_unstale":"2023-11-04T15:27:37.139590+0000","last_undegraded":"2023-11-04T15:27:37.139590+0000","last_fullsized":"2023-11-04T15:27:37.139590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:41.544754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.131453+0000","last_change":"2023-11-04T15:27:36.149560+0000","last_active":"2023-11-04T15:27:37.131453+0000","last_peered":"2023-11-04T15:27:37.131453+0000","last_clean":"2023-11-04T15:27:37.131453+0000","last_became_active":"2023-11-04T15:27:36.149156+0000","last_became_peered":"2023-11-04T15:27:36.149156+0000","last_unstale":"2023-11-04T15:27:37.131453+0000","last_undegraded":"2023-11-04T15:27:37.131453+0000","last_fullsized":"2023-11-04T15:27:37.131453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:22:17.580120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199582+0000","last_change":"2023-11-04T15:27:36.140079+0000","last_active":"2023-11-04T15:27:38.199582+0000","last_peered":"2023-11-04T15:27:38.199582+0000","last_clean":"2023-11-04T15:27:38.199582+0000","last_became_active":"2023-11-04T15:27:36.139824+0000","last_became_peered":"2023-11-04T15:27:36.139824+0000","last_unstale":"2023-11-04T15:27:38.199582+0000","last_undegraded":"2023-11-04T15:27:38.199582+0000","last_fullsized":"2023-11-04T15:27:38.199582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:28.095802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.139484+0000","last_change":"2023-11-04T15:27:36.147533+0000","last_active":"2023-11-04T15:27:37.139484+0000","last_peered":"2023-11-04T15:27:37.139484+0000","last_clean":"2023-11-04T15:27:37.139484+0000","last_became_active":"2023-11-04T15:27:36.147273+0000","last_became_peered":"2023-11-04T15:27:36.147273+0000","last_unstale":"2023-11-04T15:27:37.139484+0000","last_undegraded":"2023-11-04T15:27:37.139484+0000","last_fullsized":"2023-11-04T15:27:37.139484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:22:17.580120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.139612+0000","last_change":"2023-11-04T15:27:36.149641+0000","last_active":"2023-11-04T15:27:37.139612+0000","last_peered":"2023-11-04T15:27:37.139612+0000","last_clean":"2023-11-04T15:27:37.139612+0000","last_became_active":"2023-11-04T15:27:36.148932+0000","last_became_peered":"2023-11-04T15:27:36.148932+0000","last_unstale":"2023-11-04T15:27:37.139612+0000","last_undegraded":"2023-11-04T15:27:37.139612+0000","last_fullsized":"2023-11-04T15:27:37.139612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:12:07.727740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.137533+0000","last_change":"2023-11-04T15:27:36.151936+0000","last_active":"2023-11-04T15:27:37.137533+0000","last_peered":"2023-11-04T15:27:37.137533+0000","last_clean":"2023-11-04T15:27:37.137533+0000","last_became_active":"2023-11-04T15:27:36.150856+0000","last_became_peered":"2023-11-04T15:27:36.150856+0000","last_unstale":"2023-11-04T15:27:37.137533+0000","last_undegraded":"2023-11-04T15:27:37.137533+0000","last_fullsized":"2023-11-04T15:27:37.137533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:51:31.442634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199500+0000","last_change":"2023-11-04T15:27:36.145257+0000","last_active":"2023-11-04T15:27:38.199500+0000","last_peered":"2023-11-04T15:27:38.199500+0000","last_clean":"2023-11-04T15:27:38.199500+0000","last_became_active":"2023-11-04T15:27:36.144997+0000","last_became_peered":"2023-11-04T15:27:36.144997+0000","last_unstale":"2023-11-04T15:27:38.199500+0000","last_undegraded":"2023-11-04T15:27:38.199500+0000","last_fullsized":"2023-11-04T15:27:38.199500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:22:17.580120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138606+0000","last_change":"2023-11-04T15:27:36.150820+0000","last_active":"2023-11-04T15:27:37.138606+0000","last_peered":"2023-11-04T15:27:37.138606+0000","last_clean":"2023-11-04T15:27:37.138606+0000","last_became_active":"2023-11-04T15:27:36.150555+0000","last_became_peered":"2023-11-04T15:27:36.150555+0000","last_unstale":"2023-11-04T15:27:37.138606+0000","last_undegraded":"2023-11-04T15:27:37.138606+0000","last_fullsized":"2023-11-04T15:27:37.138606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:32:27.370984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199406+0000","last_change":"2023-11-04T15:27:36.148306+0000","last_active":"2023-11-04T15:27:38.199406+0000","last_peered":"2023-11-04T15:27:38.199406+0000","last_clean":"2023-11-04T15:27:38.199406+0000","last_became_active":"2023-11-04T15:27:36.147745+0000","last_became_peered":"2023-11-04T15:27:36.147745+0000","last_unstale":"2023-11-04T15:27:38.199406+0000","last_undegraded":"2023-11-04T15:27:38.199406+0000","last_fullsized":"2023-11-04T15:27:38.199406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:41:10.315016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138359+0000","last_change":"2023-11-04T15:27:36.151647+0000","last_active":"2023-11-04T15:27:37.138359+0000","last_peered":"2023-11-04T15:27:37.138359+0000","last_clean":"2023-11-04T15:27:37.138359+0000","last_became_active":"2023-11-04T15:27:36.150687+0000","last_became_peered":"2023-11-04T15:27:36.150687+0000","last_unstale":"2023-11-04T15:27:37.138359+0000","last_undegraded":"2023-11-04T15:27:37.138359+0000","last_fullsized":"2023-11-04T15:27:37.138359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:56:24.790444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.139334+0000","last_change":"2023-11-04T15:27:36.144207+0000","last_active":"2023-11-04T15:27:37.139334+0000","last_peered":"2023-11-04T15:27:37.139334+0000","last_clean":"2023-11-04T15:27:37.139334+0000","last_became_active":"2023-11-04T15:27:36.143551+0000","last_became_peered":"2023-11-04T15:27:36.143551+0000","last_unstale":"2023-11-04T15:27:37.139334+0000","last_undegraded":"2023-11-04T15:27:37.139334+0000","last_fullsized":"2023-11-04T15:27:37.139334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:36:21.960547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199072+0000","last_change":"2023-11-04T15:27:36.146251+0000","last_active":"2023-11-04T15:27:38.199072+0000","last_peered":"2023-11-04T15:27:38.199072+0000","last_clean":"2023-11-04T15:27:38.199072+0000","last_became_active":"2023-11-04T15:27:36.145943+0000","last_became_peered":"2023-11-04T15:27:36.145943+0000","last_unstale":"2023-11-04T15:27:38.199072+0000","last_undegraded":"2023-11-04T15:27:38.199072+0000","last_fullsized":"2023-11-04T15:27:38.199072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:48:58.102459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.130771+0000","last_change":"2023-11-04T15:27:36.146784+0000","last_active":"2023-11-04T15:27:37.130771+0000","last_peered":"2023-11-04T15:27:37.130771+0000","last_clean":"2023-11-04T15:27:37.130771+0000","last_became_active":"2023-11-04T15:27:36.144083+0000","last_became_peered":"2023-11-04T15:27:36.144083+0000","last_unstale":"2023-11-04T15:27:37.130771+0000","last_undegraded":"2023-11-04T15:27:37.130771+0000","last_fullsized":"2023-11-04T15:27:37.130771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:32:27.370984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.137581+0000","last_change":"2023-11-04T15:27:36.147265+0000","last_active":"2023-11-04T15:27:37.137581+0000","last_peered":"2023-11-04T15:27:37.137581+0000","last_clean":"2023-11-04T15:27:37.137581+0000","last_became_active":"2023-11-04T15:27:36.146546+0000","last_became_peered":"2023-11-04T15:27:36.146546+0000","last_unstale":"2023-11-04T15:27:37.137581+0000","last_undegraded":"2023-11-04T15:27:37.137581+0000","last_fullsized":"2023-11-04T15:27:37.137581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:41:10.315016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.131630+0000","last_change":"2023-11-04T15:27:36.144341+0000","last_active":"2023-11-04T15:27:37.131630+0000","last_peered":"2023-11-04T15:27:37.131630+0000","last_clean":"2023-11-04T15:27:37.131630+0000","last_became_active":"2023-11-04T15:27:36.144047+0000","last_became_peered":"2023-11-04T15:27:36.144047+0000","last_unstale":"2023-11-04T15:27:37.131630+0000","last_undegraded":"2023-11-04T15:27:37.131630+0000","last_fullsized":"2023-11-04T15:27:37.131630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:36:21.960547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.131685+0000","last_change":"2023-11-04T15:27:36.146439+0000","last_active":"2023-11-04T15:27:37.131685+0000","last_peered":"2023-11-04T15:27:37.131685+0000","last_clean":"2023-11-04T15:27:37.131685+0000","last_became_active":"2023-11-04T15:27:36.144458+0000","last_became_peered":"2023-11-04T15:27:36.144458+0000","last_unstale":"2023-11-04T15:27:37.131685+0000","last_undegraded":"2023-11-04T15:27:37.131685+0000","last_fullsized":"2023-11-04T15:27:37.131685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:52:55.975636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138690+0000","last_change":"2023-11-04T15:27:36.151339+0000","last_active":"2023-11-04T15:27:37.138690+0000","last_peered":"2023-11-04T15:27:37.138690+0000","last_clean":"2023-11-04T15:27:37.138690+0000","last_became_active":"2023-11-04T15:27:36.150270+0000","last_became_peered":"2023-11-04T15:27:36.150270+0000","last_unstale":"2023-11-04T15:27:37.138690+0000","last_undegraded":"2023-11-04T15:27:37.138690+0000","last_fullsized":"2023-11-04T15:27:37.138690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:18:00.808576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.131656+0000","last_change":"2023-11-04T15:27:36.149388+0000","last_active":"2023-11-04T15:27:37.131656+0000","last_peered":"2023-11-04T15:27:37.131656+0000","last_clean":"2023-11-04T15:27:37.131656+0000","last_became_active":"2023-11-04T15:27:36.148825+0000","last_became_peered":"2023-11-04T15:27:36.148825+0000","last_unstale":"2023-11-04T15:27:37.131656+0000","last_undegraded":"2023-11-04T15:27:37.131656+0000","last_fullsized":"2023-11-04T15:27:37.131656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:27:25.258046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199860+0000","last_change":"2023-11-04T15:27:36.145651+0000","last_active":"2023-11-04T15:27:38.199860+0000","last_peered":"2023-11-04T15:27:38.199860+0000","last_clean":"2023-11-04T15:27:38.199860+0000","last_became_active":"2023-11-04T15:27:36.145392+0000","last_became_peered":"2023-11-04T15:27:36.145392+0000","last_unstale":"2023-11-04T15:27:38.199860+0000","last_undegraded":"2023-11-04T15:27:38.199860+0000","last_fullsized":"2023-11-04T15:27:38.199860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:12:07.727740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.137860+0000","last_change":"2023-11-04T15:27:36.145527+0000","last_active":"2023-11-04T15:27:37.137860+0000","last_peered":"2023-11-04T15:27:37.137860+0000","last_clean":"2023-11-04T15:27:37.137860+0000","last_became_active":"2023-11-04T15:27:36.145273+0000","last_became_peered":"2023-11-04T15:27:36.145273+0000","last_unstale":"2023-11-04T15:27:37.137860+0000","last_undegraded":"2023-11-04T15:27:37.137860+0000","last_fullsized":"2023-11-04T15:27:37.137860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:27:25.258046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.130831+0000","last_change":"2023-11-04T15:27:36.146680+0000","last_active":"2023-11-04T15:27:37.130831+0000","last_peered":"2023-11-04T15:27:37.130831+0000","last_clean":"2023-11-04T15:27:37.130831+0000","last_became_active":"2023-11-04T15:27:36.144053+0000","last_became_peered":"2023-11-04T15:27:36.144053+0000","last_unstale":"2023-11-04T15:27:37.130831+0000","last_undegraded":"2023-11-04T15:27:37.130831+0000","last_fullsized":"2023-11-04T15:27:37.130831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:41:10.315016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138844+0000","last_change":"2023-11-04T15:27:36.148707+0000","last_active":"2023-11-04T15:27:37.138844+0000","last_peered":"2023-11-04T15:27:37.138844+0000","last_clean":"2023-11-04T15:27:37.138844+0000","last_became_active":"2023-11-04T15:27:36.148342+0000","last_became_peered":"2023-11-04T15:27:36.148342+0000","last_unstale":"2023-11-04T15:27:37.138844+0000","last_undegraded":"2023-11-04T15:27:37.138844+0000","last_fullsized":"2023-11-04T15:27:37.138844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:47:40.350777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.131523+0000","last_change":"2023-11-04T15:27:36.149431+0000","last_active":"2023-11-04T15:27:37.131523+0000","last_peered":"2023-11-04T15:27:37.131523+0000","last_clean":"2023-11-04T15:27:37.131523+0000","last_became_active":"2023-11-04T15:27:36.148951+0000","last_became_peered":"2023-11-04T15:27:36.148951+0000","last_unstale":"2023-11-04T15:27:37.131523+0000","last_undegraded":"2023-11-04T15:27:37.131523+0000","last_fullsized":"2023-11-04T15:27:37.131523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:58:32.190696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.149532+0000","last_change":"2023-11-04T15:27:35.775931+0000","last_active":"2023-11-04T15:27:36.149532+0000","last_peered":"2023-11-04T15:27:36.149532+0000","last_clean":"2023-11-04T15:27:36.149532+0000","last_became_active":"2023-11-04T15:27:35.775616+0000","last_became_peered":"2023-11-04T15:27:35.775616+0000","last_unstale":"2023-11-04T15:27:36.149532+0000","last_undegraded":"2023-11-04T15:27:36.149532+0000","last_fullsized":"2023-11-04T15:27:36.149532+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:14:34.175377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138328+0000","last_change":"2023-11-04T15:27:36.150592+0000","last_active":"2023-11-04T15:27:37.138328+0000","last_peered":"2023-11-04T15:27:37.138328+0000","last_clean":"2023-11-04T15:27:37.138328+0000","last_became_active":"2023-11-04T15:27:36.150276+0000","last_became_peered":"2023-11-04T15:27:36.150276+0000","last_unstale":"2023-11-04T15:27:37.138328+0000","last_undegraded":"2023-11-04T15:27:37.138328+0000","last_fullsized":"2023-11-04T15:27:37.138328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T22:54:18.576814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.129297+0000","last_change":"2023-11-04T15:27:35.776610+0000","last_active":"2023-11-04T15:27:36.129297+0000","last_peered":"2023-11-04T15:27:36.129297+0000","last_clean":"2023-11-04T15:27:36.129297+0000","last_became_active":"2023-11-04T15:27:35.776297+0000","last_became_peered":"2023-11-04T15:27:35.776297+0000","last_unstale":"2023-11-04T15:27:36.129297+0000","last_undegraded":"2023-11-04T15:27:36.129297+0000","last_fullsized":"2023-11-04T15:27:36.129297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:11:01.495068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199760+0000","last_change":"2023-11-04T15:27:36.139847+0000","last_active":"2023-11-04T15:27:38.199760+0000","last_peered":"2023-11-04T15:27:38.199760+0000","last_clean":"2023-11-04T15:27:38.199760+0000","last_became_active":"2023-11-04T15:27:36.139580+0000","last_became_peered":"2023-11-04T15:27:36.139580+0000","last_unstale":"2023-11-04T15:27:38.199760+0000","last_undegraded":"2023-11-04T15:27:38.199760+0000","last_fullsized":"2023-11-04T15:27:38.199760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:38:30.379384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.132950+0000","last_change":"2023-11-04T15:27:35.775977+0000","last_active":"2023-11-04T15:27:36.132950+0000","last_peered":"2023-11-04T15:27:36.132950+0000","last_clean":"2023-11-04T15:27:36.132950+0000","last_became_active":"2023-11-04T15:27:35.775486+0000","last_became_peered":"2023-11-04T15:27:35.775486+0000","last_unstale":"2023-11-04T15:27:36.132950+0000","last_undegraded":"2023-11-04T15:27:36.132950+0000","last_fullsized":"2023-11-04T15:27:36.132950+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:44:09.266115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199570+0000","last_change":"2023-11-04T15:27:36.140633+0000","last_active":"2023-11-04T15:27:38.199570+0000","last_peered":"2023-11-04T15:27:38.199570+0000","last_clean":"2023-11-04T15:27:38.199570+0000","last_became_active":"2023-11-04T15:27:36.139789+0000","last_became_peered":"2023-11-04T15:27:36.139789+0000","last_unstale":"2023-11-04T15:27:38.199570+0000","last_undegraded":"2023-11-04T15:27:38.199570+0000","last_fullsized":"2023-11-04T15:27:38.199570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:55:13.470788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.153862+0000","last_change":"2023-11-04T15:27:35.776168+0000","last_active":"2023-11-04T15:27:36.153862+0000","last_peered":"2023-11-04T15:27:36.153862+0000","last_clean":"2023-11-04T15:27:36.153862+0000","last_became_active":"2023-11-04T15:27:35.775895+0000","last_became_peered":"2023-11-04T15:27:35.775895+0000","last_unstale":"2023-11-04T15:27:36.153862+0000","last_undegraded":"2023-11-04T15:27:36.153862+0000","last_fullsized":"2023-11-04T15:27:36.153862+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:02:27.460776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.143449+0000","last_change":"2023-11-04T15:27:35.767890+0000","last_active":"2023-11-04T15:27:36.143449+0000","last_peered":"2023-11-04T15:27:36.143449+0000","last_clean":"2023-11-04T15:27:36.143449+0000","last_became_active":"2023-11-04T15:27:35.767594+0000","last_became_peered":"2023-11-04T15:27:35.767594+0000","last_unstale":"2023-11-04T15:27:36.143449+0000","last_undegraded":"2023-11-04T15:27:36.143449+0000","last_fullsized":"2023-11-04T15:27:36.143449+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:11:01.495068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138172+0000","last_change":"2023-11-04T15:27:36.148637+0000","last_active":"2023-11-04T15:27:37.138172+0000","last_peered":"2023-11-04T15:27:37.138172+0000","last_clean":"2023-11-04T15:27:37.138172+0000","last_became_active":"2023-11-04T15:27:36.148282+0000","last_became_peered":"2023-11-04T15:27:36.148282+0000","last_unstale":"2023-11-04T15:27:37.138172+0000","last_undegraded":"2023-11-04T15:27:37.138172+0000","last_fullsized":"2023-11-04T15:27:37.138172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:28:21.024990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.148423+0000","last_change":"2023-11-04T15:27:35.771839+0000","last_active":"2023-11-04T15:27:36.148423+0000","last_peered":"2023-11-04T15:27:36.148423+0000","last_clean":"2023-11-04T15:27:36.148423+0000","last_became_active":"2023-11-04T15:27:35.771554+0000","last_became_peered":"2023-11-04T15:27:35.771554+0000","last_unstale":"2023-11-04T15:27:36.148423+0000","last_undegraded":"2023-11-04T15:27:36.148423+0000","last_fullsized":"2023-11-04T15:27:36.148423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:02:11.972760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.139120+0000","last_change":"2023-11-04T15:27:36.149455+0000","last_active":"2023-11-04T15:27:37.139120+0000","last_peered":"2023-11-04T15:27:37.139120+0000","last_clean":"2023-11-04T15:27:37.139120+0000","last_became_active":"2023-11-04T15:27:36.149146+0000","last_became_peered":"2023-11-04T15:27:36.149146+0000","last_unstale":"2023-11-04T15:27:37.139120+0000","last_undegraded":"2023-11-04T15:27:37.139120+0000","last_fullsized":"2023-11-04T15:27:37.139120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:14:54.847413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.153434+0000","last_change":"2023-11-04T15:27:35.773978+0000","last_active":"2023-11-04T15:27:36.153434+0000","last_peered":"2023-11-04T15:27:36.153434+0000","last_clean":"2023-11-04T15:27:36.153434+0000","last_became_active":"2023-11-04T15:27:35.773689+0000","last_became_peered":"2023-11-04T15:27:35.773689+0000","last_unstale":"2023-11-04T15:27:36.153434+0000","last_undegraded":"2023-11-04T15:27:36.153434+0000","last_fullsized":"2023-11-04T15:27:36.153434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:52:13.268866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.139684+0000","last_change":"2023-11-04T15:27:36.141984+0000","last_active":"2023-11-04T15:27:37.139684+0000","last_peered":"2023-11-04T15:27:37.139684+0000","last_clean":"2023-11-04T15:27:37.139684+0000","last_became_active":"2023-11-04T15:27:36.141695+0000","last_became_peered":"2023-11-04T15:27:36.141695+0000","last_unstale":"2023-11-04T15:27:37.139684+0000","last_undegraded":"2023-11-04T15:27:37.139684+0000","last_fullsized":"2023-11-04T15:27:37.139684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:45:22.367523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.132473+0000","last_change":"2023-11-04T15:27:35.774108+0000","last_active":"2023-11-04T15:27:36.132473+0000","last_peered":"2023-11-04T15:27:36.132473+0000","last_clean":"2023-11-04T15:27:36.132473+0000","last_became_active":"2023-11-04T15:27:35.773818+0000","last_became_peered":"2023-11-04T15:27:35.773818+0000","last_unstale":"2023-11-04T15:27:36.132473+0000","last_undegraded":"2023-11-04T15:27:36.132473+0000","last_fullsized":"2023-11-04T15:27:36.132473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:42:49.218866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199659+0000","last_change":"2023-11-04T15:27:36.150909+0000","last_active":"2023-11-04T15:27:38.199659+0000","last_peered":"2023-11-04T15:27:38.199659+0000","last_clean":"2023-11-04T15:27:38.199659+0000","last_became_active":"2023-11-04T15:27:36.150653+0000","last_became_peered":"2023-11-04T15:27:36.150653+0000","last_unstale":"2023-11-04T15:27:38.199659+0000","last_undegraded":"2023-11-04T15:27:38.199659+0000","last_fullsized":"2023-11-04T15:27:38.199659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:36:21.960547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.152189+0000","last_change":"2023-11-04T15:27:35.773128+0000","last_active":"2023-11-04T15:27:36.152189+0000","last_peered":"2023-11-04T15:27:36.152189+0000","last_clean":"2023-11-04T15:27:36.152189+0000","last_became_active":"2023-11-04T15:27:35.772815+0000","last_became_peered":"2023-11-04T15:27:35.772815+0000","last_unstale":"2023-11-04T15:27:36.152189+0000","last_undegraded":"2023-11-04T15:27:36.152189+0000","last_fullsized":"2023-11-04T15:27:36.152189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:42:49.218866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138405+0000","last_change":"2023-11-04T15:27:36.151451+0000","last_active":"2023-11-04T15:27:37.138405+0000","last_peered":"2023-11-04T15:27:37.138405+0000","last_clean":"2023-11-04T15:27:37.138405+0000","last_became_active":"2023-11-04T15:27:36.150667+0000","last_became_peered":"2023-11-04T15:27:36.150667+0000","last_unstale":"2023-11-04T15:27:37.138405+0000","last_undegraded":"2023-11-04T15:27:37.138405+0000","last_fullsized":"2023-11-04T15:27:37.138405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:55:13.470788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.131250+0000","last_change":"2023-11-04T15:27:35.775559+0000","last_active":"2023-11-04T15:27:36.131250+0000","last_peered":"2023-11-04T15:27:36.131250+0000","last_clean":"2023-11-04T15:27:36.131250+0000","last_became_active":"2023-11-04T15:27:35.775063+0000","last_became_peered":"2023-11-04T15:27:35.775063+0000","last_unstale":"2023-11-04T15:27:36.131250+0000","last_undegraded":"2023-11-04T15:27:36.131250+0000","last_fullsized":"2023-11-04T15:27:36.131250+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:30:45.293294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138337+0000","last_change":"2023-11-04T15:27:36.140390+0000","last_active":"2023-11-04T15:27:37.138337+0000","last_peered":"2023-11-04T15:27:37.138337+0000","last_clean":"2023-11-04T15:27:37.138337+0000","last_became_active":"2023-11-04T15:27:36.139103+0000","last_became_peered":"2023-11-04T15:27:36.139103+0000","last_unstale":"2023-11-04T15:27:37.138337+0000","last_undegraded":"2023-11-04T15:27:37.138337+0000","last_fullsized":"2023-11-04T15:27:37.138337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:59:35.340281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.133063+0000","last_change":"2023-11-04T15:27:35.773686+0000","last_active":"2023-11-04T15:27:36.133063+0000","last_peered":"2023-11-04T15:27:36.133063+0000","last_clean":"2023-11-04T15:27:36.133063+0000","last_became_active":"2023-11-04T15:27:35.773449+0000","last_became_peered":"2023-11-04T15:27:35.773449+0000","last_unstale":"2023-11-04T15:27:36.133063+0000","last_undegraded":"2023-11-04T15:27:36.133063+0000","last_fullsized":"2023-11-04T15:27:36.133063+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:17:14.527023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.139466+0000","last_change":"2023-11-04T15:27:36.141355+0000","last_active":"2023-11-04T15:27:37.139466+0000","last_peered":"2023-11-04T15:27:37.139466+0000","last_clean":"2023-11-04T15:27:37.139466+0000","last_became_active":"2023-11-04T15:27:36.141086+0000","last_became_peered":"2023-11-04T15:27:36.141086+0000","last_unstale":"2023-11-04T15:27:37.139466+0000","last_undegraded":"2023-11-04T15:27:37.139466+0000","last_fullsized":"2023-11-04T15:27:37.139466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:28:45.715407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.141205+0000","last_change":"2023-11-04T15:27:35.770858+0000","last_active":"2023-11-04T15:27:36.141205+0000","last_peered":"2023-11-04T15:27:36.141205+0000","last_clean":"2023-11-04T15:27:36.141205+0000","last_became_active":"2023-11-04T15:27:35.769001+0000","last_became_peered":"2023-11-04T15:27:35.769001+0000","last_unstale":"2023-11-04T15:27:36.141205+0000","last_undegraded":"2023-11-04T15:27:36.141205+0000","last_fullsized":"2023-11-04T15:27:36.141205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:01:29.923726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.131681+0000","last_change":"2023-11-04T15:27:36.148390+0000","last_active":"2023-11-04T15:27:37.131681+0000","last_peered":"2023-11-04T15:27:37.131681+0000","last_clean":"2023-11-04T15:27:37.131681+0000","last_became_active":"2023-11-04T15:27:36.147034+0000","last_became_peered":"2023-11-04T15:27:36.147034+0000","last_unstale":"2023-11-04T15:27:37.131681+0000","last_undegraded":"2023-11-04T15:27:37.131681+0000","last_fullsized":"2023-11-04T15:27:37.131681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:14:54.847413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":167,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.136344+0000","last_change":"2023-11-04T15:27:26.267129+0000","last_active":"2023-11-04T15:27:36.136344+0000","last_peered":"2023-11-04T15:27:36.136344+0000","last_clean":"2023-11-04T15:27:36.136344+0000","last_became_active":"2023-11-04T15:27:26.266242+0000","last_became_peered":"2023-11-04T15:27:26.266242+0000","last_unstale":"2023-11-04T15:27:36.136344+0000","last_undegraded":"2023-11-04T15:27:36.136344+0000","last_fullsized":"2023-11-04T15:27:36.136344+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:25.163848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:25.163848+0000","last_clean_scrub_stamp":"2023-11-04T15:27:25.163848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:54:55.231471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.130334+0000","last_change":"2023-11-04T15:27:31.620178+0000","last_active":"2023-11-04T15:27:36.130334+0000","last_peered":"2023-11-04T15:27:36.130334+0000","last_clean":"2023-11-04T15:27:36.130334+0000","last_became_active":"2023-11-04T15:27:31.619798+0000","last_became_peered":"2023-11-04T15:27:31.619798+0000","last_unstale":"2023-11-04T15:27:36.130334+0000","last_undegraded":"2023-11-04T15:27:36.130334+0000","last_fullsized":"2023-11-04T15:27:36.130334+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:50:31.717109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.141439+0000","last_change":"2023-11-04T15:27:35.769689+0000","last_active":"2023-11-04T15:27:36.141439+0000","last_peered":"2023-11-04T15:27:36.141439+0000","last_clean":"2023-11-04T15:27:36.141439+0000","last_became_active":"2023-11-04T15:27:35.769150+0000","last_became_peered":"2023-11-04T15:27:35.769150+0000","last_unstale":"2023-11-04T15:27:36.141439+0000","last_undegraded":"2023-11-04T15:27:36.141439+0000","last_fullsized":"2023-11-04T15:27:36.141439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:15:19.151223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138508+0000","last_change":"2023-11-04T15:27:36.140877+0000","last_active":"2023-11-04T15:27:37.138508+0000","last_peered":"2023-11-04T15:27:37.138508+0000","last_clean":"2023-11-04T15:27:37.138508+0000","last_became_active":"2023-11-04T15:27:36.140619+0000","last_became_peered":"2023-11-04T15:27:36.140619+0000","last_unstale":"2023-11-04T15:27:37.138508+0000","last_undegraded":"2023-11-04T15:27:37.138508+0000","last_fullsized":"2023-11-04T15:27:37.138508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:42:12.902707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.138612+0000","last_change":"2023-11-04T15:27:31.622106+0000","last_active":"2023-11-04T15:27:36.138612+0000","last_peered":"2023-11-04T15:27:36.138612+0000","last_clean":"2023-11-04T15:27:36.138612+0000","last_became_active":"2023-11-04T15:27:31.621889+0000","last_became_peered":"2023-11-04T15:27:31.621889+0000","last_unstale":"2023-11-04T15:27:36.138612+0000","last_undegraded":"2023-11-04T15:27:36.138612+0000","last_fullsized":"2023-11-04T15:27:36.138612+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:11:00.327441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.129140+0000","last_change":"2023-11-04T15:27:35.771207+0000","last_active":"2023-11-04T15:27:36.129140+0000","last_peered":"2023-11-04T15:27:36.129140+0000","last_clean":"2023-11-04T15:27:36.129140+0000","last_became_active":"2023-11-04T15:27:35.770364+0000","last_became_peered":"2023-11-04T15:27:35.770364+0000","last_unstale":"2023-11-04T15:27:36.129140+0000","last_undegraded":"2023-11-04T15:27:36.129140+0000","last_fullsized":"2023-11-04T15:27:36.129140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:23:45.371175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199640+0000","last_change":"2023-11-04T15:27:36.144731+0000","last_active":"2023-11-04T15:27:38.199640+0000","last_peered":"2023-11-04T15:27:38.199640+0000","last_clean":"2023-11-04T15:27:38.199640+0000","last_became_active":"2023-11-04T15:27:36.144459+0000","last_became_peered":"2023-11-04T15:27:36.144459+0000","last_unstale":"2023-11-04T15:27:38.199640+0000","last_undegraded":"2023-11-04T15:27:38.199640+0000","last_fullsized":"2023-11-04T15:27:38.199640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:28:45.715407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.142013+0000","last_change":"2023-11-04T15:27:31.622710+0000","last_active":"2023-11-04T15:27:36.142013+0000","last_peered":"2023-11-04T15:27:36.142013+0000","last_clean":"2023-11-04T15:27:36.142013+0000","last_became_active":"2023-11-04T15:27:31.622378+0000","last_became_peered":"2023-11-04T15:27:31.622378+0000","last_unstale":"2023-11-04T15:27:36.142013+0000","last_undegraded":"2023-11-04T15:27:36.142013+0000","last_fullsized":"2023-11-04T15:27:36.142013+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:49:04.803105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.141277+0000","last_change":"2023-11-04T15:27:35.774630+0000","last_active":"2023-11-04T15:27:36.141277+0000","last_peered":"2023-11-04T15:27:36.141277+0000","last_clean":"2023-11-04T15:27:36.141277+0000","last_became_active":"2023-11-04T15:27:35.774339+0000","last_became_peered":"2023-11-04T15:27:35.774339+0000","last_unstale":"2023-11-04T15:27:36.141277+0000","last_undegraded":"2023-11-04T15:27:36.141277+0000","last_fullsized":"2023-11-04T15:27:36.141277+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:44:38.690122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.131722+0000","last_change":"2023-11-04T15:27:36.148319+0000","last_active":"2023-11-04T15:27:37.131722+0000","last_peered":"2023-11-04T15:27:37.131722+0000","last_clean":"2023-11-04T15:27:37.131722+0000","last_became_active":"2023-11-04T15:27:36.146930+0000","last_became_peered":"2023-11-04T15:27:36.146930+0000","last_unstale":"2023-11-04T15:27:37.131722+0000","last_undegraded":"2023-11-04T15:27:37.131722+0000","last_fullsized":"2023-11-04T15:27:37.131722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:28:45.715407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.131327+0000","last_change":"2023-11-04T15:27:31.622105+0000","last_active":"2023-11-04T15:27:36.131327+0000","last_peered":"2023-11-04T15:27:36.131327+0000","last_clean":"2023-11-04T15:27:36.131327+0000","last_became_active":"2023-11-04T15:27:31.621849+0000","last_became_peered":"2023-11-04T15:27:31.621849+0000","last_unstale":"2023-11-04T15:27:36.131327+0000","last_undegraded":"2023-11-04T15:27:36.131327+0000","last_fullsized":"2023-11-04T15:27:36.131327+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:20:41.777316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.134218+0000","last_change":"2023-11-04T15:27:35.770188+0000","last_active":"2023-11-04T15:27:36.134218+0000","last_peered":"2023-11-04T15:27:36.134218+0000","last_clean":"2023-11-04T15:27:36.134218+0000","last_became_active":"2023-11-04T15:27:35.769730+0000","last_became_peered":"2023-11-04T15:27:35.769730+0000","last_unstale":"2023-11-04T15:27:36.134218+0000","last_undegraded":"2023-11-04T15:27:36.134218+0000","last_fullsized":"2023-11-04T15:27:36.134218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:08:22.991334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.131556+0000","last_change":"2023-11-04T15:27:36.149225+0000","last_active":"2023-11-04T15:27:37.131556+0000","last_peered":"2023-11-04T15:27:37.131556+0000","last_clean":"2023-11-04T15:27:37.131556+0000","last_became_active":"2023-11-04T15:27:36.144417+0000","last_became_peered":"2023-11-04T15:27:36.144417+0000","last_unstale":"2023-11-04T15:27:37.131556+0000","last_undegraded":"2023-11-04T15:27:37.131556+0000","last_fullsized":"2023-11-04T15:27:37.131556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:41:32.995261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.131447+0000","last_change":"2023-11-04T15:27:35.770033+0000","last_active":"2023-11-04T15:27:36.131447+0000","last_peered":"2023-11-04T15:27:36.131447+0000","last_clean":"2023-11-04T15:27:36.131447+0000","last_became_active":"2023-11-04T15:27:35.769772+0000","last_became_peered":"2023-11-04T15:27:35.769772+0000","last_unstale":"2023-11-04T15:27:36.131447+0000","last_undegraded":"2023-11-04T15:27:36.131447+0000","last_fullsized":"2023-11-04T15:27:36.131447+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:00:20.246822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.142511+0000","last_change":"2023-11-04T15:27:31.622663+0000","last_active":"2023-11-04T15:27:36.142511+0000","last_peered":"2023-11-04T15:27:36.142511+0000","last_clean":"2023-11-04T15:27:36.142511+0000","last_became_active":"2023-11-04T15:27:31.622350+0000","last_became_peered":"2023-11-04T15:27:31.622350+0000","last_unstale":"2023-11-04T15:27:36.142511+0000","last_undegraded":"2023-11-04T15:27:36.142511+0000","last_fullsized":"2023-11-04T15:27:36.142511+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:31:02.273249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.131048+0000","last_change":"2023-11-04T15:27:36.144275+0000","last_active":"2023-11-04T15:27:37.131048+0000","last_peered":"2023-11-04T15:27:37.131048+0000","last_clean":"2023-11-04T15:27:37.131048+0000","last_became_active":"2023-11-04T15:27:36.143991+0000","last_became_peered":"2023-11-04T15:27:36.143991+0000","last_unstale":"2023-11-04T15:27:37.131048+0000","last_undegraded":"2023-11-04T15:27:37.131048+0000","last_fullsized":"2023-11-04T15:27:37.131048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:48:58.102459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.142118+0000","last_change":"2023-11-04T15:27:35.769416+0000","last_active":"2023-11-04T15:27:36.142118+0000","last_peered":"2023-11-04T15:27:36.142118+0000","last_clean":"2023-11-04T15:27:36.142118+0000","last_became_active":"2023-11-04T15:27:35.769095+0000","last_became_peered":"2023-11-04T15:27:35.769095+0000","last_unstale":"2023-11-04T15:27:36.142118+0000","last_undegraded":"2023-11-04T15:27:36.142118+0000","last_fullsized":"2023-11-04T15:27:36.142118+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T22:02:04.025848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.137396+0000","last_change":"2023-11-04T15:27:31.619973+0000","last_active":"2023-11-04T15:27:36.137396+0000","last_peered":"2023-11-04T15:27:36.137396+0000","last_clean":"2023-11-04T15:27:36.137396+0000","last_became_active":"2023-11-04T15:27:31.619702+0000","last_became_peered":"2023-11-04T15:27:31.619702+0000","last_unstale":"2023-11-04T15:27:36.137396+0000","last_undegraded":"2023-11-04T15:27:36.137396+0000","last_fullsized":"2023-11-04T15:27:36.137396+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:24:34.782619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199835+0000","last_change":"2023-11-04T15:27:36.139955+0000","last_active":"2023-11-04T15:27:38.199835+0000","last_peered":"2023-11-04T15:27:38.199835+0000","last_clean":"2023-11-04T15:27:38.199835+0000","last_became_active":"2023-11-04T15:27:36.139707+0000","last_became_peered":"2023-11-04T15:27:36.139707+0000","last_unstale":"2023-11-04T15:27:38.199835+0000","last_undegraded":"2023-11-04T15:27:38.199835+0000","last_fullsized":"2023-11-04T15:27:38.199835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:58:32.190696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.151891+0000","last_change":"2023-11-04T15:27:35.768818+0000","last_active":"2023-11-04T15:27:36.151891+0000","last_peered":"2023-11-04T15:27:36.151891+0000","last_clean":"2023-11-04T15:27:36.151891+0000","last_became_active":"2023-11-04T15:27:35.768320+0000","last_became_peered":"2023-11-04T15:27:35.768320+0000","last_unstale":"2023-11-04T15:27:36.151891+0000","last_undegraded":"2023-11-04T15:27:36.151891+0000","last_fullsized":"2023-11-04T15:27:36.151891+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:14:58.601545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.142320+0000","last_change":"2023-11-04T15:27:31.624625+0000","last_active":"2023-11-04T15:27:36.142320+0000","last_peered":"2023-11-04T15:27:36.142320+0000","last_clean":"2023-11-04T15:27:36.142320+0000","last_became_active":"2023-11-04T15:27:31.624347+0000","last_became_peered":"2023-11-04T15:27:31.624347+0000","last_unstale":"2023-11-04T15:27:36.142320+0000","last_undegraded":"2023-11-04T15:27:36.142320+0000","last_fullsized":"2023-11-04T15:27:36.142320+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:53:45.131692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199126+0000","last_change":"2023-11-04T15:27:36.138145+0000","last_active":"2023-11-04T15:27:38.199126+0000","last_peered":"2023-11-04T15:27:38.199126+0000","last_clean":"2023-11-04T15:27:38.199126+0000","last_became_active":"2023-11-04T15:27:36.137897+0000","last_became_peered":"2023-11-04T15:27:36.137897+0000","last_unstale":"2023-11-04T15:27:38.199126+0000","last_undegraded":"2023-11-04T15:27:38.199126+0000","last_fullsized":"2023-11-04T15:27:38.199126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:53:25.907251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199818+0000","last_change":"2023-11-04T15:27:35.772416+0000","last_active":"2023-11-04T15:27:38.199818+0000","last_peered":"2023-11-04T15:27:38.199818+0000","last_clean":"2023-11-04T15:27:38.199818+0000","last_became_active":"2023-11-04T15:27:35.772121+0000","last_became_peered":"2023-11-04T15:27:35.772121+0000","last_unstale":"2023-11-04T15:27:38.199818+0000","last_undegraded":"2023-11-04T15:27:38.199818+0000","last_fullsized":"2023-11-04T15:27:38.199818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:58:09.475936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.132771+0000","last_change":"2023-11-04T15:27:31.620235+0000","last_active":"2023-11-04T15:27:36.132771+0000","last_peered":"2023-11-04T15:27:36.132771+0000","last_clean":"2023-11-04T15:27:36.132771+0000","last_became_active":"2023-11-04T15:27:31.619831+0000","last_became_peered":"2023-11-04T15:27:31.619831+0000","last_unstale":"2023-11-04T15:27:36.132771+0000","last_undegraded":"2023-11-04T15:27:36.132771+0000","last_fullsized":"2023-11-04T15:27:36.132771+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:44:07.412379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138914+0000","last_change":"2023-11-04T15:27:36.141133+0000","last_active":"2023-11-04T15:27:37.138914+0000","last_peered":"2023-11-04T15:27:37.138914+0000","last_clean":"2023-11-04T15:27:37.138914+0000","last_became_active":"2023-11-04T15:27:36.140871+0000","last_became_peered":"2023-11-04T15:27:36.140871+0000","last_unstale":"2023-11-04T15:27:37.138914+0000","last_undegraded":"2023-11-04T15:27:37.138914+0000","last_fullsized":"2023-11-04T15:27:37.138914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:28.095802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.139653+0000","last_change":"2023-11-04T15:27:36.139723+0000","last_active":"2023-11-04T15:27:37.139653+0000","last_peered":"2023-11-04T15:27:37.139653+0000","last_clean":"2023-11-04T15:27:37.139653+0000","last_became_active":"2023-11-04T15:27:36.139487+0000","last_became_peered":"2023-11-04T15:27:36.139487+0000","last_unstale":"2023-11-04T15:27:37.139653+0000","last_undegraded":"2023-11-04T15:27:37.139653+0000","last_fullsized":"2023-11-04T15:27:37.139653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:47:58.380308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.158730+0000","last_change":"2023-11-04T15:27:35.775665+0000","last_active":"2023-11-04T15:27:36.158730+0000","last_peered":"2023-11-04T15:27:36.158730+0000","last_clean":"2023-11-04T15:27:36.158730+0000","last_became_active":"2023-11-04T15:27:35.775356+0000","last_became_peered":"2023-11-04T15:27:35.775356+0000","last_unstale":"2023-11-04T15:27:36.158730+0000","last_undegraded":"2023-11-04T15:27:36.158730+0000","last_fullsized":"2023-11-04T15:27:36.158730+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:36:12.941030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.130995+0000","last_change":"2023-11-04T15:27:36.146737+0000","last_active":"2023-11-04T15:27:37.130995+0000","last_peered":"2023-11-04T15:27:37.130995+0000","last_clean":"2023-11-04T15:27:37.130995+0000","last_became_active":"2023-11-04T15:27:36.146464+0000","last_became_peered":"2023-11-04T15:27:36.146464+0000","last_unstale":"2023-11-04T15:27:37.130995+0000","last_undegraded":"2023-11-04T15:27:37.130995+0000","last_fullsized":"2023-11-04T15:27:37.130995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:47:40.350777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.142014+0000","last_change":"2023-11-04T15:27:35.770401+0000","last_active":"2023-11-04T15:27:36.142014+0000","last_peered":"2023-11-04T15:27:36.142014+0000","last_clean":"2023-11-04T15:27:36.142014+0000","last_became_active":"2023-11-04T15:27:35.769904+0000","last_became_peered":"2023-11-04T15:27:35.769904+0000","last_unstale":"2023-11-04T15:27:36.142014+0000","last_undegraded":"2023-11-04T15:27:36.142014+0000","last_fullsized":"2023-11-04T15:27:36.142014+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:58:09.475936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.133447+0000","last_change":"2023-11-04T15:27:35.768689+0000","last_active":"2023-11-04T15:27:36.133447+0000","last_peered":"2023-11-04T15:27:36.133447+0000","last_clean":"2023-11-04T15:27:36.133447+0000","last_became_active":"2023-11-04T15:27:35.768413+0000","last_became_peered":"2023-11-04T15:27:35.768413+0000","last_unstale":"2023-11-04T15:27:36.133447+0000","last_undegraded":"2023-11-04T15:27:36.133447+0000","last_fullsized":"2023-11-04T15:27:36.133447+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:23:45.371175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199123+0000","last_change":"2023-11-04T15:27:36.139778+0000","last_active":"2023-11-04T15:27:38.199123+0000","last_peered":"2023-11-04T15:27:38.199123+0000","last_clean":"2023-11-04T15:27:38.199123+0000","last_became_active":"2023-11-04T15:27:36.139524+0000","last_became_peered":"2023-11-04T15:27:36.139524+0000","last_unstale":"2023-11-04T15:27:38.199123+0000","last_undegraded":"2023-11-04T15:27:38.199123+0000","last_fullsized":"2023-11-04T15:27:38.199123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:27:25.258046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.132100+0000","last_change":"2023-11-04T15:27:35.776242+0000","last_active":"2023-11-04T15:27:36.132100+0000","last_peered":"2023-11-04T15:27:36.132100+0000","last_clean":"2023-11-04T15:27:36.132100+0000","last_became_active":"2023-11-04T15:27:35.775917+0000","last_became_peered":"2023-11-04T15:27:35.775917+0000","last_unstale":"2023-11-04T15:27:36.132100+0000","last_undegraded":"2023-11-04T15:27:36.132100+0000","last_fullsized":"2023-11-04T15:27:36.132100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:14:58.601545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.130771+0000","last_change":"2023-11-04T15:27:36.151371+0000","last_active":"2023-11-04T15:27:37.130771+0000","last_peered":"2023-11-04T15:27:37.130771+0000","last_clean":"2023-11-04T15:27:37.130771+0000","last_became_active":"2023-11-04T15:27:36.150557+0000","last_became_peered":"2023-11-04T15:27:36.150557+0000","last_unstale":"2023-11-04T15:27:37.130771+0000","last_undegraded":"2023-11-04T15:27:37.130771+0000","last_fullsized":"2023-11-04T15:27:37.130771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:12:07.727740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138851+0000","last_change":"2023-11-04T15:27:36.150111+0000","last_active":"2023-11-04T15:27:37.138851+0000","last_peered":"2023-11-04T15:27:37.138851+0000","last_clean":"2023-11-04T15:27:37.138851+0000","last_became_active":"2023-11-04T15:27:36.149831+0000","last_became_peered":"2023-11-04T15:27:36.149831+0000","last_unstale":"2023-11-04T15:27:37.138851+0000","last_undegraded":"2023-11-04T15:27:37.138851+0000","last_fullsized":"2023-11-04T15:27:37.138851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:16:09.862958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.141100+0000","last_change":"2023-11-04T15:27:35.770634+0000","last_active":"2023-11-04T15:27:36.141100+0000","last_peered":"2023-11-04T15:27:36.141100+0000","last_clean":"2023-11-04T15:27:36.141100+0000","last_became_active":"2023-11-04T15:27:35.770022+0000","last_became_peered":"2023-11-04T15:27:35.770022+0000","last_unstale":"2023-11-04T15:27:36.141100+0000","last_undegraded":"2023-11-04T15:27:36.141100+0000","last_fullsized":"2023-11-04T15:27:36.141100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:03:49.354013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199639+0000","last_change":"2023-11-04T15:27:36.139190+0000","last_active":"2023-11-04T15:27:38.199639+0000","last_peered":"2023-11-04T15:27:38.199639+0000","last_clean":"2023-11-04T15:27:38.199639+0000","last_became_active":"2023-11-04T15:27:36.138908+0000","last_became_peered":"2023-11-04T15:27:36.138908+0000","last_unstale":"2023-11-04T15:27:38.199639+0000","last_undegraded":"2023-11-04T15:27:38.199639+0000","last_fullsized":"2023-11-04T15:27:38.199639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:32:27.370984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.141402+0000","last_change":"2023-11-04T15:27:35.768190+0000","last_active":"2023-11-04T15:27:36.141402+0000","last_peered":"2023-11-04T15:27:36.141402+0000","last_clean":"2023-11-04T15:27:36.141402+0000","last_became_active":"2023-11-04T15:27:35.767858+0000","last_became_peered":"2023-11-04T15:27:35.767858+0000","last_unstale":"2023-11-04T15:27:36.141402+0000","last_undegraded":"2023-11-04T15:27:36.141402+0000","last_fullsized":"2023-11-04T15:27:36.141402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:55:22.956180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199427+0000","last_change":"2023-11-04T15:27:36.143718+0000","last_active":"2023-11-04T15:27:38.199427+0000","last_peered":"2023-11-04T15:27:38.199427+0000","last_clean":"2023-11-04T15:27:38.199427+0000","last_became_active":"2023-11-04T15:27:36.143442+0000","last_became_peered":"2023-11-04T15:27:36.143442+0000","last_unstale":"2023-11-04T15:27:38.199427+0000","last_undegraded":"2023-11-04T15:27:38.199427+0000","last_fullsized":"2023-11-04T15:27:38.199427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:45:22.367523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.148708+0000","last_change":"2023-11-04T15:27:35.771653+0000","last_active":"2023-11-04T15:27:36.148708+0000","last_peered":"2023-11-04T15:27:36.148708+0000","last_clean":"2023-11-04T15:27:36.148708+0000","last_became_active":"2023-11-04T15:27:35.770539+0000","last_became_peered":"2023-11-04T15:27:35.770539+0000","last_unstale":"2023-11-04T15:27:36.148708+0000","last_undegraded":"2023-11-04T15:27:36.148708+0000","last_fullsized":"2023-11-04T15:27:36.148708+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:14:58.601545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.131407+0000","last_change":"2023-11-04T15:27:36.148481+0000","last_active":"2023-11-04T15:27:37.131407+0000","last_peered":"2023-11-04T15:27:37.131407+0000","last_clean":"2023-11-04T15:27:37.131407+0000","last_became_active":"2023-11-04T15:27:36.146477+0000","last_became_peered":"2023-11-04T15:27:36.146477+0000","last_unstale":"2023-11-04T15:27:37.131407+0000","last_undegraded":"2023-11-04T15:27:37.131407+0000","last_fullsized":"2023-11-04T15:27:37.131407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:53:25.907251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.140802+0000","last_change":"2023-11-04T15:27:35.772092+0000","last_active":"2023-11-04T15:27:36.140802+0000","last_peered":"2023-11-04T15:27:36.140802+0000","last_clean":"2023-11-04T15:27:36.140802+0000","last_became_active":"2023-11-04T15:27:35.771316+0000","last_became_peered":"2023-11-04T15:27:35.771316+0000","last_unstale":"2023-11-04T15:27:36.140802+0000","last_undegraded":"2023-11-04T15:27:36.140802+0000","last_fullsized":"2023-11-04T15:27:36.140802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:00:20.246822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.139555+0000","last_change":"2023-11-04T15:27:36.144382+0000","last_active":"2023-11-04T15:27:37.139555+0000","last_peered":"2023-11-04T15:27:37.139555+0000","last_clean":"2023-11-04T15:27:37.139555+0000","last_became_active":"2023-11-04T15:27:36.144066+0000","last_became_peered":"2023-11-04T15:27:36.144066+0000","last_unstale":"2023-11-04T15:27:37.139555+0000","last_undegraded":"2023-11-04T15:27:37.139555+0000","last_fullsized":"2023-11-04T15:27:37.139555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:41:32.995261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.143653+0000","last_change":"2023-11-04T15:27:35.768679+0000","last_active":"2023-11-04T15:27:36.143653+0000","last_peered":"2023-11-04T15:27:36.143653+0000","last_clean":"2023-11-04T15:27:36.143653+0000","last_became_active":"2023-11-04T15:27:35.767852+0000","last_became_peered":"2023-11-04T15:27:35.767852+0000","last_unstale":"2023-11-04T15:27:36.143653+0000","last_undegraded":"2023-11-04T15:27:36.143653+0000","last_fullsized":"2023-11-04T15:27:36.143653+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:47:47.130490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.139704+0000","last_change":"2023-11-04T15:27:36.141439+0000","last_active":"2023-11-04T15:27:37.139704+0000","last_peered":"2023-11-04T15:27:37.139704+0000","last_clean":"2023-11-04T15:27:37.139704+0000","last_became_active":"2023-11-04T15:27:36.141167+0000","last_became_peered":"2023-11-04T15:27:36.141167+0000","last_unstale":"2023-11-04T15:27:37.139704+0000","last_undegraded":"2023-11-04T15:27:37.139704+0000","last_fullsized":"2023-11-04T15:27:37.139704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:22:21.262360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.148043+0000","last_change":"2023-11-04T15:27:35.775629+0000","last_active":"2023-11-04T15:27:36.148043+0000","last_peered":"2023-11-04T15:27:36.148043+0000","last_clean":"2023-11-04T15:27:36.148043+0000","last_became_active":"2023-11-04T15:27:35.775171+0000","last_became_peered":"2023-11-04T15:27:35.775171+0000","last_unstale":"2023-11-04T15:27:36.148043+0000","last_undegraded":"2023-11-04T15:27:36.148043+0000","last_fullsized":"2023-11-04T15:27:36.148043+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:13:42.865721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199233+0000","last_change":"2023-11-04T15:27:36.146049+0000","last_active":"2023-11-04T15:27:38.199233+0000","last_peered":"2023-11-04T15:27:38.199233+0000","last_clean":"2023-11-04T15:27:38.199233+0000","last_became_active":"2023-11-04T15:27:36.145560+0000","last_became_peered":"2023-11-04T15:27:36.145560+0000","last_unstale":"2023-11-04T15:27:38.199233+0000","last_undegraded":"2023-11-04T15:27:38.199233+0000","last_fullsized":"2023-11-04T15:27:38.199233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:14:54.847413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.140784+0000","last_change":"2023-11-04T15:27:35.771225+0000","last_active":"2023-11-04T15:27:36.140784+0000","last_peered":"2023-11-04T15:27:36.140784+0000","last_clean":"2023-11-04T15:27:36.140784+0000","last_became_active":"2023-11-04T15:27:35.770873+0000","last_became_peered":"2023-11-04T15:27:35.770873+0000","last_unstale":"2023-11-04T15:27:36.140784+0000","last_undegraded":"2023-11-04T15:27:36.140784+0000","last_fullsized":"2023-11-04T15:27:36.140784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:02:11.972760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138996+0000","last_change":"2023-11-04T15:27:36.148228+0000","last_active":"2023-11-04T15:27:37.138996+0000","last_peered":"2023-11-04T15:27:37.138996+0000","last_clean":"2023-11-04T15:27:37.138996+0000","last_became_active":"2023-11-04T15:27:36.147535+0000","last_became_peered":"2023-11-04T15:27:36.147535+0000","last_unstale":"2023-11-04T15:27:37.138996+0000","last_undegraded":"2023-11-04T15:27:37.138996+0000","last_fullsized":"2023-11-04T15:27:37.138996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:48:58.102459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.147803+0000","last_change":"2023-11-04T15:27:35.776315+0000","last_active":"2023-11-04T15:27:36.147803+0000","last_peered":"2023-11-04T15:27:36.147803+0000","last_clean":"2023-11-04T15:27:36.147803+0000","last_became_active":"2023-11-04T15:27:35.775918+0000","last_became_peered":"2023-11-04T15:27:35.775918+0000","last_unstale":"2023-11-04T15:27:36.147803+0000","last_undegraded":"2023-11-04T15:27:36.147803+0000","last_fullsized":"2023-11-04T15:27:36.147803+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:08:22.991334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705672,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":798720,"data_stored":653237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]}]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":200704,"data_stored":62307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":176128,"data_stored":60597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":782336,"data_stored":651707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T15:27:48.641 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T15:27:48.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.780+0000 7fd9bf5ab640 1 Processor -- start 2023-11-04T15:27:48.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.780+0000 7fd9bf5ab640 1 -- start start 2023-11-04T15:27:48.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.781+0000 7fd9bf5ab640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd9b80a3e90 0x7fd9b80a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:48.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.781+0000 7fd9bf5ab640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9b80a4c20 con 0x7fd9b8137270 2023-11-04T15:27:48.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.781+0000 7fd9bf5ab640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9b813ad80 con 0x7fd9b8137650 2023-11-04T15:27:48.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.781+0000 7fd9bf5ab640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b80a3060 con 0x7fd9b80a3e90 2023-11-04T15:27:48.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.781+0000 7fd9bd347640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd9b8137270 0x7fd9b8139f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60946/0 (socket says 172.21.15.19:60946) 2023-11-04T15:27:48.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.781+0000 7fd9bd347640 1 -- 172.21.15.19:0/2061925201 learned_addr learned my addr 172.21.15.19:0/2061925201 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:48.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.781+0000 7fd9bcb46640 1 --2- 172.21.15.19:0/2061925201 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd9b80a3e90 0x7fd9b80a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:48.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.781+0000 7fd9affff640 1 -- 172.21.15.19:0/2061925201 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2415166866 0 0) 0x7fd9b80a4c20 con 0x7fd9b8137270 2023-11-04T15:27:48.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.781+0000 7fd9affff640 1 -- 172.21.15.19:0/2061925201 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9a4003520 con 0x7fd9b8137270 2023-11-04T15:27:48.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.781+0000 7fd9affff640 1 -- 172.21.15.19:0/2061925201 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 928082304 0 0) 0x7fd9b813ad80 con 0x7fd9b8137650 2023-11-04T15:27:48.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.781+0000 7fd9bcb46640 1 -- 172.21.15.19:0/2061925201 >> v1:172.21.15.96:6789/0 conn(0x7fd9b8137650 legacy=0x7fd9b813a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.781+0000 7fd9bcb46640 1 -- 172.21.15.19:0/2061925201 >> v1:172.21.15.19:6789/0 conn(0x7fd9b8137270 legacy=0x7fd9b8139f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.781+0000 7fd9bcb46640 1 -- 172.21.15.19:0/2061925201 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b80a5080 con 0x7fd9b80a3e90 2023-11-04T15:27:48.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.782+0000 7fd9bcb46640 1 --2- 172.21.15.19:0/2061925201 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd9b80a3e90 0x7fd9b80a6200 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd9a80097d0 tx=0x7fd9a802b600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8ee14a74968c8b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:48.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.782+0000 7fd9affff640 1 -- 172.21.15.19:0/2061925201 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b4001670 con 0x7fd9b80a3e90 2023-11-04T15:27:48.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.782+0000 7fd9affff640 1 -- 172.21.15.19:0/2061925201 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a802e050 con 0x7fd9b80a3e90 2023-11-04T15:27:48.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.782+0000 7fd9affff640 1 -- 172.21.15.19:0/2061925201 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a8030510 con 0x7fd9b80a3e90 2023-11-04T15:27:48.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.783+0000 7fd9bf5ab640 1 -- 172.21.15.19:0/2061925201 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd9b80a3e90 msgr2=0x7fd9b80a6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.783+0000 7fd9bf5ab640 1 --2- 172.21.15.19:0/2061925201 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd9b80a3e90 0x7fd9b80a6200 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd9a80097d0 tx=0x7fd9a802b600 comp rx=0 tx=0).stop 2023-11-04T15:27:48.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.783+0000 7fd9bf5ab640 1 -- 172.21.15.19:0/2061925201 shutdown_connections 2023-11-04T15:27:48.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.783+0000 7fd9bf5ab640 1 --2- 172.21.15.19:0/2061925201 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd9b80a3e90 0x7fd9b80a6200 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.783+0000 7fd9bf5ab640 1 -- 172.21.15.19:0/2061925201 >> 172.21.15.19:0/2061925201 conn(0x7fd9b80a8d70 msgr2=0x7fd9b80a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:48.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.783+0000 7fd9bf5ab640 1 -- 172.21.15.19:0/2061925201 shutdown_connections 2023-11-04T15:27:48.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.783+0000 7fd9bf5ab640 1 -- 172.21.15.19:0/2061925201 wait complete. 2023-11-04T15:27:48.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.784+0000 7fd9bf5ab640 1 Processor -- start 2023-11-04T15:27:48.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.784+0000 7fd9bf5ab640 1 -- start start 2023-11-04T15:27:48.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.784+0000 7fd9bf5ab640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9b80a3e90 0x7fd9b80ac720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:48.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.784+0000 7fd9bf5ab640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd9b8137270 0x7fd9b8098a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:48.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.784+0000 7fd9bf5ab640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9b8137650 0x7fd9b8098f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:48.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.784+0000 7fd9bf5ab640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b80acfc0 con 0x7fd9b8137650 2023-11-04T15:27:48.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.784+0000 7fd9bf5ab640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b8137b50 con 0x7fd9b80a3e90 2023-11-04T15:27:48.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.784+0000 7fd9bf5ab640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b809c4a0 con 0x7fd9b8137270 2023-11-04T15:27:48.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.784+0000 7fd9bdb48640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9b8137650 0x7fd9b8098f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:48.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.784+0000 7fd9bdb48640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9b8137650 0x7fd9b8098f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53864/0 (socket says 172.21.15.19:53864) 2023-11-04T15:27:48.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.784+0000 7fd9bdb48640 1 -- 172.21.15.19:0/3241806572 learned_addr learned my addr 172.21.15.19:0/3241806572 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:48.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.784+0000 7fd9bd347640 1 --2- 172.21.15.19:0/3241806572 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9b80a3e90 0x7fd9b80ac720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:48.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.784+0000 7fd9bcb46640 1 --2- 172.21.15.19:0/3241806572 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd9b8137270 0x7fd9b8098a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:48.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.785+0000 7fd9bdb48640 1 -- 172.21.15.19:0/3241806572 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd9b8137270 msgr2=0x7fd9b8098a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.785+0000 7fd9bdb48640 1 --2- 172.21.15.19:0/3241806572 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd9b8137270 0x7fd9b8098a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.785+0000 7fd9bdb48640 1 -- 172.21.15.19:0/3241806572 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9b80a3e90 msgr2=0x7fd9b80ac720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.785+0000 7fd9bdb48640 1 --2- 172.21.15.19:0/3241806572 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9b80a3e90 0x7fd9b80ac720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.785+0000 7fd9bdb48640 1 -- 172.21.15.19:0/3241806572 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a8009400 con 0x7fd9b8137650 2023-11-04T15:27:48.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.785+0000 7fd9bdb48640 1 --2- 172.21.15.19:0/3241806572 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9b8137650 0x7fd9b8098f90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd9b000c780 tx=0x7fd9b000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:48.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.785+0000 7fd9adffb640 1 -- 172.21.15.19:0/3241806572 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0003b70 con 0x7fd9b8137650 2023-11-04T15:27:48.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.785+0000 7fd9adffb640 1 -- 172.21.15.19:0/3241806572 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b0003cd0 con 0x7fd9b8137650 2023-11-04T15:27:48.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.785+0000 7fd9bf5ab640 1 -- 172.21.15.19:0/3241806572 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b809b720 con 0x7fd9b8137650 2023-11-04T15:27:48.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.785+0000 7fd9adffb640 1 -- 172.21.15.19:0/3241806572 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0005270 con 0x7fd9b8137650 2023-11-04T15:27:48.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.785+0000 7fd9bf5ab640 1 -- 172.21.15.19:0/3241806572 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b809ba90 con 0x7fd9b8137650 2023-11-04T15:27:48.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.786+0000 7fd9bf5ab640 1 -- 172.21.15.19:0/3241806572 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b8067d60 con 0x7fd9b8137650 2023-11-04T15:27:48.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.787+0000 7fd9adffb640 1 -- 172.21.15.19:0/3241806572 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd9b00053d0 con 0x7fd9b8137650 2023-11-04T15:27:48.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.787+0000 7fd9adffb640 1 --2- 172.21.15.19:0/3241806572 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fd99c06a430 0x7fd99c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:48.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.787+0000 7fd9adffb640 1 -- 172.21.15.19:0/3241806572 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7fd9b0087fd0 con 0x7fd9b8137650 2023-11-04T15:27:48.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.787+0000 7fd9bd347640 1 --2- 172.21.15.19:0/3241806572 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fd99c06a430 0x7fd99c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:48.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.788+0000 7fd9bd347640 1 --2- 172.21.15.19:0/3241806572 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fd99c06a430 0x7fd99c06c8f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4001d50 tx=0x7fd9b4001ce0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:48.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.791+0000 7fd9adffb640 1 -- 172.21.15.19:0/3241806572 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd9b0053c60 con 0x7fd9b8137650 2023-11-04T15:27:48.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.963+0000 7fd9bf5ab640 1 -- 172.21.15.19:0/3241806572 --> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd9b80a5340 con 0x7fd99c06a430 2023-11-04T15:27:48.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.970+0000 7fd9adffb640 1 -- 172.21.15.19:0/3241806572 <== mgr.4114 v2:172.21.15.96:6816/83123 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271312 (secure 0 0 0) 0x7fd9b40049c0 con 0x7fd99c06a430 2023-11-04T15:27:48.975 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:27:48.977 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-11-04T15:27:48.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.973+0000 7fd9bf5ab640 1 -- 172.21.15.19:0/3241806572 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fd99c06a430 msgr2=0x7fd99c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.973+0000 7fd9bf5ab640 1 --2- 172.21.15.19:0/3241806572 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fd99c06a430 0x7fd99c06c8f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4001d50 tx=0x7fd9b4001ce0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.973+0000 7fd9bf5ab640 1 -- 172.21.15.19:0/3241806572 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9b8137650 msgr2=0x7fd9b8098f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:48.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.973+0000 7fd9bf5ab640 1 --2- 172.21.15.19:0/3241806572 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9b8137650 0x7fd9b8098f90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd9b000c780 tx=0x7fd9b000cb80 comp rx=0 tx=0).stop 2023-11-04T15:27:48.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.973+0000 7fd9bf5ab640 1 -- 172.21.15.19:0/3241806572 shutdown_connections 2023-11-04T15:27:48.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.973+0000 7fd9bf5ab640 1 --2- 172.21.15.19:0/3241806572 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fd99c06a430 0x7fd99c06c8f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.973+0000 7fd9bf5ab640 1 --2- 172.21.15.19:0/3241806572 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9b8137650 0x7fd9b8098f90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.973+0000 7fd9bf5ab640 1 --2- 172.21.15.19:0/3241806572 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd9b8137270 0x7fd9b8098a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.973+0000 7fd9bf5ab640 1 --2- 172.21.15.19:0/3241806572 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9b80a3e90 0x7fd9b80ac720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:48.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.973+0000 7fd9bf5ab640 1 -- 172.21.15.19:0/3241806572 >> 172.21.15.19:0/3241806572 conn(0x7fd9b80a8d70 msgr2=0x7fd9b8135c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:48.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.973+0000 7fd9bf5ab640 1 -- 172.21.15.19:0/3241806572 shutdown_connections 2023-11-04T15:27:48.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:48.973+0000 7fd9bf5ab640 1 -- 172.21.15.19:0/3241806572 wait complete. 2023-11-04T15:27:48.985 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-11-04T15:27:48.937550+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109720,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":107776,"kb_avail":377377640,"statfs":{"total":386547056640,"available":386434703360,"internally_reserved":0,"allocated":1957888,"data_stored":1427848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110362624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.803518"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199676+0000","last_change":"2023-11-04T15:27:36.150532+0000","last_active":"2023-11-04T15:27:38.199676+0000","last_peered":"2023-11-04T15:27:38.199676+0000","last_clean":"2023-11-04T15:27:38.199676+0000","last_became_active":"2023-11-04T15:27:36.150296+0000","last_became_peered":"2023-11-04T15:27:36.150296+0000","last_unstale":"2023-11-04T15:27:38.199676+0000","last_undegraded":"2023-11-04T15:27:38.199676+0000","last_fullsized":"2023-11-04T15:27:38.199676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:41:32.995261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.139353+0000","last_change":"2023-11-04T15:27:36.149233+0000","last_active":"2023-11-04T15:27:37.139353+0000","last_peered":"2023-11-04T15:27:37.139353+0000","last_clean":"2023-11-04T15:27:37.139353+0000","last_became_active":"2023-11-04T15:27:36.148939+0000","last_became_peered":"2023-11-04T15:27:36.148939+0000","last_unstale":"2023-11-04T15:27:37.139353+0000","last_undegraded":"2023-11-04T15:27:37.139353+0000","last_fullsized":"2023-11-04T15:27:37.139353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:52:55.975636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138201+0000","last_change":"2023-11-04T15:27:36.149978+0000","last_active":"2023-11-04T15:27:37.138201+0000","last_peered":"2023-11-04T15:27:37.138201+0000","last_clean":"2023-11-04T15:27:37.138201+0000","last_became_active":"2023-11-04T15:27:36.149748+0000","last_became_peered":"2023-11-04T15:27:36.149748+0000","last_unstale":"2023-11-04T15:27:37.138201+0000","last_undegraded":"2023-11-04T15:27:37.138201+0000","last_fullsized":"2023-11-04T15:27:37.138201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:49:04.091063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.139643+0000","last_change":"2023-11-04T15:27:36.140158+0000","last_active":"2023-11-04T15:27:37.139643+0000","last_peered":"2023-11-04T15:27:37.139643+0000","last_clean":"2023-11-04T15:27:37.139643+0000","last_became_active":"2023-11-04T15:27:36.139761+0000","last_became_peered":"2023-11-04T15:27:36.139761+0000","last_unstale":"2023-11-04T15:27:37.139643+0000","last_undegraded":"2023-11-04T15:27:37.139643+0000","last_fullsized":"2023-11-04T15:27:37.139643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:38:30.379384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199913+0000","last_change":"2023-11-04T15:27:36.150520+0000","last_active":"2023-11-04T15:27:38.199913+0000","last_peered":"2023-11-04T15:27:38.199913+0000","last_clean":"2023-11-04T15:27:38.199913+0000","last_became_active":"2023-11-04T15:27:36.150017+0000","last_became_peered":"2023-11-04T15:27:36.150017+0000","last_unstale":"2023-11-04T15:27:38.199913+0000","last_undegraded":"2023-11-04T15:27:38.199913+0000","last_fullsized":"2023-11-04T15:27:38.199913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:47:40.350777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.137815+0000","last_change":"2023-11-04T15:27:36.139858+0000","last_active":"2023-11-04T15:27:37.137815+0000","last_peered":"2023-11-04T15:27:37.137815+0000","last_clean":"2023-11-04T15:27:37.137815+0000","last_became_active":"2023-11-04T15:27:36.139036+0000","last_became_peered":"2023-11-04T15:27:36.139036+0000","last_unstale":"2023-11-04T15:27:37.137815+0000","last_undegraded":"2023-11-04T15:27:37.137815+0000","last_fullsized":"2023-11-04T15:27:37.137815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:05:44.093984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.137514+0000","last_change":"2023-11-04T15:27:36.140003+0000","last_active":"2023-11-04T15:27:37.137514+0000","last_peered":"2023-11-04T15:27:37.137514+0000","last_clean":"2023-11-04T15:27:37.137514+0000","last_became_active":"2023-11-04T15:27:36.139121+0000","last_became_peered":"2023-11-04T15:27:36.139121+0000","last_unstale":"2023-11-04T15:27:37.137514+0000","last_undegraded":"2023-11-04T15:27:37.137514+0000","last_fullsized":"2023-11-04T15:27:37.137514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:57:05.896392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.137457+0000","last_change":"2023-11-04T15:27:36.148199+0000","last_active":"2023-11-04T15:27:37.137457+0000","last_peered":"2023-11-04T15:27:37.137457+0000","last_clean":"2023-11-04T15:27:37.137457+0000","last_became_active":"2023-11-04T15:27:36.147050+0000","last_became_peered":"2023-11-04T15:27:36.147050+0000","last_unstale":"2023-11-04T15:27:37.137457+0000","last_undegraded":"2023-11-04T15:27:37.137457+0000","last_fullsized":"2023-11-04T15:27:37.137457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:40:36.811342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199451+0000","last_change":"2023-11-04T15:27:36.146562+0000","last_active":"2023-11-04T15:27:38.199451+0000","last_peered":"2023-11-04T15:27:38.199451+0000","last_clean":"2023-11-04T15:27:38.199451+0000","last_became_active":"2023-11-04T15:27:36.145825+0000","last_became_peered":"2023-11-04T15:27:36.145825+0000","last_unstale":"2023-11-04T15:27:38.199451+0000","last_undegraded":"2023-11-04T15:27:38.199451+0000","last_fullsized":"2023-11-04T15:27:38.199451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:52:55.975636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138448+0000","last_change":"2023-11-04T15:27:36.150567+0000","last_active":"2023-11-04T15:27:37.138448+0000","last_peered":"2023-11-04T15:27:37.138448+0000","last_clean":"2023-11-04T15:27:37.138448+0000","last_became_active":"2023-11-04T15:27:36.150307+0000","last_became_peered":"2023-11-04T15:27:36.150307+0000","last_unstale":"2023-11-04T15:27:37.138448+0000","last_undegraded":"2023-11-04T15:27:37.138448+0000","last_fullsized":"2023-11-04T15:27:37.138448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:38:23.440792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.139590+0000","last_change":"2023-11-04T15:27:36.145307+0000","last_active":"2023-11-04T15:27:37.139590+0000","last_peered":"2023-11-04T15:27:37.139590+0000","last_clean":"2023-11-04T15:27:37.139590+0000","last_became_active":"2023-11-04T15:27:36.144988+0000","last_became_peered":"2023-11-04T15:27:36.144988+0000","last_unstale":"2023-11-04T15:27:37.139590+0000","last_undegraded":"2023-11-04T15:27:37.139590+0000","last_fullsized":"2023-11-04T15:27:37.139590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:41.544754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.131453+0000","last_change":"2023-11-04T15:27:36.149560+0000","last_active":"2023-11-04T15:27:37.131453+0000","last_peered":"2023-11-04T15:27:37.131453+0000","last_clean":"2023-11-04T15:27:37.131453+0000","last_became_active":"2023-11-04T15:27:36.149156+0000","last_became_peered":"2023-11-04T15:27:36.149156+0000","last_unstale":"2023-11-04T15:27:37.131453+0000","last_undegraded":"2023-11-04T15:27:37.131453+0000","last_fullsized":"2023-11-04T15:27:37.131453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:22:17.580120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199582+0000","last_change":"2023-11-04T15:27:36.140079+0000","last_active":"2023-11-04T15:27:38.199582+0000","last_peered":"2023-11-04T15:27:38.199582+0000","last_clean":"2023-11-04T15:27:38.199582+0000","last_became_active":"2023-11-04T15:27:36.139824+0000","last_became_peered":"2023-11-04T15:27:36.139824+0000","last_unstale":"2023-11-04T15:27:38.199582+0000","last_undegraded":"2023-11-04T15:27:38.199582+0000","last_fullsized":"2023-11-04T15:27:38.199582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:28.095802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.139484+0000","last_change":"2023-11-04T15:27:36.147533+0000","last_active":"2023-11-04T15:27:37.139484+0000","last_peered":"2023-11-04T15:27:37.139484+0000","last_clean":"2023-11-04T15:27:37.139484+0000","last_became_active":"2023-11-04T15:27:36.147273+0000","last_became_peered":"2023-11-04T15:27:36.147273+0000","last_unstale":"2023-11-04T15:27:37.139484+0000","last_undegraded":"2023-11-04T15:27:37.139484+0000","last_fullsized":"2023-11-04T15:27:37.139484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:22:17.580120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.139612+0000","last_change":"2023-11-04T15:27:36.149641+0000","last_active":"2023-11-04T15:27:37.139612+0000","last_peered":"2023-11-04T15:27:37.139612+0000","last_clean":"2023-11-04T15:27:37.139612+0000","last_became_active":"2023-11-04T15:27:36.148932+0000","last_became_peered":"2023-11-04T15:27:36.148932+0000","last_unstale":"2023-11-04T15:27:37.139612+0000","last_undegraded":"2023-11-04T15:27:37.139612+0000","last_fullsized":"2023-11-04T15:27:37.139612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:12:07.727740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.137533+0000","last_change":"2023-11-04T15:27:36.151936+0000","last_active":"2023-11-04T15:27:37.137533+0000","last_peered":"2023-11-04T15:27:37.137533+0000","last_clean":"2023-11-04T15:27:37.137533+0000","last_became_active":"2023-11-04T15:27:36.150856+0000","last_became_peered":"2023-11-04T15:27:36.150856+0000","last_unstale":"2023-11-04T15:27:37.137533+0000","last_undegraded":"2023-11-04T15:27:37.137533+0000","last_fullsized":"2023-11-04T15:27:37.137533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:51:31.442634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199500+0000","last_change":"2023-11-04T15:27:36.145257+0000","last_active":"2023-11-04T15:27:38.199500+0000","last_peered":"2023-11-04T15:27:38.199500+0000","last_clean":"2023-11-04T15:27:38.199500+0000","last_became_active":"2023-11-04T15:27:36.144997+0000","last_became_peered":"2023-11-04T15:27:36.144997+0000","last_unstale":"2023-11-04T15:27:38.199500+0000","last_undegraded":"2023-11-04T15:27:38.199500+0000","last_fullsized":"2023-11-04T15:27:38.199500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:22:17.580120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138606+0000","last_change":"2023-11-04T15:27:36.150820+0000","last_active":"2023-11-04T15:27:37.138606+0000","last_peered":"2023-11-04T15:27:37.138606+0000","last_clean":"2023-11-04T15:27:37.138606+0000","last_became_active":"2023-11-04T15:27:36.150555+0000","last_became_peered":"2023-11-04T15:27:36.150555+0000","last_unstale":"2023-11-04T15:27:37.138606+0000","last_undegraded":"2023-11-04T15:27:37.138606+0000","last_fullsized":"2023-11-04T15:27:37.138606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:32:27.370984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199406+0000","last_change":"2023-11-04T15:27:36.148306+0000","last_active":"2023-11-04T15:27:38.199406+0000","last_peered":"2023-11-04T15:27:38.199406+0000","last_clean":"2023-11-04T15:27:38.199406+0000","last_became_active":"2023-11-04T15:27:36.147745+0000","last_became_peered":"2023-11-04T15:27:36.147745+0000","last_unstale":"2023-11-04T15:27:38.199406+0000","last_undegraded":"2023-11-04T15:27:38.199406+0000","last_fullsized":"2023-11-04T15:27:38.199406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:41:10.315016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138359+0000","last_change":"2023-11-04T15:27:36.151647+0000","last_active":"2023-11-04T15:27:37.138359+0000","last_peered":"2023-11-04T15:27:37.138359+0000","last_clean":"2023-11-04T15:27:37.138359+0000","last_became_active":"2023-11-04T15:27:36.150687+0000","last_became_peered":"2023-11-04T15:27:36.150687+0000","last_unstale":"2023-11-04T15:27:37.138359+0000","last_undegraded":"2023-11-04T15:27:37.138359+0000","last_fullsized":"2023-11-04T15:27:37.138359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:56:24.790444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.139334+0000","last_change":"2023-11-04T15:27:36.144207+0000","last_active":"2023-11-04T15:27:37.139334+0000","last_peered":"2023-11-04T15:27:37.139334+0000","last_clean":"2023-11-04T15:27:37.139334+0000","last_became_active":"2023-11-04T15:27:36.143551+0000","last_became_peered":"2023-11-04T15:27:36.143551+0000","last_unstale":"2023-11-04T15:27:37.139334+0000","last_undegraded":"2023-11-04T15:27:37.139334+0000","last_fullsized":"2023-11-04T15:27:37.139334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:36:21.960547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199072+0000","last_change":"2023-11-04T15:27:36.146251+0000","last_active":"2023-11-04T15:27:38.199072+0000","last_peered":"2023-11-04T15:27:38.199072+0000","last_clean":"2023-11-04T15:27:38.199072+0000","last_became_active":"2023-11-04T15:27:36.145943+0000","last_became_peered":"2023-11-04T15:27:36.145943+0000","last_unstale":"2023-11-04T15:27:38.199072+0000","last_undegraded":"2023-11-04T15:27:38.199072+0000","last_fullsized":"2023-11-04T15:27:38.199072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:48:58.102459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.130771+0000","last_change":"2023-11-04T15:27:36.146784+0000","last_active":"2023-11-04T15:27:37.130771+0000","last_peered":"2023-11-04T15:27:37.130771+0000","last_clean":"2023-11-04T15:27:37.130771+0000","last_became_active":"2023-11-04T15:27:36.144083+0000","last_became_peered":"2023-11-04T15:27:36.144083+0000","last_unstale":"2023-11-04T15:27:37.130771+0000","last_undegraded":"2023-11-04T15:27:37.130771+0000","last_fullsized":"2023-11-04T15:27:37.130771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:32:27.370984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.137581+0000","last_change":"2023-11-04T15:27:36.147265+0000","last_active":"2023-11-04T15:27:37.137581+0000","last_peered":"2023-11-04T15:27:37.137581+0000","last_clean":"2023-11-04T15:27:37.137581+0000","last_became_active":"2023-11-04T15:27:36.146546+0000","last_became_peered":"2023-11-04T15:27:36.146546+0000","last_unstale":"2023-11-04T15:27:37.137581+0000","last_undegraded":"2023-11-04T15:27:37.137581+0000","last_fullsized":"2023-11-04T15:27:37.137581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:41:10.315016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.131630+0000","last_change":"2023-11-04T15:27:36.144341+0000","last_active":"2023-11-04T15:27:37.131630+0000","last_peered":"2023-11-04T15:27:37.131630+0000","last_clean":"2023-11-04T15:27:37.131630+0000","last_became_active":"2023-11-04T15:27:36.144047+0000","last_became_peered":"2023-11-04T15:27:36.144047+0000","last_unstale":"2023-11-04T15:27:37.131630+0000","last_undegraded":"2023-11-04T15:27:37.131630+0000","last_fullsized":"2023-11-04T15:27:37.131630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:36:21.960547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.131685+0000","last_change":"2023-11-04T15:27:36.146439+0000","last_active":"2023-11-04T15:27:37.131685+0000","last_peered":"2023-11-04T15:27:37.131685+0000","last_clean":"2023-11-04T15:27:37.131685+0000","last_became_active":"2023-11-04T15:27:36.144458+0000","last_became_peered":"2023-11-04T15:27:36.144458+0000","last_unstale":"2023-11-04T15:27:37.131685+0000","last_undegraded":"2023-11-04T15:27:37.131685+0000","last_fullsized":"2023-11-04T15:27:37.131685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:52:55.975636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138690+0000","last_change":"2023-11-04T15:27:36.151339+0000","last_active":"2023-11-04T15:27:37.138690+0000","last_peered":"2023-11-04T15:27:37.138690+0000","last_clean":"2023-11-04T15:27:37.138690+0000","last_became_active":"2023-11-04T15:27:36.150270+0000","last_became_peered":"2023-11-04T15:27:36.150270+0000","last_unstale":"2023-11-04T15:27:37.138690+0000","last_undegraded":"2023-11-04T15:27:37.138690+0000","last_fullsized":"2023-11-04T15:27:37.138690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:18:00.808576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.131656+0000","last_change":"2023-11-04T15:27:36.149388+0000","last_active":"2023-11-04T15:27:37.131656+0000","last_peered":"2023-11-04T15:27:37.131656+0000","last_clean":"2023-11-04T15:27:37.131656+0000","last_became_active":"2023-11-04T15:27:36.148825+0000","last_became_peered":"2023-11-04T15:27:36.148825+0000","last_unstale":"2023-11-04T15:27:37.131656+0000","last_undegraded":"2023-11-04T15:27:37.131656+0000","last_fullsized":"2023-11-04T15:27:37.131656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:27:25.258046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199860+0000","last_change":"2023-11-04T15:27:36.145651+0000","last_active":"2023-11-04T15:27:38.199860+0000","last_peered":"2023-11-04T15:27:38.199860+0000","last_clean":"2023-11-04T15:27:38.199860+0000","last_became_active":"2023-11-04T15:27:36.145392+0000","last_became_peered":"2023-11-04T15:27:36.145392+0000","last_unstale":"2023-11-04T15:27:38.199860+0000","last_undegraded":"2023-11-04T15:27:38.199860+0000","last_fullsized":"2023-11-04T15:27:38.199860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:12:07.727740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.137860+0000","last_change":"2023-11-04T15:27:36.145527+0000","last_active":"2023-11-04T15:27:37.137860+0000","last_peered":"2023-11-04T15:27:37.137860+0000","last_clean":"2023-11-04T15:27:37.137860+0000","last_became_active":"2023-11-04T15:27:36.145273+0000","last_became_peered":"2023-11-04T15:27:36.145273+0000","last_unstale":"2023-11-04T15:27:37.137860+0000","last_undegraded":"2023-11-04T15:27:37.137860+0000","last_fullsized":"2023-11-04T15:27:37.137860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:27:25.258046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.130831+0000","last_change":"2023-11-04T15:27:36.146680+0000","last_active":"2023-11-04T15:27:37.130831+0000","last_peered":"2023-11-04T15:27:37.130831+0000","last_clean":"2023-11-04T15:27:37.130831+0000","last_became_active":"2023-11-04T15:27:36.144053+0000","last_became_peered":"2023-11-04T15:27:36.144053+0000","last_unstale":"2023-11-04T15:27:37.130831+0000","last_undegraded":"2023-11-04T15:27:37.130831+0000","last_fullsized":"2023-11-04T15:27:37.130831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:41:10.315016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138844+0000","last_change":"2023-11-04T15:27:36.148707+0000","last_active":"2023-11-04T15:27:37.138844+0000","last_peered":"2023-11-04T15:27:37.138844+0000","last_clean":"2023-11-04T15:27:37.138844+0000","last_became_active":"2023-11-04T15:27:36.148342+0000","last_became_peered":"2023-11-04T15:27:36.148342+0000","last_unstale":"2023-11-04T15:27:37.138844+0000","last_undegraded":"2023-11-04T15:27:37.138844+0000","last_fullsized":"2023-11-04T15:27:37.138844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:47:40.350777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.131523+0000","last_change":"2023-11-04T15:27:36.149431+0000","last_active":"2023-11-04T15:27:37.131523+0000","last_peered":"2023-11-04T15:27:37.131523+0000","last_clean":"2023-11-04T15:27:37.131523+0000","last_became_active":"2023-11-04T15:27:36.148951+0000","last_became_peered":"2023-11-04T15:27:36.148951+0000","last_unstale":"2023-11-04T15:27:37.131523+0000","last_undegraded":"2023-11-04T15:27:37.131523+0000","last_fullsized":"2023-11-04T15:27:37.131523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:58:32.190696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.149532+0000","last_change":"2023-11-04T15:27:35.775931+0000","last_active":"2023-11-04T15:27:36.149532+0000","last_peered":"2023-11-04T15:27:36.149532+0000","last_clean":"2023-11-04T15:27:36.149532+0000","last_became_active":"2023-11-04T15:27:35.775616+0000","last_became_peered":"2023-11-04T15:27:35.775616+0000","last_unstale":"2023-11-04T15:27:36.149532+0000","last_undegraded":"2023-11-04T15:27:36.149532+0000","last_fullsized":"2023-11-04T15:27:36.149532+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:14:34.175377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138328+0000","last_change":"2023-11-04T15:27:36.150592+0000","last_active":"2023-11-04T15:27:37.138328+0000","last_peered":"2023-11-04T15:27:37.138328+0000","last_clean":"2023-11-04T15:27:37.138328+0000","last_became_active":"2023-11-04T15:27:36.150276+0000","last_became_peered":"2023-11-04T15:27:36.150276+0000","last_unstale":"2023-11-04T15:27:37.138328+0000","last_undegraded":"2023-11-04T15:27:37.138328+0000","last_fullsized":"2023-11-04T15:27:37.138328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T22:54:18.576814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.129297+0000","last_change":"2023-11-04T15:27:35.776610+0000","last_active":"2023-11-04T15:27:36.129297+0000","last_peered":"2023-11-04T15:27:36.129297+0000","last_clean":"2023-11-04T15:27:36.129297+0000","last_became_active":"2023-11-04T15:27:35.776297+0000","last_became_peered":"2023-11-04T15:27:35.776297+0000","last_unstale":"2023-11-04T15:27:36.129297+0000","last_undegraded":"2023-11-04T15:27:36.129297+0000","last_fullsized":"2023-11-04T15:27:36.129297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:11:01.495068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199760+0000","last_change":"2023-11-04T15:27:36.139847+0000","last_active":"2023-11-04T15:27:38.199760+0000","last_peered":"2023-11-04T15:27:38.199760+0000","last_clean":"2023-11-04T15:27:38.199760+0000","last_became_active":"2023-11-04T15:27:36.139580+0000","last_became_peered":"2023-11-04T15:27:36.139580+0000","last_unstale":"2023-11-04T15:27:38.199760+0000","last_undegraded":"2023-11-04T15:27:38.199760+0000","last_fullsized":"2023-11-04T15:27:38.199760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:38:30.379384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.132950+0000","last_change":"2023-11-04T15:27:35.775977+0000","last_active":"2023-11-04T15:27:36.132950+0000","last_peered":"2023-11-04T15:27:36.132950+0000","last_clean":"2023-11-04T15:27:36.132950+0000","last_became_active":"2023-11-04T15:27:35.775486+0000","last_became_peered":"2023-11-04T15:27:35.775486+0000","last_unstale":"2023-11-04T15:27:36.132950+0000","last_undegraded":"2023-11-04T15:27:36.132950+0000","last_fullsized":"2023-11-04T15:27:36.132950+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:44:09.266115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199570+0000","last_change":"2023-11-04T15:27:36.140633+0000","last_active":"2023-11-04T15:27:38.199570+0000","last_peered":"2023-11-04T15:27:38.199570+0000","last_clean":"2023-11-04T15:27:38.199570+0000","last_became_active":"2023-11-04T15:27:36.139789+0000","last_became_peered":"2023-11-04T15:27:36.139789+0000","last_unstale":"2023-11-04T15:27:38.199570+0000","last_undegraded":"2023-11-04T15:27:38.199570+0000","last_fullsized":"2023-11-04T15:27:38.199570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:55:13.470788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.153862+0000","last_change":"2023-11-04T15:27:35.776168+0000","last_active":"2023-11-04T15:27:36.153862+0000","last_peered":"2023-11-04T15:27:36.153862+0000","last_clean":"2023-11-04T15:27:36.153862+0000","last_became_active":"2023-11-04T15:27:35.775895+0000","last_became_peered":"2023-11-04T15:27:35.775895+0000","last_unstale":"2023-11-04T15:27:36.153862+0000","last_undegraded":"2023-11-04T15:27:36.153862+0000","last_fullsized":"2023-11-04T15:27:36.153862+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:02:27.460776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.143449+0000","last_change":"2023-11-04T15:27:35.767890+0000","last_active":"2023-11-04T15:27:36.143449+0000","last_peered":"2023-11-04T15:27:36.143449+0000","last_clean":"2023-11-04T15:27:36.143449+0000","last_became_active":"2023-11-04T15:27:35.767594+0000","last_became_peered":"2023-11-04T15:27:35.767594+0000","last_unstale":"2023-11-04T15:27:36.143449+0000","last_undegraded":"2023-11-04T15:27:36.143449+0000","last_fullsized":"2023-11-04T15:27:36.143449+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:11:01.495068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138172+0000","last_change":"2023-11-04T15:27:36.148637+0000","last_active":"2023-11-04T15:27:37.138172+0000","last_peered":"2023-11-04T15:27:37.138172+0000","last_clean":"2023-11-04T15:27:37.138172+0000","last_became_active":"2023-11-04T15:27:36.148282+0000","last_became_peered":"2023-11-04T15:27:36.148282+0000","last_unstale":"2023-11-04T15:27:37.138172+0000","last_undegraded":"2023-11-04T15:27:37.138172+0000","last_fullsized":"2023-11-04T15:27:37.138172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:28:21.024990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.148423+0000","last_change":"2023-11-04T15:27:35.771839+0000","last_active":"2023-11-04T15:27:36.148423+0000","last_peered":"2023-11-04T15:27:36.148423+0000","last_clean":"2023-11-04T15:27:36.148423+0000","last_became_active":"2023-11-04T15:27:35.771554+0000","last_became_peered":"2023-11-04T15:27:35.771554+0000","last_unstale":"2023-11-04T15:27:36.148423+0000","last_undegraded":"2023-11-04T15:27:36.148423+0000","last_fullsized":"2023-11-04T15:27:36.148423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:02:11.972760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.139120+0000","last_change":"2023-11-04T15:27:36.149455+0000","last_active":"2023-11-04T15:27:37.139120+0000","last_peered":"2023-11-04T15:27:37.139120+0000","last_clean":"2023-11-04T15:27:37.139120+0000","last_became_active":"2023-11-04T15:27:36.149146+0000","last_became_peered":"2023-11-04T15:27:36.149146+0000","last_unstale":"2023-11-04T15:27:37.139120+0000","last_undegraded":"2023-11-04T15:27:37.139120+0000","last_fullsized":"2023-11-04T15:27:37.139120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:14:54.847413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.153434+0000","last_change":"2023-11-04T15:27:35.773978+0000","last_active":"2023-11-04T15:27:36.153434+0000","last_peered":"2023-11-04T15:27:36.153434+0000","last_clean":"2023-11-04T15:27:36.153434+0000","last_became_active":"2023-11-04T15:27:35.773689+0000","last_became_peered":"2023-11-04T15:27:35.773689+0000","last_unstale":"2023-11-04T15:27:36.153434+0000","last_undegraded":"2023-11-04T15:27:36.153434+0000","last_fullsized":"2023-11-04T15:27:36.153434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:52:13.268866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.139684+0000","last_change":"2023-11-04T15:27:36.141984+0000","last_active":"2023-11-04T15:27:37.139684+0000","last_peered":"2023-11-04T15:27:37.139684+0000","last_clean":"2023-11-04T15:27:37.139684+0000","last_became_active":"2023-11-04T15:27:36.141695+0000","last_became_peered":"2023-11-04T15:27:36.141695+0000","last_unstale":"2023-11-04T15:27:37.139684+0000","last_undegraded":"2023-11-04T15:27:37.139684+0000","last_fullsized":"2023-11-04T15:27:37.139684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:45:22.367523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.132473+0000","last_change":"2023-11-04T15:27:35.774108+0000","last_active":"2023-11-04T15:27:36.132473+0000","last_peered":"2023-11-04T15:27:36.132473+0000","last_clean":"2023-11-04T15:27:36.132473+0000","last_became_active":"2023-11-04T15:27:35.773818+0000","last_became_peered":"2023-11-04T15:27:35.773818+0000","last_unstale":"2023-11-04T15:27:36.132473+0000","last_undegraded":"2023-11-04T15:27:36.132473+0000","last_fullsized":"2023-11-04T15:27:36.132473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:42:49.218866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199659+0000","last_change":"2023-11-04T15:27:36.150909+0000","last_active":"2023-11-04T15:27:38.199659+0000","last_peered":"2023-11-04T15:27:38.199659+0000","last_clean":"2023-11-04T15:27:38.199659+0000","last_became_active":"2023-11-04T15:27:36.150653+0000","last_became_peered":"2023-11-04T15:27:36.150653+0000","last_unstale":"2023-11-04T15:27:38.199659+0000","last_undegraded":"2023-11-04T15:27:38.199659+0000","last_fullsized":"2023-11-04T15:27:38.199659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:36:21.960547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.152189+0000","last_change":"2023-11-04T15:27:35.773128+0000","last_active":"2023-11-04T15:27:36.152189+0000","last_peered":"2023-11-04T15:27:36.152189+0000","last_clean":"2023-11-04T15:27:36.152189+0000","last_became_active":"2023-11-04T15:27:35.772815+0000","last_became_peered":"2023-11-04T15:27:35.772815+0000","last_unstale":"2023-11-04T15:27:36.152189+0000","last_undegraded":"2023-11-04T15:27:36.152189+0000","last_fullsized":"2023-11-04T15:27:36.152189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:42:49.218866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138405+0000","last_change":"2023-11-04T15:27:36.151451+0000","last_active":"2023-11-04T15:27:37.138405+0000","last_peered":"2023-11-04T15:27:37.138405+0000","last_clean":"2023-11-04T15:27:37.138405+0000","last_became_active":"2023-11-04T15:27:36.150667+0000","last_became_peered":"2023-11-04T15:27:36.150667+0000","last_unstale":"2023-11-04T15:27:37.138405+0000","last_undegraded":"2023-11-04T15:27:37.138405+0000","last_fullsized":"2023-11-04T15:27:37.138405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:55:13.470788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.131250+0000","last_change":"2023-11-04T15:27:35.775559+0000","last_active":"2023-11-04T15:27:36.131250+0000","last_peered":"2023-11-04T15:27:36.131250+0000","last_clean":"2023-11-04T15:27:36.131250+0000","last_became_active":"2023-11-04T15:27:35.775063+0000","last_became_peered":"2023-11-04T15:27:35.775063+0000","last_unstale":"2023-11-04T15:27:36.131250+0000","last_undegraded":"2023-11-04T15:27:36.131250+0000","last_fullsized":"2023-11-04T15:27:36.131250+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:30:45.293294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138337+0000","last_change":"2023-11-04T15:27:36.140390+0000","last_active":"2023-11-04T15:27:37.138337+0000","last_peered":"2023-11-04T15:27:37.138337+0000","last_clean":"2023-11-04T15:27:37.138337+0000","last_became_active":"2023-11-04T15:27:36.139103+0000","last_became_peered":"2023-11-04T15:27:36.139103+0000","last_unstale":"2023-11-04T15:27:37.138337+0000","last_undegraded":"2023-11-04T15:27:37.138337+0000","last_fullsized":"2023-11-04T15:27:37.138337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:59:35.340281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.133063+0000","last_change":"2023-11-04T15:27:35.773686+0000","last_active":"2023-11-04T15:27:36.133063+0000","last_peered":"2023-11-04T15:27:36.133063+0000","last_clean":"2023-11-04T15:27:36.133063+0000","last_became_active":"2023-11-04T15:27:35.773449+0000","last_became_peered":"2023-11-04T15:27:35.773449+0000","last_unstale":"2023-11-04T15:27:36.133063+0000","last_undegraded":"2023-11-04T15:27:36.133063+0000","last_fullsized":"2023-11-04T15:27:36.133063+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:17:14.527023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.139466+0000","last_change":"2023-11-04T15:27:36.141355+0000","last_active":"2023-11-04T15:27:37.139466+0000","last_peered":"2023-11-04T15:27:37.139466+0000","last_clean":"2023-11-04T15:27:37.139466+0000","last_became_active":"2023-11-04T15:27:36.141086+0000","last_became_peered":"2023-11-04T15:27:36.141086+0000","last_unstale":"2023-11-04T15:27:37.139466+0000","last_undegraded":"2023-11-04T15:27:37.139466+0000","last_fullsized":"2023-11-04T15:27:37.139466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:28:45.715407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.141205+0000","last_change":"2023-11-04T15:27:35.770858+0000","last_active":"2023-11-04T15:27:36.141205+0000","last_peered":"2023-11-04T15:27:36.141205+0000","last_clean":"2023-11-04T15:27:36.141205+0000","last_became_active":"2023-11-04T15:27:35.769001+0000","last_became_peered":"2023-11-04T15:27:35.769001+0000","last_unstale":"2023-11-04T15:27:36.141205+0000","last_undegraded":"2023-11-04T15:27:36.141205+0000","last_fullsized":"2023-11-04T15:27:36.141205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:01:29.923726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.131681+0000","last_change":"2023-11-04T15:27:36.148390+0000","last_active":"2023-11-04T15:27:37.131681+0000","last_peered":"2023-11-04T15:27:37.131681+0000","last_clean":"2023-11-04T15:27:37.131681+0000","last_became_active":"2023-11-04T15:27:36.147034+0000","last_became_peered":"2023-11-04T15:27:36.147034+0000","last_unstale":"2023-11-04T15:27:37.131681+0000","last_undegraded":"2023-11-04T15:27:37.131681+0000","last_fullsized":"2023-11-04T15:27:37.131681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:14:54.847413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":167,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.136344+0000","last_change":"2023-11-04T15:27:26.267129+0000","last_active":"2023-11-04T15:27:36.136344+0000","last_peered":"2023-11-04T15:27:36.136344+0000","last_clean":"2023-11-04T15:27:36.136344+0000","last_became_active":"2023-11-04T15:27:26.266242+0000","last_became_peered":"2023-11-04T15:27:26.266242+0000","last_unstale":"2023-11-04T15:27:36.136344+0000","last_undegraded":"2023-11-04T15:27:36.136344+0000","last_fullsized":"2023-11-04T15:27:36.136344+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:25.163848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:25.163848+0000","last_clean_scrub_stamp":"2023-11-04T15:27:25.163848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:54:55.231471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.130334+0000","last_change":"2023-11-04T15:27:31.620178+0000","last_active":"2023-11-04T15:27:36.130334+0000","last_peered":"2023-11-04T15:27:36.130334+0000","last_clean":"2023-11-04T15:27:36.130334+0000","last_became_active":"2023-11-04T15:27:31.619798+0000","last_became_peered":"2023-11-04T15:27:31.619798+0000","last_unstale":"2023-11-04T15:27:36.130334+0000","last_undegraded":"2023-11-04T15:27:36.130334+0000","last_fullsized":"2023-11-04T15:27:36.130334+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:50:31.717109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.141439+0000","last_change":"2023-11-04T15:27:35.769689+0000","last_active":"2023-11-04T15:27:36.141439+0000","last_peered":"2023-11-04T15:27:36.141439+0000","last_clean":"2023-11-04T15:27:36.141439+0000","last_became_active":"2023-11-04T15:27:35.769150+0000","last_became_peered":"2023-11-04T15:27:35.769150+0000","last_unstale":"2023-11-04T15:27:36.141439+0000","last_undegraded":"2023-11-04T15:27:36.141439+0000","last_fullsized":"2023-11-04T15:27:36.141439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:15:19.151223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138508+0000","last_change":"2023-11-04T15:27:36.140877+0000","last_active":"2023-11-04T15:27:37.138508+0000","last_peered":"2023-11-04T15:27:37.138508+0000","last_clean":"2023-11-04T15:27:37.138508+0000","last_became_active":"2023-11-04T15:27:36.140619+0000","last_became_peered":"2023-11-04T15:27:36.140619+0000","last_unstale":"2023-11-04T15:27:37.138508+0000","last_undegraded":"2023-11-04T15:27:37.138508+0000","last_fullsized":"2023-11-04T15:27:37.138508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:42:12.902707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.138612+0000","last_change":"2023-11-04T15:27:31.622106+0000","last_active":"2023-11-04T15:27:36.138612+0000","last_peered":"2023-11-04T15:27:36.138612+0000","last_clean":"2023-11-04T15:27:36.138612+0000","last_became_active":"2023-11-04T15:27:31.621889+0000","last_became_peered":"2023-11-04T15:27:31.621889+0000","last_unstale":"2023-11-04T15:27:36.138612+0000","last_undegraded":"2023-11-04T15:27:36.138612+0000","last_fullsized":"2023-11-04T15:27:36.138612+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:11:00.327441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.129140+0000","last_change":"2023-11-04T15:27:35.771207+0000","last_active":"2023-11-04T15:27:36.129140+0000","last_peered":"2023-11-04T15:27:36.129140+0000","last_clean":"2023-11-04T15:27:36.129140+0000","last_became_active":"2023-11-04T15:27:35.770364+0000","last_became_peered":"2023-11-04T15:27:35.770364+0000","last_unstale":"2023-11-04T15:27:36.129140+0000","last_undegraded":"2023-11-04T15:27:36.129140+0000","last_fullsized":"2023-11-04T15:27:36.129140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:23:45.371175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199640+0000","last_change":"2023-11-04T15:27:36.144731+0000","last_active":"2023-11-04T15:27:38.199640+0000","last_peered":"2023-11-04T15:27:38.199640+0000","last_clean":"2023-11-04T15:27:38.199640+0000","last_became_active":"2023-11-04T15:27:36.144459+0000","last_became_peered":"2023-11-04T15:27:36.144459+0000","last_unstale":"2023-11-04T15:27:38.199640+0000","last_undegraded":"2023-11-04T15:27:38.199640+0000","last_fullsized":"2023-11-04T15:27:38.199640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:28:45.715407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.142013+0000","last_change":"2023-11-04T15:27:31.622710+0000","last_active":"2023-11-04T15:27:36.142013+0000","last_peered":"2023-11-04T15:27:36.142013+0000","last_clean":"2023-11-04T15:27:36.142013+0000","last_became_active":"2023-11-04T15:27:31.622378+0000","last_became_peered":"2023-11-04T15:27:31.622378+0000","last_unstale":"2023-11-04T15:27:36.142013+0000","last_undegraded":"2023-11-04T15:27:36.142013+0000","last_fullsized":"2023-11-04T15:27:36.142013+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:49:04.803105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.141277+0000","last_change":"2023-11-04T15:27:35.774630+0000","last_active":"2023-11-04T15:27:36.141277+0000","last_peered":"2023-11-04T15:27:36.141277+0000","last_clean":"2023-11-04T15:27:36.141277+0000","last_became_active":"2023-11-04T15:27:35.774339+0000","last_became_peered":"2023-11-04T15:27:35.774339+0000","last_unstale":"2023-11-04T15:27:36.141277+0000","last_undegraded":"2023-11-04T15:27:36.141277+0000","last_fullsized":"2023-11-04T15:27:36.141277+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:44:38.690122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.131722+0000","last_change":"2023-11-04T15:27:36.148319+0000","last_active":"2023-11-04T15:27:37.131722+0000","last_peered":"2023-11-04T15:27:37.131722+0000","last_clean":"2023-11-04T15:27:37.131722+0000","last_became_active":"2023-11-04T15:27:36.146930+0000","last_became_peered":"2023-11-04T15:27:36.146930+0000","last_unstale":"2023-11-04T15:27:37.131722+0000","last_undegraded":"2023-11-04T15:27:37.131722+0000","last_fullsized":"2023-11-04T15:27:37.131722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:28:45.715407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.131327+0000","last_change":"2023-11-04T15:27:31.622105+0000","last_active":"2023-11-04T15:27:36.131327+0000","last_peered":"2023-11-04T15:27:36.131327+0000","last_clean":"2023-11-04T15:27:36.131327+0000","last_became_active":"2023-11-04T15:27:31.621849+0000","last_became_peered":"2023-11-04T15:27:31.621849+0000","last_unstale":"2023-11-04T15:27:36.131327+0000","last_undegraded":"2023-11-04T15:27:36.131327+0000","last_fullsized":"2023-11-04T15:27:36.131327+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:20:41.777316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.134218+0000","last_change":"2023-11-04T15:27:35.770188+0000","last_active":"2023-11-04T15:27:36.134218+0000","last_peered":"2023-11-04T15:27:36.134218+0000","last_clean":"2023-11-04T15:27:36.134218+0000","last_became_active":"2023-11-04T15:27:35.769730+0000","last_became_peered":"2023-11-04T15:27:35.769730+0000","last_unstale":"2023-11-04T15:27:36.134218+0000","last_undegraded":"2023-11-04T15:27:36.134218+0000","last_fullsized":"2023-11-04T15:27:36.134218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:08:22.991334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.131556+0000","last_change":"2023-11-04T15:27:36.149225+0000","last_active":"2023-11-04T15:27:37.131556+0000","last_peered":"2023-11-04T15:27:37.131556+0000","last_clean":"2023-11-04T15:27:37.131556+0000","last_became_active":"2023-11-04T15:27:36.144417+0000","last_became_peered":"2023-11-04T15:27:36.144417+0000","last_unstale":"2023-11-04T15:27:37.131556+0000","last_undegraded":"2023-11-04T15:27:37.131556+0000","last_fullsized":"2023-11-04T15:27:37.131556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:41:32.995261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.131447+0000","last_change":"2023-11-04T15:27:35.770033+0000","last_active":"2023-11-04T15:27:36.131447+0000","last_peered":"2023-11-04T15:27:36.131447+0000","last_clean":"2023-11-04T15:27:36.131447+0000","last_became_active":"2023-11-04T15:27:35.769772+0000","last_became_peered":"2023-11-04T15:27:35.769772+0000","last_unstale":"2023-11-04T15:27:36.131447+0000","last_undegraded":"2023-11-04T15:27:36.131447+0000","last_fullsized":"2023-11-04T15:27:36.131447+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:00:20.246822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.142511+0000","last_change":"2023-11-04T15:27:31.622663+0000","last_active":"2023-11-04T15:27:36.142511+0000","last_peered":"2023-11-04T15:27:36.142511+0000","last_clean":"2023-11-04T15:27:36.142511+0000","last_became_active":"2023-11-04T15:27:31.622350+0000","last_became_peered":"2023-11-04T15:27:31.622350+0000","last_unstale":"2023-11-04T15:27:36.142511+0000","last_undegraded":"2023-11-04T15:27:36.142511+0000","last_fullsized":"2023-11-04T15:27:36.142511+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:31:02.273249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.131048+0000","last_change":"2023-11-04T15:27:36.144275+0000","last_active":"2023-11-04T15:27:37.131048+0000","last_peered":"2023-11-04T15:27:37.131048+0000","last_clean":"2023-11-04T15:27:37.131048+0000","last_became_active":"2023-11-04T15:27:36.143991+0000","last_became_peered":"2023-11-04T15:27:36.143991+0000","last_unstale":"2023-11-04T15:27:37.131048+0000","last_undegraded":"2023-11-04T15:27:37.131048+0000","last_fullsized":"2023-11-04T15:27:37.131048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:48:58.102459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.142118+0000","last_change":"2023-11-04T15:27:35.769416+0000","last_active":"2023-11-04T15:27:36.142118+0000","last_peered":"2023-11-04T15:27:36.142118+0000","last_clean":"2023-11-04T15:27:36.142118+0000","last_became_active":"2023-11-04T15:27:35.769095+0000","last_became_peered":"2023-11-04T15:27:35.769095+0000","last_unstale":"2023-11-04T15:27:36.142118+0000","last_undegraded":"2023-11-04T15:27:36.142118+0000","last_fullsized":"2023-11-04T15:27:36.142118+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T22:02:04.025848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.137396+0000","last_change":"2023-11-04T15:27:31.619973+0000","last_active":"2023-11-04T15:27:36.137396+0000","last_peered":"2023-11-04T15:27:36.137396+0000","last_clean":"2023-11-04T15:27:36.137396+0000","last_became_active":"2023-11-04T15:27:31.619702+0000","last_became_peered":"2023-11-04T15:27:31.619702+0000","last_unstale":"2023-11-04T15:27:36.137396+0000","last_undegraded":"2023-11-04T15:27:36.137396+0000","last_fullsized":"2023-11-04T15:27:36.137396+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:24:34.782619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199835+0000","last_change":"2023-11-04T15:27:36.139955+0000","last_active":"2023-11-04T15:27:38.199835+0000","last_peered":"2023-11-04T15:27:38.199835+0000","last_clean":"2023-11-04T15:27:38.199835+0000","last_became_active":"2023-11-04T15:27:36.139707+0000","last_became_peered":"2023-11-04T15:27:36.139707+0000","last_unstale":"2023-11-04T15:27:38.199835+0000","last_undegraded":"2023-11-04T15:27:38.199835+0000","last_fullsized":"2023-11-04T15:27:38.199835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:58:32.190696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.151891+0000","last_change":"2023-11-04T15:27:35.768818+0000","last_active":"2023-11-04T15:27:36.151891+0000","last_peered":"2023-11-04T15:27:36.151891+0000","last_clean":"2023-11-04T15:27:36.151891+0000","last_became_active":"2023-11-04T15:27:35.768320+0000","last_became_peered":"2023-11-04T15:27:35.768320+0000","last_unstale":"2023-11-04T15:27:36.151891+0000","last_undegraded":"2023-11-04T15:27:36.151891+0000","last_fullsized":"2023-11-04T15:27:36.151891+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:14:58.601545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.142320+0000","last_change":"2023-11-04T15:27:31.624625+0000","last_active":"2023-11-04T15:27:36.142320+0000","last_peered":"2023-11-04T15:27:36.142320+0000","last_clean":"2023-11-04T15:27:36.142320+0000","last_became_active":"2023-11-04T15:27:31.624347+0000","last_became_peered":"2023-11-04T15:27:31.624347+0000","last_unstale":"2023-11-04T15:27:36.142320+0000","last_undegraded":"2023-11-04T15:27:36.142320+0000","last_fullsized":"2023-11-04T15:27:36.142320+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:53:45.131692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199126+0000","last_change":"2023-11-04T15:27:36.138145+0000","last_active":"2023-11-04T15:27:38.199126+0000","last_peered":"2023-11-04T15:27:38.199126+0000","last_clean":"2023-11-04T15:27:38.199126+0000","last_became_active":"2023-11-04T15:27:36.137897+0000","last_became_peered":"2023-11-04T15:27:36.137897+0000","last_unstale":"2023-11-04T15:27:38.199126+0000","last_undegraded":"2023-11-04T15:27:38.199126+0000","last_fullsized":"2023-11-04T15:27:38.199126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:53:25.907251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199818+0000","last_change":"2023-11-04T15:27:35.772416+0000","last_active":"2023-11-04T15:27:38.199818+0000","last_peered":"2023-11-04T15:27:38.199818+0000","last_clean":"2023-11-04T15:27:38.199818+0000","last_became_active":"2023-11-04T15:27:35.772121+0000","last_became_peered":"2023-11-04T15:27:35.772121+0000","last_unstale":"2023-11-04T15:27:38.199818+0000","last_undegraded":"2023-11-04T15:27:38.199818+0000","last_fullsized":"2023-11-04T15:27:38.199818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:58:09.475936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.132771+0000","last_change":"2023-11-04T15:27:31.620235+0000","last_active":"2023-11-04T15:27:36.132771+0000","last_peered":"2023-11-04T15:27:36.132771+0000","last_clean":"2023-11-04T15:27:36.132771+0000","last_became_active":"2023-11-04T15:27:31.619831+0000","last_became_peered":"2023-11-04T15:27:31.619831+0000","last_unstale":"2023-11-04T15:27:36.132771+0000","last_undegraded":"2023-11-04T15:27:36.132771+0000","last_fullsized":"2023-11-04T15:27:36.132771+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:44:07.412379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138914+0000","last_change":"2023-11-04T15:27:36.141133+0000","last_active":"2023-11-04T15:27:37.138914+0000","last_peered":"2023-11-04T15:27:37.138914+0000","last_clean":"2023-11-04T15:27:37.138914+0000","last_became_active":"2023-11-04T15:27:36.140871+0000","last_became_peered":"2023-11-04T15:27:36.140871+0000","last_unstale":"2023-11-04T15:27:37.138914+0000","last_undegraded":"2023-11-04T15:27:37.138914+0000","last_fullsized":"2023-11-04T15:27:37.138914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:28.095802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.139653+0000","last_change":"2023-11-04T15:27:36.139723+0000","last_active":"2023-11-04T15:27:37.139653+0000","last_peered":"2023-11-04T15:27:37.139653+0000","last_clean":"2023-11-04T15:27:37.139653+0000","last_became_active":"2023-11-04T15:27:36.139487+0000","last_became_peered":"2023-11-04T15:27:36.139487+0000","last_unstale":"2023-11-04T15:27:37.139653+0000","last_undegraded":"2023-11-04T15:27:37.139653+0000","last_fullsized":"2023-11-04T15:27:37.139653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:47:58.380308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.158730+0000","last_change":"2023-11-04T15:27:35.775665+0000","last_active":"2023-11-04T15:27:36.158730+0000","last_peered":"2023-11-04T15:27:36.158730+0000","last_clean":"2023-11-04T15:27:36.158730+0000","last_became_active":"2023-11-04T15:27:35.775356+0000","last_became_peered":"2023-11-04T15:27:35.775356+0000","last_unstale":"2023-11-04T15:27:36.158730+0000","last_undegraded":"2023-11-04T15:27:36.158730+0000","last_fullsized":"2023-11-04T15:27:36.158730+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:36:12.941030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.130995+0000","last_change":"2023-11-04T15:27:36.146737+0000","last_active":"2023-11-04T15:27:37.130995+0000","last_peered":"2023-11-04T15:27:37.130995+0000","last_clean":"2023-11-04T15:27:37.130995+0000","last_became_active":"2023-11-04T15:27:36.146464+0000","last_became_peered":"2023-11-04T15:27:36.146464+0000","last_unstale":"2023-11-04T15:27:37.130995+0000","last_undegraded":"2023-11-04T15:27:37.130995+0000","last_fullsized":"2023-11-04T15:27:37.130995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:47:40.350777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.142014+0000","last_change":"2023-11-04T15:27:35.770401+0000","last_active":"2023-11-04T15:27:36.142014+0000","last_peered":"2023-11-04T15:27:36.142014+0000","last_clean":"2023-11-04T15:27:36.142014+0000","last_became_active":"2023-11-04T15:27:35.769904+0000","last_became_peered":"2023-11-04T15:27:35.769904+0000","last_unstale":"2023-11-04T15:27:36.142014+0000","last_undegraded":"2023-11-04T15:27:36.142014+0000","last_fullsized":"2023-11-04T15:27:36.142014+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:58:09.475936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.133447+0000","last_change":"2023-11-04T15:27:35.768689+0000","last_active":"2023-11-04T15:27:36.133447+0000","last_peered":"2023-11-04T15:27:36.133447+0000","last_clean":"2023-11-04T15:27:36.133447+0000","last_became_active":"2023-11-04T15:27:35.768413+0000","last_became_peered":"2023-11-04T15:27:35.768413+0000","last_unstale":"2023-11-04T15:27:36.133447+0000","last_undegraded":"2023-11-04T15:27:36.133447+0000","last_fullsized":"2023-11-04T15:27:36.133447+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:23:45.371175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199123+0000","last_change":"2023-11-04T15:27:36.139778+0000","last_active":"2023-11-04T15:27:38.199123+0000","last_peered":"2023-11-04T15:27:38.199123+0000","last_clean":"2023-11-04T15:27:38.199123+0000","last_became_active":"2023-11-04T15:27:36.139524+0000","last_became_peered":"2023-11-04T15:27:36.139524+0000","last_unstale":"2023-11-04T15:27:38.199123+0000","last_undegraded":"2023-11-04T15:27:38.199123+0000","last_fullsized":"2023-11-04T15:27:38.199123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:27:25.258046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.132100+0000","last_change":"2023-11-04T15:27:35.776242+0000","last_active":"2023-11-04T15:27:36.132100+0000","last_peered":"2023-11-04T15:27:36.132100+0000","last_clean":"2023-11-04T15:27:36.132100+0000","last_became_active":"2023-11-04T15:27:35.775917+0000","last_became_peered":"2023-11-04T15:27:35.775917+0000","last_unstale":"2023-11-04T15:27:36.132100+0000","last_undegraded":"2023-11-04T15:27:36.132100+0000","last_fullsized":"2023-11-04T15:27:36.132100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:14:58.601545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.130771+0000","last_change":"2023-11-04T15:27:36.151371+0000","last_active":"2023-11-04T15:27:37.130771+0000","last_peered":"2023-11-04T15:27:37.130771+0000","last_clean":"2023-11-04T15:27:37.130771+0000","last_became_active":"2023-11-04T15:27:36.150557+0000","last_became_peered":"2023-11-04T15:27:36.150557+0000","last_unstale":"2023-11-04T15:27:37.130771+0000","last_undegraded":"2023-11-04T15:27:37.130771+0000","last_fullsized":"2023-11-04T15:27:37.130771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:12:07.727740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138851+0000","last_change":"2023-11-04T15:27:36.150111+0000","last_active":"2023-11-04T15:27:37.138851+0000","last_peered":"2023-11-04T15:27:37.138851+0000","last_clean":"2023-11-04T15:27:37.138851+0000","last_became_active":"2023-11-04T15:27:36.149831+0000","last_became_peered":"2023-11-04T15:27:36.149831+0000","last_unstale":"2023-11-04T15:27:37.138851+0000","last_undegraded":"2023-11-04T15:27:37.138851+0000","last_fullsized":"2023-11-04T15:27:37.138851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:16:09.862958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.141100+0000","last_change":"2023-11-04T15:27:35.770634+0000","last_active":"2023-11-04T15:27:36.141100+0000","last_peered":"2023-11-04T15:27:36.141100+0000","last_clean":"2023-11-04T15:27:36.141100+0000","last_became_active":"2023-11-04T15:27:35.770022+0000","last_became_peered":"2023-11-04T15:27:35.770022+0000","last_unstale":"2023-11-04T15:27:36.141100+0000","last_undegraded":"2023-11-04T15:27:36.141100+0000","last_fullsized":"2023-11-04T15:27:36.141100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:03:49.354013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199639+0000","last_change":"2023-11-04T15:27:36.139190+0000","last_active":"2023-11-04T15:27:38.199639+0000","last_peered":"2023-11-04T15:27:38.199639+0000","last_clean":"2023-11-04T15:27:38.199639+0000","last_became_active":"2023-11-04T15:27:36.138908+0000","last_became_peered":"2023-11-04T15:27:36.138908+0000","last_unstale":"2023-11-04T15:27:38.199639+0000","last_undegraded":"2023-11-04T15:27:38.199639+0000","last_fullsized":"2023-11-04T15:27:38.199639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:32:27.370984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.141402+0000","last_change":"2023-11-04T15:27:35.768190+0000","last_active":"2023-11-04T15:27:36.141402+0000","last_peered":"2023-11-04T15:27:36.141402+0000","last_clean":"2023-11-04T15:27:36.141402+0000","last_became_active":"2023-11-04T15:27:35.767858+0000","last_became_peered":"2023-11-04T15:27:35.767858+0000","last_unstale":"2023-11-04T15:27:36.141402+0000","last_undegraded":"2023-11-04T15:27:36.141402+0000","last_fullsized":"2023-11-04T15:27:36.141402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:55:22.956180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199427+0000","last_change":"2023-11-04T15:27:36.143718+0000","last_active":"2023-11-04T15:27:38.199427+0000","last_peered":"2023-11-04T15:27:38.199427+0000","last_clean":"2023-11-04T15:27:38.199427+0000","last_became_active":"2023-11-04T15:27:36.143442+0000","last_became_peered":"2023-11-04T15:27:36.143442+0000","last_unstale":"2023-11-04T15:27:38.199427+0000","last_undegraded":"2023-11-04T15:27:38.199427+0000","last_fullsized":"2023-11-04T15:27:38.199427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:45:22.367523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.148708+0000","last_change":"2023-11-04T15:27:35.771653+0000","last_active":"2023-11-04T15:27:36.148708+0000","last_peered":"2023-11-04T15:27:36.148708+0000","last_clean":"2023-11-04T15:27:36.148708+0000","last_became_active":"2023-11-04T15:27:35.770539+0000","last_became_peered":"2023-11-04T15:27:35.770539+0000","last_unstale":"2023-11-04T15:27:36.148708+0000","last_undegraded":"2023-11-04T15:27:36.148708+0000","last_fullsized":"2023-11-04T15:27:36.148708+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:14:58.601545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.131407+0000","last_change":"2023-11-04T15:27:36.148481+0000","last_active":"2023-11-04T15:27:37.131407+0000","last_peered":"2023-11-04T15:27:37.131407+0000","last_clean":"2023-11-04T15:27:37.131407+0000","last_became_active":"2023-11-04T15:27:36.146477+0000","last_became_peered":"2023-11-04T15:27:36.146477+0000","last_unstale":"2023-11-04T15:27:37.131407+0000","last_undegraded":"2023-11-04T15:27:37.131407+0000","last_fullsized":"2023-11-04T15:27:37.131407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:53:25.907251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.140802+0000","last_change":"2023-11-04T15:27:35.772092+0000","last_active":"2023-11-04T15:27:36.140802+0000","last_peered":"2023-11-04T15:27:36.140802+0000","last_clean":"2023-11-04T15:27:36.140802+0000","last_became_active":"2023-11-04T15:27:35.771316+0000","last_became_peered":"2023-11-04T15:27:35.771316+0000","last_unstale":"2023-11-04T15:27:36.140802+0000","last_undegraded":"2023-11-04T15:27:36.140802+0000","last_fullsized":"2023-11-04T15:27:36.140802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:00:20.246822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.139555+0000","last_change":"2023-11-04T15:27:36.144382+0000","last_active":"2023-11-04T15:27:37.139555+0000","last_peered":"2023-11-04T15:27:37.139555+0000","last_clean":"2023-11-04T15:27:37.139555+0000","last_became_active":"2023-11-04T15:27:36.144066+0000","last_became_peered":"2023-11-04T15:27:36.144066+0000","last_unstale":"2023-11-04T15:27:37.139555+0000","last_undegraded":"2023-11-04T15:27:37.139555+0000","last_fullsized":"2023-11-04T15:27:37.139555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:41:32.995261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.143653+0000","last_change":"2023-11-04T15:27:35.768679+0000","last_active":"2023-11-04T15:27:36.143653+0000","last_peered":"2023-11-04T15:27:36.143653+0000","last_clean":"2023-11-04T15:27:36.143653+0000","last_became_active":"2023-11-04T15:27:35.767852+0000","last_became_peered":"2023-11-04T15:27:35.767852+0000","last_unstale":"2023-11-04T15:27:36.143653+0000","last_undegraded":"2023-11-04T15:27:36.143653+0000","last_fullsized":"2023-11-04T15:27:36.143653+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:47:47.130490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.139704+0000","last_change":"2023-11-04T15:27:36.141439+0000","last_active":"2023-11-04T15:27:37.139704+0000","last_peered":"2023-11-04T15:27:37.139704+0000","last_clean":"2023-11-04T15:27:37.139704+0000","last_became_active":"2023-11-04T15:27:36.141167+0000","last_became_peered":"2023-11-04T15:27:36.141167+0000","last_unstale":"2023-11-04T15:27:37.139704+0000","last_undegraded":"2023-11-04T15:27:37.139704+0000","last_fullsized":"2023-11-04T15:27:37.139704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:22:21.262360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.148043+0000","last_change":"2023-11-04T15:27:35.775629+0000","last_active":"2023-11-04T15:27:36.148043+0000","last_peered":"2023-11-04T15:27:36.148043+0000","last_clean":"2023-11-04T15:27:36.148043+0000","last_became_active":"2023-11-04T15:27:35.775171+0000","last_became_peered":"2023-11-04T15:27:35.775171+0000","last_unstale":"2023-11-04T15:27:36.148043+0000","last_undegraded":"2023-11-04T15:27:36.148043+0000","last_fullsized":"2023-11-04T15:27:36.148043+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:13:42.865721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:38.199233+0000","last_change":"2023-11-04T15:27:36.146049+0000","last_active":"2023-11-04T15:27:38.199233+0000","last_peered":"2023-11-04T15:27:38.199233+0000","last_clean":"2023-11-04T15:27:38.199233+0000","last_became_active":"2023-11-04T15:27:36.145560+0000","last_became_peered":"2023-11-04T15:27:36.145560+0000","last_unstale":"2023-11-04T15:27:38.199233+0000","last_undegraded":"2023-11-04T15:27:38.199233+0000","last_fullsized":"2023-11-04T15:27:38.199233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:14:54.847413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.140784+0000","last_change":"2023-11-04T15:27:35.771225+0000","last_active":"2023-11-04T15:27:36.140784+0000","last_peered":"2023-11-04T15:27:36.140784+0000","last_clean":"2023-11-04T15:27:36.140784+0000","last_became_active":"2023-11-04T15:27:35.770873+0000","last_became_peered":"2023-11-04T15:27:35.770873+0000","last_unstale":"2023-11-04T15:27:36.140784+0000","last_undegraded":"2023-11-04T15:27:36.140784+0000","last_fullsized":"2023-11-04T15:27:36.140784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:02:11.972760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T15:27:37.138996+0000","last_change":"2023-11-04T15:27:36.148228+0000","last_active":"2023-11-04T15:27:37.138996+0000","last_peered":"2023-11-04T15:27:37.138996+0000","last_clean":"2023-11-04T15:27:37.138996+0000","last_became_active":"2023-11-04T15:27:36.147535+0000","last_became_peered":"2023-11-04T15:27:36.147535+0000","last_unstale":"2023-11-04T15:27:37.138996+0000","last_undegraded":"2023-11-04T15:27:37.138996+0000","last_fullsized":"2023-11-04T15:27:37.138996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:48:58.102459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-04T15:27:36.147803+0000","last_change":"2023-11-04T15:27:35.776315+0000","last_active":"2023-11-04T15:27:36.147803+0000","last_peered":"2023-11-04T15:27:36.147803+0000","last_clean":"2023-11-04T15:27:36.147803+0000","last_became_active":"2023-11-04T15:27:35.775918+0000","last_became_peered":"2023-11-04T15:27:35.775918+0000","last_unstale":"2023-11-04T15:27:36.147803+0000","last_undegraded":"2023-11-04T15:27:36.147803+0000","last_fullsized":"2023-11-04T15:27:36.147803+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:08:22.991334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705672,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":798720,"data_stored":653237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]}]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":200704,"data_stored":62307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":176128,"data_stored":60597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":782336,"data_stored":651707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T15:27:48.990 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-04T15:27:48.991 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-04T15:27:48.991 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-04T15:27:48.991 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-04T15:27:49.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.129+0000 7f15af64c640 1 Processor -- start 2023-11-04T15:27:49.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.129+0000 7f15af64c640 1 -- start start 2023-11-04T15:27:49.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.130+0000 7f15af64c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15a8133ea0 0x7f15a8134280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:49.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.130+0000 7f15af64c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f15a8139ff0 0x7f15a813a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:49.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.130+0000 7f15af64c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15a81347c0 con 0x7f15a813a930 2023-11-04T15:27:49.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.130+0000 7f15af64c640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15a80a0e90 con 0x7f15a8139ff0 2023-11-04T15:27:49.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.130+0000 7f15af64c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a8136a80 con 0x7f15a8133ea0 2023-11-04T15:27:49.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.130+0000 7f15ad3e8640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15a8133ea0 0x7f15a8134280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:49.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.130+0000 7f15ad3e8640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15a8133ea0 0x7f15a8134280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.19:49444/0 (socket says 172.21.15.19:49444) 2023-11-04T15:27:49.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.130+0000 7f15ad3e8640 1 -- 172.21.15.19:0/3406968506 learned_addr learned my addr 172.21.15.19:0/3406968506 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:49.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.130+0000 7f15acbe7640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f15a8139ff0 0x7f15a813a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:49.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.130+0000 7f15a7fff640 1 -- 172.21.15.19:0/3406968506 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3738656433 0 0) 0x7f15a0001110 con 0x7f15a813a930 2023-11-04T15:27:49.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.130+0000 7f15a7fff640 1 -- 172.21.15.19:0/3406968506 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1590003520 con 0x7f15a813a930 2023-11-04T15:27:49.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.130+0000 7f15ad3e8640 1 -- 172.21.15.19:0/3406968506 >> v2:172.21.15.96:3300/0 conn(0x7f15a8139ff0 msgr2=0x7f15a813a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:49.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.130+0000 7f15ad3e8640 1 --2- 172.21.15.19:0/3406968506 >> v2:172.21.15.96:3300/0 conn(0x7f15a8139ff0 0x7f15a813a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:49.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.130+0000 7f15ad3e8640 1 -- 172.21.15.19:0/3406968506 >> v1:172.21.15.96:6789/0 conn(0x7f15a813a930 legacy=0x7f15a8141320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:49.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.130+0000 7f15ad3e8640 1 -- 172.21.15.19:0/3406968506 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a80a0c10 con 0x7f15a8133ea0 2023-11-04T15:27:49.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.131+0000 7f15ad3e8640 1 --2- 172.21.15.19:0/3406968506 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15a8133ea0 0x7f15a8134280 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1598009e50 tx=0x7f159802be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e249fde1c65181ef server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:49.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.131+0000 7f15a7fff640 1 -- 172.21.15.19:0/3406968506 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159802c9e0 con 0x7f15a8133ea0 2023-11-04T15:27:49.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.132+0000 7f15a7fff640 1 -- 172.21.15.19:0/3406968506 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159802cb40 con 0x7f15a8133ea0 2023-11-04T15:27:49.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.132+0000 7f15a7fff640 1 -- 172.21.15.19:0/3406968506 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15980343f0 con 0x7f15a8133ea0 2023-11-04T15:27:49.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.132+0000 7f15af64c640 1 -- 172.21.15.19:0/3406968506 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15a8133ea0 msgr2=0x7f15a8134280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:49.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.132+0000 7f15af64c640 1 --2- 172.21.15.19:0/3406968506 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15a8133ea0 0x7f15a8134280 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1598009e50 tx=0x7f159802be40 comp rx=0 tx=0).stop 2023-11-04T15:27:49.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.132+0000 7f15af64c640 1 -- 172.21.15.19:0/3406968506 shutdown_connections 2023-11-04T15:27:49.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.132+0000 7f15af64c640 1 --2- 172.21.15.19:0/3406968506 >> v2:172.21.15.96:3300/0 conn(0x7f15a8139ff0 0x7f15a813a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:49.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.132+0000 7f15af64c640 1 --2- 172.21.15.19:0/3406968506 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15a8133ea0 0x7f15a8134280 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:49.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.132+0000 7f15af64c640 1 -- 172.21.15.19:0/3406968506 >> 172.21.15.19:0/3406968506 conn(0x7f15a80a5e20 msgr2=0x7f15a80a6230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:49.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.132+0000 7f15af64c640 1 -- 172.21.15.19:0/3406968506 shutdown_connections 2023-11-04T15:27:49.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.132+0000 7f15af64c640 1 -- 172.21.15.19:0/3406968506 wait complete. 2023-11-04T15:27:49.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.133+0000 7f15af64c640 1 Processor -- start 2023-11-04T15:27:49.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.133+0000 7f15af64c640 1 -- start start 2023-11-04T15:27:49.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.134+0000 7f15af64c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15a8133ea0 0x7f15a809be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:49.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.134+0000 7f15af64c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15a8139ff0 0x7f15a809c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:49.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.134+0000 7f15af64c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15a813a930 0x7f15a809c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:49.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.134+0000 7f15af64c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a80716e0 con 0x7f15a813a930 2023-11-04T15:27:49.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.134+0000 7f15af64c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a809d500 con 0x7f15a8139ff0 2023-11-04T15:27:49.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.134+0000 7f15af64c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a8071920 con 0x7f15a8133ea0 2023-11-04T15:27:49.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.134+0000 7f15adbe9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15a813a930 0x7f15a809c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:49.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.134+0000 7f15adbe9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15a813a930 0x7f15a809c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53876/0 (socket says 172.21.15.19:53876) 2023-11-04T15:27:49.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.134+0000 7f15adbe9640 1 -- 172.21.15.19:0/3044369527 learned_addr learned my addr 172.21.15.19:0/3044369527 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:49.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.134+0000 7f15acbe7640 1 --2- 172.21.15.19:0/3044369527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15a8139ff0 0x7f15a809c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:49.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.134+0000 7f15ad3e8640 1 --2- 172.21.15.19:0/3044369527 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15a8133ea0 0x7f15a809be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:49.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.134+0000 7f15adbe9640 1 -- 172.21.15.19:0/3044369527 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15a8133ea0 msgr2=0x7f15a809be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:49.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.134+0000 7f15adbe9640 1 --2- 172.21.15.19:0/3044369527 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15a8133ea0 0x7f15a809be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:49.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.134+0000 7f15adbe9640 1 -- 172.21.15.19:0/3044369527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15a8139ff0 msgr2=0x7f15a809c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:49.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.134+0000 7f15adbe9640 1 --2- 172.21.15.19:0/3044369527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15a8139ff0 0x7f15a809c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:49.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.134+0000 7f15adbe9640 1 -- 172.21.15.19:0/3044369527 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1598009b30 con 0x7f15a813a930 2023-11-04T15:27:49.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.134+0000 7f15adbe9640 1 --2- 172.21.15.19:0/3044369527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15a813a930 0x7f15a809c890 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f15a0007fd0 tx=0x7f15a000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:49.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.134+0000 7f15a5ffb640 1 -- 172.21.15.19:0/3044369527 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a00052d0 con 0x7f15a813a930 2023-11-04T15:27:49.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.134+0000 7f15a5ffb640 1 -- 172.21.15.19:0/3044369527 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a0005450 con 0x7f15a813a930 2023-11-04T15:27:49.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.134+0000 7f15af64c640 1 -- 172.21.15.19:0/3044369527 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15a809de10 con 0x7f15a813a930 2023-11-04T15:27:49.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.134+0000 7f15a5ffb640 1 -- 172.21.15.19:0/3044369527 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a0003830 con 0x7f15a813a930 2023-11-04T15:27:49.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.135+0000 7f15af64c640 1 -- 172.21.15.19:0/3044369527 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a809fa60 con 0x7f15a813a930 2023-11-04T15:27:49.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.136+0000 7f15af64c640 1 -- 172.21.15.19:0/3044369527 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15a809ecf0 con 0x7f15a813a930 2023-11-04T15:27:49.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.136+0000 7f15a5ffb640 1 -- 172.21.15.19:0/3044369527 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f15a0003a50 con 0x7f15a813a930 2023-11-04T15:27:49.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.136+0000 7f15a5ffb640 1 --2- 172.21.15.19:0/3044369527 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f159406a430 0x7f159406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:49.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.137+0000 7f15a5ffb640 1 -- 172.21.15.19:0/3044369527 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f15a00876c0 con 0x7f15a813a930 2023-11-04T15:27:49.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.137+0000 7f15ad3e8640 1 --2- 172.21.15.19:0/3044369527 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f159406a430 0x7f159406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:49.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.137+0000 7f15ad3e8640 1 --2- 172.21.15.19:0/3044369527 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f159406a430 0x7f159406c8f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1598035000 tx=0x7f1598030000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:49.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.141+0000 7f15a5ffb640 1 -- 172.21.15.19:0/3044369527 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f15a0053350 con 0x7f15a813a930 2023-11-04T15:27:49.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.354+0000 7f15af64c640 1 -- 172.21.15.19:0/3044369527 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f15a809ef10 con 0x7f15a813a930 2023-11-04T15:27:49.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.354+0000 7f15a5ffb640 1 -- 172.21.15.19:0/3044369527 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f15a0056970 con 0x7f15a813a930 2023-11-04T15:27:49.355 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:27:49.356 INFO:teuthology.orchestra.run.smithi019.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-04T15:27:49.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.356+0000 7f15af64c640 1 -- 172.21.15.19:0/3044369527 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f159406a430 msgr2=0x7f159406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:49.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.356+0000 7f15af64c640 1 --2- 172.21.15.19:0/3044369527 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f159406a430 0x7f159406c8f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1598035000 tx=0x7f1598030000 comp rx=0 tx=0).stop 2023-11-04T15:27:49.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.356+0000 7f15af64c640 1 -- 172.21.15.19:0/3044369527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15a813a930 msgr2=0x7f15a809c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:49.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.356+0000 7f15af64c640 1 --2- 172.21.15.19:0/3044369527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15a813a930 0x7f15a809c890 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f15a0007fd0 tx=0x7f15a000c820 comp rx=0 tx=0).stop 2023-11-04T15:27:49.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.356+0000 7f15af64c640 1 -- 172.21.15.19:0/3044369527 shutdown_connections 2023-11-04T15:27:49.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.356+0000 7f15af64c640 1 --2- 172.21.15.19:0/3044369527 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f159406a430 0x7f159406c8f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:49.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.356+0000 7f15af64c640 1 --2- 172.21.15.19:0/3044369527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15a813a930 0x7f15a809c890 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:49.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.356+0000 7f15af64c640 1 --2- 172.21.15.19:0/3044369527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15a8139ff0 0x7f15a809c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:49.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.356+0000 7f15af64c640 1 --2- 172.21.15.19:0/3044369527 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15a8133ea0 0x7f15a809be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:49.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.356+0000 7f15af64c640 1 -- 172.21.15.19:0/3044369527 >> 172.21.15.19:0/3044369527 conn(0x7f15a80a5e20 msgr2=0x7f15a80a6f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:49.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.356+0000 7f15af64c640 1 -- 172.21.15.19:0/3044369527 shutdown_connections 2023-11-04T15:27:49.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.356+0000 7f15af64c640 1 -- 172.21.15.19:0/3044369527 wait complete. 2023-11-04T15:27:49.368 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-04T15:27:49.369 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T15:27:49.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.474+0000 7f315faf7640 1 Processor -- start 2023-11-04T15:27:49.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.474+0000 7f315faf7640 1 -- start start 2023-11-04T15:27:49.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.474+0000 7f315faf7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3158137270 0x7f31580a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:49.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.474+0000 7f315faf7640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3158137650 0x7f315813a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:49.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.475+0000 7f315faf7640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31580a4c20 con 0x7f31580a3e90 2023-11-04T15:27:49.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.475+0000 7f315faf7640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31580a3060 con 0x7f3158137270 2023-11-04T15:27:49.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.475+0000 7f315faf7640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31580a5080 con 0x7f3158137650 2023-11-04T15:27:49.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.475+0000 7f315d893640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3158137270 0x7f31580a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:49.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.475+0000 7f315d092640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f31580a3e90 0x7f3158139f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60960/0 (socket says 172.21.15.19:60960) 2023-11-04T15:27:49.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.475+0000 7f315d092640 1 -- 172.21.15.19:0/3164015732 learned_addr learned my addr 172.21.15.19:0/3164015732 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:49.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.475+0000 7f315e094640 1 --2- 172.21.15.19:0/3164015732 >> v2:172.21.15.96:3300/0 conn(0x7f3158137650 0x7f315813a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:49.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.475+0000 7f315d893640 1 -- 172.21.15.19:0/3164015732 >> v2:172.21.15.96:3300/0 conn(0x7f3158137650 msgr2=0x7f315813a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:49.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.475+0000 7f315d893640 1 --2- 172.21.15.19:0/3164015732 >> v2:172.21.15.96:3300/0 conn(0x7f3158137650 0x7f315813a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:49.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.475+0000 7f315d893640 1 -- 172.21.15.19:0/3164015732 >> v1:172.21.15.19:6789/0 conn(0x7f31580a3e90 legacy=0x7f3158139f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:49.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.475+0000 7f315d893640 1 -- 172.21.15.19:0/3164015732 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31580a3440 con 0x7f3158137270 2023-11-04T15:27:49.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.476+0000 7f315d893640 1 --2- 172.21.15.19:0/3164015732 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3158137270 0x7f31580a6200 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f31580a5800 tx=0x7f315402b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4fda7dffe3f2c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:49.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.476+0000 7f315c891640 1 -- 172.21.15.19:0/3164015732 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3154031710 con 0x7f3158137270 2023-11-04T15:27:49.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.476+0000 7f315c891640 1 -- 172.21.15.19:0/3164015732 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315402f050 con 0x7f3158137270 2023-11-04T15:27:49.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.476+0000 7f315c891640 1 -- 172.21.15.19:0/3164015732 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3154031a90 con 0x7f3158137270 2023-11-04T15:27:49.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.476+0000 7f315faf7640 1 -- 172.21.15.19:0/3164015732 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3158137270 msgr2=0x7f31580a6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:49.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.476+0000 7f315faf7640 1 --2- 172.21.15.19:0/3164015732 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3158137270 0x7f31580a6200 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f31580a5800 tx=0x7f315402b7b0 comp rx=0 tx=0).stop 2023-11-04T15:27:49.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.476+0000 7f315faf7640 1 -- 172.21.15.19:0/3164015732 shutdown_connections 2023-11-04T15:27:49.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.476+0000 7f315faf7640 1 --2- 172.21.15.19:0/3164015732 >> v2:172.21.15.96:3300/0 conn(0x7f3158137650 0x7f315813a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:49.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.476+0000 7f315faf7640 1 --2- 172.21.15.19:0/3164015732 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3158137270 0x7f31580a6200 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:49.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.476+0000 7f315faf7640 1 -- 172.21.15.19:0/3164015732 >> 172.21.15.19:0/3164015732 conn(0x7f31580a8d70 msgr2=0x7f31580a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:49.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.477+0000 7f315faf7640 1 -- 172.21.15.19:0/3164015732 shutdown_connections 2023-11-04T15:27:49.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.477+0000 7f315faf7640 1 -- 172.21.15.19:0/3164015732 wait complete. 2023-11-04T15:27:49.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.477+0000 7f315faf7640 1 Processor -- start 2023-11-04T15:27:49.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.478+0000 7f315faf7640 1 -- start start 2023-11-04T15:27:49.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.478+0000 7f315faf7640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f31580a3e90 0x7f31581ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:49.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.478+0000 7f315faf7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3158137270 0x7f31581cf400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:49.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.478+0000 7f315faf7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3158137650 0x7f31581cf940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:49.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.478+0000 7f315faf7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31580a09e0 con 0x7f3158137650 2023-11-04T15:27:49.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.478+0000 7f315faf7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315809e630 con 0x7f3158137270 2023-11-04T15:27:49.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.478+0000 7f315faf7640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f315809ec20 con 0x7f31580a3e90 2023-11-04T15:27:49.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.478+0000 7f315e094640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3158137650 0x7f31581cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:49.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.478+0000 7f315e094640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3158137650 0x7f31581cf940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53896/0 (socket says 172.21.15.19:53896) 2023-11-04T15:27:49.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.478+0000 7f315e094640 1 -- 172.21.15.19:0/2355367073 learned_addr learned my addr 172.21.15.19:0/2355367073 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:49.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.478+0000 7f315d092640 1 --2- 172.21.15.19:0/2355367073 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3158137270 0x7f31581cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:49.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.478+0000 7f315e094640 1 -- 172.21.15.19:0/2355367073 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f31580a3e90 msgr2=0x7f31581ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:49.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.478+0000 7f315e094640 1 --2- 172.21.15.19:0/2355367073 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f31580a3e90 0x7f31581ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:49.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.478+0000 7f315e094640 1 -- 172.21.15.19:0/2355367073 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3158137270 msgr2=0x7f31581cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:49.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.478+0000 7f315e094640 1 --2- 172.21.15.19:0/2355367073 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3158137270 0x7f31581cf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:49.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.478+0000 7f315e094640 1 -- 172.21.15.19:0/2355367073 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3154009400 con 0x7f3158137650 2023-11-04T15:27:49.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.478+0000 7f315e094640 1 --2- 172.21.15.19:0/2355367073 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3158137650 0x7f31581cf940 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3150007e40 tx=0x7f315000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:49.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.479+0000 7f314e7fc640 1 -- 172.21.15.19:0/2355367073 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3150014620 con 0x7f3158137650 2023-11-04T15:27:49.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.479+0000 7f314e7fc640 1 -- 172.21.15.19:0/2355367073 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315000ee90 con 0x7f3158137650 2023-11-04T15:27:49.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.479+0000 7f315faf7640 1 -- 172.21.15.19:0/2355367073 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f315809f290 con 0x7f3158137650 2023-11-04T15:27:49.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.479+0000 7f314e7fc640 1 -- 172.21.15.19:0/2355367073 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31500149e0 con 0x7f3158137650 2023-11-04T15:27:49.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.479+0000 7f315faf7640 1 -- 172.21.15.19:0/2355367073 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f315809e280 con 0x7f3158137650 2023-11-04T15:27:49.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.480+0000 7f315faf7640 1 -- 172.21.15.19:0/2355367073 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3158067d60 con 0x7f3158137650 2023-11-04T15:27:49.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.480+0000 7f314e7fc640 1 -- 172.21.15.19:0/2355367073 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3150014b40 con 0x7f3158137650 2023-11-04T15:27:49.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.480+0000 7f314e7fc640 1 --2- 172.21.15.19:0/2355367073 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f313c06a430 0x7f313c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:49.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.480+0000 7f314e7fc640 1 -- 172.21.15.19:0/2355367073 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f3150088c90 con 0x7f3158137650 2023-11-04T15:27:49.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.480+0000 7f315d893640 1 --2- 172.21.15.19:0/2355367073 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f313c06a430 0x7f313c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:49.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.481+0000 7f315d893640 1 --2- 172.21.15.19:0/2355367073 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f313c06a430 0x7f313c06c8f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3154035000 tx=0x7f3154030000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:49.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.485+0000 7f314e7fc640 1 -- 172.21.15.19:0/2355367073 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3150054870 con 0x7f3158137650 2023-11-04T15:27:49.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.662+0000 7f315faf7640 1 -- 172.21.15.19:0/2355367073 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f315809e770 con 0x7f3158137650 2023-11-04T15:27:49.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.663+0000 7f314e7fc640 1 -- 172.21.15.19:0/2355367073 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+13180 (secure 0 0 0) 0x7f3150057e90 con 0x7f3158137650 2023-11-04T15:27:49.664 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:27:49.664 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":19,"fsid":"e87311d5-496a-4b07-9654-358fe5bbf950","created":"2023-11-04T15:27:14.865121+0000","modified":"2023-11-04T15:27:37.127226+0000","last_up_change":"2023-11-04T15:27:24.162282+0000","last_in_change":"2023-11-04T15:27:15.971035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T15:27:24.987312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-04T15:27:30.500235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-04T15:27:34.476271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-04T15:27:35.096759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"34818469-ebf2-4dd4-8119-af19a0121036","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":82879},{"type":"v1","addr":"172.21.15.19:6801","nonce":82879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":82879},{"type":"v1","addr":"172.21.15.19:6803","nonce":82879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":82879},{"type":"v1","addr":"172.21.15.19:6807","nonce":82879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":82879},{"type":"v1","addr":"172.21.15.19:6805","nonce":82879}]},"public_addr":"172.21.15.19:6801/82879","cluster_addr":"172.21.15.19:6803/82879","heartbeat_back_addr":"172.21.15.19:6807/82879","heartbeat_front_addr":"172.21.15.19:6805/82879","state":["exists","up"]},{"osd":1,"uuid":"92dab290-7912-4eea-b6f6-c754c2480721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":82880},{"type":"v1","addr":"172.21.15.19:6809","nonce":82880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":82880},{"type":"v1","addr":"172.21.15.19:6811","nonce":82880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":82880},{"type":"v1","addr":"172.21.15.19:6815","nonce":82880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":82880},{"type":"v1","addr":"172.21.15.19:6813","nonce":82880}]},"public_addr":"172.21.15.19:6809/82880","cluster_addr":"172.21.15.19:6811/82880","heartbeat_back_addr":"172.21.15.19:6815/82880","heartbeat_front_addr":"172.21.15.19:6813/82880","state":["exists","up"]},{"osd":2,"uuid":"1be47db4-6dd1-4ce5-832b-bc6ad30c78c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":83458},{"type":"v1","addr":"172.21.15.96:6808","nonce":83458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":83458},{"type":"v1","addr":"172.21.15.96:6811","nonce":83458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":83458},{"type":"v1","addr":"172.21.15.96:6815","nonce":83458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":83458},{"type":"v1","addr":"172.21.15.96:6813","nonce":83458}]},"public_addr":"172.21.15.96:6808/83458","cluster_addr":"172.21.15.96:6811/83458","heartbeat_back_addr":"172.21.15.96:6815/83458","heartbeat_front_addr":"172.21.15.96:6813/83458","state":["exists","up"]},{"osd":3,"uuid":"46505800-d64f-49ef-b811-5b5979f48252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":83459},{"type":"v1","addr":"172.21.15.96:6801","nonce":83459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":83459},{"type":"v1","addr":"172.21.15.96:6803","nonce":83459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6807","nonce":83459},{"type":"v1","addr":"172.21.15.96:6809","nonce":83459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":83459},{"type":"v1","addr":"172.21.15.96:6805","nonce":83459}]},"public_addr":"172.21.15.96:6801/83459","cluster_addr":"172.21.15.96:6803/83459","heartbeat_back_addr":"172.21.15.96:6809/83459","heartbeat_front_addr":"172.21.15.96:6805/83459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.081547+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.132075+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.094919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.074106+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T15:27:49.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.665+0000 7f315faf7640 1 -- 172.21.15.19:0/2355367073 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f313c06a430 msgr2=0x7f313c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:49.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.665+0000 7f315faf7640 1 --2- 172.21.15.19:0/2355367073 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f313c06a430 0x7f313c06c8f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3154035000 tx=0x7f3154030000 comp rx=0 tx=0).stop 2023-11-04T15:27:49.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.665+0000 7f315faf7640 1 -- 172.21.15.19:0/2355367073 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3158137650 msgr2=0x7f31581cf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:49.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.665+0000 7f315faf7640 1 --2- 172.21.15.19:0/2355367073 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3158137650 0x7f31581cf940 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3150007e40 tx=0x7f315000e4b0 comp rx=0 tx=0).stop 2023-11-04T15:27:49.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.665+0000 7f315faf7640 1 -- 172.21.15.19:0/2355367073 shutdown_connections 2023-11-04T15:27:49.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.665+0000 7f315faf7640 1 --2- 172.21.15.19:0/2355367073 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f313c06a430 0x7f313c06c8f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:49.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.665+0000 7f315faf7640 1 --2- 172.21.15.19:0/2355367073 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3158137650 0x7f31581cf940 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:49.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.665+0000 7f315faf7640 1 --2- 172.21.15.19:0/2355367073 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3158137270 0x7f31581cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:49.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.665+0000 7f315faf7640 1 --2- 172.21.15.19:0/2355367073 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f31580a3e90 0x7f31581ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:49.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.665+0000 7f315faf7640 1 -- 172.21.15.19:0/2355367073 >> 172.21.15.19:0/2355367073 conn(0x7f31580a8d70 msgr2=0x7f3158139d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:49.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.665+0000 7f315faf7640 1 -- 172.21.15.19:0/2355367073 shutdown_connections 2023-11-04T15:27:49.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.665+0000 7f315faf7640 1 -- 172.21.15.19:0/2355367073 wait complete. 2023-11-04T15:27:49.677 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T15:27:24.987312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-04T15:27:30.500235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T15:27:34.476271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T15:27:35.096759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T15:27:49.677 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T15:27:49.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.784+0000 7fbf38e77640 1 Processor -- start 2023-11-04T15:27:49.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.784+0000 7fbf38e77640 1 -- start start 2023-11-04T15:27:49.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.785+0000 7fbf38e77640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbf34136090 0x7fbf34136470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:49.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.785+0000 7fbf38e77640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbf340a6370 0x7fbf3413a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:49.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.785+0000 7fbf38e77640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbf3413a670 0x7fbf3413ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:49.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.785+0000 7fbf38e77640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf340a68d0 con 0x7fbf34136090 2023-11-04T15:27:49.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.785+0000 7fbf38e77640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf340abe60 con 0x7fbf3413a670 2023-11-04T15:27:49.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.785+0000 7fbf38e77640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf340a30a0 con 0x7fbf340a6370 2023-11-04T15:27:49.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.785+0000 7fbf3259c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbf34136090 0x7fbf34136470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:49.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.785+0000 7fbf3259c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbf34136090 0x7fbf34136470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54516/0 (socket says 172.21.15.19:54516) 2023-11-04T15:27:49.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.785+0000 7fbf3259c640 1 -- 172.21.15.19:0/138038920 learned_addr learned my addr 172.21.15.19:0/138038920 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:49.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.785+0000 7fbf32d9d640 1 --2- 172.21.15.19:0/138038920 >> v2:172.21.15.96:3300/0 conn(0x7fbf3413a670 0x7fbf3413ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:49.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.785+0000 7fbf31d9b640 1 --2- 172.21.15.19:0/138038920 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbf340a6370 0x7fbf3413a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:49.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.785+0000 7fbf3259c640 1 -- 172.21.15.19:0/138038920 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbf340a6370 msgr2=0x7fbf3413a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:49.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.785+0000 7fbf3259c640 1 --2- 172.21.15.19:0/138038920 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbf340a6370 0x7fbf3413a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:49.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.785+0000 7fbf3259c640 1 -- 172.21.15.19:0/138038920 >> v2:172.21.15.96:3300/0 conn(0x7fbf3413a670 msgr2=0x7fbf3413ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:49.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.785+0000 7fbf3259c640 1 --2- 172.21.15.19:0/138038920 >> v2:172.21.15.96:3300/0 conn(0x7fbf3413a670 0x7fbf3413ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:49.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.785+0000 7fbf3259c640 1 -- 172.21.15.19:0/138038920 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf340a4b90 con 0x7fbf34136090 2023-11-04T15:27:49.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.786+0000 7fbf3259c640 1 --2- 172.21.15.19:0/138038920 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf34136090 0x7fbf34136470 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbf340ac290 tx=0x7fbf2c02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be60b98e86f558e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:49.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.786+0000 7fbf3159a640 1 -- 172.21.15.19:0/138038920 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c031750 con 0x7fbf34136090 2023-11-04T15:27:49.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.786+0000 7fbf3159a640 1 -- 172.21.15.19:0/138038920 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2c0318b0 con 0x7fbf34136090 2023-11-04T15:27:49.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.786+0000 7fbf3159a640 1 -- 172.21.15.19:0/138038920 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c031c40 con 0x7fbf34136090 2023-11-04T15:27:49.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.786+0000 7fbf38e77640 1 -- 172.21.15.19:0/138038920 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf34136090 msgr2=0x7fbf34136470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:49.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.786+0000 7fbf38e77640 1 --2- 172.21.15.19:0/138038920 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf34136090 0x7fbf34136470 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbf340ac290 tx=0x7fbf2c02b7f0 comp rx=0 tx=0).stop 2023-11-04T15:27:49.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.786+0000 7fbf38e77640 1 -- 172.21.15.19:0/138038920 shutdown_connections 2023-11-04T15:27:49.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.786+0000 7fbf38e77640 1 --2- 172.21.15.19:0/138038920 >> v2:172.21.15.96:3300/0 conn(0x7fbf3413a670 0x7fbf3413ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:49.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.786+0000 7fbf38e77640 1 --2- 172.21.15.19:0/138038920 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbf340a6370 0x7fbf3413a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:49.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.786+0000 7fbf38e77640 1 --2- 172.21.15.19:0/138038920 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf34136090 0x7fbf34136470 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:49.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.786+0000 7fbf38e77640 1 -- 172.21.15.19:0/138038920 >> 172.21.15.19:0/138038920 conn(0x7fbf340ac3f0 msgr2=0x7fbf340ac800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:49.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.787+0000 7fbf38e77640 1 -- 172.21.15.19:0/138038920 shutdown_connections 2023-11-04T15:27:49.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.787+0000 7fbf38e77640 1 -- 172.21.15.19:0/138038920 wait complete. 2023-11-04T15:27:49.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.788+0000 7fbf38e77640 1 Processor -- start 2023-11-04T15:27:49.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.788+0000 7fbf38e77640 1 -- start start 2023-11-04T15:27:49.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.788+0000 7fbf38e77640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf340a6370 0x7fbf3412ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:49.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.788+0000 7fbf38e77640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbf34136090 0x7fbf3412f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:49.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.788+0000 7fbf38e77640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf3413a670 0x7fbf341ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:49.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.788+0000 7fbf38e77640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf340992c0 con 0x7fbf340a6370 2023-11-04T15:27:49.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.788+0000 7fbf38e77640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf34099880 con 0x7fbf3413a670 2023-11-04T15:27:49.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.788+0000 7fbf38e77640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf340994b0 con 0x7fbf34136090 2023-11-04T15:27:49.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.788+0000 7fbf3259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf340a6370 0x7fbf3412ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:49.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.788+0000 7fbf3259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf340a6370 0x7fbf3412ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54520/0 (socket says 172.21.15.19:54520) 2023-11-04T15:27:49.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.788+0000 7fbf3259c640 1 -- 172.21.15.19:0/141736490 learned_addr learned my addr 172.21.15.19:0/141736490 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:49.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.788+0000 7fbf32d9d640 1 --2- 172.21.15.19:0/141736490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf3413a670 0x7fbf341ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:49.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.788+0000 7fbf31d9b640 1 --2- 172.21.15.19:0/141736490 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbf34136090 0x7fbf3412f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:49.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.788+0000 7fbf3259c640 1 -- 172.21.15.19:0/141736490 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbf34136090 msgr2=0x7fbf3412f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:49.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.788+0000 7fbf3259c640 1 --2- 172.21.15.19:0/141736490 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbf34136090 0x7fbf3412f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:49.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.788+0000 7fbf3259c640 1 -- 172.21.15.19:0/141736490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf3413a670 msgr2=0x7fbf341ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:49.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.788+0000 7fbf3259c640 1 --2- 172.21.15.19:0/141736490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf3413a670 0x7fbf341ce9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:49.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.788+0000 7fbf3259c640 1 -- 172.21.15.19:0/141736490 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf2c0094d0 con 0x7fbf340a6370 2023-11-04T15:27:49.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.789+0000 7fbf3259c640 1 --2- 172.21.15.19:0/141736490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf340a6370 0x7fbf3412ee90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c0097c0 tx=0x7fbf2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:49.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.789+0000 7fbf22ffd640 1 -- 172.21.15.19:0/141736490 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c033c80 con 0x7fbf340a6370 2023-11-04T15:27:49.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.789+0000 7fbf22ffd640 1 -- 172.21.15.19:0/141736490 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2c033de0 con 0x7fbf340a6370 2023-11-04T15:27:49.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.789+0000 7fbf38e77640 1 -- 172.21.15.19:0/141736490 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf34099e70 con 0x7fbf340a6370 2023-11-04T15:27:49.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.789+0000 7fbf22ffd640 1 -- 172.21.15.19:0/141736490 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c03c640 con 0x7fbf340a6370 2023-11-04T15:27:49.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.789+0000 7fbf38e77640 1 -- 172.21.15.19:0/141736490 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf3409a250 con 0x7fbf340a6370 2023-11-04T15:27:49.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.790+0000 7fbf38e77640 1 -- 172.21.15.19:0/141736490 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf34067d60 con 0x7fbf340a6370 2023-11-04T15:27:49.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.790+0000 7fbf22ffd640 1 -- 172.21.15.19:0/141736490 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbf2c03a040 con 0x7fbf340a6370 2023-11-04T15:27:49.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.790+0000 7fbf22ffd640 1 --2- 172.21.15.19:0/141736490 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fbf1406a430 0x7fbf1406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:49.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.791+0000 7fbf22ffd640 1 -- 172.21.15.19:0/141736490 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7fbf2c0a9fe0 con 0x7fbf340a6370 2023-11-04T15:27:49.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.791+0000 7fbf31d9b640 1 --2- 172.21.15.19:0/141736490 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fbf1406a430 0x7fbf1406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:49.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.791+0000 7fbf31d9b640 1 --2- 172.21.15.19:0/141736490 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fbf1406a430 0x7fbf1406c8f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbf340a99f0 tx=0x7fbf28008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:49.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.795+0000 7fbf22ffd640 1 -- 172.21.15.19:0/141736490 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbf2c075c50 con 0x7fbf340a6370 2023-11-04T15:27:49.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.971+0000 7fbf38e77640 1 -- 172.21.15.19:0/141736490 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbf3412f910 con 0x7fbf340a6370 2023-11-04T15:27:49.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.971+0000 7fbf22ffd640 1 -- 172.21.15.19:0/141736490 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbf2c0380a0 con 0x7fbf340a6370 2023-11-04T15:27:49.972 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-11-04T15:27:49.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.973+0000 7fbf38e77640 1 -- 172.21.15.19:0/141736490 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fbf1406a430 msgr2=0x7fbf1406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:49.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.973+0000 7fbf38e77640 1 --2- 172.21.15.19:0/141736490 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fbf1406a430 0x7fbf1406c8f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbf340a99f0 tx=0x7fbf28008040 comp rx=0 tx=0).stop 2023-11-04T15:27:49.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.973+0000 7fbf38e77640 1 -- 172.21.15.19:0/141736490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf340a6370 msgr2=0x7fbf3412ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:49.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.973+0000 7fbf38e77640 1 --2- 172.21.15.19:0/141736490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf340a6370 0x7fbf3412ee90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c0097c0 tx=0x7fbf2c0046c0 comp rx=0 tx=0).stop 2023-11-04T15:27:49.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.973+0000 7fbf38e77640 1 -- 172.21.15.19:0/141736490 shutdown_connections 2023-11-04T15:27:49.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.973+0000 7fbf38e77640 1 --2- 172.21.15.19:0/141736490 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fbf1406a430 0x7fbf1406c8f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:49.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.973+0000 7fbf38e77640 1 --2- 172.21.15.19:0/141736490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf3413a670 0x7fbf341ce9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:49.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.973+0000 7fbf38e77640 1 --2- 172.21.15.19:0/141736490 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbf34136090 0x7fbf3412f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:49.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.973+0000 7fbf38e77640 1 --2- 172.21.15.19:0/141736490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf340a6370 0x7fbf3412ee90 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:49.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.973+0000 7fbf38e77640 1 -- 172.21.15.19:0/141736490 >> 172.21.15.19:0/141736490 conn(0x7fbf340ac3f0 msgr2=0x7fbf34135320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:49.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.973+0000 7fbf38e77640 1 -- 172.21.15.19:0/141736490 shutdown_connections 2023-11-04T15:27:49.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:49.973+0000 7fbf38e77640 1 -- 172.21.15.19:0/141736490 wait complete. 2023-11-04T15:27:49.984 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-04T15:27:50.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.092+0000 7f601e78b640 1 Processor -- start 2023-11-04T15:27:50.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.092+0000 7f601e78b640 1 -- start start 2023-11-04T15:27:50.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.093+0000 7f601e78b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f601812e770 0x7f6018099300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:50.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.093+0000 7f601e78b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f601812eb50 0x7f6018070170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:50.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.093+0000 7f601e78b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6018071c50 con 0x7f60180706b0 2023-11-04T15:27:50.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.093+0000 7f601e78b640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6018099c60 con 0x7f601812e770 2023-11-04T15:27:50.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.093+0000 7f601e78b640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6018065990 con 0x7f601812eb50 2023-11-04T15:27:50.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.093+0000 7f601cd28640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f60180706b0 0x7f601813f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41496/0 (socket says 172.21.15.19:41496) 2023-11-04T15:27:50.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.093+0000 7f601cd28640 1 -- 172.21.15.19:0/2782454672 learned_addr learned my addr 172.21.15.19:0/2782454672 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:50.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.093+0000 7f6016ffd640 1 -- 172.21.15.19:0/2782454672 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2040981250 0 0) 0x7f6018071c50 con 0x7f60180706b0 2023-11-04T15:27:50.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.093+0000 7f6017fff640 1 --2- 172.21.15.19:0/2782454672 >> v2:172.21.15.96:3300/0 conn(0x7f601812e770 0x7f6018099300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:50.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.093+0000 7f6016ffd640 1 -- 172.21.15.19:0/2782454672 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6000003520 con 0x7f60180706b0 2023-11-04T15:27:50.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.093+0000 7f60177fe640 1 --2- 172.21.15.19:0/2782454672 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f601812eb50 0x7f6018070170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:50.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.094+0000 7f6016ffd640 1 -- 172.21.15.19:0/2782454672 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3372208340 0 0) 0x7f6000003520 con 0x7f60180706b0 2023-11-04T15:27:50.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.094+0000 7f6016ffd640 1 -- 172.21.15.19:0/2782454672 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f601812eb50 msgr2=0x7f6018070170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:50.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.094+0000 7f6016ffd640 1 --2- 172.21.15.19:0/2782454672 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f601812eb50 0x7f6018070170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:50.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.094+0000 7f6016ffd640 1 -- 172.21.15.19:0/2782454672 >> v2:172.21.15.96:3300/0 conn(0x7f601812e770 msgr2=0x7f6018099300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:50.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.094+0000 7f6016ffd640 1 --2- 172.21.15.19:0/2782454672 >> v2:172.21.15.96:3300/0 conn(0x7f601812e770 0x7f6018099300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:50.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.094+0000 7f6016ffd640 1 -- 172.21.15.19:0/2782454672 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6018065c50 con 0x7f60180706b0 2023-11-04T15:27:50.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.094+0000 7f6016ffd640 1 -- 172.21.15.19:0/2782454672 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3646097784 0 0) 0x7f60100019f0 con 0x7f60180706b0 2023-11-04T15:27:50.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.094+0000 7f6016ffd640 1 -- 172.21.15.19:0/2782454672 >> v1:172.21.15.19:6789/0 conn(0x7f60180706b0 legacy=0x7f601813f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:50.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.094+0000 7f6016ffd640 1 --2- 172.21.15.19:0/2782454672 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6000003970 0x7f6000003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:50.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.094+0000 7f6016ffd640 1 --2- 172.21.15.19:0/2782454672 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f601812eb50 0x7f60000047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:50.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.094+0000 7f6016ffd640 1 --2- 172.21.15.19:0/2782454672 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6000004d00 0x7f6000005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:50.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.094+0000 7f6016ffd640 1 -- 172.21.15.19:0/2782454672 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6018099c60 con 0x7f6000003970 2023-11-04T15:27:50.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.094+0000 7f6016ffd640 1 -- 172.21.15.19:0/2782454672 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6018065990 con 0x7f6000004d00 2023-11-04T15:27:50.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.094+0000 7f6016ffd640 1 -- 172.21.15.19:0/2782454672 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600000ba00 con 0x7f601812eb50 2023-11-04T15:27:50.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.094+0000 7f6017fff640 1 --2- 172.21.15.19:0/2782454672 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6000003970 0x7f6000003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:50.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.094+0000 7f60177fe640 1 --2- 172.21.15.19:0/2782454672 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f601812eb50 0x7f60000047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:50.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.094+0000 7f601cd28640 1 --2- 172.21.15.19:0/2782454672 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6000004d00 0x7f6000005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:50.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.094+0000 7f6017fff640 1 -- 172.21.15.19:0/2782454672 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f601812eb50 msgr2=0x7f60000047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:50.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.094+0000 7f6017fff640 1 --2- 172.21.15.19:0/2782454672 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f601812eb50 0x7f60000047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:50.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.094+0000 7f6017fff640 1 -- 172.21.15.19:0/2782454672 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6000004d00 msgr2=0x7f6000005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:50.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.094+0000 7f6017fff640 1 --2- 172.21.15.19:0/2782454672 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6000004d00 0x7f6000005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:50.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.094+0000 7f6017fff640 1 -- 172.21.15.19:0/2782454672 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6000003520 con 0x7f6000003970 2023-11-04T15:27:50.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.094+0000 7f60177fe640 1 --2- 172.21.15.19:0/2782454672 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f601812eb50 0x7f60000047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:27:50.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.094+0000 7f601cd28640 1 --2- 172.21.15.19:0/2782454672 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6000004d00 0x7f6000005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:27:50.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.095+0000 7f6017fff640 1 --2- 172.21.15.19:0/2782454672 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6000003970 0x7f6000003d90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6008009ac0 tx=0x7f60000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c0d18cb6f79fdcf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:50.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.095+0000 7f6016ffd640 1 -- 172.21.15.19:0/2782454672 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600802c710 con 0x7f6000003970 2023-11-04T15:27:50.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.095+0000 7f6016ffd640 1 -- 172.21.15.19:0/2782454672 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600802c870 con 0x7f6000003970 2023-11-04T15:27:50.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.095+0000 7f6016ffd640 1 -- 172.21.15.19:0/2782454672 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600802cc00 con 0x7f6000003970 2023-11-04T15:27:50.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.095+0000 7f601e78b640 1 -- 172.21.15.19:0/2782454672 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6000003970 msgr2=0x7f6000003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:50.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.095+0000 7f601e78b640 1 --2- 172.21.15.19:0/2782454672 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6000003970 0x7f6000003d90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6008009ac0 tx=0x7f60000057f0 comp rx=0 tx=0).stop 2023-11-04T15:27:50.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.095+0000 7f601cd28640 1 -- 172.21.15.19:0/2782454672 reap_dead start 2023-11-04T15:27:50.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.095+0000 7f601e78b640 1 -- 172.21.15.19:0/2782454672 shutdown_connections 2023-11-04T15:27:50.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.095+0000 7f601e78b640 1 -- 172.21.15.19:0/2782454672 >> 172.21.15.19:0/2782454672 conn(0x7f60180a8920 msgr2=0x7f60180a8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:50.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.096+0000 7f601e78b640 1 -- 172.21.15.19:0/2782454672 shutdown_connections 2023-11-04T15:27:50.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.096+0000 7f601e78b640 1 -- 172.21.15.19:0/2782454672 wait complete. 2023-11-04T15:27:50.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.096+0000 7f601e78b640 1 Processor -- start 2023-11-04T15:27:50.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.097+0000 7f601e78b640 1 -- start start 2023-11-04T15:27:50.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.097+0000 7f601e78b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6000003970 0x7f60181c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:50.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.097+0000 7f601e78b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f60181c9c90 0x7f60181cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:50.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.097+0000 7f601e78b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60181ca110 0x7f60181cce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:50.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.097+0000 7f601e78b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6018137500 con 0x7f6000003970 2023-11-04T15:27:50.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.097+0000 7f601e78b640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601809e000 con 0x7f60181ca110 2023-11-04T15:27:50.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.097+0000 7f601e78b640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60181c94b0 con 0x7f60181c9c90 2023-11-04T15:27:50.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.097+0000 7f6017fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6000003970 0x7f60181c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:50.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.097+0000 7f6017fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6000003970 0x7f60181c9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54542/0 (socket says 172.21.15.19:54542) 2023-11-04T15:27:50.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.097+0000 7f6017fff640 1 -- 172.21.15.19:0/1423394118 learned_addr learned my addr 172.21.15.19:0/1423394118 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:50.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.097+0000 7f6017fff640 1 -- 172.21.15.19:0/1423394118 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f60181c9c90 msgr2=0x7f60181cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:50.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.097+0000 7f6017fff640 1 --2- 172.21.15.19:0/1423394118 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f60181c9c90 0x7f60181cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:50.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.097+0000 7f601cd28640 1 --2- 172.21.15.19:0/1423394118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60181ca110 0x7f60181cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:50.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.097+0000 7f6017fff640 1 -- 172.21.15.19:0/1423394118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60181ca110 msgr2=0x7f60181cce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:50.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.097+0000 7f6017fff640 1 --2- 172.21.15.19:0/1423394118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60181ca110 0x7f60181cce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:50.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.097+0000 7f6017fff640 1 -- 172.21.15.19:0/1423394118 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6018137ce0 con 0x7f6000003970 2023-11-04T15:27:50.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.097+0000 7f601cd28640 1 --2- 172.21.15.19:0/1423394118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60181ca110 0x7f60181cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T15:27:50.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.098+0000 7f6017fff640 1 --2- 172.21.15.19:0/1423394118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6000003970 0x7f60181c9750 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6008000c00 tx=0x7f6008004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:50.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.098+0000 7f6014ff9640 1 -- 172.21.15.19:0/1423394118 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6008003810 con 0x7f6000003970 2023-11-04T15:27:50.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.098+0000 7f6014ff9640 1 -- 172.21.15.19:0/1423394118 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600802de90 con 0x7f6000003970 2023-11-04T15:27:50.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.098+0000 7f601e78b640 1 -- 172.21.15.19:0/1423394118 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f601809cd30 con 0x7f6000003970 2023-11-04T15:27:50.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.098+0000 7f6014ff9640 1 -- 172.21.15.19:0/1423394118 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6008003bb0 con 0x7f6000003970 2023-11-04T15:27:50.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.098+0000 7f601e78b640 1 -- 172.21.15.19:0/1423394118 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f601809cff0 con 0x7f6000003970 2023-11-04T15:27:50.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.099+0000 7f601e78b640 1 -- 172.21.15.19:0/1423394118 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6018067d60 con 0x7f6000003970 2023-11-04T15:27:50.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.099+0000 7f6014ff9640 1 -- 172.21.15.19:0/1423394118 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6008003d10 con 0x7f6000003970 2023-11-04T15:27:50.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.100+0000 7f6014ff9640 1 --2- 172.21.15.19:0/1423394118 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f600406a460 0x7f600406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:50.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.100+0000 7f6014ff9640 1 -- 172.21.15.19:0/1423394118 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f60080aa280 con 0x7f6000003970 2023-11-04T15:27:50.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.100+0000 7f60177fe640 1 --2- 172.21.15.19:0/1423394118 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f600406a460 0x7f600406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:50.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.100+0000 7f60177fe640 1 --2- 172.21.15.19:0/1423394118 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f600406a460 0x7f600406c920 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f60180a7940 tx=0x7f600c008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:50.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.104+0000 7f6014ff9640 1 -- 172.21.15.19:0/1423394118 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6008075dc0 con 0x7f6000003970 2023-11-04T15:27:50.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.281+0000 7f601e78b640 1 -- 172.21.15.19:0/1423394118 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6018137a80 con 0x7f6000003970 2023-11-04T15:27:50.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.281+0000 7f6014ff9640 1 -- 172.21.15.19:0/1423394118 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f60080793e0 con 0x7f6000003970 2023-11-04T15:27:50.283 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 8 2023-11-04T15:27:50.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.283+0000 7f601e78b640 1 -- 172.21.15.19:0/1423394118 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f600406a460 msgr2=0x7f600406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:50.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.283+0000 7f601e78b640 1 --2- 172.21.15.19:0/1423394118 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f600406a460 0x7f600406c920 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f60180a7940 tx=0x7f600c008040 comp rx=0 tx=0).stop 2023-11-04T15:27:50.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.283+0000 7f601e78b640 1 -- 172.21.15.19:0/1423394118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6000003970 msgr2=0x7f60181c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:50.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.283+0000 7f601e78b640 1 --2- 172.21.15.19:0/1423394118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6000003970 0x7f60181c9750 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6008000c00 tx=0x7f6008004730 comp rx=0 tx=0).stop 2023-11-04T15:27:50.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.283+0000 7f601e78b640 1 -- 172.21.15.19:0/1423394118 shutdown_connections 2023-11-04T15:27:50.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.283+0000 7f601e78b640 1 --2- 172.21.15.19:0/1423394118 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f600406a460 0x7f600406c920 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:50.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.283+0000 7f601e78b640 1 --2- 172.21.15.19:0/1423394118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60181ca110 0x7f60181cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:50.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.283+0000 7f601e78b640 1 --2- 172.21.15.19:0/1423394118 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f60181c9c90 0x7f60181cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:50.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.283+0000 7f601e78b640 1 --2- 172.21.15.19:0/1423394118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6000003970 0x7f60181c9750 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:50.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.283+0000 7f601e78b640 1 -- 172.21.15.19:0/1423394118 >> 172.21.15.19:0/1423394118 conn(0x7f60180a8920 msgr2=0x7f601812b890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:50.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.283+0000 7f601e78b640 1 -- 172.21.15.19:0/1423394118 shutdown_connections 2023-11-04T15:27:50.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.283+0000 7f601e78b640 1 -- 172.21.15.19:0/1423394118 wait complete. 2023-11-04T15:27:50.294 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T15:27:50.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.402+0000 7f0da4a77640 1 Processor -- start 2023-11-04T15:27:50.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.402+0000 7f0da4a77640 1 -- start start 2023-11-04T15:27:50.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.402+0000 7f0da4a77640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0da0136090 0x7f0da0136470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:50.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.402+0000 7f0da4a77640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0da00a6370 0x7f0da013a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:50.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.402+0000 7f0da4a77640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0da013a670 0x7f0da013ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:50.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.402+0000 7f0da4a77640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0da00a68d0 con 0x7f0da013a670 2023-11-04T15:27:50.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.402+0000 7f0da4a77640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0da00abe60 con 0x7f0da0136090 2023-11-04T15:27:50.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.402+0000 7f0da4a77640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da00a30a0 con 0x7f0da00a6370 2023-11-04T15:27:50.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.402+0000 7f0d9ed9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0da013a670 0x7f0da013ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:50.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.402+0000 7f0d9ed9d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0da013a670 0x7f0da013ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54552/0 (socket says 172.21.15.19:54552) 2023-11-04T15:27:50.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.402+0000 7f0d9ed9d640 1 -- 172.21.15.19:0/3011731614 learned_addr learned my addr 172.21.15.19:0/3011731614 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:50.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.403+0000 7f0d9e59c640 1 --2- 172.21.15.19:0/3011731614 >> v2:172.21.15.96:3300/0 conn(0x7f0da0136090 0x7f0da0136470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:50.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.403+0000 7f0d9dd9b640 1 --2- 172.21.15.19:0/3011731614 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0da00a6370 0x7f0da013a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:50.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.403+0000 7f0d9ed9d640 1 -- 172.21.15.19:0/3011731614 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0da00a6370 msgr2=0x7f0da013a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:50.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.403+0000 7f0d9ed9d640 1 --2- 172.21.15.19:0/3011731614 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0da00a6370 0x7f0da013a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:50.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.403+0000 7f0d9ed9d640 1 -- 172.21.15.19:0/3011731614 >> v2:172.21.15.96:3300/0 conn(0x7f0da0136090 msgr2=0x7f0da0136470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:50.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.403+0000 7f0d9ed9d640 1 --2- 172.21.15.19:0/3011731614 >> v2:172.21.15.96:3300/0 conn(0x7f0da0136090 0x7f0da0136470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:50.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.403+0000 7f0d9ed9d640 1 -- 172.21.15.19:0/3011731614 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da00a4b90 con 0x7f0da013a670 2023-11-04T15:27:50.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.403+0000 7f0d9dd9b640 1 --2- 172.21.15.19:0/3011731614 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0da00a6370 0x7f0da013a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:27:50.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.404+0000 7f0d9ed9d640 1 --2- 172.21.15.19:0/3011731614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0da013a670 0x7f0da013ab00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0da00a3990 tx=0x7f0d9802bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb760596f4fda64f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:50.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.404+0000 7f0d9d59a640 1 -- 172.21.15.19:0/3011731614 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9802c950 con 0x7f0da013a670 2023-11-04T15:27:50.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.404+0000 7f0d9d59a640 1 -- 172.21.15.19:0/3011731614 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9802cab0 con 0x7f0da013a670 2023-11-04T15:27:50.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.404+0000 7f0d9d59a640 1 -- 172.21.15.19:0/3011731614 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9802ce40 con 0x7f0da013a670 2023-11-04T15:27:50.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.404+0000 7f0da4a77640 1 -- 172.21.15.19:0/3011731614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0da013a670 msgr2=0x7f0da013ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:50.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.404+0000 7f0da4a77640 1 --2- 172.21.15.19:0/3011731614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0da013a670 0x7f0da013ab00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0da00a3990 tx=0x7f0d9802bdb0 comp rx=0 tx=0).stop 2023-11-04T15:27:50.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.404+0000 7f0da4a77640 1 -- 172.21.15.19:0/3011731614 shutdown_connections 2023-11-04T15:27:50.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.404+0000 7f0da4a77640 1 --2- 172.21.15.19:0/3011731614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0da013a670 0x7f0da013ab00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:50.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.404+0000 7f0da4a77640 1 --2- 172.21.15.19:0/3011731614 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0da00a6370 0x7f0da013a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:50.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.404+0000 7f0da4a77640 1 --2- 172.21.15.19:0/3011731614 >> v2:172.21.15.96:3300/0 conn(0x7f0da0136090 0x7f0da0136470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:50.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.404+0000 7f0da4a77640 1 -- 172.21.15.19:0/3011731614 >> 172.21.15.19:0/3011731614 conn(0x7f0da00ac3f0 msgr2=0x7f0da00ac800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:50.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.404+0000 7f0da4a77640 1 -- 172.21.15.19:0/3011731614 shutdown_connections 2023-11-04T15:27:50.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.404+0000 7f0da4a77640 1 -- 172.21.15.19:0/3011731614 wait complete. 2023-11-04T15:27:50.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.405+0000 7f0da4a77640 1 Processor -- start 2023-11-04T15:27:50.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.405+0000 7f0da4a77640 1 -- start start 2023-11-04T15:27:50.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.406+0000 7f0da4a77640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0da00a6370 0x7f0da01ce900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:50.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.406+0000 7f0da4a77640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0da0136090 0x7f0da01cee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:50.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.406+0000 7f0da4a77640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0da013a670 0x7f0da01cf380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:50.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.406+0000 7f0da4a77640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da00995b0 con 0x7f0da013a670 2023-11-04T15:27:50.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.406+0000 7f0da4a77640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da00997a0 con 0x7f0da00a6370 2023-11-04T15:27:50.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.406+0000 7f0da4a77640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da00a82c0 con 0x7f0da0136090 2023-11-04T15:27:50.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.406+0000 7f0d9ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0da013a670 0x7f0da01cf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:50.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.406+0000 7f0d9ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0da013a670 0x7f0da01cf380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54566/0 (socket says 172.21.15.19:54566) 2023-11-04T15:27:50.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.406+0000 7f0d9ed9d640 1 -- 172.21.15.19:0/584545455 learned_addr learned my addr 172.21.15.19:0/584545455 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:50.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.406+0000 7f0d9e59c640 1 --2- 172.21.15.19:0/584545455 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0da00a6370 0x7f0da01ce900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:50.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.406+0000 7f0d9dd9b640 1 --2- 172.21.15.19:0/584545455 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0da0136090 0x7f0da01cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:50.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.406+0000 7f0d9ed9d640 1 -- 172.21.15.19:0/584545455 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0da0136090 msgr2=0x7f0da01cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:50.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.406+0000 7f0d9ed9d640 1 --2- 172.21.15.19:0/584545455 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0da0136090 0x7f0da01cee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:50.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.406+0000 7f0d9ed9d640 1 -- 172.21.15.19:0/584545455 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0da00a6370 msgr2=0x7f0da01ce900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:50.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.406+0000 7f0d9ed9d640 1 --2- 172.21.15.19:0/584545455 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0da00a6370 0x7f0da01ce900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:50.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.406+0000 7f0d9ed9d640 1 -- 172.21.15.19:0/584545455 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d98009b30 con 0x7f0da013a670 2023-11-04T15:27:50.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.407+0000 7f0d9ed9d640 1 --2- 172.21.15.19:0/584545455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0da013a670 0x7f0da01cf380 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0d98036040 tx=0x7f0d98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:50.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.407+0000 7f0d8effd640 1 -- 172.21.15.19:0/584545455 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d98009510 con 0x7f0da013a670 2023-11-04T15:27:50.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.407+0000 7f0d8effd640 1 -- 172.21.15.19:0/584545455 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9803e450 con 0x7f0da013a670 2023-11-04T15:27:50.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.407+0000 7f0da4a77640 1 -- 172.21.15.19:0/584545455 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0da0099af0 con 0x7f0da013a670 2023-11-04T15:27:50.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.407+0000 7f0d8effd640 1 -- 172.21.15.19:0/584545455 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9803e7e0 con 0x7f0da013a670 2023-11-04T15:27:50.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.407+0000 7f0da4a77640 1 -- 172.21.15.19:0/584545455 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0da009ac70 con 0x7f0da013a670 2023-11-04T15:27:50.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.408+0000 7f0da4a77640 1 -- 172.21.15.19:0/584545455 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0da0099960 con 0x7f0da013a670 2023-11-04T15:27:50.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.408+0000 7f0d8effd640 1 -- 172.21.15.19:0/584545455 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0d9803e940 con 0x7f0da013a670 2023-11-04T15:27:50.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.408+0000 7f0d8effd640 1 --2- 172.21.15.19:0/584545455 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f0d8006a430 0x7f0d8006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:50.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.409+0000 7f0d8effd640 1 -- 172.21.15.19:0/584545455 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f0d980aaef0 con 0x7f0da013a670 2023-11-04T15:27:50.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.409+0000 7f0d9e59c640 1 --2- 172.21.15.19:0/584545455 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f0d8006a430 0x7f0d8006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:50.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.409+0000 7f0d9e59c640 1 --2- 172.21.15.19:0/584545455 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f0d8006a430 0x7f0d8006c8f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0d90009ac0 tx=0x7f0d90009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:50.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.413+0000 7f0d8effd640 1 -- 172.21.15.19:0/584545455 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0d98076b80 con 0x7f0da013a670 2023-11-04T15:27:50.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.586+0000 7f0da4a77640 1 -- 172.21.15.19:0/584545455 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0da0099ce0 con 0x7f0da013a670 2023-11-04T15:27:50.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.586+0000 7f0d8effd640 1 -- 172.21.15.19:0/584545455 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v19) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0d9807a1a0 con 0x7f0da013a670 2023-11-04T15:27:50.588 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-04T15:27:50.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.588+0000 7f0da4a77640 1 -- 172.21.15.19:0/584545455 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f0d8006a430 msgr2=0x7f0d8006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:50.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.588+0000 7f0da4a77640 1 --2- 172.21.15.19:0/584545455 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f0d8006a430 0x7f0d8006c8f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0d90009ac0 tx=0x7f0d90009190 comp rx=0 tx=0).stop 2023-11-04T15:27:50.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.588+0000 7f0da4a77640 1 -- 172.21.15.19:0/584545455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0da013a670 msgr2=0x7f0da01cf380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:50.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.588+0000 7f0da4a77640 1 --2- 172.21.15.19:0/584545455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0da013a670 0x7f0da01cf380 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0d98036040 tx=0x7f0d98004a40 comp rx=0 tx=0).stop 2023-11-04T15:27:50.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.588+0000 7f0da4a77640 1 -- 172.21.15.19:0/584545455 shutdown_connections 2023-11-04T15:27:50.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.588+0000 7f0da4a77640 1 --2- 172.21.15.19:0/584545455 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f0d8006a430 0x7f0d8006c8f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:50.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.588+0000 7f0da4a77640 1 --2- 172.21.15.19:0/584545455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0da013a670 0x7f0da01cf380 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:50.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.588+0000 7f0da4a77640 1 --2- 172.21.15.19:0/584545455 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0da0136090 0x7f0da01cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:50.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.588+0000 7f0da4a77640 1 --2- 172.21.15.19:0/584545455 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0da00a6370 0x7f0da01ce900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:50.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.588+0000 7f0da4a77640 1 -- 172.21.15.19:0/584545455 >> 172.21.15.19:0/584545455 conn(0x7f0da00ac3f0 msgr2=0x7f0da01c22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:50.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.588+0000 7f0da4a77640 1 -- 172.21.15.19:0/584545455 shutdown_connections 2023-11-04T15:27:50.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.588+0000 7f0da4a77640 1 -- 172.21.15.19:0/584545455 wait complete. 2023-11-04T15:27:50.600 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T15:27:50.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.707+0000 7f0edb949640 1 Processor -- start 2023-11-04T15:27:50.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.707+0000 7f0edb949640 1 -- start start 2023-11-04T15:27:50.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.707+0000 7f0edb949640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0ed40a6370 0x7f0ed413f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:50.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.707+0000 7f0edb949640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed40abe60 con 0x7f0ed413f990 2023-11-04T15:27:50.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.707+0000 7f0edb949640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed40a30a0 con 0x7f0ed4136090 2023-11-04T15:27:50.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.707+0000 7f0edb949640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed40a68d0 con 0x7f0ed40a6370 2023-11-04T15:27:50.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.708+0000 7f0ed9ee6640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0ed413f990 0x7f0ed4141d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41508/0 (socket says 172.21.15.19:41508) 2023-11-04T15:27:50.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.708+0000 7f0ed9ee6640 1 -- 172.21.15.19:0/1938633295 learned_addr learned my addr 172.21.15.19:0/1938633295 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:50.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.708+0000 7f0ed8ee4640 1 --2- 172.21.15.19:0/1938633295 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0ed40a6370 0x7f0ed413f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:50.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.708+0000 7f0ecbfff640 1 -- 172.21.15.19:0/1938633295 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1497230596 0 0) 0x7f0ed40abe60 con 0x7f0ed413f990 2023-11-04T15:27:50.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.708+0000 7f0ecbfff640 1 -- 172.21.15.19:0/1938633295 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ec0003520 con 0x7f0ed413f990 2023-11-04T15:27:50.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.708+0000 7f0ecbfff640 1 -- 172.21.15.19:0/1938633295 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 655645149 0 0) 0x7f0ed40a30a0 con 0x7f0ed4136090 2023-11-04T15:27:50.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.708+0000 7f0ecbfff640 1 -- 172.21.15.19:0/1938633295 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ed40abe60 con 0x7f0ed4136090 2023-11-04T15:27:50.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.708+0000 7f0ed8ee4640 1 -- 172.21.15.19:0/1938633295 >> v1:172.21.15.96:6789/0 conn(0x7f0ed4136090 legacy=0x7f0ed4136470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:50.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.708+0000 7f0ed8ee4640 1 -- 172.21.15.19:0/1938633295 >> v1:172.21.15.19:6789/0 conn(0x7f0ed413f990 legacy=0x7f0ed4141d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:50.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.708+0000 7f0ed8ee4640 1 -- 172.21.15.19:0/1938633295 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed40a4b90 con 0x7f0ed40a6370 2023-11-04T15:27:50.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.709+0000 7f0ed8ee4640 1 --2- 172.21.15.19:0/1938633295 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0ed40a6370 0x7f0ed413f450 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0ec40097d0 tx=0x7f0ec402b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46a65a580c527481 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:50.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.709+0000 7f0ecbfff640 1 -- 172.21.15.19:0/1938633295 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4031770 con 0x7f0ed40a6370 2023-11-04T15:27:50.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.709+0000 7f0ecbfff640 1 -- 172.21.15.19:0/1938633295 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec40318d0 con 0x7f0ed40a6370 2023-11-04T15:27:50.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.709+0000 7f0ecbfff640 1 -- 172.21.15.19:0/1938633295 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4031c40 con 0x7f0ed40a6370 2023-11-04T15:27:50.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.709+0000 7f0edb949640 1 -- 172.21.15.19:0/1938633295 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0ed40a6370 msgr2=0x7f0ed413f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:50.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.709+0000 7f0edb949640 1 --2- 172.21.15.19:0/1938633295 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0ed40a6370 0x7f0ed413f450 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0ec40097d0 tx=0x7f0ec402b810 comp rx=0 tx=0).stop 2023-11-04T15:27:50.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.709+0000 7f0edb949640 1 -- 172.21.15.19:0/1938633295 shutdown_connections 2023-11-04T15:27:50.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.709+0000 7f0edb949640 1 --2- 172.21.15.19:0/1938633295 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0ed40a6370 0x7f0ed413f450 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:50.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.709+0000 7f0edb949640 1 -- 172.21.15.19:0/1938633295 >> 172.21.15.19:0/1938633295 conn(0x7f0ed40ac3f0 msgr2=0x7f0ed40ac800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:50.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.710+0000 7f0edb949640 1 -- 172.21.15.19:0/1938633295 shutdown_connections 2023-11-04T15:27:50.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.710+0000 7f0edb949640 1 -- 172.21.15.19:0/1938633295 wait complete. 2023-11-04T15:27:50.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.710+0000 7f0edb949640 1 Processor -- start 2023-11-04T15:27:50.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.710+0000 7f0edb949640 1 -- start start 2023-11-04T15:27:50.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.711+0000 7f0edb949640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0ed40a6370 0x7f0ed412ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:50.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.711+0000 7f0edb949640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ed4136090 0x7f0ed4130450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:50.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.711+0000 7f0edb949640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ed413f990 0x7f0ed41cec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:50.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.711+0000 7f0edb949640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed413e520 con 0x7f0ed413f990 2023-11-04T15:27:50.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.711+0000 7f0edb949640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed4130990 con 0x7f0ed4136090 2023-11-04T15:27:50.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.711+0000 7f0edb949640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed4097a00 con 0x7f0ed40a6370 2023-11-04T15:27:50.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.711+0000 7f0ed9ee6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ed413f990 0x7f0ed41cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:50.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.711+0000 7f0ed9ee6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ed413f990 0x7f0ed41cec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54572/0 (socket says 172.21.15.19:54572) 2023-11-04T15:27:50.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.711+0000 7f0ed9ee6640 1 -- 172.21.15.19:0/2619238415 learned_addr learned my addr 172.21.15.19:0/2619238415 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:50.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.711+0000 7f0ed8ee4640 1 --2- 172.21.15.19:0/2619238415 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ed4136090 0x7f0ed4130450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:50.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.711+0000 7f0ed9ee6640 1 -- 172.21.15.19:0/2619238415 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0ed40a6370 msgr2=0x7f0ed412ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:50.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.711+0000 7f0ed96e5640 1 --2- 172.21.15.19:0/2619238415 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0ed40a6370 0x7f0ed412ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:50.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.711+0000 7f0ed9ee6640 1 --2- 172.21.15.19:0/2619238415 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0ed40a6370 0x7f0ed412ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:50.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.711+0000 7f0ed9ee6640 1 -- 172.21.15.19:0/2619238415 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ed4136090 msgr2=0x7f0ed4130450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:50.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.711+0000 7f0ed9ee6640 1 --2- 172.21.15.19:0/2619238415 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ed4136090 0x7f0ed4130450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:50.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.711+0000 7f0ed9ee6640 1 -- 172.21.15.19:0/2619238415 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec4009400 con 0x7f0ed413f990 2023-11-04T15:27:50.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.711+0000 7f0ed8ee4640 1 --2- 172.21.15.19:0/2619238415 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ed4136090 0x7f0ed4130450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T15:27:50.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.711+0000 7f0ed9ee6640 1 --2- 172.21.15.19:0/2619238415 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ed413f990 0x7f0ed41cec90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00cae0 tx=0x7f0ecc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:50.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.712+0000 7f0ec9ffb640 1 -- 172.21.15.19:0/2619238415 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc00ac40 con 0x7f0ed413f990 2023-11-04T15:27:50.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.712+0000 7f0ec9ffb640 1 -- 172.21.15.19:0/2619238415 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ecc00ada0 con 0x7f0ed413f990 2023-11-04T15:27:50.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.712+0000 7f0edb949640 1 -- 172.21.15.19:0/2619238415 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed40a5f20 con 0x7f0ed413f990 2023-11-04T15:27:50.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.712+0000 7f0ec9ffb640 1 -- 172.21.15.19:0/2619238415 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc012600 con 0x7f0ed413f990 2023-11-04T15:27:50.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.712+0000 7f0edb949640 1 -- 172.21.15.19:0/2619238415 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed40a25e0 con 0x7f0ed413f990 2023-11-04T15:27:50.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.713+0000 7f0edb949640 1 -- 172.21.15.19:0/2619238415 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed4067d60 con 0x7f0ed413f990 2023-11-04T15:27:50.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.713+0000 7f0ec9ffb640 1 -- 172.21.15.19:0/2619238415 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0ecc007070 con 0x7f0ed413f990 2023-11-04T15:27:50.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.714+0000 7f0ec9ffb640 1 --2- 172.21.15.19:0/2619238415 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f0eb806a460 0x7f0eb806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:50.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.714+0000 7f0ec9ffb640 1 -- 172.21.15.19:0/2619238415 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f0ecc088130 con 0x7f0ed413f990 2023-11-04T15:27:50.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.714+0000 7f0ed96e5640 1 --2- 172.21.15.19:0/2619238415 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f0eb806a460 0x7f0eb806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:50.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.714+0000 7f0ed96e5640 1 --2- 172.21.15.19:0/2619238415 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f0eb806a460 0x7f0eb806c920 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0007fd0 tx=0x7f0ed0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:50.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.718+0000 7f0ec9ffb640 1 -- 172.21.15.19:0/2619238415 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0ecc053dc0 con 0x7f0ed413f990 2023-11-04T15:27:50.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.893+0000 7f0edb949640 1 -- 172.21.15.19:0/2619238415 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0ed40a7120 con 0x7f0ed413f990 2023-11-04T15:27:50.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.893+0000 7f0ec9ffb640 1 -- 172.21.15.19:0/2619238415 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v19) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0ecc0573e0 con 0x7f0ed413f990 2023-11-04T15:27:50.895 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2023-11-04T15:27:50.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.895+0000 7f0edb949640 1 -- 172.21.15.19:0/2619238415 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f0eb806a460 msgr2=0x7f0eb806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:50.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.895+0000 7f0edb949640 1 --2- 172.21.15.19:0/2619238415 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f0eb806a460 0x7f0eb806c920 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0007fd0 tx=0x7f0ed0009040 comp rx=0 tx=0).stop 2023-11-04T15:27:50.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.895+0000 7f0edb949640 1 -- 172.21.15.19:0/2619238415 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ed413f990 msgr2=0x7f0ed41cec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:50.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.895+0000 7f0edb949640 1 --2- 172.21.15.19:0/2619238415 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ed413f990 0x7f0ed41cec90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00cae0 tx=0x7f0ecc00a060 comp rx=0 tx=0).stop 2023-11-04T15:27:50.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.895+0000 7f0edb949640 1 -- 172.21.15.19:0/2619238415 shutdown_connections 2023-11-04T15:27:50.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.895+0000 7f0edb949640 1 --2- 172.21.15.19:0/2619238415 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f0eb806a460 0x7f0eb806c920 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:50.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.895+0000 7f0edb949640 1 --2- 172.21.15.19:0/2619238415 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ed413f990 0x7f0ed41cec90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:50.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.895+0000 7f0edb949640 1 --2- 172.21.15.19:0/2619238415 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ed4136090 0x7f0ed4130450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:50.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.895+0000 7f0edb949640 1 --2- 172.21.15.19:0/2619238415 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0ed40a6370 0x7f0ed412ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:50.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.895+0000 7f0edb949640 1 -- 172.21.15.19:0/2619238415 >> 172.21.15.19:0/2619238415 conn(0x7f0ed40ac3f0 msgr2=0x7f0ed40a7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:50.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.895+0000 7f0edb949640 1 -- 172.21.15.19:0/2619238415 shutdown_connections 2023-11-04T15:27:50.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:50.895+0000 7f0edb949640 1 -- 172.21.15.19:0/2619238415 wait complete. 2023-11-04T15:27:50.906 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T15:27:51.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.011+0000 7f1994a4c640 1 Processor -- start 2023-11-04T15:27:51.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.011+0000 7f1994a4c640 1 -- start start 2023-11-04T15:27:51.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.012+0000 7f1994a4c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f19900a3e90 0x7f19900a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:51.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.012+0000 7f1994a4c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1990137650 0x7f199013a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:51.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.012+0000 7f1994a4c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19900a4c20 con 0x7f1990137270 2023-11-04T15:27:51.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.012+0000 7f1994a4c640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19900a3060 con 0x7f19900a3e90 2023-11-04T15:27:51.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.012+0000 7f1994a4c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19900a5080 con 0x7f1990137650 2023-11-04T15:27:51.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.012+0000 7f198dd9b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f19900a3e90 0x7f19900a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:51.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.012+0000 7f198ed9d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1990137650 0x7f199013a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:51.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.012+0000 7f198dd9b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f19900a3e90 0x7f19900a6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.19:33874/0 (socket says 172.21.15.19:33874) 2023-11-04T15:27:51.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.012+0000 7f198ed9d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1990137650 0x7f199013a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.19:49698/0 (socket says 172.21.15.19:49698) 2023-11-04T15:27:51.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.012+0000 7f198dd9b640 1 -- 172.21.15.19:0/1892034012 learned_addr learned my addr 172.21.15.19:0/1892034012 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:51.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.012+0000 7f198e59c640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f1990137270 0x7f1990139f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.19:32832/0 (socket says 172.21.15.19:32832) 2023-11-04T15:27:51.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.013+0000 7f198ed9d640 1 -- 172.21.15.19:0/1892034012 >> v2:172.21.15.96:3300/0 conn(0x7f19900a3e90 msgr2=0x7f19900a6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:51.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.013+0000 7f198ed9d640 1 --2- 172.21.15.19:0/1892034012 >> v2:172.21.15.96:3300/0 conn(0x7f19900a3e90 0x7f19900a6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:51.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.013+0000 7f198ed9d640 1 -- 172.21.15.19:0/1892034012 >> v1:172.21.15.96:6789/0 conn(0x7f1990137270 legacy=0x7f1990139f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:51.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.013+0000 7f198ed9d640 1 -- 172.21.15.19:0/1892034012 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19900a3440 con 0x7f1990137650 2023-11-04T15:27:51.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.013+0000 7f198d59a640 1 -- 172.21.15.19:0/1892034012 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3224416080 0 0) 0x7f19900a4c20 con 0x7f1990137270 2023-11-04T15:27:51.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.013+0000 7f198dd9b640 1 --2- 172.21.15.19:0/1892034012 >> v2:172.21.15.96:3300/0 conn(0x7f19900a3e90 0x7f19900a6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T15:27:51.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.013+0000 7f198ed9d640 1 --2- 172.21.15.19:0/1892034012 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1990137650 0x7f199013a670 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1980009d90 tx=0x7f198002bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=641b8f158a310ba5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:51.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.013+0000 7f198d59a640 1 -- 172.21.15.19:0/1892034012 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198002cb30 con 0x7f1990137650 2023-11-04T15:27:51.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.014+0000 7f198d59a640 1 -- 172.21.15.19:0/1892034012 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198002cc90 con 0x7f1990137650 2023-11-04T15:27:51.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.014+0000 7f198d59a640 1 -- 172.21.15.19:0/1892034012 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1980034440 con 0x7f1990137650 2023-11-04T15:27:51.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.014+0000 7f1994a4c640 1 -- 172.21.15.19:0/1892034012 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1990137650 msgr2=0x7f199013a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:51.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.014+0000 7f1994a4c640 1 --2- 172.21.15.19:0/1892034012 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1990137650 0x7f199013a670 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1980009d90 tx=0x7f198002bd80 comp rx=0 tx=0).stop 2023-11-04T15:27:51.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.014+0000 7f1994a4c640 1 -- 172.21.15.19:0/1892034012 shutdown_connections 2023-11-04T15:27:51.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.014+0000 7f1994a4c640 1 --2- 172.21.15.19:0/1892034012 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1990137650 0x7f199013a670 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:51.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.014+0000 7f1994a4c640 1 --2- 172.21.15.19:0/1892034012 >> v2:172.21.15.96:3300/0 conn(0x7f19900a3e90 0x7f19900a6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:51.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.014+0000 7f1994a4c640 1 -- 172.21.15.19:0/1892034012 >> 172.21.15.19:0/1892034012 conn(0x7f19900a8d70 msgr2=0x7f19900a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:51.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.014+0000 7f1994a4c640 1 -- 172.21.15.19:0/1892034012 shutdown_connections 2023-11-04T15:27:51.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.014+0000 7f1994a4c640 1 -- 172.21.15.19:0/1892034012 wait complete. 2023-11-04T15:27:51.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.015+0000 7f1994a4c640 1 Processor -- start 2023-11-04T15:27:51.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.015+0000 7f1994a4c640 1 -- start start 2023-11-04T15:27:51.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.016+0000 7f1994a4c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19900a3e90 0x7f19901cec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:51.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.016+0000 7f1994a4c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1990137270 0x7f19901cf190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:51.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.016+0000 7f1994a4c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1990137650 0x7f19901cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:51.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.016+0000 7f1994a4c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199009bd10 con 0x7f1990137650 2023-11-04T15:27:51.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.016+0000 7f1994a4c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1990099c90 con 0x7f19900a3e90 2023-11-04T15:27:51.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.016+0000 7f1994a4c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199009b910 con 0x7f1990137270 2023-11-04T15:27:51.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.016+0000 7f198ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1990137650 0x7f19901cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:51.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.016+0000 7f198ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1990137650 0x7f19901cf6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54580/0 (socket says 172.21.15.19:54580) 2023-11-04T15:27:51.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.016+0000 7f198ed9d640 1 -- 172.21.15.19:0/139159776 learned_addr learned my addr 172.21.15.19:0/139159776 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:51.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.016+0000 7f198dd9b640 1 --2- 172.21.15.19:0/139159776 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1990137270 0x7f19901cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:51.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.016+0000 7f198e59c640 1 --2- 172.21.15.19:0/139159776 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19900a3e90 0x7f19901cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:51.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.016+0000 7f198ed9d640 1 -- 172.21.15.19:0/139159776 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1990137270 msgr2=0x7f19901cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:51.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.016+0000 7f198ed9d640 1 --2- 172.21.15.19:0/139159776 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1990137270 0x7f19901cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:51.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.016+0000 7f198ed9d640 1 -- 172.21.15.19:0/139159776 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19900a3e90 msgr2=0x7f19901cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:51.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.016+0000 7f198ed9d640 1 --2- 172.21.15.19:0/139159776 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19900a3e90 0x7f19901cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:51.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.016+0000 7f198ed9d640 1 -- 172.21.15.19:0/139159776 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19780094d0 con 0x7f1990137650 2023-11-04T15:27:51.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.016+0000 7f198ed9d640 1 --2- 172.21.15.19:0/139159776 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1990137650 0x7f19901cf6d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1980009d90 tx=0x7f1980004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:51.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.016+0000 7f1986ffd640 1 -- 172.21.15.19:0/139159776 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1980034e40 con 0x7f1990137650 2023-11-04T15:27:51.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.016+0000 7f1986ffd640 1 -- 172.21.15.19:0/139159776 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1980034440 con 0x7f1990137650 2023-11-04T15:27:51.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.016+0000 7f1994a4c640 1 -- 172.21.15.19:0/139159776 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1980009a70 con 0x7f1990137650 2023-11-04T15:27:51.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.016+0000 7f1986ffd640 1 -- 172.21.15.19:0/139159776 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19800408a0 con 0x7f1990137650 2023-11-04T15:27:51.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.017+0000 7f1994a4c640 1 -- 172.21.15.19:0/139159776 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199009c8f0 con 0x7f1990137650 2023-11-04T15:27:51.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.018+0000 7f1994a4c640 1 -- 172.21.15.19:0/139159776 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1990067d60 con 0x7f1990137650 2023-11-04T15:27:51.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.018+0000 7f1986ffd640 1 -- 172.21.15.19:0/139159776 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1980040a00 con 0x7f1990137650 2023-11-04T15:27:51.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.018+0000 7f1986ffd640 1 --2- 172.21.15.19:0/139159776 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f197006a430 0x7f197006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:51.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.018+0000 7f1986ffd640 1 -- 172.21.15.19:0/139159776 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f19800aab40 con 0x7f1990137650 2023-11-04T15:27:51.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.018+0000 7f198e59c640 1 --2- 172.21.15.19:0/139159776 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f197006a430 0x7f197006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:51.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.019+0000 7f198e59c640 1 --2- 172.21.15.19:0/139159776 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f197006a430 0x7f197006c8f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1988000f60 tx=0x7f1988007d50 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:51.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.023+0000 7f1986ffd640 1 -- 172.21.15.19:0/139159776 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f19800767d0 con 0x7f1990137650 2023-11-04T15:27:51.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.237+0000 7f1994a4c640 1 -- 172.21.15.19:0/139159776 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19900a3af0 con 0x7f1990137650 2023-11-04T15:27:51.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.237+0000 7f1986ffd640 1 -- 172.21.15.19:0/139159776 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3130 (secure 0 0 0) 0x7f1980039c50 con 0x7f1990137650 2023-11-04T15:27:51.240 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:27:51.240 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4219,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6819/3642584554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3642584554},{"type":"v1","addr":"172.21.15.96:6819","nonce":3642584554}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T15:27:36.125743+0000","modified":"2023-11-04T15:27:38.140154+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6817/2992197248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2992197248},{"type":"v1","addr":"172.21.15.19:6817","nonce":2992197248}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T15:27:51.242 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 6 2023-11-04T15:27:51.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.239+0000 7f1994a4c640 1 -- 172.21.15.19:0/139159776 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f197006a430 msgr2=0x7f197006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:51.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.239+0000 7f1994a4c640 1 --2- 172.21.15.19:0/139159776 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f197006a430 0x7f197006c8f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1988000f60 tx=0x7f1988007d50 comp rx=0 tx=0).stop 2023-11-04T15:27:51.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.239+0000 7f1994a4c640 1 -- 172.21.15.19:0/139159776 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1990137650 msgr2=0x7f19901cf6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:51.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.239+0000 7f1994a4c640 1 --2- 172.21.15.19:0/139159776 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1990137650 0x7f19901cf6d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1980009d90 tx=0x7f1980004a40 comp rx=0 tx=0).stop 2023-11-04T15:27:51.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.239+0000 7f1994a4c640 1 -- 172.21.15.19:0/139159776 shutdown_connections 2023-11-04T15:27:51.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.239+0000 7f1994a4c640 1 --2- 172.21.15.19:0/139159776 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f197006a430 0x7f197006c8f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:51.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.239+0000 7f1994a4c640 1 --2- 172.21.15.19:0/139159776 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1990137650 0x7f19901cf6d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:51.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.239+0000 7f1994a4c640 1 --2- 172.21.15.19:0/139159776 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1990137270 0x7f19901cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:51.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.239+0000 7f1994a4c640 1 --2- 172.21.15.19:0/139159776 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f19900a3e90 0x7f19901cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:51.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.239+0000 7f1994a4c640 1 -- 172.21.15.19:0/139159776 >> 172.21.15.19:0/139159776 conn(0x7f19900a8d70 msgr2=0x7f1990134ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:51.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.239+0000 7f1994a4c640 1 -- 172.21.15.19:0/139159776 shutdown_connections 2023-11-04T15:27:51.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.239+0000 7f1994a4c640 1 -- 172.21.15.19:0/139159776 wait complete. 2023-11-04T15:27:51.251 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T15:27:51.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.355+0000 7f86361bb640 1 Processor -- start 2023-11-04T15:27:51.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.355+0000 7f86361bb640 1 -- start start 2023-11-04T15:27:51.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.356+0000 7f86361bb640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8630141290 0x7f8630143680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:51.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.356+0000 7f86361bb640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86300a0f50 con 0x7f86301340b0 2023-11-04T15:27:51.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.356+0000 7f86361bb640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86300a4810 con 0x7f8630133cd0 2023-11-04T15:27:51.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.356+0000 7f86361bb640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86300a5370 con 0x7f8630141290 2023-11-04T15:27:51.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.356+0000 7f862effd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f86301340b0 0x7f86300a4100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41512/0 (socket says 172.21.15.19:41512) 2023-11-04T15:27:51.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.356+0000 7f862effd640 1 -- 172.21.15.19:0/674737578 learned_addr learned my addr 172.21.15.19:0/674737578 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:51.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.356+0000 7f862ffff640 1 --2- 172.21.15.19:0/674737578 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8630141290 0x7f8630143680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:51.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.356+0000 7f862e7fc640 1 -- 172.21.15.19:0/674737578 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 36854641 0 0) 0x7f86300a0f50 con 0x7f86301340b0 2023-11-04T15:27:51.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.356+0000 7f862e7fc640 1 -- 172.21.15.19:0/674737578 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8618003520 con 0x7f86301340b0 2023-11-04T15:27:51.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.356+0000 7f862e7fc640 1 -- 172.21.15.19:0/674737578 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4166888709 0 0) 0x7f86300a4810 con 0x7f8630133cd0 2023-11-04T15:27:51.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.357+0000 7f862e7fc640 1 -- 172.21.15.19:0/674737578 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86300a0f50 con 0x7f8630133cd0 2023-11-04T15:27:51.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.357+0000 7f862ffff640 1 -- 172.21.15.19:0/674737578 >> v1:172.21.15.96:6789/0 conn(0x7f8630133cd0 legacy=0x7f86300a39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:51.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.357+0000 7f862ffff640 1 -- 172.21.15.19:0/674737578 >> v1:172.21.15.19:6789/0 conn(0x7f86301340b0 legacy=0x7f86300a4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:51.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.357+0000 7f862ffff640 1 -- 172.21.15.19:0/674737578 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86300a04f0 con 0x7f8630141290 2023-11-04T15:27:51.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.357+0000 7f862ffff640 1 --2- 172.21.15.19:0/674737578 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8630141290 0x7f8630143680 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8628009dc0 tx=0x7f862802be00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa04e5f127178640 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:51.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.357+0000 7f862e7fc640 1 -- 172.21.15.19:0/674737578 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862802cbb0 con 0x7f8630141290 2023-11-04T15:27:51.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.358+0000 7f862e7fc640 1 -- 172.21.15.19:0/674737578 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862802cd10 con 0x7f8630141290 2023-11-04T15:27:51.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.358+0000 7f862e7fc640 1 -- 172.21.15.19:0/674737578 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8628034660 con 0x7f8630141290 2023-11-04T15:27:51.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.358+0000 7f86361bb640 1 -- 172.21.15.19:0/674737578 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8630141290 msgr2=0x7f8630143680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:51.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.358+0000 7f86361bb640 1 --2- 172.21.15.19:0/674737578 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8630141290 0x7f8630143680 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8628009dc0 tx=0x7f862802be00 comp rx=0 tx=0).stop 2023-11-04T15:27:51.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.358+0000 7f86361bb640 1 -- 172.21.15.19:0/674737578 shutdown_connections 2023-11-04T15:27:51.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.358+0000 7f86361bb640 1 --2- 172.21.15.19:0/674737578 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8630141290 0x7f8630143680 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:51.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.358+0000 7f86361bb640 1 -- 172.21.15.19:0/674737578 >> 172.21.15.19:0/674737578 conn(0x7f86300a8ff0 msgr2=0x7f86300a9400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:51.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.358+0000 7f86361bb640 1 -- 172.21.15.19:0/674737578 shutdown_connections 2023-11-04T15:27:51.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.358+0000 7f86361bb640 1 -- 172.21.15.19:0/674737578 wait complete. 2023-11-04T15:27:51.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.359+0000 7f86361bb640 1 Processor -- start 2023-11-04T15:27:51.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.359+0000 7f86361bb640 1 -- start start 2023-11-04T15:27:51.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.360+0000 7f86361bb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8630133cd0 0x7f863009be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:51.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.360+0000 7f86361bb640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f86301340b0 0x7f863009c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:51.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.360+0000 7f86361bb640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8630141290 0x7f863009c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:51.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.360+0000 7f86361bb640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8630137ed0 con 0x7f8630133cd0 2023-11-04T15:27:51.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.360+0000 7f86361bb640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863009ee30 con 0x7f8630141290 2023-11-04T15:27:51.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.360+0000 7f86361bb640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f863009e5a0 con 0x7f86301340b0 2023-11-04T15:27:51.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.360+0000 7f862f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8630133cd0 0x7f863009be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:51.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.360+0000 7f862f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8630133cd0 0x7f863009be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54596/0 (socket says 172.21.15.19:54596) 2023-11-04T15:27:51.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.360+0000 7f862f7fe640 1 -- 172.21.15.19:0/3195787315 learned_addr learned my addr 172.21.15.19:0/3195787315 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:51.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.360+0000 7f862effd640 1 --2- 172.21.15.19:0/3195787315 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f86301340b0 0x7f863009c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:51.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.360+0000 7f862ffff640 1 --2- 172.21.15.19:0/3195787315 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8630141290 0x7f863009c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:51.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.360+0000 7f862f7fe640 1 -- 172.21.15.19:0/3195787315 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f86301340b0 msgr2=0x7f863009c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:51.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.360+0000 7f862f7fe640 1 --2- 172.21.15.19:0/3195787315 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f86301340b0 0x7f863009c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:51.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.360+0000 7f862f7fe640 1 -- 172.21.15.19:0/3195787315 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8630141290 msgr2=0x7f863009c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:51.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.360+0000 7f862f7fe640 1 --2- 172.21.15.19:0/3195787315 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8630141290 0x7f863009c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:51.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.360+0000 7f862f7fe640 1 -- 172.21.15.19:0/3195787315 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8628009a70 con 0x7f8630133cd0 2023-11-04T15:27:51.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.360+0000 7f862ffff640 1 --2- 172.21.15.19:0/3195787315 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8630141290 0x7f863009c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T15:27:51.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.360+0000 7f862f7fe640 1 --2- 172.21.15.19:0/3195787315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8630133cd0 0x7f863009be10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f862000c430 tx=0x7f862000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:51.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.360+0000 7f8617fff640 1 -- 172.21.15.19:0/3195787315 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86200052d0 con 0x7f8630133cd0 2023-11-04T15:27:51.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.360+0000 7f8617fff640 1 -- 172.21.15.19:0/3195787315 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8620005450 con 0x7f8630133cd0 2023-11-04T15:27:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.360+0000 7f8617fff640 1 -- 172.21.15.19:0/3195787315 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8620003830 con 0x7f8630133cd0 2023-11-04T15:27:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.360+0000 7f86361bb640 1 -- 172.21.15.19:0/3195787315 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86301389b0 con 0x7f8630133cd0 2023-11-04T15:27:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.360+0000 7f86361bb640 1 -- 172.21.15.19:0/3195787315 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86300a8240 con 0x7f8630133cd0 2023-11-04T15:27:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.361+0000 7f86361bb640 1 -- 172.21.15.19:0/3195787315 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8630067d60 con 0x7f8630133cd0 2023-11-04T15:27:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.362+0000 7f8617fff640 1 -- 172.21.15.19:0/3195787315 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8620003990 con 0x7f8630133cd0 2023-11-04T15:27:51.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.362+0000 7f8617fff640 1 --2- 172.21.15.19:0/3195787315 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f861c06a430 0x7f861c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:51.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.362+0000 7f8617fff640 1 -- 172.21.15.19:0/3195787315 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f8620087960 con 0x7f8630133cd0 2023-11-04T15:27:51.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.362+0000 7f862effd640 1 --2- 172.21.15.19:0/3195787315 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f861c06a430 0x7f861c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:51.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.363+0000 7f862effd640 1 --2- 172.21.15.19:0/3195787315 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f861c06a430 0x7f861c06c8f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8630071910 tx=0x7f8624009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:51.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.366+0000 7f8617fff640 1 -- 172.21.15.19:0/3195787315 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f86200534a0 con 0x7f8630133cd0 2023-11-04T15:27:51.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.542+0000 7f86361bb640 1 -- 172.21.15.19:0/3195787315 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f863009d900 con 0x7f8630133cd0 2023-11-04T15:27:51.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.543+0000 7f8617fff640 1 -- 172.21.15.19:0/3195787315 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+13180 (secure 0 0 0) 0x7f8620056ac0 con 0x7f8630133cd0 2023-11-04T15:27:51.544 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:27:51.545 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":19,"fsid":"e87311d5-496a-4b07-9654-358fe5bbf950","created":"2023-11-04T15:27:14.865121+0000","modified":"2023-11-04T15:27:37.127226+0000","last_up_change":"2023-11-04T15:27:24.162282+0000","last_in_change":"2023-11-04T15:27:15.971035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T15:27:24.987312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-04T15:27:30.500235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-04T15:27:34.476271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-04T15:27:35.096759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"34818469-ebf2-4dd4-8119-af19a0121036","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":82879},{"type":"v1","addr":"172.21.15.19:6801","nonce":82879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":82879},{"type":"v1","addr":"172.21.15.19:6803","nonce":82879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":82879},{"type":"v1","addr":"172.21.15.19:6807","nonce":82879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":82879},{"type":"v1","addr":"172.21.15.19:6805","nonce":82879}]},"public_addr":"172.21.15.19:6801/82879","cluster_addr":"172.21.15.19:6803/82879","heartbeat_back_addr":"172.21.15.19:6807/82879","heartbeat_front_addr":"172.21.15.19:6805/82879","state":["exists","up"]},{"osd":1,"uuid":"92dab290-7912-4eea-b6f6-c754c2480721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":82880},{"type":"v1","addr":"172.21.15.19:6809","nonce":82880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":82880},{"type":"v1","addr":"172.21.15.19:6811","nonce":82880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":82880},{"type":"v1","addr":"172.21.15.19:6815","nonce":82880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":82880},{"type":"v1","addr":"172.21.15.19:6813","nonce":82880}]},"public_addr":"172.21.15.19:6809/82880","cluster_addr":"172.21.15.19:6811/82880","heartbeat_back_addr":"172.21.15.19:6815/82880","heartbeat_front_addr":"172.21.15.19:6813/82880","state":["exists","up"]},{"osd":2,"uuid":"1be47db4-6dd1-4ce5-832b-bc6ad30c78c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":83458},{"type":"v1","addr":"172.21.15.96:6808","nonce":83458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":83458},{"type":"v1","addr":"172.21.15.96:6811","nonce":83458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":83458},{"type":"v1","addr":"172.21.15.96:6815","nonce":83458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":83458},{"type":"v1","addr":"172.21.15.96:6813","nonce":83458}]},"public_addr":"172.21.15.96:6808/83458","cluster_addr":"172.21.15.96:6811/83458","heartbeat_back_addr":"172.21.15.96:6815/83458","heartbeat_front_addr":"172.21.15.96:6813/83458","state":["exists","up"]},{"osd":3,"uuid":"46505800-d64f-49ef-b811-5b5979f48252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":83459},{"type":"v1","addr":"172.21.15.96:6801","nonce":83459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":83459},{"type":"v1","addr":"172.21.15.96:6803","nonce":83459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6807","nonce":83459},{"type":"v1","addr":"172.21.15.96:6809","nonce":83459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":83459},{"type":"v1","addr":"172.21.15.96:6805","nonce":83459}]},"public_addr":"172.21.15.96:6801/83459","cluster_addr":"172.21.15.96:6803/83459","heartbeat_back_addr":"172.21.15.96:6809/83459","heartbeat_front_addr":"172.21.15.96:6805/83459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.081547+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.132075+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.094919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.074106+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T15:27:51.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.545+0000 7f86361bb640 1 -- 172.21.15.19:0/3195787315 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f861c06a430 msgr2=0x7f861c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:51.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.545+0000 7f86361bb640 1 --2- 172.21.15.19:0/3195787315 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f861c06a430 0x7f861c06c8f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8630071910 tx=0x7f8624009040 comp rx=0 tx=0).stop 2023-11-04T15:27:51.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.545+0000 7f86361bb640 1 -- 172.21.15.19:0/3195787315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8630133cd0 msgr2=0x7f863009be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:51.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.545+0000 7f86361bb640 1 --2- 172.21.15.19:0/3195787315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8630133cd0 0x7f863009be10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f862000c430 tx=0x7f862000c8f0 comp rx=0 tx=0).stop 2023-11-04T15:27:51.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.545+0000 7f86361bb640 1 -- 172.21.15.19:0/3195787315 shutdown_connections 2023-11-04T15:27:51.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.545+0000 7f86361bb640 1 --2- 172.21.15.19:0/3195787315 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f861c06a430 0x7f861c06c8f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:51.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.545+0000 7f86361bb640 1 --2- 172.21.15.19:0/3195787315 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8630141290 0x7f863009c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:51.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.545+0000 7f86361bb640 1 --2- 172.21.15.19:0/3195787315 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f86301340b0 0x7f863009c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:51.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.545+0000 7f86361bb640 1 --2- 172.21.15.19:0/3195787315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8630133cd0 0x7f863009be10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:51.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.545+0000 7f86361bb640 1 -- 172.21.15.19:0/3195787315 >> 172.21.15.19:0/3195787315 conn(0x7f86300a8ff0 msgr2=0x7f8630136760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:51.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.545+0000 7f86361bb640 1 -- 172.21.15.19:0/3195787315 shutdown_connections 2023-11-04T15:27:51.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.545+0000 7f86361bb640 1 -- 172.21.15.19:0/3195787315 wait complete. 2023-11-04T15:27:51.557 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T15:27:24.987312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-04T15:27:30.500235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T15:27:34.476271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T15:27:35.096759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T15:27:51.558 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T15:27:51.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.665+0000 7fc3521dd640 1 Processor -- start 2023-11-04T15:27:51.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.665+0000 7fc3521dd640 1 -- start start 2023-11-04T15:27:51.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.666+0000 7fc3521dd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc34c0a6370 0x7fc34c13f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:51.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.666+0000 7fc3521dd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc34c13f990 0x7fc34c141d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:51.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.666+0000 7fc3521dd640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc34c0abe60 con 0x7fc34c136090 2023-11-04T15:27:51.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.666+0000 7fc3521dd640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc34c0a68d0 con 0x7fc34c0a6370 2023-11-04T15:27:51.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.666+0000 7fc3521dd640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c0a30a0 con 0x7fc34c13f990 2023-11-04T15:27:51.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.666+0000 7fc34affd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc34c0a6370 0x7fc34c13f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:51.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.666+0000 7fc34b7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc34c136090 0x7fc34c136470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41524/0 (socket says 172.21.15.19:41524) 2023-11-04T15:27:51.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.666+0000 7fc34b7fe640 1 -- 172.21.15.19:0/844347161 learned_addr learned my addr 172.21.15.19:0/844347161 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:51.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.666+0000 7fc34bfff640 1 --2- 172.21.15.19:0/844347161 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc34c13f990 0x7fc34c141d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:51.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.666+0000 7fc34affd640 1 -- 172.21.15.19:0/844347161 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc34c13f990 msgr2=0x7fc34c141d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:51.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.666+0000 7fc34affd640 1 --2- 172.21.15.19:0/844347161 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc34c13f990 0x7fc34c141d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:51.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.666+0000 7fc34affd640 1 -- 172.21.15.19:0/844347161 >> v1:172.21.15.19:6789/0 conn(0x7fc34c136090 legacy=0x7fc34c136470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:51.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.666+0000 7fc34affd640 1 -- 172.21.15.19:0/844347161 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc34c0a4b90 con 0x7fc34c0a6370 2023-11-04T15:27:51.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.666+0000 7fc34a7fc640 1 -- 172.21.15.19:0/844347161 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 273141247 0 0) 0x7fc34c0abe60 con 0x7fc34c136090 2023-11-04T15:27:51.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.667+0000 7fc34affd640 1 --2- 172.21.15.19:0/844347161 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc34c0a6370 0x7fc34c13f450 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc3400097a0 tx=0x7fc34002b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80469c8536839c91 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:51.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.667+0000 7fc34a7fc640 1 -- 172.21.15.19:0/844347161 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34002f050 con 0x7fc34c0a6370 2023-11-04T15:27:51.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.667+0000 7fc34a7fc640 1 -- 172.21.15.19:0/844347161 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc340031700 con 0x7fc34c0a6370 2023-11-04T15:27:51.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.667+0000 7fc34a7fc640 1 -- 172.21.15.19:0/844347161 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc340031a90 con 0x7fc34c0a6370 2023-11-04T15:27:51.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.667+0000 7fc3521dd640 1 -- 172.21.15.19:0/844347161 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc34c0a6370 msgr2=0x7fc34c13f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:51.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.667+0000 7fc3521dd640 1 --2- 172.21.15.19:0/844347161 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc34c0a6370 0x7fc34c13f450 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc3400097a0 tx=0x7fc34002b7a0 comp rx=0 tx=0).stop 2023-11-04T15:27:51.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.667+0000 7fc3521dd640 1 -- 172.21.15.19:0/844347161 shutdown_connections 2023-11-04T15:27:51.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.667+0000 7fc3521dd640 1 --2- 172.21.15.19:0/844347161 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc34c13f990 0x7fc34c141d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:51.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.667+0000 7fc3521dd640 1 --2- 172.21.15.19:0/844347161 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc34c0a6370 0x7fc34c13f450 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:51.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.668+0000 7fc3521dd640 1 -- 172.21.15.19:0/844347161 >> 172.21.15.19:0/844347161 conn(0x7fc34c0ac3f0 msgr2=0x7fc34c0ac800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:51.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.668+0000 7fc3521dd640 1 -- 172.21.15.19:0/844347161 shutdown_connections 2023-11-04T15:27:51.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.668+0000 7fc3521dd640 1 -- 172.21.15.19:0/844347161 wait complete. 2023-11-04T15:27:51.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.668+0000 7fc3521dd640 1 Processor -- start 2023-11-04T15:27:51.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.669+0000 7fc3521dd640 1 -- start start 2023-11-04T15:27:51.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.669+0000 7fc3521dd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc34c0a6370 0x7fc34c1cec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:51.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.669+0000 7fc3521dd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc34c136090 0x7fc34c1cf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:51.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.669+0000 7fc3521dd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc34c13f990 0x7fc34c1cf710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:51.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.669+0000 7fc3521dd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c0a5f90 con 0x7fc34c136090 2023-11-04T15:27:51.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.669+0000 7fc3521dd640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c13cd40 con 0x7fc34c13f990 2023-11-04T15:27:51.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.669+0000 7fc3521dd640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c13e180 con 0x7fc34c0a6370 2023-11-04T15:27:51.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.669+0000 7fc34affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc34c136090 0x7fc34c1cf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:51.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.669+0000 7fc34affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc34c136090 0x7fc34c1cf1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54620/0 (socket says 172.21.15.19:54620) 2023-11-04T15:27:51.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.669+0000 7fc34affd640 1 -- 172.21.15.19:0/2406590339 learned_addr learned my addr 172.21.15.19:0/2406590339 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:51.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.669+0000 7fc34bfff640 1 --2- 172.21.15.19:0/2406590339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc34c13f990 0x7fc34c1cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:51.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.669+0000 7fc34affd640 1 -- 172.21.15.19:0/2406590339 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc34c0a6370 msgr2=0x7fc34c1cec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:51.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.669+0000 7fc34b7fe640 1 --2- 172.21.15.19:0/2406590339 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc34c0a6370 0x7fc34c1cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:51.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.669+0000 7fc34affd640 1 --2- 172.21.15.19:0/2406590339 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc34c0a6370 0x7fc34c1cec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:51.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.669+0000 7fc34affd640 1 -- 172.21.15.19:0/2406590339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc34c13f990 msgr2=0x7fc34c1cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:51.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.669+0000 7fc34affd640 1 --2- 172.21.15.19:0/2406590339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc34c13f990 0x7fc34c1cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:51.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.669+0000 7fc34affd640 1 -- 172.21.15.19:0/2406590339 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc340009400 con 0x7fc34c136090 2023-11-04T15:27:51.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.669+0000 7fc34bfff640 1 --2- 172.21.15.19:0/2406590339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc34c13f990 0x7fc34c1cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T15:27:51.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.669+0000 7fc34b7fe640 1 --2- 172.21.15.19:0/2406590339 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc34c0a6370 0x7fc34c1cec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T15:27:51.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.670+0000 7fc34affd640 1 --2- 172.21.15.19:0/2406590339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc34c136090 0x7fc34c1cf1d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc340000c00 tx=0x7fc3400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:51.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.670+0000 7fc333fff640 1 -- 172.21.15.19:0/2406590339 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc340033c30 con 0x7fc34c136090 2023-11-04T15:27:51.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.670+0000 7fc333fff640 1 -- 172.21.15.19:0/2406590339 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc340033d90 con 0x7fc34c136090 2023-11-04T15:27:51.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.670+0000 7fc3521dd640 1 -- 172.21.15.19:0/2406590339 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc34c13c3c0 con 0x7fc34c136090 2023-11-04T15:27:51.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.670+0000 7fc333fff640 1 -- 172.21.15.19:0/2406590339 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34003c640 con 0x7fc34c136090 2023-11-04T15:27:51.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.670+0000 7fc3521dd640 1 -- 172.21.15.19:0/2406590339 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc34c137d70 con 0x7fc34c136090 2023-11-04T15:27:51.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.671+0000 7fc3521dd640 1 -- 172.21.15.19:0/2406590339 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc34c067d60 con 0x7fc34c136090 2023-11-04T15:27:51.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.671+0000 7fc333fff640 1 -- 172.21.15.19:0/2406590339 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc34003a040 con 0x7fc34c136090 2023-11-04T15:27:51.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.672+0000 7fc333fff640 1 --2- 172.21.15.19:0/2406590339 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc33806a430 0x7fc33806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:51.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.672+0000 7fc333fff640 1 -- 172.21.15.19:0/2406590339 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7fc3400a9e40 con 0x7fc34c136090 2023-11-04T15:27:51.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.672+0000 7fc34b7fe640 1 --2- 172.21.15.19:0/2406590339 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc33806a430 0x7fc33806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:51.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.672+0000 7fc34b7fe640 1 --2- 172.21.15.19:0/2406590339 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc33806a430 0x7fc33806c8f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc33c000f60 tx=0x7fc33c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:51.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.676+0000 7fc333fff640 1 -- 172.21.15.19:0/2406590339 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc340075b40 con 0x7fc34c136090 2023-11-04T15:27:51.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.855+0000 7fc3521dd640 1 -- 172.21.15.19:0/2406590339 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc34c0ab1f0 con 0x7fc34c136090 2023-11-04T15:27:51.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.855+0000 7fc333fff640 1 -- 172.21.15.19:0/2406590339 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc340043020 con 0x7fc34c136090 2023-11-04T15:27:51.857 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-11-04T15:27:51.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.857+0000 7fc3521dd640 1 -- 172.21.15.19:0/2406590339 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc33806a430 msgr2=0x7fc33806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:51.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.857+0000 7fc3521dd640 1 --2- 172.21.15.19:0/2406590339 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc33806a430 0x7fc33806c8f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc33c000f60 tx=0x7fc33c009040 comp rx=0 tx=0).stop 2023-11-04T15:27:51.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.857+0000 7fc3521dd640 1 -- 172.21.15.19:0/2406590339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc34c136090 msgr2=0x7fc34c1cf1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:51.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.857+0000 7fc3521dd640 1 --2- 172.21.15.19:0/2406590339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc34c136090 0x7fc34c1cf1d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc340000c00 tx=0x7fc3400046c0 comp rx=0 tx=0).stop 2023-11-04T15:27:51.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.857+0000 7fc3521dd640 1 -- 172.21.15.19:0/2406590339 shutdown_connections 2023-11-04T15:27:51.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.857+0000 7fc3521dd640 1 --2- 172.21.15.19:0/2406590339 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc33806a430 0x7fc33806c8f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:51.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.857+0000 7fc3521dd640 1 --2- 172.21.15.19:0/2406590339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc34c13f990 0x7fc34c1cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:51.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.858+0000 7fc3521dd640 1 --2- 172.21.15.19:0/2406590339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc34c136090 0x7fc34c1cf1d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:51.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.858+0000 7fc3521dd640 1 --2- 172.21.15.19:0/2406590339 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc34c0a6370 0x7fc34c1cec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:51.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.858+0000 7fc3521dd640 1 -- 172.21.15.19:0/2406590339 >> 172.21.15.19:0/2406590339 conn(0x7fc34c0ac3f0 msgr2=0x7fc34c0a7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:51.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.858+0000 7fc3521dd640 1 -- 172.21.15.19:0/2406590339 shutdown_connections 2023-11-04T15:27:51.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.858+0000 7fc3521dd640 1 -- 172.21.15.19:0/2406590339 wait complete. 2023-11-04T15:27:51.869 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-04T15:27:51.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.976+0000 7f7251c56640 1 Processor -- start 2023-11-04T15:27:51.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.977+0000 7f7251c56640 1 -- start start 2023-11-04T15:27:51.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.977+0000 7f7251c56640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f724c136110 0x7f724c0a63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:51.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.977+0000 7f7251c56640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f724c0a5740 con 0x7f724c1364f0 2023-11-04T15:27:51.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.977+0000 7f7251c56640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f724c0a51a0 con 0x7f724c13a890 2023-11-04T15:27:51.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.977+0000 7f7251c56640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f724c0a3e60 con 0x7f724c136110 2023-11-04T15:27:51.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.977+0000 7f724affd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f724c1364f0 0x7f724c13a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41540/0 (socket says 172.21.15.19:41540) 2023-11-04T15:27:51.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.977+0000 7f724affd640 1 -- 172.21.15.19:0/1027822540 learned_addr learned my addr 172.21.15.19:0/1027822540 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:51.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.977+0000 7f724b7fe640 1 --2- 172.21.15.19:0/1027822540 >> v2:172.21.15.96:3300/0 conn(0x7f724c136110 0x7f724c0a63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:51.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.977+0000 7f724a7fc640 1 -- 172.21.15.19:0/1027822540 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2172143458 0 0) 0x7f724c0a5740 con 0x7f724c1364f0 2023-11-04T15:27:51.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.977+0000 7f724a7fc640 1 -- 172.21.15.19:0/1027822540 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7234003520 con 0x7f724c1364f0 2023-11-04T15:27:51.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.978+0000 7f724a7fc640 1 -- 172.21.15.19:0/1027822540 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 407694257 0 0) 0x7f7234003520 con 0x7f724c1364f0 2023-11-04T15:27:51.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.978+0000 7f724a7fc640 1 -- 172.21.15.19:0/1027822540 >> v2:172.21.15.96:3300/0 conn(0x7f724c136110 msgr2=0x7f724c0a63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:51.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.978+0000 7f724a7fc640 1 --2- 172.21.15.19:0/1027822540 >> v2:172.21.15.96:3300/0 conn(0x7f724c136110 0x7f724c0a63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:51.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.978+0000 7f724a7fc640 1 -- 172.21.15.19:0/1027822540 >> v1:172.21.15.96:6789/0 conn(0x7f724c13a890 legacy=0x7f724c1424c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:51.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.978+0000 7f724a7fc640 1 -- 172.21.15.19:0/1027822540 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f724c0a5460 con 0x7f724c1364f0 2023-11-04T15:27:51.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.978+0000 7f724a7fc640 1 -- 172.21.15.19:0/1027822540 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3646097784 0 0) 0x7f7240001670 con 0x7f724c1364f0 2023-11-04T15:27:51.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.978+0000 7f724a7fc640 1 -- 172.21.15.19:0/1027822540 >> v1:172.21.15.19:6789/0 conn(0x7f724c1364f0 legacy=0x7f724c13a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:51.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.978+0000 7f724a7fc640 1 --2- 172.21.15.19:0/1027822540 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7234003970 0x7f7234003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:51.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.978+0000 7f724a7fc640 1 --2- 172.21.15.19:0/1027822540 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f72340047c0 0x7f7234004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:51.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.978+0000 7f724a7fc640 1 --2- 172.21.15.19:0/1027822540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72340052a0 0x7f723400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:51.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.978+0000 7f724a7fc640 1 -- 172.21.15.19:0/1027822540 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724c0a3e60 con 0x7f7234003970 2023-11-04T15:27:51.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.978+0000 7f724a7fc640 1 -- 172.21.15.19:0/1027822540 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723400c170 con 0x7f72340052a0 2023-11-04T15:27:51.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.978+0000 7f724a7fc640 1 -- 172.21.15.19:0/1027822540 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f723400c330 con 0x7f72340047c0 2023-11-04T15:27:51.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.978+0000 7f724b7fe640 1 --2- 172.21.15.19:0/1027822540 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7234003970 0x7f7234003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:51.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.978+0000 7f724affd640 1 --2- 172.21.15.19:0/1027822540 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f72340047c0 0x7f7234004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:51.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.978+0000 7f724bfff640 1 --2- 172.21.15.19:0/1027822540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72340052a0 0x7f723400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:51.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.978+0000 7f724b7fe640 1 -- 172.21.15.19:0/1027822540 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f72340047c0 msgr2=0x7f7234004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:51.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.978+0000 7f724b7fe640 1 --2- 172.21.15.19:0/1027822540 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f72340047c0 0x7f7234004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:51.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.978+0000 7f724b7fe640 1 -- 172.21.15.19:0/1027822540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72340052a0 msgr2=0x7f723400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:51.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.978+0000 7f724b7fe640 1 --2- 172.21.15.19:0/1027822540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72340052a0 0x7f723400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:51.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.978+0000 7f724b7fe640 1 -- 172.21.15.19:0/1027822540 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7234003520 con 0x7f7234003970 2023-11-04T15:27:51.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.978+0000 7f724bfff640 1 --2- 172.21.15.19:0/1027822540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72340052a0 0x7f723400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:27:51.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.978+0000 7f724bfff640 1 -- 172.21.15.19:0/1027822540 reap_dead start 2023-11-04T15:27:51.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.978+0000 7f724affd640 1 --2- 172.21.15.19:0/1027822540 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f72340047c0 0x7f7234004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:27:51.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.979+0000 7f724b7fe640 1 --2- 172.21.15.19:0/1027822540 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7234003970 0x7f7234003d90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f723c009a90 tx=0x7f72340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92db7650c11459 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:51.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.979+0000 7f724a7fc640 1 -- 172.21.15.19:0/1027822540 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723c02c680 con 0x7f7234003970 2023-11-04T15:27:51.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.979+0000 7f724a7fc640 1 -- 172.21.15.19:0/1027822540 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f723c02c7e0 con 0x7f7234003970 2023-11-04T15:27:51.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.979+0000 7f724a7fc640 1 -- 172.21.15.19:0/1027822540 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723c02cb70 con 0x7f7234003970 2023-11-04T15:27:51.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.980+0000 7f7251c56640 1 -- 172.21.15.19:0/1027822540 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7234003970 msgr2=0x7f7234003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:51.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.980+0000 7f7251c56640 1 --2- 172.21.15.19:0/1027822540 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7234003970 0x7f7234003d90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f723c009a90 tx=0x7f72340057f0 comp rx=0 tx=0).stop 2023-11-04T15:27:51.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.980+0000 7f7251c56640 1 -- 172.21.15.19:0/1027822540 shutdown_connections 2023-11-04T15:27:51.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.980+0000 7f7251c56640 1 --2- 172.21.15.19:0/1027822540 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7234003970 0x7f7234003d90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:51.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.980+0000 7f7251c56640 1 -- 172.21.15.19:0/1027822540 >> 172.21.15.19:0/1027822540 conn(0x7f724c0ac3b0 msgr2=0x7f724c0ac7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:51.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.980+0000 7f7251c56640 1 -- 172.21.15.19:0/1027822540 shutdown_connections 2023-11-04T15:27:51.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.980+0000 7f7251c56640 1 -- 172.21.15.19:0/1027822540 wait complete. 2023-11-04T15:27:51.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.980+0000 7f7251c56640 1 Processor -- start 2023-11-04T15:27:51.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.981+0000 7f7251c56640 1 -- start start 2023-11-04T15:27:51.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.981+0000 7f7251c56640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7234003970 0x7f724c098a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:51.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.981+0000 7f7251c56640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f724c098f90 0x7f724c0993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:51.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.981+0000 7f7251c56640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f724c134bf0 0x7f724c135070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:51.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.981+0000 7f7251c56640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724c09c230 con 0x7f7234003970 2023-11-04T15:27:51.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.981+0000 7f7251c56640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724c137de0 con 0x7f724c098f90 2023-11-04T15:27:51.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.981+0000 7f7251c56640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f724c09bbf0 con 0x7f724c134bf0 2023-11-04T15:27:51.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.981+0000 7f724b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7234003970 0x7f724c098a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:51.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.981+0000 7f724b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7234003970 0x7f724c098a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54636/0 (socket says 172.21.15.19:54636) 2023-11-04T15:27:51.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.981+0000 7f724b7fe640 1 -- 172.21.15.19:0/2018557761 learned_addr learned my addr 172.21.15.19:0/2018557761 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:51.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.981+0000 7f724affd640 1 --2- 172.21.15.19:0/2018557761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f724c098f90 0x7f724c0993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:51.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.981+0000 7f724bfff640 1 --2- 172.21.15.19:0/2018557761 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f724c134bf0 0x7f724c135070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:51.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.982+0000 7f724b7fe640 1 -- 172.21.15.19:0/2018557761 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f724c134bf0 msgr2=0x7f724c135070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:51.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.982+0000 7f724b7fe640 1 --2- 172.21.15.19:0/2018557761 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f724c134bf0 0x7f724c135070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:51.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.982+0000 7f724b7fe640 1 -- 172.21.15.19:0/2018557761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f724c098f90 msgr2=0x7f724c0993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:51.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.982+0000 7f724b7fe640 1 --2- 172.21.15.19:0/2018557761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f724c098f90 0x7f724c0993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:51.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.982+0000 7f724b7fe640 1 -- 172.21.15.19:0/2018557761 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f724c09aa50 con 0x7f7234003970 2023-11-04T15:27:51.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.982+0000 7f724affd640 1 --2- 172.21.15.19:0/2018557761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f724c098f90 0x7f724c0993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:27:51.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.982+0000 7f724b7fe640 1 --2- 172.21.15.19:0/2018557761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7234003970 0x7f724c098a50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f723c02c220 tx=0x7f723c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:51.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.982+0000 7f7233fff640 1 -- 172.21.15.19:0/2018557761 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723c003810 con 0x7f7234003970 2023-11-04T15:27:51.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.982+0000 7f7233fff640 1 -- 172.21.15.19:0/2018557761 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f723c003970 con 0x7f7234003970 2023-11-04T15:27:51.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.982+0000 7f7251c56640 1 -- 172.21.15.19:0/2018557761 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f724c09c7c0 con 0x7f7234003970 2023-11-04T15:27:51.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.982+0000 7f7233fff640 1 -- 172.21.15.19:0/2018557761 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723c003d00 con 0x7f7234003970 2023-11-04T15:27:51.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.982+0000 7f7251c56640 1 -- 172.21.15.19:0/2018557761 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f724c09d940 con 0x7f7234003970 2023-11-04T15:27:51.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.983+0000 7f7251c56640 1 -- 172.21.15.19:0/2018557761 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f724c0a4240 con 0x7f7234003970 2023-11-04T15:27:51.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.983+0000 7f7233fff640 1 -- 172.21.15.19:0/2018557761 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f723c034440 con 0x7f7234003970 2023-11-04T15:27:51.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.984+0000 7f7233fff640 1 --2- 172.21.15.19:0/2018557761 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f723806a460 0x7f723806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:51.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.984+0000 7f7233fff640 1 -- 172.21.15.19:0/2018557761 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f723c0aa180 con 0x7f7234003970 2023-11-04T15:27:51.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.984+0000 7f724affd640 1 --2- 172.21.15.19:0/2018557761 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f723806a460 0x7f723806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:52.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.984+0000 7f724affd640 1 --2- 172.21.15.19:0/2018557761 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f723806a460 0x7f723806c920 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f72400010e0 tx=0x7f7240009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:52.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:51.988+0000 7f7233fff640 1 -- 172.21.15.19:0/2018557761 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f723c075e10 con 0x7f7234003970 2023-11-04T15:27:52.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.164+0000 7f7251c56640 1 -- 172.21.15.19:0/2018557761 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f724c067d60 con 0x7f7234003970 2023-11-04T15:27:52.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.164+0000 7f7233fff640 1 -- 172.21.15.19:0/2018557761 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f723c003e60 con 0x7f7234003970 2023-11-04T15:27:52.166 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 8 2023-11-04T15:27:52.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.166+0000 7f7251c56640 1 -- 172.21.15.19:0/2018557761 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f723806a460 msgr2=0x7f723806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:52.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.166+0000 7f7251c56640 1 --2- 172.21.15.19:0/2018557761 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f723806a460 0x7f723806c920 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f72400010e0 tx=0x7f7240009040 comp rx=0 tx=0).stop 2023-11-04T15:27:52.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.166+0000 7f7251c56640 1 -- 172.21.15.19:0/2018557761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7234003970 msgr2=0x7f724c098a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:52.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.166+0000 7f7251c56640 1 --2- 172.21.15.19:0/2018557761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7234003970 0x7f724c098a50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f723c02c220 tx=0x7f723c004730 comp rx=0 tx=0).stop 2023-11-04T15:27:52.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.167+0000 7f7251c56640 1 -- 172.21.15.19:0/2018557761 shutdown_connections 2023-11-04T15:27:52.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.167+0000 7f7251c56640 1 --2- 172.21.15.19:0/2018557761 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f723806a460 0x7f723806c920 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:52.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.167+0000 7f7251c56640 1 --2- 172.21.15.19:0/2018557761 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f724c134bf0 0x7f724c135070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:52.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.167+0000 7f7251c56640 1 --2- 172.21.15.19:0/2018557761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f724c098f90 0x7f724c0993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:52.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.167+0000 7f7251c56640 1 --2- 172.21.15.19:0/2018557761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7234003970 0x7f724c098a50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:52.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.167+0000 7f7251c56640 1 -- 172.21.15.19:0/2018557761 >> 172.21.15.19:0/2018557761 conn(0x7f724c0ac3b0 msgr2=0x7f724c1bf9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:52.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.167+0000 7f7251c56640 1 -- 172.21.15.19:0/2018557761 shutdown_connections 2023-11-04T15:27:52.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.167+0000 7f7251c56640 1 -- 172.21.15.19:0/2018557761 wait complete. 2023-11-04T15:27:52.178 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T15:27:52.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.285+0000 7f7da5384640 1 Processor -- start 2023-11-04T15:27:52.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.285+0000 7f7da5384640 1 -- start start 2023-11-04T15:27:52.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.286+0000 7f7da5384640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7da00a6370 0x7f7da013f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:52.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.286+0000 7f7da5384640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7da013f990 0x7f7da0141d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:52.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.286+0000 7f7da5384640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7da00abe60 con 0x7f7da0136090 2023-11-04T15:27:52.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.286+0000 7f7da5384640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7da00a68d0 con 0x7f7da00a6370 2023-11-04T15:27:52.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.286+0000 7f7da5384640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7da00a30a0 con 0x7f7da013f990 2023-11-04T15:27:52.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.286+0000 7f7d9e7fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7da00a6370 0x7f7da013f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:52.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.286+0000 7f7d9e7fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7da00a6370 0x7f7da013f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54638/0 (socket says 172.21.15.19:54638) 2023-11-04T15:27:52.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.286+0000 7f7d9e7fc640 1 -- 172.21.15.19:0/2300431255 learned_addr learned my addr 172.21.15.19:0/2300431255 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:52.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.286+0000 7f7d9f7fe640 1 --2- 172.21.15.19:0/2300431255 >> v2:172.21.15.96:3300/0 conn(0x7f7da013f990 0x7f7da0141d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:52.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.286+0000 7f7d9e7fc640 1 -- 172.21.15.19:0/2300431255 >> v2:172.21.15.96:3300/0 conn(0x7f7da013f990 msgr2=0x7f7da0141d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:52.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.286+0000 7f7d9e7fc640 1 --2- 172.21.15.19:0/2300431255 >> v2:172.21.15.96:3300/0 conn(0x7f7da013f990 0x7f7da0141d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:52.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.286+0000 7f7d9e7fc640 1 -- 172.21.15.19:0/2300431255 >> v1:172.21.15.96:6789/0 conn(0x7f7da0136090 legacy=0x7f7da0136470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:52.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.286+0000 7f7d9e7fc640 1 -- 172.21.15.19:0/2300431255 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da00a4b90 con 0x7f7da00a6370 2023-11-04T15:27:52.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.286+0000 7f7d9f7fe640 1 --2- 172.21.15.19:0/2300431255 >> v2:172.21.15.96:3300/0 conn(0x7f7da013f990 0x7f7da0141d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T15:27:52.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.287+0000 7f7d9e7fc640 1 --2- 172.21.15.19:0/2300431255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7da00a6370 0x7f7da013f450 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7da006a7e0 tx=0x7f7d9402b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fb03bd5d7903004 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:52.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.287+0000 7f7d9dffb640 1 -- 172.21.15.19:0/2300431255 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d94031750 con 0x7f7da00a6370 2023-11-04T15:27:52.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.287+0000 7f7d9dffb640 1 -- 172.21.15.19:0/2300431255 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d940318b0 con 0x7f7da00a6370 2023-11-04T15:27:52.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.287+0000 7f7d9dffb640 1 -- 172.21.15.19:0/2300431255 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d94031c40 con 0x7f7da00a6370 2023-11-04T15:27:52.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.288+0000 7f7da5384640 1 -- 172.21.15.19:0/2300431255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7da00a6370 msgr2=0x7f7da013f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:52.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.288+0000 7f7da5384640 1 --2- 172.21.15.19:0/2300431255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7da00a6370 0x7f7da013f450 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7da006a7e0 tx=0x7f7d9402b7f0 comp rx=0 tx=0).stop 2023-11-04T15:27:52.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.288+0000 7f7da5384640 1 -- 172.21.15.19:0/2300431255 shutdown_connections 2023-11-04T15:27:52.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.288+0000 7f7da5384640 1 --2- 172.21.15.19:0/2300431255 >> v2:172.21.15.96:3300/0 conn(0x7f7da013f990 0x7f7da0141d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:52.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.288+0000 7f7da5384640 1 --2- 172.21.15.19:0/2300431255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7da00a6370 0x7f7da013f450 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:52.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.288+0000 7f7da5384640 1 -- 172.21.15.19:0/2300431255 >> 172.21.15.19:0/2300431255 conn(0x7f7da00ac3f0 msgr2=0x7f7da00ac800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:52.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.288+0000 7f7da5384640 1 -- 172.21.15.19:0/2300431255 shutdown_connections 2023-11-04T15:27:52.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.288+0000 7f7da5384640 1 -- 172.21.15.19:0/2300431255 wait complete. 2023-11-04T15:27:52.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.289+0000 7f7da5384640 1 Processor -- start 2023-11-04T15:27:52.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.289+0000 7f7da5384640 1 -- start start 2023-11-04T15:27:52.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.289+0000 7f7da5384640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7da00a6370 0x7f7da0139950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:52.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.289+0000 7f7da5384640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7da0136090 0x7f7da0139e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:52.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.289+0000 7f7da5384640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7da013f990 0x7f7da013a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:52.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.289+0000 7f7da5384640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da013cc00 con 0x7f7da0136090 2023-11-04T15:27:52.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.289+0000 7f7da5384640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da013e130 con 0x7f7da00a6370 2023-11-04T15:27:52.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.289+0000 7f7da5384640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7da013ce50 con 0x7f7da013f990 2023-11-04T15:27:52.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.289+0000 7f7d9e7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7da0136090 0x7f7da0139e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:52.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.289+0000 7f7d9e7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7da0136090 0x7f7da0139e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54642/0 (socket says 172.21.15.19:54642) 2023-11-04T15:27:52.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.289+0000 7f7d9e7fc640 1 -- 172.21.15.19:0/2977176772 learned_addr learned my addr 172.21.15.19:0/2977176772 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:52.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.290+0000 7f7d9effd640 1 --2- 172.21.15.19:0/2977176772 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7da00a6370 0x7f7da0139950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:52.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.290+0000 7f7d9f7fe640 1 --2- 172.21.15.19:0/2977176772 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7da013f990 0x7f7da013a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:52.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.290+0000 7f7d9e7fc640 1 -- 172.21.15.19:0/2977176772 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7da013f990 msgr2=0x7f7da013a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:52.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.290+0000 7f7d9e7fc640 1 --2- 172.21.15.19:0/2977176772 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7da013f990 0x7f7da013a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:52.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.290+0000 7f7d9e7fc640 1 -- 172.21.15.19:0/2977176772 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7da00a6370 msgr2=0x7f7da0139950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:52.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.290+0000 7f7d9e7fc640 1 --2- 172.21.15.19:0/2977176772 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7da00a6370 0x7f7da0139950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:52.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.290+0000 7f7d9e7fc640 1 -- 172.21.15.19:0/2977176772 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d940094d0 con 0x7f7da0136090 2023-11-04T15:27:52.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.290+0000 7f7d9e7fc640 1 --2- 172.21.15.19:0/2977176772 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7da0136090 0x7f7da0139e90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7d94000c00 tx=0x7f7d940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:52.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.290+0000 7f7d877fe640 1 -- 172.21.15.19:0/2977176772 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d94033c60 con 0x7f7da0136090 2023-11-04T15:27:52.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.290+0000 7f7d877fe640 1 -- 172.21.15.19:0/2977176772 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d94033dc0 con 0x7f7da0136090 2023-11-04T15:27:52.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.290+0000 7f7da5384640 1 -- 172.21.15.19:0/2977176772 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7da00aaa60 con 0x7f7da0136090 2023-11-04T15:27:52.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.290+0000 7f7d877fe640 1 -- 172.21.15.19:0/2977176772 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9403d6b0 con 0x7f7da0136090 2023-11-04T15:27:52.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.290+0000 7f7da5384640 1 -- 172.21.15.19:0/2977176772 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7da013e330 con 0x7f7da0136090 2023-11-04T15:27:52.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.291+0000 7f7da5384640 1 -- 172.21.15.19:0/2977176772 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7da0067d60 con 0x7f7da0136090 2023-11-04T15:27:52.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.291+0000 7f7d877fe640 1 -- 172.21.15.19:0/2977176772 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7d9403a040 con 0x7f7da0136090 2023-11-04T15:27:52.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.292+0000 7f7d877fe640 1 --2- 172.21.15.19:0/2977176772 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f7d8c06a460 0x7f7d8c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:52.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.292+0000 7f7d877fe640 1 -- 172.21.15.19:0/2977176772 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f7d940aa360 con 0x7f7da0136090 2023-11-04T15:27:52.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.292+0000 7f7d9effd640 1 --2- 172.21.15.19:0/2977176772 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f7d8c06a460 0x7f7d8c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:52.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.293+0000 7f7d9effd640 1 --2- 172.21.15.19:0/2977176772 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f7d8c06a460 0x7f7d8c06c920 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7d980017f0 tx=0x7f7d98009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:52.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.296+0000 7f7d877fe640 1 -- 172.21.15.19:0/2977176772 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7d94075ff0 con 0x7f7da0136090 2023-11-04T15:27:52.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.470+0000 7f7da5384640 1 -- 172.21.15.19:0/2977176772 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7da0072190 con 0x7f7da0136090 2023-11-04T15:27:52.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.471+0000 7f7d877fe640 1 -- 172.21.15.19:0/2977176772 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v19) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7d94038020 con 0x7f7da0136090 2023-11-04T15:27:52.472 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-04T15:27:52.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.472+0000 7f7da5384640 1 -- 172.21.15.19:0/2977176772 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f7d8c06a460 msgr2=0x7f7d8c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:52.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.472+0000 7f7da5384640 1 --2- 172.21.15.19:0/2977176772 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f7d8c06a460 0x7f7d8c06c920 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7d980017f0 tx=0x7f7d98009040 comp rx=0 tx=0).stop 2023-11-04T15:27:52.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.472+0000 7f7da5384640 1 -- 172.21.15.19:0/2977176772 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7da0136090 msgr2=0x7f7da0139e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:52.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.472+0000 7f7da5384640 1 --2- 172.21.15.19:0/2977176772 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7da0136090 0x7f7da0139e90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7d94000c00 tx=0x7f7d940046c0 comp rx=0 tx=0).stop 2023-11-04T15:27:52.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.472+0000 7f7da5384640 1 -- 172.21.15.19:0/2977176772 shutdown_connections 2023-11-04T15:27:52.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.472+0000 7f7da5384640 1 --2- 172.21.15.19:0/2977176772 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f7d8c06a460 0x7f7d8c06c920 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:52.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.472+0000 7f7da5384640 1 --2- 172.21.15.19:0/2977176772 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7da013f990 0x7f7da013a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:52.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.472+0000 7f7da5384640 1 --2- 172.21.15.19:0/2977176772 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7da0136090 0x7f7da0139e90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:52.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.472+0000 7f7da5384640 1 --2- 172.21.15.19:0/2977176772 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7da00a6370 0x7f7da0139950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:52.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.472+0000 7f7da5384640 1 -- 172.21.15.19:0/2977176772 >> 172.21.15.19:0/2977176772 conn(0x7f7da00ac3f0 msgr2=0x7f7da0133370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:52.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.472+0000 7f7da5384640 1 -- 172.21.15.19:0/2977176772 shutdown_connections 2023-11-04T15:27:52.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.472+0000 7f7da5384640 1 -- 172.21.15.19:0/2977176772 wait complete. 2023-11-04T15:27:52.484 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T15:27:52.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.592+0000 7f28d07a4640 1 Processor -- start 2023-11-04T15:27:52.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.592+0000 7f28d07a4640 1 -- start start 2023-11-04T15:27:52.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.592+0000 7f28d07a4640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f28c8138010 0x7f28c81383f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:52.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.592+0000 7f28d07a4640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f28c8138930 0x7f28c8131760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:52.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.592+0000 7f28d07a4640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c806f230 con 0x7f28c8131ca0 2023-11-04T15:27:52.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.592+0000 7f28d07a4640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28c806f560 con 0x7f28c8138010 2023-11-04T15:27:52.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.592+0000 7f28d07a4640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c80a40e0 con 0x7f28c8138930 2023-11-04T15:27:52.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.593+0000 7f28ce540640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f28c8138010 0x7f28c81383f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:52.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.593+0000 7f28ced41640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f28c8131ca0 0x7f28c813f550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41552/0 (socket says 172.21.15.19:41552) 2023-11-04T15:27:52.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.593+0000 7f28ced41640 1 -- 172.21.15.19:0/372312524 learned_addr learned my addr 172.21.15.19:0/372312524 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:52.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.593+0000 7f28cdd3f640 1 --2- 172.21.15.19:0/372312524 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f28c8138930 0x7f28c8131760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:52.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.593+0000 7f28ce540640 1 -- 172.21.15.19:0/372312524 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f28c8138930 msgr2=0x7f28c8131760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:52.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.593+0000 7f28ce540640 1 --2- 172.21.15.19:0/372312524 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f28c8138930 0x7f28c8131760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:52.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.593+0000 7f28ce540640 1 -- 172.21.15.19:0/372312524 >> v1:172.21.15.19:6789/0 conn(0x7f28c8131ca0 legacy=0x7f28c813f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:52.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.593+0000 7f28ce540640 1 -- 172.21.15.19:0/372312524 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c806d700 con 0x7f28c8138010 2023-11-04T15:27:52.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.593+0000 7f28cd53e640 1 -- 172.21.15.19:0/372312524 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 530339341 0 0) 0x7f28c806f230 con 0x7f28c8131ca0 2023-11-04T15:27:52.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.594+0000 7f28ce540640 1 --2- 172.21.15.19:0/372312524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28c8138010 0x7f28c81383f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f28c40097a0 tx=0x7f28c402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0fbe4b1ceda984f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:52.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.594+0000 7f28cd53e640 1 -- 172.21.15.19:0/372312524 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c402f050 con 0x7f28c8138010 2023-11-04T15:27:52.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.594+0000 7f28cd53e640 1 -- 172.21.15.19:0/372312524 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c4031700 con 0x7f28c8138010 2023-11-04T15:27:52.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.594+0000 7f28cd53e640 1 -- 172.21.15.19:0/372312524 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c4031a90 con 0x7f28c8138010 2023-11-04T15:27:52.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.594+0000 7f28d07a4640 1 -- 172.21.15.19:0/372312524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28c8138010 msgr2=0x7f28c81383f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:52.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.594+0000 7f28d07a4640 1 --2- 172.21.15.19:0/372312524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28c8138010 0x7f28c81383f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f28c40097a0 tx=0x7f28c402b7a0 comp rx=0 tx=0).stop 2023-11-04T15:27:52.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.594+0000 7f28d07a4640 1 -- 172.21.15.19:0/372312524 shutdown_connections 2023-11-04T15:27:52.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.594+0000 7f28d07a4640 1 --2- 172.21.15.19:0/372312524 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f28c8138930 0x7f28c8131760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:52.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.594+0000 7f28d07a4640 1 --2- 172.21.15.19:0/372312524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28c8138010 0x7f28c81383f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:52.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.594+0000 7f28d07a4640 1 -- 172.21.15.19:0/372312524 >> 172.21.15.19:0/372312524 conn(0x7f28c80a83a0 msgr2=0x7f28c80a87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:52.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.594+0000 7f28d07a4640 1 -- 172.21.15.19:0/372312524 shutdown_connections 2023-11-04T15:27:52.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.594+0000 7f28d07a4640 1 -- 172.21.15.19:0/372312524 wait complete. 2023-11-04T15:27:52.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.595+0000 7f28d07a4640 1 Processor -- start 2023-11-04T15:27:52.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.595+0000 7f28d07a4640 1 -- start start 2023-11-04T15:27:52.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.596+0000 7f28d07a4640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28c8131ca0 0x7f28c8098a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:52.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.596+0000 7f28d07a4640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f28c8138010 0x7f28c8098f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:52.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.596+0000 7f28d07a4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28c8138930 0x7f28c80994d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:52.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.596+0000 7f28d07a4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c809c670 con 0x7f28c8138930 2023-11-04T15:27:52.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.596+0000 7f28d07a4640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c809b190 con 0x7f28c8131ca0 2023-11-04T15:27:52.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.596+0000 7f28d07a4640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c809a8b0 con 0x7f28c8138010 2023-11-04T15:27:52.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.596+0000 7f28ced41640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28c8138930 0x7f28c80994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:52.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.596+0000 7f28ced41640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28c8138930 0x7f28c80994d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54650/0 (socket says 172.21.15.19:54650) 2023-11-04T15:27:52.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.596+0000 7f28ced41640 1 -- 172.21.15.19:0/3583781986 learned_addr learned my addr 172.21.15.19:0/3583781986 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:52.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.596+0000 7f28ce540640 1 --2- 172.21.15.19:0/3583781986 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28c8131ca0 0x7f28c8098a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:52.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.596+0000 7f28cdd3f640 1 --2- 172.21.15.19:0/3583781986 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f28c8138010 0x7f28c8098f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:52.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.596+0000 7f28ced41640 1 -- 172.21.15.19:0/3583781986 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f28c8138010 msgr2=0x7f28c8098f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:52.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.596+0000 7f28ced41640 1 --2- 172.21.15.19:0/3583781986 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f28c8138010 0x7f28c8098f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:52.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.596+0000 7f28ced41640 1 -- 172.21.15.19:0/3583781986 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28c8131ca0 msgr2=0x7f28c8098a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:52.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.596+0000 7f28ced41640 1 --2- 172.21.15.19:0/3583781986 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28c8131ca0 0x7f28c8098a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:52.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.596+0000 7f28ced41640 1 -- 172.21.15.19:0/3583781986 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c4009400 con 0x7f28c8138930 2023-11-04T15:27:52.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.596+0000 7f28ced41640 1 --2- 172.21.15.19:0/3583781986 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28c8138930 0x7f28c80994d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f28c000c7b0 tx=0x7f28c000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:52.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.596+0000 7f28baffd640 1 -- 172.21.15.19:0/3583781986 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c000a640 con 0x7f28c8138930 2023-11-04T15:27:52.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.596+0000 7f28baffd640 1 -- 172.21.15.19:0/3583781986 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c000a7c0 con 0x7f28c8138930 2023-11-04T15:27:52.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.596+0000 7f28d07a4640 1 -- 172.21.15.19:0/3583781986 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28c809bb30 con 0x7f28c8138930 2023-11-04T15:27:52.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.597+0000 7f28baffd640 1 -- 172.21.15.19:0/3583781986 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c000ab70 con 0x7f28c8138930 2023-11-04T15:27:52.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.597+0000 7f28d07a4640 1 -- 172.21.15.19:0/3583781986 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c809c1f0 con 0x7f28c8138930 2023-11-04T15:27:52.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.597+0000 7f28d07a4640 1 -- 172.21.15.19:0/3583781986 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c8067d60 con 0x7f28c8138930 2023-11-04T15:27:52.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.598+0000 7f28baffd640 1 -- 172.21.15.19:0/3583781986 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f28c000acd0 con 0x7f28c8138930 2023-11-04T15:27:52.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.598+0000 7f28baffd640 1 --2- 172.21.15.19:0/3583781986 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f28ac06a430 0x7f28ac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:52.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.598+0000 7f28baffd640 1 -- 172.21.15.19:0/3583781986 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f28c0087760 con 0x7f28c8138930 2023-11-04T15:27:52.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.599+0000 7f28ce540640 1 --2- 172.21.15.19:0/3583781986 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f28ac06a430 0x7f28ac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:52.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.599+0000 7f28ce540640 1 --2- 172.21.15.19:0/3583781986 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f28ac06a430 0x7f28ac06c8f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f28c4035000 tx=0x7f28c4008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:52.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.603+0000 7f28baffd640 1 -- 172.21.15.19:0/3583781986 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f28c00532a0 con 0x7f28c8138930 2023-11-04T15:27:52.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.778+0000 7f28d07a4640 1 -- 172.21.15.19:0/3583781986 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f28c806aa40 con 0x7f28c8138930 2023-11-04T15:27:52.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.778+0000 7f28baffd640 1 -- 172.21.15.19:0/3583781986 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v19) v1 ==== 100+0+11 (secure 0 0 0) 0x7f28c00180a0 con 0x7f28c8138930 2023-11-04T15:27:52.780 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2023-11-04T15:27:52.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.780+0000 7f28d07a4640 1 -- 172.21.15.19:0/3583781986 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f28ac06a430 msgr2=0x7f28ac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:52.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.780+0000 7f28d07a4640 1 --2- 172.21.15.19:0/3583781986 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f28ac06a430 0x7f28ac06c8f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f28c4035000 tx=0x7f28c4008030 comp rx=0 tx=0).stop 2023-11-04T15:27:52.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.780+0000 7f28d07a4640 1 -- 172.21.15.19:0/3583781986 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28c8138930 msgr2=0x7f28c80994d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:52.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.780+0000 7f28d07a4640 1 --2- 172.21.15.19:0/3583781986 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28c8138930 0x7f28c80994d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f28c000c7b0 tx=0x7f28c000cc70 comp rx=0 tx=0).stop 2023-11-04T15:27:52.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.780+0000 7f28d07a4640 1 -- 172.21.15.19:0/3583781986 shutdown_connections 2023-11-04T15:27:52.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.780+0000 7f28d07a4640 1 --2- 172.21.15.19:0/3583781986 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f28ac06a430 0x7f28ac06c8f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:52.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.780+0000 7f28d07a4640 1 --2- 172.21.15.19:0/3583781986 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28c8138930 0x7f28c80994d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:52.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.780+0000 7f28d07a4640 1 --2- 172.21.15.19:0/3583781986 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f28c8138010 0x7f28c8098f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:52.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.780+0000 7f28d07a4640 1 --2- 172.21.15.19:0/3583781986 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28c8131ca0 0x7f28c8098a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:52.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.780+0000 7f28d07a4640 1 -- 172.21.15.19:0/3583781986 >> 172.21.15.19:0/3583781986 conn(0x7f28c80a83a0 msgr2=0x7f28c80a4900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:52.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.780+0000 7f28d07a4640 1 -- 172.21.15.19:0/3583781986 shutdown_connections 2023-11-04T15:27:52.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.780+0000 7f28d07a4640 1 -- 172.21.15.19:0/3583781986 wait complete. 2023-11-04T15:27:52.792 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T15:27:52.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.897+0000 7eff2497e640 1 Processor -- start 2023-11-04T15:27:52.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.897+0000 7eff2497e640 1 -- start start 2023-11-04T15:27:52.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.897+0000 7eff2497e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7eff20137270 0x7eff200a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:52.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.897+0000 7eff2497e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7eff200a3e90 0x7eff20139f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:52.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.897+0000 7eff2497e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff200a4c20 con 0x7eff20137650 2023-11-04T15:27:52.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.897+0000 7eff2497e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff200a3060 con 0x7eff200a3e90 2023-11-04T15:27:52.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.897+0000 7eff2497e640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff200a5080 con 0x7eff20137270 2023-11-04T15:27:52.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.897+0000 7eff1dd9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7eff200a3e90 0x7eff20139f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:52.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.897+0000 7eff1ed9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7eff20137650 0x7eff2013a4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41554/0 (socket says 172.21.15.19:41554) 2023-11-04T15:27:52.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.897+0000 7eff1dd9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7eff200a3e90 0x7eff20139f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54662/0 (socket says 172.21.15.19:54662) 2023-11-04T15:27:52.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.897+0000 7eff1ed9d640 1 -- 172.21.15.19:0/2868825756 learned_addr learned my addr 172.21.15.19:0/2868825756 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:52.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.897+0000 7eff1e59c640 1 --2- 172.21.15.19:0/2868825756 >> v2:172.21.15.96:3300/0 conn(0x7eff20137270 0x7eff200a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:52.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.898+0000 7eff1dd9b640 1 -- 172.21.15.19:0/2868825756 >> v2:172.21.15.96:3300/0 conn(0x7eff20137270 msgr2=0x7eff200a6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:52.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.898+0000 7eff1dd9b640 1 --2- 172.21.15.19:0/2868825756 >> v2:172.21.15.96:3300/0 conn(0x7eff20137270 0x7eff200a6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:52.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.898+0000 7eff1dd9b640 1 -- 172.21.15.19:0/2868825756 >> v1:172.21.15.19:6789/0 conn(0x7eff20137650 legacy=0x7eff2013a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:52.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.898+0000 7eff1d59a640 1 -- 172.21.15.19:0/2868825756 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 344267031 0 0) 0x7eff200a4c20 con 0x7eff20137650 2023-11-04T15:27:52.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.898+0000 7eff1dd9b640 1 -- 172.21.15.19:0/2868825756 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff200a3440 con 0x7eff200a3e90 2023-11-04T15:27:52.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.899+0000 7eff1dd9b640 1 --2- 172.21.15.19:0/2868825756 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff200a3e90 0x7eff20139f60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7eff200ad2d0 tx=0x7eff0802b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33745f5dec716340 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:52.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.899+0000 7eff1d59a640 1 -- 172.21.15.19:0/2868825756 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff08031710 con 0x7eff200a3e90 2023-11-04T15:27:52.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.899+0000 7eff1d59a640 1 -- 172.21.15.19:0/2868825756 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0802f050 con 0x7eff200a3e90 2023-11-04T15:27:52.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.899+0000 7eff1d59a640 1 -- 172.21.15.19:0/2868825756 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff08031a90 con 0x7eff200a3e90 2023-11-04T15:27:52.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.899+0000 7eff2497e640 1 -- 172.21.15.19:0/2868825756 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff200a3e90 msgr2=0x7eff20139f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:52.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.899+0000 7eff2497e640 1 --2- 172.21.15.19:0/2868825756 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff200a3e90 0x7eff20139f60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7eff200ad2d0 tx=0x7eff0802b7b0 comp rx=0 tx=0).stop 2023-11-04T15:27:52.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.899+0000 7eff2497e640 1 -- 172.21.15.19:0/2868825756 shutdown_connections 2023-11-04T15:27:52.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.899+0000 7eff2497e640 1 --2- 172.21.15.19:0/2868825756 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff200a3e90 0x7eff20139f60 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:52.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.899+0000 7eff2497e640 1 --2- 172.21.15.19:0/2868825756 >> v2:172.21.15.96:3300/0 conn(0x7eff20137270 0x7eff200a6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:52.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.899+0000 7eff2497e640 1 -- 172.21.15.19:0/2868825756 >> 172.21.15.19:0/2868825756 conn(0x7eff200a8d70 msgr2=0x7eff200a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:52.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.899+0000 7eff2497e640 1 -- 172.21.15.19:0/2868825756 shutdown_connections 2023-11-04T15:27:52.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.899+0000 7eff2497e640 1 -- 172.21.15.19:0/2868825756 wait complete. 2023-11-04T15:27:52.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.900+0000 7eff2497e640 1 Processor -- start 2023-11-04T15:27:52.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.900+0000 7eff2497e640 1 -- start start 2023-11-04T15:27:52.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.901+0000 7eff2497e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff200a3e90 0x7eff201ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:52.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.901+0000 7eff2497e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7eff20137270 0x7eff201cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:52.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.901+0000 7eff2497e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff20137650 0x7eff201cf610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:52.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.901+0000 7eff2497e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff200a2400 con 0x7eff20137650 2023-11-04T15:27:52.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.901+0000 7eff2497e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff20099aa0 con 0x7eff200a3e90 2023-11-04T15:27:52.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.901+0000 7eff2497e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff2009be50 con 0x7eff20137270 2023-11-04T15:27:52.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.901+0000 7eff1ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff20137650 0x7eff201cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:52.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.901+0000 7eff1ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff20137650 0x7eff201cf610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54676/0 (socket says 172.21.15.19:54676) 2023-11-04T15:27:52.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.901+0000 7eff1ed9d640 1 -- 172.21.15.19:0/226162828 learned_addr learned my addr 172.21.15.19:0/226162828 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:52.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.901+0000 7eff1e59c640 1 --2- 172.21.15.19:0/226162828 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff200a3e90 0x7eff201ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:52.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.901+0000 7eff1dd9b640 1 --2- 172.21.15.19:0/226162828 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7eff20137270 0x7eff201cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:52.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.901+0000 7eff1ed9d640 1 -- 172.21.15.19:0/226162828 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7eff20137270 msgr2=0x7eff201cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:52.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.901+0000 7eff1ed9d640 1 --2- 172.21.15.19:0/226162828 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7eff20137270 0x7eff201cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:52.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.901+0000 7eff1ed9d640 1 -- 172.21.15.19:0/226162828 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff200a3e90 msgr2=0x7eff201ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:52.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.901+0000 7eff1ed9d640 1 --2- 172.21.15.19:0/226162828 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff200a3e90 0x7eff201ceb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:52.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.901+0000 7eff1ed9d640 1 -- 172.21.15.19:0/226162828 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff08009400 con 0x7eff20137650 2023-11-04T15:27:52.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.901+0000 7eff1ed9d640 1 --2- 172.21.15.19:0/226162828 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff20137650 0x7eff201cf610 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7eff1800c480 tx=0x7eff1800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:52.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.902+0000 7eff16ffd640 1 -- 172.21.15.19:0/226162828 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff180074e0 con 0x7eff20137650 2023-11-04T15:27:52.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.902+0000 7eff16ffd640 1 -- 172.21.15.19:0/226162828 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff18007660 con 0x7eff20137650 2023-11-04T15:27:52.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.902+0000 7eff2497e640 1 -- 172.21.15.19:0/226162828 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff20137b50 con 0x7eff20137650 2023-11-04T15:27:52.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.902+0000 7eff16ffd640 1 -- 172.21.15.19:0/226162828 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff18004a20 con 0x7eff20137650 2023-11-04T15:27:52.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.902+0000 7eff2497e640 1 -- 172.21.15.19:0/226162828 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff200a2910 con 0x7eff20137650 2023-11-04T15:27:52.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.903+0000 7eff2497e640 1 -- 172.21.15.19:0/226162828 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff2009bca0 con 0x7eff20137650 2023-11-04T15:27:52.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.903+0000 7eff16ffd640 1 -- 172.21.15.19:0/226162828 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7eff18004b80 con 0x7eff20137650 2023-11-04T15:27:52.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.903+0000 7eff16ffd640 1 --2- 172.21.15.19:0/226162828 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7eff0006a430 0x7eff0006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:52.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.903+0000 7eff16ffd640 1 -- 172.21.15.19:0/226162828 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7eff18087510 con 0x7eff20137650 2023-11-04T15:27:52.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.903+0000 7eff1e59c640 1 --2- 172.21.15.19:0/226162828 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7eff0006a430 0x7eff0006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:52.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.904+0000 7eff1e59c640 1 --2- 172.21.15.19:0/226162828 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7eff0006a430 0x7eff0006c8f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7eff100074a0 tx=0x7eff1000b040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:52.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:52.908+0000 7eff16ffd640 1 -- 172.21.15.19:0/226162828 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7eff180531b0 con 0x7eff20137650 2023-11-04T15:27:53.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.119+0000 7eff2497e640 1 -- 172.21.15.19:0/226162828 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff20067d60 con 0x7eff20137650 2023-11-04T15:27:53.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.120+0000 7eff16ffd640 1 -- 172.21.15.19:0/226162828 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3130 (secure 0 0 0) 0x7eff18018090 con 0x7eff20137650 2023-11-04T15:27:53.121 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:27:53.122 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4219,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6819/3642584554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3642584554},{"type":"v1","addr":"172.21.15.96:6819","nonce":3642584554}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T15:27:36.125743+0000","modified":"2023-11-04T15:27:38.140154+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6817/2992197248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2992197248},{"type":"v1","addr":"172.21.15.19:6817","nonce":2992197248}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T15:27:53.122 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 6 2023-11-04T15:27:53.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.122+0000 7eff2497e640 1 -- 172.21.15.19:0/226162828 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7eff0006a430 msgr2=0x7eff0006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:53.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.122+0000 7eff2497e640 1 --2- 172.21.15.19:0/226162828 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7eff0006a430 0x7eff0006c8f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7eff100074a0 tx=0x7eff1000b040 comp rx=0 tx=0).stop 2023-11-04T15:27:53.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.122+0000 7eff2497e640 1 -- 172.21.15.19:0/226162828 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff20137650 msgr2=0x7eff201cf610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:53.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.122+0000 7eff2497e640 1 --2- 172.21.15.19:0/226162828 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff20137650 0x7eff201cf610 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7eff1800c480 tx=0x7eff1800c940 comp rx=0 tx=0).stop 2023-11-04T15:27:53.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.122+0000 7eff2497e640 1 -- 172.21.15.19:0/226162828 shutdown_connections 2023-11-04T15:27:53.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.122+0000 7eff2497e640 1 --2- 172.21.15.19:0/226162828 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7eff0006a430 0x7eff0006c8f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:53.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.122+0000 7eff2497e640 1 --2- 172.21.15.19:0/226162828 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff20137650 0x7eff201cf610 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:53.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.122+0000 7eff2497e640 1 --2- 172.21.15.19:0/226162828 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7eff20137270 0x7eff201cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:53.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.122+0000 7eff2497e640 1 --2- 172.21.15.19:0/226162828 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff200a3e90 0x7eff201ceb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:53.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.122+0000 7eff2497e640 1 -- 172.21.15.19:0/226162828 >> 172.21.15.19:0/226162828 conn(0x7eff200a8d70 msgr2=0x7eff201c2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:53.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.122+0000 7eff2497e640 1 -- 172.21.15.19:0/226162828 shutdown_connections 2023-11-04T15:27:53.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.122+0000 7eff2497e640 1 -- 172.21.15.19:0/226162828 wait complete. 2023-11-04T15:27:53.133 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T15:27:53.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.238+0000 7f79cc6af640 1 Processor -- start 2023-11-04T15:27:53.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.238+0000 7f79cc6af640 1 -- start start 2023-11-04T15:27:53.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.239+0000 7f79cc6af640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f79c40a3e90 0x7f79c40a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:53.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.239+0000 7f79cc6af640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c40a4c20 con 0x7f79c4137270 2023-11-04T15:27:53.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.239+0000 7f79cc6af640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c413ad80 con 0x7f79c4137650 2023-11-04T15:27:53.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.239+0000 7f79cc6af640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c40a3060 con 0x7f79c40a3e90 2023-11-04T15:27:53.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.239+0000 7f79ca44b640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f79c4137270 0x7f79c4139f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41562/0 (socket says 172.21.15.19:41562) 2023-11-04T15:27:53.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.239+0000 7f79ca44b640 1 -- 172.21.15.19:0/2901191094 learned_addr learned my addr 172.21.15.19:0/2901191094 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:27:53.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.239+0000 7f79c9c4a640 1 --2- 172.21.15.19:0/2901191094 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f79c40a3e90 0x7f79c40a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:53.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.239+0000 7f79c9449640 1 -- 172.21.15.19:0/2901191094 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 908374635 0 0) 0x7f79c40a4c20 con 0x7f79c4137270 2023-11-04T15:27:53.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.239+0000 7f79c9449640 1 -- 172.21.15.19:0/2901191094 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79ac003520 con 0x7f79c4137270 2023-11-04T15:27:53.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.239+0000 7f79c9449640 1 -- 172.21.15.19:0/2901191094 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 94775264 0 0) 0x7f79c413ad80 con 0x7f79c4137650 2023-11-04T15:27:53.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.239+0000 7f79c9449640 1 -- 172.21.15.19:0/2901191094 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79c40a4c20 con 0x7f79c4137650 2023-11-04T15:27:53.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.239+0000 7f79c9449640 1 -- 172.21.15.19:0/2901191094 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3076469814 0 0) 0x7f79ac003520 con 0x7f79c4137270 2023-11-04T15:27:53.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.239+0000 7f79c9c4a640 1 -- 172.21.15.19:0/2901191094 >> v1:172.21.15.96:6789/0 conn(0x7f79c4137650 legacy=0x7f79c413a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:53.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.239+0000 7f79c9c4a640 1 -- 172.21.15.19:0/2901191094 >> v1:172.21.15.19:6789/0 conn(0x7f79c4137270 legacy=0x7f79c4139f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:53.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.239+0000 7f79c9c4a640 1 -- 172.21.15.19:0/2901191094 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c40a5080 con 0x7f79c40a3e90 2023-11-04T15:27:53.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.240+0000 7f79c9c4a640 1 --2- 172.21.15.19:0/2901191094 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f79c40a3e90 0x7f79c40a6200 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f79b80097d0 tx=0x7f79b802b6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=417389628ab467b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:53.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.240+0000 7f79c9449640 1 -- 172.21.15.19:0/2901191094 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc001670 con 0x7f79c40a3e90 2023-11-04T15:27:53.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.240+0000 7f79c9449640 1 -- 172.21.15.19:0/2901191094 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b802e050 con 0x7f79c40a3e90 2023-11-04T15:27:53.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.240+0000 7f79c9449640 1 -- 172.21.15.19:0/2901191094 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b8030730 con 0x7f79c40a3e90 2023-11-04T15:27:53.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.241+0000 7f79cc6af640 1 -- 172.21.15.19:0/2901191094 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f79c40a3e90 msgr2=0x7f79c40a6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:53.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.241+0000 7f79cc6af640 1 --2- 172.21.15.19:0/2901191094 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f79c40a3e90 0x7f79c40a6200 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f79b80097d0 tx=0x7f79b802b6e0 comp rx=0 tx=0).stop 2023-11-04T15:27:53.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.241+0000 7f79cc6af640 1 -- 172.21.15.19:0/2901191094 shutdown_connections 2023-11-04T15:27:53.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.241+0000 7f79cc6af640 1 --2- 172.21.15.19:0/2901191094 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f79c40a3e90 0x7f79c40a6200 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:53.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.241+0000 7f79cc6af640 1 -- 172.21.15.19:0/2901191094 >> 172.21.15.19:0/2901191094 conn(0x7f79c40a8d70 msgr2=0x7f79c40a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:53.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.241+0000 7f79cc6af640 1 -- 172.21.15.19:0/2901191094 shutdown_connections 2023-11-04T15:27:53.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.241+0000 7f79cc6af640 1 -- 172.21.15.19:0/2901191094 wait complete. 2023-11-04T15:27:53.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.242+0000 7f79cc6af640 1 Processor -- start 2023-11-04T15:27:53.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.242+0000 7f79cc6af640 1 -- start start 2023-11-04T15:27:53.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.242+0000 7f79cc6af640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79c40a3e90 0x7f79c4133a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:53.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.242+0000 7f79cc6af640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f79c4137270 0x7f79c4133f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:53.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.242+0000 7f79cc6af640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79c4137650 0x7f79c41344b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:53.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.242+0000 7f79cc6af640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c409f750 con 0x7f79c4137650 2023-11-04T15:27:53.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.242+0000 7f79cc6af640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c409e270 con 0x7f79c40a3e90 2023-11-04T15:27:53.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.242+0000 7f79cc6af640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c409d990 con 0x7f79c4137270 2023-11-04T15:27:53.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.242+0000 7f79cac4c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79c4137650 0x7f79c41344b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:53.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.242+0000 7f79cac4c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79c4137650 0x7f79c41344b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54688/0 (socket says 172.21.15.19:54688) 2023-11-04T15:27:53.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.242+0000 7f79cac4c640 1 -- 172.21.15.19:0/1712830817 learned_addr learned my addr 172.21.15.19:0/1712830817 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:53.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.243+0000 7f79c9c4a640 1 --2- 172.21.15.19:0/1712830817 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f79c4137270 0x7f79c4133f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:53.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.243+0000 7f79ca44b640 1 --2- 172.21.15.19:0/1712830817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79c40a3e90 0x7f79c4133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:53.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.243+0000 7f79cac4c640 1 -- 172.21.15.19:0/1712830817 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f79c4137270 msgr2=0x7f79c4133f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:53.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.243+0000 7f79cac4c640 1 --2- 172.21.15.19:0/1712830817 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f79c4137270 0x7f79c4133f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:53.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.243+0000 7f79cac4c640 1 -- 172.21.15.19:0/1712830817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79c40a3e90 msgr2=0x7f79c4133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:53.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.243+0000 7f79cac4c640 1 --2- 172.21.15.19:0/1712830817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79c40a3e90 0x7f79c4133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:53.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.243+0000 7f79cac4c640 1 -- 172.21.15.19:0/1712830817 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b8009400 con 0x7f79c4137650 2023-11-04T15:27:53.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.243+0000 7f79cac4c640 1 --2- 172.21.15.19:0/1712830817 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79c4137650 0x7f79c41344b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f79b400c7c0 tx=0x7f79b400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:53.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.243+0000 7f79c2ffd640 1 -- 172.21.15.19:0/1712830817 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b4003b70 con 0x7f79c4137650 2023-11-04T15:27:53.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.243+0000 7f79c2ffd640 1 -- 172.21.15.19:0/1712830817 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b4003cd0 con 0x7f79c4137650 2023-11-04T15:27:53.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.243+0000 7f79cc6af640 1 -- 172.21.15.19:0/1712830817 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c409ec10 con 0x7f79c4137650 2023-11-04T15:27:53.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.243+0000 7f79c2ffd640 1 -- 172.21.15.19:0/1712830817 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b400aa50 con 0x7f79c4137650 2023-11-04T15:27:53.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.243+0000 7f79cc6af640 1 -- 172.21.15.19:0/1712830817 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c409f9a0 con 0x7f79c4137650 2023-11-04T15:27:53.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.244+0000 7f79cc6af640 1 -- 172.21.15.19:0/1712830817 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c4067d60 con 0x7f79c4137650 2023-11-04T15:27:53.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.244+0000 7f79c2ffd640 1 -- 172.21.15.19:0/1712830817 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f79b400abb0 con 0x7f79c4137650 2023-11-04T15:27:53.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.245+0000 7f79c2ffd640 1 --2- 172.21.15.19:0/1712830817 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f79b006a430 0x7f79b006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:53.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.245+0000 7f79c2ffd640 1 -- 172.21.15.19:0/1712830817 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f79b4088200 con 0x7f79c4137650 2023-11-04T15:27:53.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.245+0000 7f79ca44b640 1 --2- 172.21.15.19:0/1712830817 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f79b006a430 0x7f79b006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:53.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.245+0000 7f79ca44b640 1 --2- 172.21.15.19:0/1712830817 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f79b006a430 0x7f79b006c8f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f79bc000f60 tx=0x7f79bc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:53.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.249+0000 7f79c2ffd640 1 -- 172.21.15.19:0/1712830817 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f79b4053de0 con 0x7f79c4137650 2023-11-04T15:27:53.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.426+0000 7f79cc6af640 1 -- 172.21.15.19:0/1712830817 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79c40a3af0 con 0x7f79c4137650 2023-11-04T15:27:53.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.427+0000 7f79c2ffd640 1 -- 172.21.15.19:0/1712830817 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+13180 (secure 0 0 0) 0x7f79b4080e60 con 0x7f79c4137650 2023-11-04T15:27:53.429 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:27:53.429 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":19,"fsid":"e87311d5-496a-4b07-9654-358fe5bbf950","created":"2023-11-04T15:27:14.865121+0000","modified":"2023-11-04T15:27:37.127226+0000","last_up_change":"2023-11-04T15:27:24.162282+0000","last_in_change":"2023-11-04T15:27:15.971035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T15:27:24.987312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-04T15:27:30.500235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-04T15:27:34.476271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-04T15:27:35.096759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"34818469-ebf2-4dd4-8119-af19a0121036","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":82879},{"type":"v1","addr":"172.21.15.19:6801","nonce":82879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":82879},{"type":"v1","addr":"172.21.15.19:6803","nonce":82879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":82879},{"type":"v1","addr":"172.21.15.19:6807","nonce":82879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":82879},{"type":"v1","addr":"172.21.15.19:6805","nonce":82879}]},"public_addr":"172.21.15.19:6801/82879","cluster_addr":"172.21.15.19:6803/82879","heartbeat_back_addr":"172.21.15.19:6807/82879","heartbeat_front_addr":"172.21.15.19:6805/82879","state":["exists","up"]},{"osd":1,"uuid":"92dab290-7912-4eea-b6f6-c754c2480721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":82880},{"type":"v1","addr":"172.21.15.19:6809","nonce":82880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":82880},{"type":"v1","addr":"172.21.15.19:6811","nonce":82880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":82880},{"type":"v1","addr":"172.21.15.19:6815","nonce":82880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":82880},{"type":"v1","addr":"172.21.15.19:6813","nonce":82880}]},"public_addr":"172.21.15.19:6809/82880","cluster_addr":"172.21.15.19:6811/82880","heartbeat_back_addr":"172.21.15.19:6815/82880","heartbeat_front_addr":"172.21.15.19:6813/82880","state":["exists","up"]},{"osd":2,"uuid":"1be47db4-6dd1-4ce5-832b-bc6ad30c78c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":83458},{"type":"v1","addr":"172.21.15.96:6808","nonce":83458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":83458},{"type":"v1","addr":"172.21.15.96:6811","nonce":83458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":83458},{"type":"v1","addr":"172.21.15.96:6815","nonce":83458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":83458},{"type":"v1","addr":"172.21.15.96:6813","nonce":83458}]},"public_addr":"172.21.15.96:6808/83458","cluster_addr":"172.21.15.96:6811/83458","heartbeat_back_addr":"172.21.15.96:6815/83458","heartbeat_front_addr":"172.21.15.96:6813/83458","state":["exists","up"]},{"osd":3,"uuid":"46505800-d64f-49ef-b811-5b5979f48252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":83459},{"type":"v1","addr":"172.21.15.96:6801","nonce":83459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":83459},{"type":"v1","addr":"172.21.15.96:6803","nonce":83459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6807","nonce":83459},{"type":"v1","addr":"172.21.15.96:6809","nonce":83459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":83459},{"type":"v1","addr":"172.21.15.96:6805","nonce":83459}]},"public_addr":"172.21.15.96:6801/83459","cluster_addr":"172.21.15.96:6803/83459","heartbeat_back_addr":"172.21.15.96:6809/83459","heartbeat_front_addr":"172.21.15.96:6805/83459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.081547+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.132075+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.094919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.074106+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T15:27:53.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.429+0000 7f79cc6af640 1 -- 172.21.15.19:0/1712830817 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f79b006a430 msgr2=0x7f79b006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:53.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.429+0000 7f79cc6af640 1 --2- 172.21.15.19:0/1712830817 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f79b006a430 0x7f79b006c8f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f79bc000f60 tx=0x7f79bc009040 comp rx=0 tx=0).stop 2023-11-04T15:27:53.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.429+0000 7f79cc6af640 1 -- 172.21.15.19:0/1712830817 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79c4137650 msgr2=0x7f79c41344b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:53.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.429+0000 7f79cc6af640 1 --2- 172.21.15.19:0/1712830817 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79c4137650 0x7f79c41344b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f79b400c7c0 tx=0x7f79b400cc80 comp rx=0 tx=0).stop 2023-11-04T15:27:53.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.429+0000 7f79cc6af640 1 -- 172.21.15.19:0/1712830817 shutdown_connections 2023-11-04T15:27:53.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.429+0000 7f79cc6af640 1 --2- 172.21.15.19:0/1712830817 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f79b006a430 0x7f79b006c8f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:53.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.429+0000 7f79cc6af640 1 --2- 172.21.15.19:0/1712830817 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79c4137650 0x7f79c41344b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:53.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.429+0000 7f79cc6af640 1 --2- 172.21.15.19:0/1712830817 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f79c4137270 0x7f79c4133f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:53.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.429+0000 7f79cc6af640 1 --2- 172.21.15.19:0/1712830817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79c40a3e90 0x7f79c4133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:53.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.429+0000 7f79cc6af640 1 -- 172.21.15.19:0/1712830817 >> 172.21.15.19:0/1712830817 conn(0x7f79c40a8d70 msgr2=0x7f79c4139d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:53.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.429+0000 7f79cc6af640 1 -- 172.21.15.19:0/1712830817 shutdown_connections 2023-11-04T15:27:53.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.429+0000 7f79cc6af640 1 -- 172.21.15.19:0/1712830817 wait complete. 2023-11-04T15:27:53.441 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T15:27:53.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.545+0000 7fab90cb9640 1 Processor -- start 2023-11-04T15:27:53.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.545+0000 7fab90cb9640 1 -- start start 2023-11-04T15:27:53.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.546+0000 7fab90cb9640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fab8c131de0 0x7fab8c0a4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:53.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.546+0000 7fab90cb9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fab8c1321c0 0x7fab8c069c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:53.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.546+0000 7fab90cb9640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fab8c06a1b0 0x7fab8c06a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:53.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.546+0000 7fab90cb9640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab8c0a2700 con 0x7fab8c1321c0 2023-11-04T15:27:53.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.546+0000 7fab90cb9640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab8c09fec0 con 0x7fab8c131de0 2023-11-04T15:27:53.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.546+0000 7fab90cb9640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c132620 con 0x7fab8c06a1b0 2023-11-04T15:27:53.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.546+0000 7fab83fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fab8c1321c0 0x7fab8c069c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:53.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.546+0000 7fab83fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fab8c1321c0 0x7fab8c069c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54690/0 (socket says 172.21.15.19:54690) 2023-11-04T15:27:53.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.546+0000 7fab83fff640 1 -- 172.21.15.19:0/3742783815 learned_addr learned my addr 172.21.15.19:0/3742783815 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:53.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.546+0000 7fab8ad9d640 1 --2- 172.21.15.19:0/3742783815 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fab8c06a1b0 0x7fab8c06a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:53.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.546+0000 7fab8a59c640 1 --2- 172.21.15.19:0/3742783815 >> v2:172.21.15.96:3300/0 conn(0x7fab8c131de0 0x7fab8c0a4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:53.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.546+0000 7fab83fff640 1 -- 172.21.15.19:0/3742783815 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fab8c06a1b0 msgr2=0x7fab8c06a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:53.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.546+0000 7fab83fff640 1 --2- 172.21.15.19:0/3742783815 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fab8c06a1b0 0x7fab8c06a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:53.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.546+0000 7fab83fff640 1 -- 172.21.15.19:0/3742783815 >> v2:172.21.15.96:3300/0 conn(0x7fab8c131de0 msgr2=0x7fab8c0a4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:53.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.546+0000 7fab83fff640 1 --2- 172.21.15.19:0/3742783815 >> v2:172.21.15.96:3300/0 conn(0x7fab8c131de0 0x7fab8c0a4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:53.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.546+0000 7fab83fff640 1 -- 172.21.15.19:0/3742783815 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8c0a2bb0 con 0x7fab8c1321c0 2023-11-04T15:27:53.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.546+0000 7fab8a59c640 1 --2- 172.21.15.19:0/3742783815 >> v2:172.21.15.96:3300/0 conn(0x7fab8c131de0 0x7fab8c0a4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:27:53.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.547+0000 7fab83fff640 1 --2- 172.21.15.19:0/3742783815 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab8c1321c0 0x7fab8c069c70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fab8c0a2d40 tx=0x7fab7402b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf0474271ef65e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:53.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.547+0000 7fab89d9b640 1 -- 172.21.15.19:0/3742783815 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab74031750 con 0x7fab8c1321c0 2023-11-04T15:27:53.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.547+0000 7fab89d9b640 1 -- 172.21.15.19:0/3742783815 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab740318b0 con 0x7fab8c1321c0 2023-11-04T15:27:53.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.547+0000 7fab89d9b640 1 -- 172.21.15.19:0/3742783815 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab74031c40 con 0x7fab8c1321c0 2023-11-04T15:27:53.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.548+0000 7fab90cb9640 1 -- 172.21.15.19:0/3742783815 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab8c1321c0 msgr2=0x7fab8c069c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:53.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.548+0000 7fab90cb9640 1 --2- 172.21.15.19:0/3742783815 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab8c1321c0 0x7fab8c069c70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fab8c0a2d40 tx=0x7fab7402b7f0 comp rx=0 tx=0).stop 2023-11-04T15:27:53.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.548+0000 7fab90cb9640 1 -- 172.21.15.19:0/3742783815 shutdown_connections 2023-11-04T15:27:53.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.548+0000 7fab90cb9640 1 --2- 172.21.15.19:0/3742783815 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fab8c06a1b0 0x7fab8c06a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:53.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.548+0000 7fab90cb9640 1 --2- 172.21.15.19:0/3742783815 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab8c1321c0 0x7fab8c069c70 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:53.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.548+0000 7fab90cb9640 1 --2- 172.21.15.19:0/3742783815 >> v2:172.21.15.96:3300/0 conn(0x7fab8c131de0 0x7fab8c0a4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:53.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.548+0000 7fab90cb9640 1 -- 172.21.15.19:0/3742783815 >> 172.21.15.19:0/3742783815 conn(0x7fab8c0a8ff0 msgr2=0x7fab8c0a9400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:53.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.548+0000 7fab90cb9640 1 -- 172.21.15.19:0/3742783815 shutdown_connections 2023-11-04T15:27:53.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.548+0000 7fab90cb9640 1 -- 172.21.15.19:0/3742783815 wait complete. 2023-11-04T15:27:53.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.549+0000 7fab90cb9640 1 Processor -- start 2023-11-04T15:27:53.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.549+0000 7fab90cb9640 1 -- start start 2023-11-04T15:27:53.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.549+0000 7fab90cb9640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab8c06a1b0 0x7fab8c1cf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:53.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.549+0000 7fab90cb9640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fab8c131de0 0x7fab8c1cf710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:53.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.549+0000 7fab90cb9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab8c1321c0 0x7fab8c0a04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:53.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.549+0000 7fab90cb9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c09c030 con 0x7fab8c1321c0 2023-11-04T15:27:53.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.549+0000 7fab90cb9640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c09d300 con 0x7fab8c06a1b0 2023-11-04T15:27:53.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.549+0000 7fab90cb9640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c1cfc50 con 0x7fab8c131de0 2023-11-04T15:27:53.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.550+0000 7fab8ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab8c1321c0 0x7fab8c0a04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:53.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.550+0000 7fab8ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab8c1321c0 0x7fab8c0a04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54702/0 (socket says 172.21.15.19:54702) 2023-11-04T15:27:53.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.550+0000 7fab8ad9d640 1 -- 172.21.15.19:0/2470021482 learned_addr learned my addr 172.21.15.19:0/2470021482 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:53.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.550+0000 7fab8a59c640 1 --2- 172.21.15.19:0/2470021482 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab8c06a1b0 0x7fab8c1cf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:53.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.550+0000 7fab83fff640 1 --2- 172.21.15.19:0/2470021482 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fab8c131de0 0x7fab8c1cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:53.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.550+0000 7fab8ad9d640 1 -- 172.21.15.19:0/2470021482 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fab8c131de0 msgr2=0x7fab8c1cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:53.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.550+0000 7fab8ad9d640 1 --2- 172.21.15.19:0/2470021482 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fab8c131de0 0x7fab8c1cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:53.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.550+0000 7fab8ad9d640 1 -- 172.21.15.19:0/2470021482 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab8c06a1b0 msgr2=0x7fab8c1cf1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:53.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.550+0000 7fab8ad9d640 1 --2- 172.21.15.19:0/2470021482 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab8c06a1b0 0x7fab8c1cf1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:53.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.550+0000 7fab8ad9d640 1 -- 172.21.15.19:0/2470021482 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab740094d0 con 0x7fab8c1321c0 2023-11-04T15:27:53.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.550+0000 7fab8ad9d640 1 --2- 172.21.15.19:0/2470021482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab8c1321c0 0x7fab8c0a04f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fab84009dd0 tx=0x7fab8400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:53.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.550+0000 7fab82ffd640 1 -- 172.21.15.19:0/2470021482 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab84014480 con 0x7fab8c1321c0 2023-11-04T15:27:53.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.550+0000 7fab82ffd640 1 -- 172.21.15.19:0/2470021482 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8400f040 con 0x7fab8c1321c0 2023-11-04T15:27:53.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.550+0000 7fab90cb9640 1 -- 172.21.15.19:0/2470021482 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab8c0a4690 con 0x7fab8c1321c0 2023-11-04T15:27:53.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.550+0000 7fab82ffd640 1 -- 172.21.15.19:0/2470021482 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab84014840 con 0x7fab8c1321c0 2023-11-04T15:27:53.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.550+0000 7fab90cb9640 1 -- 172.21.15.19:0/2470021482 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab8c135a50 con 0x7fab8c1321c0 2023-11-04T15:27:53.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.551+0000 7fab90cb9640 1 -- 172.21.15.19:0/2470021482 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab8c06f3f0 con 0x7fab8c1321c0 2023-11-04T15:27:53.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.552+0000 7fab82ffd640 1 -- 172.21.15.19:0/2470021482 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fab840149a0 con 0x7fab8c1321c0 2023-11-04T15:27:53.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.552+0000 7fab82ffd640 1 --2- 172.21.15.19:0/2470021482 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fab6c06a430 0x7fab6c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:53.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.552+0000 7fab82ffd640 1 -- 172.21.15.19:0/2470021482 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7fab84088f10 con 0x7fab8c1321c0 2023-11-04T15:27:53.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.552+0000 7fab8a59c640 1 --2- 172.21.15.19:0/2470021482 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fab6c06a430 0x7fab6c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:53.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.553+0000 7fab8a59c640 1 --2- 172.21.15.19:0/2470021482 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fab6c06a430 0x7fab6c06c8f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fab7c006fd0 tx=0x7fab7c008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:53.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.556+0000 7fab82ffd640 1 -- 172.21.15.19:0/2470021482 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fab84054af0 con 0x7fab8c1321c0 2023-11-04T15:27:53.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.769+0000 7fab90cb9640 1 -- 172.21.15.19:0/2470021482 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab8c067d60 con 0x7fab8c1321c0 2023-11-04T15:27:53.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.770+0000 7fab82ffd640 1 -- 172.21.15.19:0/2470021482 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3130 (secure 0 0 0) 0x7fab84018090 con 0x7fab8c1321c0 2023-11-04T15:27:53.771 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:27:53.772 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4219,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6819/3642584554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3642584554},{"type":"v1","addr":"172.21.15.96:6819","nonce":3642584554}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T15:27:36.125743+0000","modified":"2023-11-04T15:27:38.140154+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6817/2992197248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2992197248},{"type":"v1","addr":"172.21.15.19:6817","nonce":2992197248}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T15:27:53.772 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 6 2023-11-04T15:27:53.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.772+0000 7fab90cb9640 1 -- 172.21.15.19:0/2470021482 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fab6c06a430 msgr2=0x7fab6c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:53.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.772+0000 7fab90cb9640 1 --2- 172.21.15.19:0/2470021482 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fab6c06a430 0x7fab6c06c8f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fab7c006fd0 tx=0x7fab7c008040 comp rx=0 tx=0).stop 2023-11-04T15:27:53.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.772+0000 7fab90cb9640 1 -- 172.21.15.19:0/2470021482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab8c1321c0 msgr2=0x7fab8c0a04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:53.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.772+0000 7fab90cb9640 1 --2- 172.21.15.19:0/2470021482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab8c1321c0 0x7fab8c0a04f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fab84009dd0 tx=0x7fab8400c490 comp rx=0 tx=0).stop 2023-11-04T15:27:53.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.772+0000 7fab90cb9640 1 -- 172.21.15.19:0/2470021482 shutdown_connections 2023-11-04T15:27:53.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.772+0000 7fab90cb9640 1 --2- 172.21.15.19:0/2470021482 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fab6c06a430 0x7fab6c06c8f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:53.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.772+0000 7fab90cb9640 1 --2- 172.21.15.19:0/2470021482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab8c1321c0 0x7fab8c0a04f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:53.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.772+0000 7fab90cb9640 1 --2- 172.21.15.19:0/2470021482 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fab8c131de0 0x7fab8c1cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:53.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.772+0000 7fab90cb9640 1 --2- 172.21.15.19:0/2470021482 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab8c06a1b0 0x7fab8c1cf1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:53.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.772+0000 7fab90cb9640 1 -- 172.21.15.19:0/2470021482 >> 172.21.15.19:0/2470021482 conn(0x7fab8c0a8ff0 msgr2=0x7fab8c12f840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:53.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.772+0000 7fab90cb9640 1 -- 172.21.15.19:0/2470021482 shutdown_connections 2023-11-04T15:27:53.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:53.772+0000 7fab90cb9640 1 -- 172.21.15.19:0/2470021482 wait complete. 2023-11-04T15:27:53.985 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T15:27:36.125743+0000', 'modified': '2023-11-04T15:27:38.140154+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4254}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4254': {'gid': 4254, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.19:6817/2992197248', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6816', 'nonce': 2992197248}, {'type': 'v1', 'addr': '172.21.15.19:6817', 'nonce': 2992197248}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T15:27:53.985 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T15:27:53.986 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-04T15:27:54.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.092+0000 7fca09a5c640 1 Processor -- start 2023-11-04T15:27:54.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.092+0000 7fca09a5c640 1 -- start start 2023-11-04T15:27:54.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.093+0000 7fca09a5c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fca04137270 0x7fca040a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:54.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.093+0000 7fca09a5c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fca040a3e90 0x7fca04139f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:54.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.093+0000 7fca09a5c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca040a4c20 con 0x7fca04137650 2023-11-04T15:27:54.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.093+0000 7fca09a5c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca040a3060 con 0x7fca040a3e90 2023-11-04T15:27:54.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.093+0000 7fca09a5c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca040a5080 con 0x7fca04137270 2023-11-04T15:27:54.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.093+0000 7fca027fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fca040a3e90 0x7fca04139f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:54.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.093+0000 7fca027fc640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fca040a3e90 0x7fca04139f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54708/0 (socket says 172.21.15.19:54708) 2023-11-04T15:27:54.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.093+0000 7fca027fc640 1 -- 172.21.15.19:0/502359501 learned_addr learned my addr 172.21.15.19:0/502359501 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:54.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.093+0000 7fca02ffd640 1 --2- 172.21.15.19:0/502359501 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fca04137270 0x7fca040a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:54.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.093+0000 7fca027fc640 1 -- 172.21.15.19:0/502359501 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fca04137270 msgr2=0x7fca040a6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:54.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.093+0000 7fca027fc640 1 --2- 172.21.15.19:0/502359501 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fca04137270 0x7fca040a6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.093+0000 7fca027fc640 1 -- 172.21.15.19:0/502359501 >> v1:172.21.15.96:6789/0 conn(0x7fca04137650 legacy=0x7fca0413a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:54.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.093+0000 7fca027fc640 1 -- 172.21.15.19:0/502359501 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca040a3440 con 0x7fca040a3e90 2023-11-04T15:27:54.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.094+0000 7fca027fc640 1 --2- 172.21.15.19:0/502359501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca040a3e90 0x7fca04139f60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8009870 tx=0x7fc9f802b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bedf1883560b733 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:54.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.094+0000 7fca01ffb640 1 -- 172.21.15.19:0/502359501 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f8031740 con 0x7fca040a3e90 2023-11-04T15:27:54.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.094+0000 7fca01ffb640 1 -- 172.21.15.19:0/502359501 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f80318a0 con 0x7fca040a3e90 2023-11-04T15:27:54.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.094+0000 7fca01ffb640 1 -- 172.21.15.19:0/502359501 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f8031c30 con 0x7fca040a3e90 2023-11-04T15:27:54.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.095+0000 7fca09a5c640 1 -- 172.21.15.19:0/502359501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca040a3e90 msgr2=0x7fca04139f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:54.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.095+0000 7fca09a5c640 1 --2- 172.21.15.19:0/502359501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca040a3e90 0x7fca04139f60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8009870 tx=0x7fc9f802b7e0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.095+0000 7fca09a5c640 1 -- 172.21.15.19:0/502359501 shutdown_connections 2023-11-04T15:27:54.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.095+0000 7fca09a5c640 1 --2- 172.21.15.19:0/502359501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca040a3e90 0x7fca04139f60 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.095+0000 7fca09a5c640 1 --2- 172.21.15.19:0/502359501 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fca04137270 0x7fca040a6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.095+0000 7fca09a5c640 1 -- 172.21.15.19:0/502359501 >> 172.21.15.19:0/502359501 conn(0x7fca040a8d70 msgr2=0x7fca040a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:54.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.095+0000 7fca09a5c640 1 -- 172.21.15.19:0/502359501 shutdown_connections 2023-11-04T15:27:54.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.095+0000 7fca09a5c640 1 -- 172.21.15.19:0/502359501 wait complete. 2023-11-04T15:27:54.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.096+0000 7fca09a5c640 1 Processor -- start 2023-11-04T15:27:54.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.096+0000 7fca09a5c640 1 -- start start 2023-11-04T15:27:54.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.096+0000 7fca09a5c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fca040a3e90 0x7fca041cc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:54.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.096+0000 7fca09a5c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca04137270 0x7fca041cc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:54.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.096+0000 7fca09a5c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca04137650 0x7fca041cf490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:54.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.096+0000 7fca09a5c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0409c9d0 con 0x7fca04137270 2023-11-04T15:27:54.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.096+0000 7fca09a5c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca041ccec0 con 0x7fca04137650 2023-11-04T15:27:54.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.096+0000 7fca09a5c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca041cc030 con 0x7fca040a3e90 2023-11-04T15:27:54.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.097+0000 7fca027fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca04137270 0x7fca041cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:54.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.097+0000 7fca027fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca04137270 0x7fca041cc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54722/0 (socket says 172.21.15.19:54722) 2023-11-04T15:27:54.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.097+0000 7fca027fc640 1 -- 172.21.15.19:0/2216990418 learned_addr learned my addr 172.21.15.19:0/2216990418 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:54.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.097+0000 7fca02ffd640 1 --2- 172.21.15.19:0/2216990418 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fca040a3e90 0x7fca041cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:54.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.097+0000 7fca037fe640 1 --2- 172.21.15.19:0/2216990418 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca04137650 0x7fca041cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:54.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.097+0000 7fca027fc640 1 -- 172.21.15.19:0/2216990418 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fca040a3e90 msgr2=0x7fca041cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:54.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.097+0000 7fca027fc640 1 --2- 172.21.15.19:0/2216990418 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fca040a3e90 0x7fca041cc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.097+0000 7fca027fc640 1 -- 172.21.15.19:0/2216990418 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca04137650 msgr2=0x7fca041cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:54.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.097+0000 7fca027fc640 1 --2- 172.21.15.19:0/2216990418 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca04137650 0x7fca041cf490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.097+0000 7fca027fc640 1 -- 172.21.15.19:0/2216990418 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f80094d0 con 0x7fca04137270 2023-11-04T15:27:54.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.097+0000 7fca027fc640 1 --2- 172.21.15.19:0/2216990418 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca04137270 0x7fca041cc980 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8009870 tx=0x7fc9f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:54.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.097+0000 7fc9ebfff640 1 -- 172.21.15.19:0/2216990418 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f8033c70 con 0x7fca04137270 2023-11-04T15:27:54.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.097+0000 7fc9ebfff640 1 -- 172.21.15.19:0/2216990418 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f8033dd0 con 0x7fca04137270 2023-11-04T15:27:54.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.097+0000 7fca09a5c640 1 -- 172.21.15.19:0/2216990418 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca0409e040 con 0x7fca04137270 2023-11-04T15:27:54.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.097+0000 7fc9ebfff640 1 -- 172.21.15.19:0/2216990418 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f803c640 con 0x7fca04137270 2023-11-04T15:27:54.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.097+0000 7fca09a5c640 1 -- 172.21.15.19:0/2216990418 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca0409cbc0 con 0x7fca04137270 2023-11-04T15:27:54.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.099+0000 7fc9ebfff640 1 -- 172.21.15.19:0/2216990418 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc9f803a040 con 0x7fca04137270 2023-11-04T15:27:54.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.099+0000 7fc9ebfff640 1 --2- 172.21.15.19:0/2216990418 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc9f006a430 0x7fc9f006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:54.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.099+0000 7fc9ebfff640 1 -- 172.21.15.19:0/2216990418 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7fc9f80a9dd0 con 0x7fca04137270 2023-11-04T15:27:54.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.099+0000 7fca02ffd640 1 --2- 172.21.15.19:0/2216990418 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc9f006a430 0x7fc9f006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:54.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.100+0000 7fca02ffd640 1 --2- 172.21.15.19:0/2216990418 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc9f006a430 0x7fc9f006c8f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4003b80 tx=0x7fc9f40098d0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:54.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.100+0000 7fca0c5c8740 1 Processor -- start 2023-11-04T15:27:54.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.100+0000 7fca0c5c8740 1 -- start start 2023-11-04T15:27:54.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.101+0000 7fca0c5c8740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x558588e84840 0x558588e7fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:54.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.101+0000 7fca0c5c8740 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x558588e9d2f0 0x558588e80240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:54.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.101+0000 7fca0c5c8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558588e80780 0x558588e9a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:54.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.101+0000 7fca0c5c8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x558588df0030 con 0x558588e80780 2023-11-04T15:27:54.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.101+0000 7fca0c5c8740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x558588ded7c0 con 0x558588e84840 2023-11-04T15:27:54.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.101+0000 7fca0c5c8740 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x558588de90b0 con 0x558588e9d2f0 2023-11-04T15:27:54.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.101+0000 7fca037fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558588e80780 0x558588e9a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:54.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.101+0000 7fca037fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558588e80780 0x558588e9a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54724/0 (socket says 172.21.15.19:54724) 2023-11-04T15:27:54.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.101+0000 7fca037fe640 1 -- 172.21.15.19:0/3446453412 learned_addr learned my addr 172.21.15.19:0/3446453412 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:54.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.101+0000 7fca027fc640 1 --2- 172.21.15.19:0/3446453412 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x558588e9d2f0 0x558588e80240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:54.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.101+0000 7fca02ffd640 1 --2- 172.21.15.19:0/3446453412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x558588e84840 0x558588e7fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:54.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.101+0000 7fca037fe640 1 -- 172.21.15.19:0/3446453412 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x558588e9d2f0 msgr2=0x558588e80240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:54.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.101+0000 7fca037fe640 1 --2- 172.21.15.19:0/3446453412 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x558588e9d2f0 0x558588e80240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.101+0000 7fca037fe640 1 -- 172.21.15.19:0/3446453412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x558588e84840 msgr2=0x558588e7fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:54.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.101+0000 7fca037fe640 1 --2- 172.21.15.19:0/3446453412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x558588e84840 0x558588e7fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.101+0000 7fca037fe640 1 -- 172.21.15.19:0/3446453412 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558588da3bc0 con 0x558588e80780 2023-11-04T15:27:54.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.101+0000 7fca037fe640 1 --2- 172.21.15.19:0/3446453412 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558588e80780 0x558588e9a120 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009900 tx=0x7fc9fc009dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c56acf64b90e3f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:54.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.101+0000 7fc9e97fa640 1 -- 172.21.15.19:0/3446453412 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc004020 con 0x558588e80780 2023-11-04T15:27:54.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.101+0000 7fc9e97fa640 1 -- 172.21.15.19:0/3446453412 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9fc004180 con 0x558588e80780 2023-11-04T15:27:54.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.101+0000 7fc9e97fa640 1 -- 172.21.15.19:0/3446453412 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc00ea20 con 0x558588e80780 2023-11-04T15:27:54.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.102+0000 7fca0c5c8740 1 -- 172.21.15.19:0/3446453412 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558588e80780 msgr2=0x558588e9a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:54.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.102+0000 7fca0c5c8740 1 --2- 172.21.15.19:0/3446453412 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558588e80780 0x558588e9a120 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009900 tx=0x7fc9fc009dc0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.102+0000 7fca0c5c8740 1 -- 172.21.15.19:0/3446453412 shutdown_connections 2023-11-04T15:27:54.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.102+0000 7fca0c5c8740 1 --2- 172.21.15.19:0/3446453412 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558588e80780 0x558588e9a120 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.102+0000 7fca0c5c8740 1 --2- 172.21.15.19:0/3446453412 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x558588e9d2f0 0x558588e80240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.102+0000 7fca0c5c8740 1 --2- 172.21.15.19:0/3446453412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x558588e84840 0x558588e7fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.102+0000 7fca0c5c8740 1 -- 172.21.15.19:0/3446453412 >> 172.21.15.19:0/3446453412 conn(0x558588e81aa0 msgr2=0x558588e82a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.102+0000 7fca0c5c8740 1 -- 172.21.15.19:0/3446453412 shutdown_connections 2023-11-04T15:27:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.102+0000 7fca0c5c8740 1 -- 172.21.15.19:0/3446453412 wait complete. 2023-11-04T15:27:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.103+0000 7fca0c5c8740 1 -- start start 2023-11-04T15:27:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.103+0000 7fca0c5c8740 1 Processor -- start 2023-11-04T15:27:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.103+0000 7fca0c5c8740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x558588e84840 0x558588e9a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.103+0000 7fca0c5c8740 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x558588e9d2f0 0x558588e9aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.103+0000 7fca0c5c8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558588ea5ac0 0x558588eb8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.103+0000 7fca0c5c8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x558588da77c0 con 0x558588ea5ac0 2023-11-04T15:27:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.103+0000 7fca0c5c8740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x558588da7460 con 0x558588e84840 2023-11-04T15:27:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.103+0000 7fca0c5c8740 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x558588d6d1b0 con 0x558588e9d2f0 2023-11-04T15:27:54.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.103+0000 7fca0c5c8740 10 client.0 _ll_register_callbacks cb 0x558588d706d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T15:27:54.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.103+0000 7fca037fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558588ea5ac0 0x558588eb8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:54.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.103+0000 7fca037fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558588ea5ac0 0x558588eb8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54734/0 (socket says 172.21.15.19:54734) 2023-11-04T15:27:54.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.103+0000 7fca037fe640 1 -- 172.21.15.19:0/3157556377 learned_addr learned my addr 172.21.15.19:0/3157556377 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:54.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.103+0000 7fca027fc640 1 --2- 172.21.15.19:0/3157556377 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x558588e9d2f0 0x558588e9aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:54.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.103+0000 7fca02ffd640 1 --2- 172.21.15.19:0/3157556377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x558588e84840 0x558588e9a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:54.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.104+0000 7fca037fe640 1 -- 172.21.15.19:0/3157556377 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x558588e9d2f0 msgr2=0x558588e9aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:54.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.104+0000 7fca037fe640 1 --2- 172.21.15.19:0/3157556377 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x558588e9d2f0 0x558588e9aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.104+0000 7fca037fe640 1 -- 172.21.15.19:0/3157556377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x558588e84840 msgr2=0x558588e9a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:54.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.104+0000 7fca037fe640 1 --2- 172.21.15.19:0/3157556377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x558588e84840 0x558588e9a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.104+0000 7fca037fe640 1 -- 172.21.15.19:0/3157556377 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9fc009530 con 0x558588ea5ac0 2023-11-04T15:27:54.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.104+0000 7fca02ffd640 1 --2- 172.21.15.19:0/3157556377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x558588e84840 0x558588e9a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T15:27:54.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.104+0000 7fca037fe640 1 --2- 172.21.15.19:0/3157556377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558588ea5ac0 0x558588eb8300 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc00ec80 tx=0x7fc9fc004680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=600515615b6a7bc6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:54.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.104+0000 7fc9e27fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2023-11-04T15:27:54.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.104+0000 7fc9e27fc640 1 -- 172.21.15.19:0/3157556377 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc021070 con 0x558588ea5ac0 2023-11-04T15:27:54.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.104+0000 7fc9e27fc640 1 -- 172.21.15.19:0/3157556377 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7fc9fc003800 con 0x558588ea5ac0 2023-11-04T15:27:54.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.104+0000 7fca0c5c8740 1 -- 172.21.15.19:0/3157556377 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558588dda9e0 con 0x558588ea5ac0 2023-11-04T15:27:54.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.104+0000 7fc9e27fc640 1 -- 172.21.15.19:0/3157556377 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9fc00ee60 con 0x558588ea5ac0 2023-11-04T15:27:54.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.104+0000 7fca0c5c8740 10 client.4644 fetch_fsmap learned FSMap version 6 2023-11-04T15:27:54.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.104+0000 7fca0c5c8740 1 -- 172.21.15.19:0/3157556377 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x558588de7730 con 0x558588ea5ac0 2023-11-04T15:27:54.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.104+0000 7fc9e27fc640 1 -- 172.21.15.19:0/3157556377 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9fc031070 con 0x558588ea5ac0 2023-11-04T15:27:54.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.104+0000 7fc9e27fc640 1 -- 172.21.15.19:0/3157556377 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 6) v1 ==== 2016+0+0 (secure 0 0 0) 0x7fc9fc011070 con 0x558588ea5ac0 2023-11-04T15:27:54.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.104+0000 7fca0c5c8740 10 client.4644 fetch_fsmap finished waiting for FSMap version 6 2023-11-04T15:27:54.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.104+0000 7fca0c5c8740 10 client.4644 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T15:27:54.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.104+0000 7fca0c5c8740 20 client.4644 populate_metadata read hostname 'smithi019' 2023-11-04T15:27:54.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.104+0000 7fca0c5c8740 1 --2- 172.21.15.19:0/3157556377 >> [v2:172.21.15.19:6816/2992197248,v1:172.21.15.19:6817/2992197248] conn(0x558588ec1e00 0x558588ec41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:54.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.104+0000 7fca0c5c8740 4 client.4644 mds_command: new command op to 4254 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-04T15:27:54.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.104+0000 7fca0c5c8740 1 -- 172.21.15.19:0/3157556377 --> [v2:172.21.15.19:6816/2992197248,v1:172.21.15.19:6817/2992197248] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558588de2130 con 0x558588ec1e00 2023-11-04T15:27:54.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.104+0000 7fca02ffd640 1 --2- 172.21.15.19:0/3157556377 >> [v2:172.21.15.19:6816/2992197248,v1:172.21.15.19:6817/2992197248] conn(0x558588ec1e00 0x558588ec41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:54.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.105+0000 7fc9e27fc640 10 client.4644 ms_handle_connect on v2:172.21.15.19:6816/2992197248 2023-11-04T15:27:54.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.105+0000 7fca02ffd640 1 --2- 172.21.15.19:0/3157556377 >> [v2:172.21.15.19:6816/2992197248,v1:172.21.15.19:6817/2992197248] conn(0x558588ec1e00 0x558588ec41f0 crc :-1 s=READY pgs=9 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=728a0ba03fdc3ba1 server_cookie=135bae28829f66b7 in_seq=0 out_seq=0 2023-11-04T15:27:54.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.105+0000 7fc9e27fc640 1 -- 172.21.15.19:0/3157556377 <== mds.0 v2:172.21.15.19:6816/2992197248 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x558588de2130 con 0x558588ec1e00 2023-11-04T15:27:54.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.105+0000 7fc9e27fc640 10 client.4644 handle_command_reply: tid=0 2023-11-04T15:27:54.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.105+0000 7fca0c5c8740 1 client.4644 shutdown 2023-11-04T15:27:54.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.105+0000 7fca0c5c8740 1 -- 172.21.15.19:0/3157556377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558588ea5ac0 msgr2=0x558588eb8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:54.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.105+0000 7fca0c5c8740 1 --2- 172.21.15.19:0/3157556377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558588ea5ac0 0x558588eb8300 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc00ec80 tx=0x7fc9fc004680 comp rx=0 tx=0).stop 2023-11-04T15:27:54.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.105+0000 7fca0c5c8740 1 -- 172.21.15.19:0/3157556377 shutdown_connections 2023-11-04T15:27:54.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.105+0000 7fca0c5c8740 1 --2- 172.21.15.19:0/3157556377 >> [v2:172.21.15.19:6816/2992197248,v1:172.21.15.19:6817/2992197248] conn(0x558588ec1e00 0x558588ec41f0 crc :-1 s=READY pgs=9 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.105+0000 7fca0c5c8740 1 --2- 172.21.15.19:0/3157556377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558588ea5ac0 0x558588eb8300 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.105+0000 7fca0c5c8740 1 --2- 172.21.15.19:0/3157556377 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x558588e9d2f0 0x558588e9aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.105+0000 7fc9e27fc640 0 client.4644 ms_handle_reset on v2:172.21.15.19:6816/2992197248 2023-11-04T15:27:54.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.105+0000 7fca0c5c8740 1 --2- 172.21.15.19:0/3157556377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x558588e84840 0x558588e9a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.105+0000 7fca0c5c8740 1 -- 172.21.15.19:0/3157556377 >> 172.21.15.19:0/3157556377 conn(0x558588e80780 msgr2=0x558588e7eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:54.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.106+0000 7fca0c5c8740 1 -- 172.21.15.19:0/3157556377 shutdown_connections 2023-11-04T15:27:54.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.106+0000 7fca0c5c8740 1 -- 172.21.15.19:0/3157556377 wait complete. 2023-11-04T15:27:54.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.106+0000 7fca0c5c8740 20 client.4644 trim_cache size 0 max 16384 2023-11-04T15:27:54.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.120+0000 7fca0c5c8740 1 Processor -- start 2023-11-04T15:27:54.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.120+0000 7fca0c5c8740 1 -- start start 2023-11-04T15:27:54.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.121+0000 7fca0c5c8740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x558588e84840 0x558588e9dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:54.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.121+0000 7fca0c5c8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558588e9d2f0 0x558588e9e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:54.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.121+0000 7fca0c5c8740 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x558588ea5ac0 0x558588e9e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:54.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.121+0000 7fca0c5c8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x558588e9f300 con 0x558588e9d2f0 2023-11-04T15:27:54.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.121+0000 7fca0c5c8740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x558588e7b4c0 con 0x558588e84840 2023-11-04T15:27:54.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.121+0000 7fca0c5c8740 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x558588ea3920 con 0x558588ea5ac0 2023-11-04T15:27:54.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.121+0000 7fca027fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558588e9d2f0 0x558588e9e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:54.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.121+0000 7fca027fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558588e9d2f0 0x558588e9e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54740/0 (socket says 172.21.15.19:54740) 2023-11-04T15:27:54.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.121+0000 7fca027fc640 1 -- 172.21.15.19:0/3274489377 learned_addr learned my addr 172.21.15.19:0/3274489377 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:54.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.121+0000 7fca02ffd640 1 --2- 172.21.15.19:0/3274489377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x558588e84840 0x558588e9dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:54.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.121+0000 7fca037fe640 1 --2- 172.21.15.19:0/3274489377 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x558588ea5ac0 0x558588e9e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:54.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.121+0000 7fca027fc640 1 -- 172.21.15.19:0/3274489377 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x558588ea5ac0 msgr2=0x558588e9e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:54.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.121+0000 7fca027fc640 1 --2- 172.21.15.19:0/3274489377 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x558588ea5ac0 0x558588e9e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.121+0000 7fca027fc640 1 -- 172.21.15.19:0/3274489377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x558588e84840 msgr2=0x558588e9dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:54.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.121+0000 7fca027fc640 1 --2- 172.21.15.19:0/3274489377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x558588e84840 0x558588e9dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.121+0000 7fca027fc640 1 -- 172.21.15.19:0/3274489377 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558588d89b60 con 0x558588e9d2f0 2023-11-04T15:27:54.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.121+0000 7fca037fe640 1 --2- 172.21.15.19:0/3274489377 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x558588ea5ac0 0x558588e9e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T15:27:54.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.122+0000 7fca027fc640 1 --2- 172.21.15.19:0/3274489377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558588e9d2f0 0x558588e9e160 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc9f80a87c0 tx=0x7fc9f8009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fed74fcdd81fc98 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:54.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.122+0000 7fc9e9ffb640 1 -- 172.21.15.19:0/3274489377 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f8040020 con 0x558588e9d2f0 2023-11-04T15:27:54.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.122+0000 7fc9e9ffb640 1 -- 172.21.15.19:0/3274489377 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f80797a0 con 0x558588e9d2f0 2023-11-04T15:27:54.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.122+0000 7fc9e9ffb640 1 -- 172.21.15.19:0/3274489377 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f807d520 con 0x558588e9d2f0 2023-11-04T15:27:54.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.122+0000 7fca0c5c8740 1 -- 172.21.15.19:0/3274489377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558588e9d2f0 msgr2=0x558588e9e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:54.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.122+0000 7fca0c5c8740 1 --2- 172.21.15.19:0/3274489377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558588e9d2f0 0x558588e9e160 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc9f80a87c0 tx=0x7fc9f8009240 comp rx=0 tx=0).stop 2023-11-04T15:27:54.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.122+0000 7fca0c5c8740 1 -- 172.21.15.19:0/3274489377 shutdown_connections 2023-11-04T15:27:54.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.122+0000 7fca0c5c8740 1 --2- 172.21.15.19:0/3274489377 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x558588ea5ac0 0x558588e9e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.122+0000 7fca0c5c8740 1 --2- 172.21.15.19:0/3274489377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558588e9d2f0 0x558588e9e160 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.122+0000 7fca0c5c8740 1 --2- 172.21.15.19:0/3274489377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x558588e84840 0x558588e9dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.122+0000 7fca0c5c8740 1 -- 172.21.15.19:0/3274489377 >> 172.21.15.19:0/3274489377 conn(0x558588e80780 msgr2=0x558588e7eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:54.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.122+0000 7fca0c5c8740 1 -- 172.21.15.19:0/3274489377 shutdown_connections 2023-11-04T15:27:54.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.122+0000 7fca0c5c8740 1 -- 172.21.15.19:0/3274489377 wait complete. 2023-11-04T15:27:54.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.123+0000 7fca0c5c8740 1 -- start start 2023-11-04T15:27:54.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.123+0000 7fca0c5c8740 1 Processor -- start 2023-11-04T15:27:54.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.123+0000 7fca0c5c8740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x558588e84840 0x558588f0f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:54.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.123+0000 7fca0c5c8740 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x558588e9d2f0 0x558588f0f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:54.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.123+0000 7fca0c5c8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558588ea5ac0 0x558588f0bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:54.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.123+0000 7fca0c5c8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x558588ea19c0 con 0x558588ea5ac0 2023-11-04T15:27:54.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.123+0000 7fca0c5c8740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x558588ebdab0 con 0x558588e84840 2023-11-04T15:27:54.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.123+0000 7fca0c5c8740 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x558588f0f230 con 0x558588e9d2f0 2023-11-04T15:27:54.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.123+0000 7fca0c5c8740 10 client.0 _ll_register_callbacks cb 0x7fc9fc009300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T15:27:54.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.123+0000 7fca037fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558588ea5ac0 0x558588f0bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:54.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.123+0000 7fca02ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x558588e84840 0x558588f0f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:54.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.123+0000 7fca037fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558588ea5ac0 0x558588f0bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54748/0 (socket says 172.21.15.19:54748) 2023-11-04T15:27:54.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.123+0000 7fca02ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x558588e84840 0x558588f0f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.19:34038/0 (socket says 172.21.15.19:34038) 2023-11-04T15:27:54.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.123+0000 7fca027fc640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x558588e9d2f0 0x558588f0f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:54.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.123+0000 7fca037fe640 1 -- 172.21.15.19:0/3147100059 learned_addr learned my addr 172.21.15.19:0/3147100059 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:54.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.124+0000 7fca037fe640 1 -- 172.21.15.19:0/3147100059 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x558588e9d2f0 msgr2=0x558588f0f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:54.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.124+0000 7fca037fe640 1 --2- 172.21.15.19:0/3147100059 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x558588e9d2f0 0x558588f0f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.124+0000 7fca037fe640 1 -- 172.21.15.19:0/3147100059 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x558588e84840 msgr2=0x558588f0f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:54.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.124+0000 7fca037fe640 1 --2- 172.21.15.19:0/3147100059 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x558588e84840 0x558588f0f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.124+0000 7fca037fe640 1 -- 172.21.15.19:0/3147100059 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca0409cbc0 con 0x558588ea5ac0 2023-11-04T15:27:54.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.124+0000 7fca037fe640 1 --2- 172.21.15.19:0/3147100059 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558588ea5ac0 0x558588f0bc80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc006dc0 tx=0x7fc9fc006f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f8ab1c0f70f8392 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:54.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.124+0000 7fc9e27fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2023-11-04T15:27:54.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.124+0000 7fc9e27fc640 1 -- 172.21.15.19:0/3147100059 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc00eb20 con 0x558588ea5ac0 2023-11-04T15:27:54.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.124+0000 7fc9e27fc640 1 -- 172.21.15.19:0/3147100059 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7fc9fc000e40 con 0x558588ea5ac0 2023-11-04T15:27:54.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.124+0000 7fca0c5c8740 1 -- 172.21.15.19:0/3147100059 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc9fc004180 con 0x558588ea5ac0 2023-11-04T15:27:54.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.124+0000 7fc9e27fc640 1 -- 172.21.15.19:0/3147100059 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9fc003a00 con 0x558588ea5ac0 2023-11-04T15:27:54.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.124+0000 7fca0c5c8740 10 client.4650 fetch_fsmap learned FSMap version 6 2023-11-04T15:27:54.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.124+0000 7fca0c5c8740 1 -- 172.21.15.19:0/3147100059 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x558588daf270 con 0x558588ea5ac0 2023-11-04T15:27:54.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.124+0000 7fc9e27fc640 1 -- 172.21.15.19:0/3147100059 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9fc004180 con 0x558588ea5ac0 2023-11-04T15:27:54.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.124+0000 7fc9e27fc640 1 -- 172.21.15.19:0/3147100059 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 6) v1 ==== 2016+0+0 (secure 0 0 0) 0x7fc9fc011050 con 0x558588ea5ac0 2023-11-04T15:27:54.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.124+0000 7fca0c5c8740 10 client.4650 fetch_fsmap finished waiting for FSMap version 6 2023-11-04T15:27:54.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.124+0000 7fca0c5c8740 10 client.4650 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T15:27:54.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.124+0000 7fca0c5c8740 20 client.4650 populate_metadata read hostname 'smithi019' 2023-11-04T15:27:54.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.125+0000 7fca0c5c8740 1 --2- 172.21.15.19:0/3147100059 >> [v2:172.21.15.19:6816/2992197248,v1:172.21.15.19:6817/2992197248] conn(0x558588f0c1c0 0x558588f0c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:54.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.125+0000 7fca0c5c8740 4 client.4650 mds_command: new command op to 4254 tid=0[{"prefix": "status"}] 2023-11-04T15:27:54.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.125+0000 7fca0c5c8740 1 -- 172.21.15.19:0/3147100059 --> [v2:172.21.15.19:6816/2992197248,v1:172.21.15.19:6817/2992197248] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558588de1e50 con 0x558588f0c1c0 2023-11-04T15:27:54.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.125+0000 7fca02ffd640 1 --2- 172.21.15.19:0/3147100059 >> [v2:172.21.15.19:6816/2992197248,v1:172.21.15.19:6817/2992197248] conn(0x558588f0c1c0 0x558588f0c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:54.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.125+0000 7fca02ffd640 1 --2- 172.21.15.19:0/3147100059 >> [v2:172.21.15.19:6816/2992197248,v1:172.21.15.19:6817/2992197248] conn(0x558588f0c1c0 0x558588f0c5a0 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bca83a1c9e607217 server_cookie=efa9b68f9f7dfbf3 in_seq=0 out_seq=0 2023-11-04T15:27:54.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.125+0000 7fc9e27fc640 10 client.4650 ms_handle_connect on v2:172.21.15.19:6816/2992197248 2023-11-04T15:27:54.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.125+0000 7fc9e27fc640 1 -- 172.21.15.19:0/3147100059 <== mds.0 v2:172.21.15.19:6816/2992197248 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x558588de1e50 con 0x558588f0c1c0 2023-11-04T15:27:54.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.125+0000 7fc9e27fc640 10 client.4650 handle_command_reply: tid=0 2023-11-04T15:27:54.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.125+0000 7fca0c5c8740 1 client.4650 shutdown 2023-11-04T15:27:54.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.125+0000 7fca0c5c8740 1 -- 172.21.15.19:0/3147100059 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558588ea5ac0 msgr2=0x558588f0bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:54.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.125+0000 7fca0c5c8740 1 --2- 172.21.15.19:0/3147100059 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558588ea5ac0 0x558588f0bc80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc006dc0 tx=0x7fc9fc006f50 comp rx=0 tx=0).stop 2023-11-04T15:27:54.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.125+0000 7fca0c5c8740 1 -- 172.21.15.19:0/3147100059 shutdown_connections 2023-11-04T15:27:54.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.125+0000 7fca0c5c8740 1 --2- 172.21.15.19:0/3147100059 >> [v2:172.21.15.19:6816/2992197248,v1:172.21.15.19:6817/2992197248] conn(0x558588f0c1c0 0x558588f0c5a0 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.125+0000 7fca0c5c8740 1 --2- 172.21.15.19:0/3147100059 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558588ea5ac0 0x558588f0bc80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.125+0000 7fca0c5c8740 1 --2- 172.21.15.19:0/3147100059 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x558588e9d2f0 0x558588f0f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.125+0000 7fc9e27fc640 0 client.4650 ms_handle_reset on v2:172.21.15.19:6816/2992197248 2023-11-04T15:27:54.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.125+0000 7fca0c5c8740 1 --2- 172.21.15.19:0/3147100059 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x558588e84840 0x558588f0f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.125+0000 7fca0c5c8740 1 -- 172.21.15.19:0/3147100059 >> 172.21.15.19:0/3147100059 conn(0x558588e80780 msgr2=0x558588e9f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:54.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.125+0000 7fca0c5c8740 1 -- 172.21.15.19:0/3147100059 shutdown_connections 2023-11-04T15:27:54.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.125+0000 7fca0c5c8740 1 -- 172.21.15.19:0/3147100059 wait complete. 2023-11-04T15:27:54.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.125+0000 7fca0c5c8740 20 client.4650 trim_cache size 0 max 16384 2023-11-04T15:27:54.156 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2023-11-04T15:27:54.156 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "e87311d5-496a-4b07-9654-358fe5bbf950", 2023-11-04T15:27:54.156 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2023-11-04T15:27:54.156 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 4254, 2023-11-04T15:27:54.157 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2023-11-04T15:27:54.157 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2023-11-04T15:27:54.157 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2023-11-04T15:27:54.157 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 17.998099753999998, 2023-11-04T15:27:54.157 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 6, 2023-11-04T15:27:54.158 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 19, 2023-11-04T15:27:54.158 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 19, 2023-11-04T15:27:54.158 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 22.400925088000001 2023-11-04T15:27:54.158 INFO:teuthology.orchestra.run.smithi019.stdout:} 2023-11-04T15:27:54.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.126+0000 7fca09a5c640 1 -- 172.21.15.19:0/2216990418 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc9f006a430 msgr2=0x7fc9f006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:54.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.126+0000 7fca09a5c640 1 --2- 172.21.15.19:0/2216990418 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc9f006a430 0x7fc9f006c8f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4003b80 tx=0x7fc9f40098d0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.126+0000 7fca09a5c640 1 -- 172.21.15.19:0/2216990418 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca04137270 msgr2=0x7fca041cc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:54.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.126+0000 7fca09a5c640 1 --2- 172.21.15.19:0/2216990418 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca04137270 0x7fca041cc980 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8009870 tx=0x7fc9f80046c0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.126+0000 7fca09a5c640 1 -- 172.21.15.19:0/2216990418 shutdown_connections 2023-11-04T15:27:54.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.126+0000 7fca09a5c640 1 --2- 172.21.15.19:0/2216990418 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc9f006a430 0x7fc9f006c8f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.126+0000 7fca09a5c640 1 --2- 172.21.15.19:0/2216990418 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca04137650 0x7fca041cf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.126+0000 7fca09a5c640 1 --2- 172.21.15.19:0/2216990418 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca04137270 0x7fca041cc980 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.126+0000 7fca09a5c640 1 --2- 172.21.15.19:0/2216990418 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fca040a3e90 0x7fca041cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.126+0000 7fca09a5c640 1 -- 172.21.15.19:0/2216990418 >> 172.21.15.19:0/2216990418 conn(0x7fca040a8d70 msgr2=0x7fca04134ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:54.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.126+0000 7fca09a5c640 1 -- 172.21.15.19:0/2216990418 shutdown_connections 2023-11-04T15:27:54.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.126+0000 7fca09a5c640 1 -- 172.21.15.19:0/2216990418 wait complete. 2023-11-04T15:27:54.162 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-11-04T15:27:54.186 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-11-04T15:27:54.187 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-11-04T15:27:54.187 INFO:tasks.ceph_fuse:client.0 config is {} 2023-11-04T15:27:54.187 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-04T15:27:54.188 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T15:27:54.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T15:27:54.189 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2023-11-04T15:27:54.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T15:27:54.207 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link delete ceph-brx 2023-11-04T15:27:54.283 INFO:teuthology.orchestra.run.smithi130.stderr:Cannot find device "ceph-brx" 2023-11-04T15:27:54.284 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T15:27:54.285 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-11-04T15:27:54.285 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T15:27:54.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.390+0000 7f6426977640 1 Processor -- start 2023-11-04T15:27:54.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.390+0000 7f6426977640 1 -- start start 2023-11-04T15:27:54.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.391+0000 7f6426977640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6420133cb0 0x7f6420134090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:54.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.391+0000 7f6426977640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6420137320 0x7f642013ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:54.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.391+0000 7f6426977640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64200a0df0 con 0x7f64200a0730 2023-11-04T15:27:54.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.391+0000 7f6426977640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f642009fd20 con 0x7f6420133cb0 2023-11-04T15:27:54.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.391+0000 7f6426977640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64200a13b0 con 0x7f6420137320 2023-11-04T15:27:54.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.391+0000 7f6424f14640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6420137320 0x7f642013ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:54.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.391+0000 7f641ffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6420133cb0 0x7f6420134090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:54.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.391+0000 7f6424f14640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6420137320 0x7f642013ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.19:49900/0 (socket says 172.21.15.19:49900) 2023-11-04T15:27:54.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.391+0000 7f6424f14640 1 -- 172.21.15.19:0/1554417899 learned_addr learned my addr 172.21.15.19:0/1554417899 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:54.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.391+0000 7f6424f14640 1 -- 172.21.15.19:0/1554417899 >> v2:172.21.15.96:3300/0 conn(0x7f6420133cb0 msgr2=0x7f6420134090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:27:54.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.391+0000 7f6424f14640 1 --2- 172.21.15.19:0/1554417899 >> v2:172.21.15.96:3300/0 conn(0x7f6420133cb0 0x7f6420134090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.392+0000 7f6424f14640 1 -- 172.21.15.19:0/1554417899 >> v1:172.21.15.96:6789/0 conn(0x7f64200a0730 legacy=0x7f6420136c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:54.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.392+0000 7f6424f14640 1 -- 172.21.15.19:0/1554417899 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64200a0180 con 0x7f6420137320 2023-11-04T15:27:54.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.392+0000 7f6424f14640 1 --2- 172.21.15.19:0/1554417899 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6420137320 0x7f642013ef50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6418009e50 tx=0x7f641802e050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81b616b5ac433e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:54.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.392+0000 7f641effd640 1 -- 172.21.15.19:0/1554417899 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641802ebf0 con 0x7f6420137320 2023-11-04T15:27:54.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.393+0000 7f641effd640 1 -- 172.21.15.19:0/1554417899 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641802ed50 con 0x7f6420137320 2023-11-04T15:27:54.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.393+0000 7f641effd640 1 -- 172.21.15.19:0/1554417899 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6418036610 con 0x7f6420137320 2023-11-04T15:27:54.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.393+0000 7f6426977640 1 -- 172.21.15.19:0/1554417899 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6420137320 msgr2=0x7f642013ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:54.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.393+0000 7f6426977640 1 --2- 172.21.15.19:0/1554417899 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6420137320 0x7f642013ef50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6418009e50 tx=0x7f641802e050 comp rx=0 tx=0).stop 2023-11-04T15:27:54.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.393+0000 7f6426977640 1 -- 172.21.15.19:0/1554417899 shutdown_connections 2023-11-04T15:27:54.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.393+0000 7f6426977640 1 --2- 172.21.15.19:0/1554417899 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6420137320 0x7f642013ef50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.393+0000 7f6426977640 1 --2- 172.21.15.19:0/1554417899 >> v2:172.21.15.96:3300/0 conn(0x7f6420133cb0 0x7f6420134090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.393+0000 7f6426977640 1 -- 172.21.15.19:0/1554417899 >> 172.21.15.19:0/1554417899 conn(0x7f64200a9060 msgr2=0x7f64200a9470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:54.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.393+0000 7f6426977640 1 -- 172.21.15.19:0/1554417899 shutdown_connections 2023-11-04T15:27:54.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.393+0000 7f6426977640 1 -- 172.21.15.19:0/1554417899 wait complete. 2023-11-04T15:27:54.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.394+0000 7f6426977640 1 Processor -- start 2023-11-04T15:27:54.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.394+0000 7f6426977640 1 -- start start 2023-11-04T15:27:54.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.395+0000 7f6426977640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64200a0730 0x7f64201cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:54.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.395+0000 7f6426977640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6420133cb0 0x7f64201cc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:54.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.395+0000 7f6426977640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6420137320 0x7f64201cee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:54.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.395+0000 7f6426977640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64201348b0 con 0x7f64200a0730 2023-11-04T15:27:54.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.395+0000 7f6426977640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64201cc890 con 0x7f6420137320 2023-11-04T15:27:54.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.395+0000 7f6426977640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6420070c80 con 0x7f6420133cb0 2023-11-04T15:27:54.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.395+0000 7f641ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64200a0730 0x7f64201cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:54.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.395+0000 7f641ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64200a0730 0x7f64201cbe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54764/0 (socket says 172.21.15.19:54764) 2023-11-04T15:27:54.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.395+0000 7f641ffff640 1 -- 172.21.15.19:0/1763399990 learned_addr learned my addr 172.21.15.19:0/1763399990 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:27:54.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.395+0000 7f641f7fe640 1 --2- 172.21.15.19:0/1763399990 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6420133cb0 0x7f64201cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:54.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.395+0000 7f6424f14640 1 --2- 172.21.15.19:0/1763399990 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6420137320 0x7f64201cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:54.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.395+0000 7f641ffff640 1 -- 172.21.15.19:0/1763399990 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6420133cb0 msgr2=0x7f64201cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:54.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.395+0000 7f641ffff640 1 --2- 172.21.15.19:0/1763399990 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6420133cb0 0x7f64201cc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.395+0000 7f641ffff640 1 -- 172.21.15.19:0/1763399990 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6420137320 msgr2=0x7f64201cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:54.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.395+0000 7f641ffff640 1 --2- 172.21.15.19:0/1763399990 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6420137320 0x7f64201cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.395+0000 7f641ffff640 1 -- 172.21.15.19:0/1763399990 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6418009b30 con 0x7f64200a0730 2023-11-04T15:27:54.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.395+0000 7f641f7fe640 1 --2- 172.21.15.19:0/1763399990 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6420133cb0 0x7f64201cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:27:54.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.395+0000 7f641ffff640 1 --2- 172.21.15.19:0/1763399990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64200a0730 0x7f64201cbe10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f641000e990 tx=0x7f641000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:54.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.395+0000 7f641cff9640 1 -- 172.21.15.19:0/1763399990 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6410009690 con 0x7f64200a0730 2023-11-04T15:27:54.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.395+0000 7f641cff9640 1 -- 172.21.15.19:0/1763399990 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641000c9e0 con 0x7f64200a0730 2023-11-04T15:27:54.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.395+0000 7f6426977640 1 -- 172.21.15.19:0/1763399990 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6420070eb0 con 0x7f64200a0730 2023-11-04T15:27:54.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.395+0000 7f641cff9640 1 -- 172.21.15.19:0/1763399990 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641000cd90 con 0x7f64200a0730 2023-11-04T15:27:54.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.395+0000 7f6426977640 1 -- 172.21.15.19:0/1763399990 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f642011fda0 con 0x7f64200a0730 2023-11-04T15:27:54.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.396+0000 7f6426977640 1 -- 172.21.15.19:0/1763399990 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64200713a0 con 0x7f64200a0730 2023-11-04T15:27:54.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.397+0000 7f641cff9640 1 -- 172.21.15.19:0/1763399990 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6410013470 con 0x7f64200a0730 2023-11-04T15:27:54.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.397+0000 7f641cff9640 1 --2- 172.21.15.19:0/1763399990 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f640c06a460 0x7f640c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:27:54.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.397+0000 7f641cff9640 1 -- 172.21.15.19:0/1763399990 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4334+0+0 (secure 0 0 0) 0x7f6410088590 con 0x7f64200a0730 2023-11-04T15:27:54.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.398+0000 7f641f7fe640 1 --2- 172.21.15.19:0/1763399990 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f640c06a460 0x7f640c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:27:54.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.398+0000 7f641f7fe640 1 --2- 172.21.15.19:0/1763399990 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f640c06a460 0x7f640c06c920 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6414007fd0 tx=0x7f6414009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:27:54.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.402+0000 7f641cff9640 1 -- 172.21.15.19:0/1763399990 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6410054170 con 0x7f64200a0730 2023-11-04T15:27:54.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.612+0000 7f6426977640 1 -- 172.21.15.19:0/1763399990 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6420067d60 con 0x7f64200a0730 2023-11-04T15:27:54.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.612+0000 7f641cff9640 1 -- 172.21.15.19:0/1763399990 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6410057790 con 0x7f64200a0730 2023-11-04T15:27:54.614 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T15:27:54.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.614+0000 7f6426977640 1 -- 172.21.15.19:0/1763399990 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f640c06a460 msgr2=0x7f640c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:54.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.614+0000 7f6426977640 1 --2- 172.21.15.19:0/1763399990 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f640c06a460 0x7f640c06c920 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6414007fd0 tx=0x7f6414009040 comp rx=0 tx=0).stop 2023-11-04T15:27:54.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.614+0000 7f6426977640 1 -- 172.21.15.19:0/1763399990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64200a0730 msgr2=0x7f64201cbe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:27:54.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.614+0000 7f6426977640 1 --2- 172.21.15.19:0/1763399990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64200a0730 0x7f64201cbe10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f641000e990 tx=0x7f641000ee50 comp rx=0 tx=0).stop 2023-11-04T15:27:54.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.614+0000 7f6426977640 1 -- 172.21.15.19:0/1763399990 shutdown_connections 2023-11-04T15:27:54.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.614+0000 7f6426977640 1 --2- 172.21.15.19:0/1763399990 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f640c06a460 0x7f640c06c920 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.614+0000 7f6426977640 1 --2- 172.21.15.19:0/1763399990 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6420137320 0x7f64201cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.614+0000 7f6426977640 1 --2- 172.21.15.19:0/1763399990 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6420133cb0 0x7f64201cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.614+0000 7f6426977640 1 --2- 172.21.15.19:0/1763399990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64200a0730 0x7f64201cbe10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:27:54.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.614+0000 7f6426977640 1 -- 172.21.15.19:0/1763399990 >> 172.21.15.19:0/1763399990 conn(0x7f64200a9060 msgr2=0x7f642009f050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:27:54.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.614+0000 7f6426977640 1 -- 172.21.15.19:0/1763399990 shutdown_connections 2023-11-04T15:27:54.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:27:54.614+0000 7f6426977640 1 -- 172.21.15.19:0/1763399990 wait complete. 2023-11-04T15:27:54.626 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T15:27:54.627 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T15:27:54.627 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi130.front.sepia.ceph.com 2023-11-04T15:27:54.627 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T15:27:54.627 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T15:27:54.628 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T15:27:54.628 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T15:27:54.628 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T15:27:54.629 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T15:27:54.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T15:27:54.629 DEBUG:teuthology.orchestra.run.smithi130:> ip addr 2023-11-04T15:27:54.647 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T15:27:54.647 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T15:27:54.647 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T15:27:54.647 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-11-04T15:27:54.648 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2023-11-04T15:27:54.648 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-11-04T15:27:54.648 INFO:teuthology.orchestra.run.smithi130.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T15:27:54.648 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:96 brd ff:ff:ff:ff:ff:ff 2023-11-04T15:27:54.648 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f0 2023-11-04T15:27:54.649 INFO:teuthology.orchestra.run.smithi130.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T15:27:54.649 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:97 brd ff:ff:ff:ff:ff:ff 2023-11-04T15:27:54.649 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f1 2023-11-04T15:27:54.649 INFO:teuthology.orchestra.run.smithi130.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-04T15:27:54.649 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:36 brd ff:ff:ff:ff:ff:ff 2023-11-04T15:27:54.650 INFO:teuthology.orchestra.run.smithi130.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T15:27:54.650 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:37 brd ff:ff:ff:ff:ff:ff 2023-11-04T15:27:54.650 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.21.15.130/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-04T15:27:54.650 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft 42632sec preferred_lft 42632sec 2023-11-04T15:27:54.651 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::ec4:7aff:fe88:7f37/64 scope link 2023-11-04T15:27:54.651 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-11-04T15:27:54.651 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-04T15:27:54.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T15:27:54.652 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-11-04T15:27:54.652 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-11-04T15:27:54.653 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link add name ceph-brx type bridge 2023-11-04T15:27:54.653 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip addr flush dev ceph-brx 2023-11-04T15:27:54.653 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set ceph-brx up 2023-11-04T15:27:54.653 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-04T15:27:54.654 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-11-04T15:27:54.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T15:27:54.813 DEBUG:teuthology.orchestra.run.smithi130:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T15:27:54.840 INFO:teuthology.orchestra.run.smithi130.stdout:1 2023-11-04T15:27:54.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T15:27:54.842 DEBUG:teuthology.orchestra.run.smithi130:> route 2023-11-04T15:27:54.912 INFO:teuthology.orchestra.run.smithi130.stdout:Kernel IP routing table 2023-11-04T15:27:54.912 INFO:teuthology.orchestra.run.smithi130.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T15:27:54.913 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T15:27:54.913 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T15:27:54.913 INFO:teuthology.orchestra.run.smithi130.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T15:27:54.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T15:27:54.914 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-11-04T15:27:54.914 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-11-04T15:27:54.915 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T15:27:54.915 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T15:27:54.915 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T15:27:54.916 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-11-04T15:27:54.980 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:27:54.983 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:27:54.986 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:27:55.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T15:27:55.227 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2023-11-04T15:27:55.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T15:27:55.243 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list-id 2023-11-04T15:27:55.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T15:27:55.298 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-11-04T15:27:55.298 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-11-04T15:27:55.299 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T15:27:55.299 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-04T15:27:55.299 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-11-04T15:27:55.380 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-04T15:27:55.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T15:27:55.381 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-11-04T15:27:55.381 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-11-04T15:27:55.382 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-04T15:27:55.382 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-04T15:27:55.382 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-04T15:27:55.383 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-04T15:27:55.383 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-04T15:27:55.383 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-11-04T15:27:55.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T15:27:55.520 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-11-04T15:27:55.521 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-11-04T15:27:55.521 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set brx.0 up 2023-11-04T15:27:55.521 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set dev brx.0 master ceph-brx 2023-11-04T15:27:55.522 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-11-04T15:27:55.563 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T15:27:55.563 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T15:27:55.564 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T15:27:55.618 INFO:teuthology.orchestra.run.smithi130.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T15:27:55.619 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T15:27:55.619 DEBUG:teuthology.orchestra.run.smithi130:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T15:27:55.673 DEBUG:teuthology.orchestra.run.smithi130:> sudo modprobe fuse 2023-11-04T15:27:55.741 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-04T15:27:55.742 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-04T15:27:55.808 INFO:teuthology.orchestra.run.smithi130.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-04T15:27:55.809 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-04T15:27:55.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T15:27:55.810 DEBUG:teuthology.orchestra.run.smithi130:> ls /sys/fs/fuse/connections 2023-11-04T15:27:55.864 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T15:27:55.865 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T15:27:55.907 DEBUG:teuthology.orchestra.run.smithi130:> sudo modprobe fuse 2023-11-04T15:27:55.933 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-04T15:27:55.933 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-04T15:27:55.998 INFO:teuthology.orchestra.run.smithi130.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-04T15:27:55.999 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-04T15:27:55.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T15:27:56.000 DEBUG:teuthology.orchestra.run.smithi130:> ls /sys/fs/fuse/connections 2023-11-04T15:27:56.021 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi130.stderr:2023-11-04T15:27:56.019+0000 7f4ea01db480 -1 init, newargv = 0x558b1ef5a9c0 newargc=15 2023-11-04T15:27:56.021 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi130.stderr:ceph-fuse[80056]: starting ceph client 2023-11-04T15:27:56.026 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi130.stderr:ceph-fuse[80056]: starting fuse 2023-11-04T15:27:56.035 INFO:teuthology.orchestra.run.smithi130.stdout:42 2023-11-04T15:27:56.036 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-11-04T15:27:56.036 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-04T15:27:56.037 DEBUG:teuthology.orchestra.run.smithi130:> import glob 2023-11-04T15:27:56.037 DEBUG:teuthology.orchestra.run.smithi130:> import re 2023-11-04T15:27:56.037 DEBUG:teuthology.orchestra.run.smithi130:> import os 2023-11-04T15:27:56.037 DEBUG:teuthology.orchestra.run.smithi130:> import subprocess 2023-11-04T15:27:56.038 DEBUG:teuthology.orchestra.run.smithi130:> 2023-11-04T15:27:56.038 DEBUG:teuthology.orchestra.run.smithi130:> def _find_admin_socket(client_name): 2023-11-04T15:27:56.038 DEBUG:teuthology.orchestra.run.smithi130:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T15:27:56.039 DEBUG:teuthology.orchestra.run.smithi130:> files = glob.glob(asok_path) 2023-11-04T15:27:56.039 DEBUG:teuthology.orchestra.run.smithi130:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T15:27:56.039 DEBUG:teuthology.orchestra.run.smithi130:> 2023-11-04T15:27:56.040 DEBUG:teuthology.orchestra.run.smithi130:> # Given a non-glob path, it better be there 2023-11-04T15:27:56.040 DEBUG:teuthology.orchestra.run.smithi130:> if "*" not in asok_path: 2023-11-04T15:27:56.040 DEBUG:teuthology.orchestra.run.smithi130:> assert(len(files) == 1) 2023-11-04T15:27:56.040 DEBUG:teuthology.orchestra.run.smithi130:> return files[0] 2023-11-04T15:27:56.041 DEBUG:teuthology.orchestra.run.smithi130:> 2023-11-04T15:27:56.041 DEBUG:teuthology.orchestra.run.smithi130:> for f in files: 2023-11-04T15:27:56.041 DEBUG:teuthology.orchestra.run.smithi130:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T15:27:56.042 DEBUG:teuthology.orchestra.run.smithi130:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T15:27:56.042 DEBUG:teuthology.orchestra.run.smithi130:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T15:27:56.042 DEBUG:teuthology.orchestra.run.smithi130:> contents = proc_f.read() 2023-11-04T15:27:56.042 DEBUG:teuthology.orchestra.run.smithi130:> if mountpoint in contents: 2023-11-04T15:27:56.043 DEBUG:teuthology.orchestra.run.smithi130:> return f 2023-11-04T15:27:56.043 DEBUG:teuthology.orchestra.run.smithi130:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T15:27:56.043 DEBUG:teuthology.orchestra.run.smithi130:> 2023-11-04T15:27:56.044 DEBUG:teuthology.orchestra.run.smithi130:> print(_find_admin_socket("client.0")) 2023-11-04T15:27:56.044 DEBUG:teuthology.orchestra.run.smithi130:> ' 2023-11-04T15:27:56.152 INFO:teuthology.orchestra.run.smithi130.stdout:/var/run/ceph/ceph-client.0.80056.asok 2023-11-04T15:27:56.339 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.80056.asok 2023-11-04T15:27:56.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T15:27:56.340 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.80056.asok status 2023-11-04T15:27:56.472 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-11-04T15:27:56.473 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": { 2023-11-04T15:27:56.473 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_sha1": "f7e9f9af51acf98e0ccc3037487018e4ae40caa5", 2023-11-04T15:27:56.473 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_version": "ceph version 18.2.0-1181-gf7e9f9af (f7e9f9af51acf98e0ccc3037487018e4ae40caa5) reef (stable)", 2023-11-04T15:27:56.473 INFO:teuthology.orchestra.run.smithi130.stdout: "entity_id": "0", 2023-11-04T15:27:56.473 INFO:teuthology.orchestra.run.smithi130.stdout: "hostname": "smithi130", 2023-11-04T15:27:56.474 INFO:teuthology.orchestra.run.smithi130.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T15:27:56.474 INFO:teuthology.orchestra.run.smithi130.stdout: "pid": "80056", 2023-11-04T15:27:56.474 INFO:teuthology.orchestra.run.smithi130.stdout: "root": "/" 2023-11-04T15:27:56.474 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-11-04T15:27:56.474 INFO:teuthology.orchestra.run.smithi130.stdout: "dentry_count": 0, 2023-11-04T15:27:56.475 INFO:teuthology.orchestra.run.smithi130.stdout: "dentry_pinned_count": 0, 2023-11-04T15:27:56.475 INFO:teuthology.orchestra.run.smithi130.stdout: "id": 4555, 2023-11-04T15:27:56.475 INFO:teuthology.orchestra.run.smithi130.stdout: "inst": { 2023-11-04T15:27:56.475 INFO:teuthology.orchestra.run.smithi130.stdout: "name": { 2023-11-04T15:27:56.475 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "client", 2023-11-04T15:27:56.475 INFO:teuthology.orchestra.run.smithi130.stdout: "num": 4555 2023-11-04T15:27:56.476 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-11-04T15:27:56.476 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": { 2023-11-04T15:27:56.476 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-11-04T15:27:56.476 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:0", 2023-11-04T15:27:56.477 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2389733268 2023-11-04T15:27:56.477 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-11-04T15:27:56.477 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-11-04T15:27:56.477 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": { 2023-11-04T15:27:56.477 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-11-04T15:27:56.478 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "172.21.15.130:0", 2023-11-04T15:27:56.478 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 2389733268 2023-11-04T15:27:56.478 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-11-04T15:27:56.478 INFO:teuthology.orchestra.run.smithi130.stdout: "inst_str": "client.4555 172.21.15.130:0/2389733268", 2023-11-04T15:27:56.478 INFO:teuthology.orchestra.run.smithi130.stdout: "addr_str": "172.21.15.130:0/2389733268", 2023-11-04T15:27:56.479 INFO:teuthology.orchestra.run.smithi130.stdout: "inode_count": 1, 2023-11-04T15:27:56.479 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_epoch": 6, 2023-11-04T15:27:56.479 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_epoch": 19, 2023-11-04T15:27:56.479 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_epoch_barrier": 0, 2023-11-04T15:27:56.479 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklisted": false, 2023-11-04T15:27:56.480 INFO:teuthology.orchestra.run.smithi130.stdout: "fs_name": "cephfs" 2023-11-04T15:27:56.480 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-11-04T15:27:56.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T15:27:56.482 DEBUG:teuthology.orchestra.run.smithi130:> stat --file-system '--printf=%T 2023-11-04T15:27:56.482 DEBUG:teuthology.orchestra.run.smithi130:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T15:27:56.497 INFO:teuthology.orchestra.run.smithi130.stdout:fuseblk 2023-11-04T15:27:56.498 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T15:27:56.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T15:27:56.499 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T15:27:56.565 INFO:teuthology.run_tasks:Running task workunit... 2023-11-04T15:27:56.577 INFO:tasks.workunit:Pulling workunits from ref f7e9f9af51acf98e0ccc3037487018e4ae40caa5 2023-11-04T15:27:56.578 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-11-04T15:27:56.578 DEBUG:teuthology.orchestra.run.smithi130:> stat -- /home/ubuntu/cephtest/mnt.0 2023-11-04T15:27:56.621 INFO:teuthology.orchestra.run.smithi130.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-11-04T15:27:56.621 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2023-11-04T15:27:56.622 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 2ah/42d Inode: 1 Links: 2 2023-11-04T15:27:56.622 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T15:27:56.622 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:fusefs_t:s0 2023-11-04T15:27:56.622 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-11-04T15:27:56.622 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2023-11-04 15:27:36.128080656 +0000 2023-11-04T15:27:56.623 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2023-11-04 15:27:56.562333062 +0000 2023-11-04T15:27:56.623 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: - 2023-11-04T15:27:56.623 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-11-04T15:27:56.623 DEBUG:teuthology.orchestra.run.smithi130:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-11-04T15:27:56.694 INFO:tasks.workunit:timeout=3h 2023-11-04T15:27:56.695 INFO:tasks.workunit:cleanup=True 2023-11-04T15:27:56.695 DEBUG:teuthology.orchestra.run.smithi130:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout f7e9f9af51acf98e0ccc3037487018e4ae40caa5 2023-11-04T15:27:56.749 INFO:tasks.workunit.client.0.smithi130.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-11-04T15:28:25.134 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:28:25.138 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:28:25.141 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:28:41.586 INFO:tasks.workunit.client.0.smithi130.stderr:Note: switching to 'f7e9f9af51acf98e0ccc3037487018e4ae40caa5'. 2023-11-04T15:28:41.587 INFO:tasks.workunit.client.0.smithi130.stderr: 2023-11-04T15:28:41.587 INFO:tasks.workunit.client.0.smithi130.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-11-04T15:28:41.587 INFO:tasks.workunit.client.0.smithi130.stderr:changes and commit them, and you can discard any commits you make in this 2023-11-04T15:28:41.587 INFO:tasks.workunit.client.0.smithi130.stderr:state without impacting any branches by switching back to a branch. 2023-11-04T15:28:41.588 INFO:tasks.workunit.client.0.smithi130.stderr: 2023-11-04T15:28:41.588 INFO:tasks.workunit.client.0.smithi130.stderr:If you want to create a new branch to retain commits you create, you may 2023-11-04T15:28:41.588 INFO:tasks.workunit.client.0.smithi130.stderr:do so (now or later) by using -c with the switch command. Example: 2023-11-04T15:28:41.588 INFO:tasks.workunit.client.0.smithi130.stderr: 2023-11-04T15:28:41.588 INFO:tasks.workunit.client.0.smithi130.stderr: git switch -c 2023-11-04T15:28:41.589 INFO:tasks.workunit.client.0.smithi130.stderr: 2023-11-04T15:28:41.589 INFO:tasks.workunit.client.0.smithi130.stderr:Or undo this operation with: 2023-11-04T15:28:41.589 INFO:tasks.workunit.client.0.smithi130.stderr: 2023-11-04T15:28:41.589 INFO:tasks.workunit.client.0.smithi130.stderr: git switch - 2023-11-04T15:28:41.589 INFO:tasks.workunit.client.0.smithi130.stderr: 2023-11-04T15:28:41.590 INFO:tasks.workunit.client.0.smithi130.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-11-04T15:28:41.590 INFO:tasks.workunit.client.0.smithi130.stderr: 2023-11-04T15:28:41.590 INFO:tasks.workunit.client.0.smithi130.stderr:HEAD is now at f7e9f9af51a Merge pull request #54161 from cbodley/wip-61352-reef 2023-11-04T15:28:41.591 DEBUG:teuthology.orchestra.run.smithi130:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-11-04T15:28:41.618 INFO:tasks.workunit.client.0.smithi130.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-11-04T15:28:41.620 INFO:tasks.workunit.client.0.smithi130.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-11-04T15:28:41.621 INFO:tasks.workunit.client.0.smithi130.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-11-04T15:28:42.372 INFO:tasks.workunit.client.0.smithi130.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-11-04T15:28:42.433 INFO:tasks.workunit.client.0.smithi130.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-11-04T15:28:42.474 INFO:tasks.workunit.client.0.smithi130.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-11-04T15:28:42.476 INFO:tasks.workunit.client.0.smithi130.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-11-04T15:28:42.478 INFO:tasks.workunit.client.0.smithi130.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-11-04T15:28:42.515 INFO:tasks.workunit.client.0.smithi130.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-11-04T15:28:42.518 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-11-04T15:28:42.518 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-11-04T15:28:42.574 INFO:tasks.workunit:Running workunits matching libcephfs/test.sh on client.0... 2023-11-04T15:28:42.575 INFO:tasks.workunit:Running workunit libcephfs/test.sh... 2023-11-04T15:28:42.576 DEBUG:teuthology.orchestra.run.smithi130:workunit test libcephfs/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f7e9f9af51acf98e0ccc3037487018e4ae40caa5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh 2023-11-04T15:28:42.675 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] Running 133 tests from 4 test suites. 2023-11-04T15:28:42.675 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment set-up. 2023-11-04T15:28:42.676 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 124 tests from LibCephFS 2023-11-04T15:28:42.676 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.SnapDiffLib 2023-11-04T15:28:42.779 INFO:tasks.workunit.client.0.smithi130.stdout:2 vs. 3 2023-11-04T15:28:42.780 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 listing verification--------- 2023-11-04T15:28:46.735 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap2 listing verification--------- 2023-11-04T15:28:51.735 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 vs. snap2 diff listing for / 2023-11-04T15:28:51.739 INFO:tasks.workunit.client.0.smithi130.stdout:dirB snap 3 2023-11-04T15:28:51.739 INFO:tasks.workunit.client.0.smithi130.stdout:fileB snap 3 2023-11-04T15:28:51.740 INFO:tasks.workunit.client.0.smithi130.stdout:fileC snap 2 2023-11-04T15:28:51.740 INFO:tasks.workunit.client.0.smithi130.stdout:fileA snap 3 2023-11-04T15:28:51.741 INFO:tasks.workunit.client.0.smithi130.stdout:dirC snap 2 2023-11-04T15:28:51.741 INFO:tasks.workunit.client.0.smithi130.stdout:dirD snap 3 2023-11-04T15:28:51.741 INFO:tasks.workunit.client.0.smithi130.stdout:dirA snap 3 2023-11-04T15:28:51.741 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 vs. snap2 diff listing verification for / 2023-11-04T15:28:51.746 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 vs. snap2 diff listing verification for /dirA 2023-11-04T15:28:51.750 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 vs. snap2 diff listing verification for /dirB 2023-11-04T15:28:51.755 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap2 vs. snap1 diff listing verification for /dirC 2023-11-04T15:28:51.760 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 vs. snap2 diff listing verification for /dirD 2023-11-04T15:28:51.763 INFO:tasks.workunit.client.0.smithi130.stdout:---------invalid snapdiff params, the same snaps--------- 2023-11-04T15:28:51.765 INFO:tasks.workunit.client.0.smithi130.stderr: Failed to readdir snapdiff, ret:-22 , snap2 vs. snap2 2023-11-04T15:28:51.765 INFO:tasks.workunit.client.0.smithi130.stdout:---------invalid snapdiff params, no snap_other --------- 2023-11-04T15:28:51.766 INFO:tasks.workunit.client.0.smithi130.stdout:------------- closing ------------- 2023-11-04T15:28:51.766 INFO:tasks.workunit.client.0.smithi130.stderr: Failed to open snapdiff, ret:-22 2023-11-04T15:28:52.717 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.SnapDiffLib (10042 ms) 2023-11-04T15:28:52.717 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.SnapDiffLib2 2023-11-04T15:28:52.904 INFO:tasks.workunit.client.0.smithi130.stdout:6 vs. 7 vs. 8 2023-11-04T15:28:52.904 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 listing verification--------- 2023-11-04T15:28:55.285 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:28:55.289 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:28:55.292 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:28:56.735 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap2 listing verification--------- 2023-11-04T15:29:01.738 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap3 listing verification--------- 2023-11-04T15:29:01.744 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 listing verification--------- 2023-11-04T15:29:01.749 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap2 listing verification--------- 2023-11-04T15:29:01.753 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap3 listing verification--------- 2023-11-04T15:29:01.757 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 vs. snap2 diff listing for / 2023-11-04T15:29:01.762 INFO:tasks.workunit.client.0.smithi130.stdout:fileG snap 7 2023-11-04T15:29:01.763 INFO:tasks.workunit.client.0.smithi130.stdout:dirB snap 7 2023-11-04T15:29:01.763 INFO:tasks.workunit.client.0.smithi130.stdout:fileB snap 7 2023-11-04T15:29:01.763 INFO:tasks.workunit.client.0.smithi130.stdout:fileC snap 6 2023-11-04T15:29:01.763 INFO:tasks.workunit.client.0.smithi130.stdout:fileA snap 7 2023-11-04T15:29:01.764 INFO:tasks.workunit.client.0.smithi130.stdout:dirC snap 6 2023-11-04T15:29:01.764 INFO:tasks.workunit.client.0.smithi130.stdout:dirD snap 7 2023-11-04T15:29:01.764 INFO:tasks.workunit.client.0.smithi130.stdout:fileF snap 6 2023-11-04T15:29:01.765 INFO:tasks.workunit.client.0.smithi130.stdout:dirA snap 7 2023-11-04T15:29:01.765 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 vs. snap2 diff listing verification for / 2023-11-04T15:29:01.768 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 listing verification--------- 2023-11-04T15:29:01.773 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap2 listing verification--------- 2023-11-04T15:29:01.776 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap3 listing verification--------- 2023-11-04T15:29:01.779 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap2 vs. snap1 diff listing verification for / 2023-11-04T15:29:01.784 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 listing verification--------- 2023-11-04T15:29:01.788 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap2 listing verification--------- 2023-11-04T15:29:01.792 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap3 listing verification--------- 2023-11-04T15:29:01.795 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 vs. snap3 diff listing verification for / 2023-11-04T15:29:01.799 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap2 vs. snap3 diff listing verification for / 2023-11-04T15:29:01.803 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 listing verification--------- 2023-11-04T15:29:01.807 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap2 listing verification--------- 2023-11-04T15:29:01.811 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap3 listing verification--------- 2023-11-04T15:29:01.813 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 vs. snap2 diff listing for /dirA 2023-11-04T15:29:01.816 INFO:tasks.workunit.client.0.smithi130.stdout:fileA snap 7 2023-11-04T15:29:01.816 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 vs. snap2 diff listing verification for /dirA 2023-11-04T15:29:01.818 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 vs. snap2 diff listing for /dirB 2023-11-04T15:29:01.822 INFO:tasks.workunit.client.0.smithi130.stdout:fileb snap 7 2023-11-04T15:29:01.822 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 vs. snap2 diff listing verification for /dirB 2023-11-04T15:29:01.825 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 vs. snap2 diff listing for /dirD 2023-11-04T15:29:01.827 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 vs. snap2 diff listing verification for /dirD 2023-11-04T15:29:01.830 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 listing verification--------- 2023-11-04T15:29:01.833 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap2 listing verification--------- 2023-11-04T15:29:01.837 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap3 listing verification--------- 2023-11-04T15:29:01.840 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 vs. snap2 diff listing verification for / 2023-11-04T15:29:01.844 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap3 vs. snap2 diff listing verification for / 2023-11-04T15:29:01.848 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 vs. snap3 diff listing verification for / 2023-11-04T15:29:01.852 INFO:tasks.workunit.client.0.smithi130.stdout:------------- closing ------------- 2023-11-04T15:29:02.756 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.SnapDiffLib2 (10039 ms) 2023-11-04T15:29:02.756 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.SnapDiffCases1_2 2023-11-04T15:29:03.139 INFO:tasks.workunit.client.0.smithi130.stdout:12 vs. 13 2023-11-04T15:29:03.139 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 vs. snap2 diff listing for / 2023-11-04T15:29:03.144 INFO:tasks.workunit.client.0.smithi130.stdout:C snap 12 2023-11-04T15:29:03.145 INFO:tasks.workunit.client.0.smithi130.stdout:L snap 13 2023-11-04T15:29:03.145 INFO:tasks.workunit.client.0.smithi130.stdout:S snap 13 2023-11-04T15:29:03.147 INFO:tasks.workunit.client.0.smithi130.stdout:T snap 13 2023-11-04T15:29:03.148 INFO:tasks.workunit.client.0.smithi130.stdout:d snap 13 2023-11-04T15:29:03.148 INFO:tasks.workunit.client.0.smithi130.stdout:G snap 12 2023-11-04T15:29:03.148 INFO:tasks.workunit.client.0.smithi130.stdout:l snap 13 2023-11-04T15:29:03.149 INFO:tasks.workunit.client.0.smithi130.stdout:e snap 13 2023-11-04T15:29:03.149 INFO:tasks.workunit.client.0.smithi130.stdout:~e snap 13 2023-11-04T15:29:03.149 INFO:tasks.workunit.client.0.smithi130.stdout:g snap 12 2023-11-04T15:29:03.149 INFO:tasks.workunit.client.0.smithi130.stdout:c snap 12 2023-11-04T15:29:03.150 INFO:tasks.workunit.client.0.smithi130.stdout:b snap 13 2023-11-04T15:29:03.150 INFO:tasks.workunit.client.0.smithi130.stdout:f snap 13 2023-11-04T15:29:03.151 INFO:tasks.workunit.client.0.smithi130.stdout:I snap 13 2023-11-04T15:29:03.151 INFO:tasks.workunit.client.0.smithi130.stdout:K snap 13 2023-11-04T15:29:03.151 INFO:tasks.workunit.client.0.smithi130.stdout:k snap 13 2023-11-04T15:29:03.151 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 vs. snap2 diff listing verification for / 2023-11-04T15:29:03.153 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 vs. snap2 diff listing verification for /S 2023-11-04T15:29:03.156 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 vs. snap2 diff listing verification for /T 2023-11-04T15:29:03.159 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap2 vs. snap1 diff listing verification for /C 2023-11-04T15:29:03.164 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap2 vs. snap1 diff listing verification for /C/CC 2023-11-04T15:29:03.168 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 vs. snap2 diff listing verification for /I 2023-11-04T15:29:03.171 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 vs. snap2 diff listing verification for /I/J 2023-11-04T15:29:03.176 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 vs. snap2 diff listing verification for /L 2023-11-04T15:29:03.181 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 vs. snap2 diff listing verification for /L/LL 2023-11-04T15:29:03.184 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 vs. snap2 diff listing verification for /L/LN 2023-11-04T15:29:03.188 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 vs. snap2 diff listing verification for /L/LM 2023-11-04T15:29:03.192 INFO:tasks.workunit.client.0.smithi130.stdout:------------- 2023-11-04T15:29:03.784 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.SnapDiffCases1_2 (1028 ms) 2023-11-04T15:29:03.784 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.SnapDiffCases2_3 2023-11-04T15:29:04.176 INFO:tasks.workunit.client.0.smithi130.stdout:19 vs. 20 2023-11-04T15:29:04.177 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap2 vs. snap3 diff listing for / 2023-11-04T15:29:04.180 INFO:tasks.workunit.client.0.smithi130.stdout:H snap 20 2023-11-04T15:29:04.182 INFO:tasks.workunit.client.0.smithi130.stdout:L snap 20 2023-11-04T15:29:04.185 INFO:tasks.workunit.client.0.smithi130.stdout:S snap 20 2023-11-04T15:29:04.185 INFO:tasks.workunit.client.0.smithi130.stdout:ff snap 19 2023-11-04T15:29:04.186 INFO:tasks.workunit.client.0.smithi130.stdout:T snap 20 2023-11-04T15:29:04.186 INFO:tasks.workunit.client.0.smithi130.stdout:d snap 20 2023-11-04T15:29:04.187 INFO:tasks.workunit.client.0.smithi130.stdout:G snap 20 2023-11-04T15:29:04.187 INFO:tasks.workunit.client.0.smithi130.stdout:e snap 19 2023-11-04T15:29:04.187 INFO:tasks.workunit.client.0.smithi130.stdout:~e snap 19 2023-11-04T15:29:04.188 INFO:tasks.workunit.client.0.smithi130.stdout:g snap 20 2023-11-04T15:29:04.188 INFO:tasks.workunit.client.0.smithi130.stdout:b snap 20 2023-11-04T15:29:04.188 INFO:tasks.workunit.client.0.smithi130.stdout:f snap 19 2023-11-04T15:29:04.188 INFO:tasks.workunit.client.0.smithi130.stdout:I snap 20 2023-11-04T15:29:04.189 INFO:tasks.workunit.client.0.smithi130.stdout:a snap 20 2023-11-04T15:29:04.189 INFO:tasks.workunit.client.0.smithi130.stdout:K snap 19 2023-11-04T15:29:04.189 INFO:tasks.workunit.client.0.smithi130.stdout:k snap 19 2023-11-04T15:29:04.189 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap2 vs. snap3 diff listing verification for / 2023-11-04T15:29:04.193 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap2 vs. snap3 diff listing verification for /S 2023-11-04T15:29:04.196 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap2 vs. snap3 diff listing verification for /T 2023-11-04T15:29:04.200 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap2 vs. snap3 diff listing verification for /G 2023-11-04T15:29:04.204 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap3 vs. snap2 diff listing verification for /K 2023-11-04T15:29:04.208 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap2 vs. snap3 diff listing verification for /H 2023-11-04T15:29:04.212 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap2 vs. snap3 diff listing verification for /I 2023-11-04T15:29:04.216 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap2 vs. snap3 diff listing verification for /I/J 2023-11-04T15:29:04.220 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap2 vs. snap3 diff listing verification for /L 2023-11-04T15:29:04.224 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap2 vs. snap3 diff listing verification for /L/LL 2023-11-04T15:29:04.227 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap3 vs. snap2 diff listing verification for /L/LM 2023-11-04T15:29:04.232 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap2 vs. snap3 diff listing verification for /L/LN 2023-11-04T15:29:04.814 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.SnapDiffCases2_3 (1030 ms) 2023-11-04T15:29:04.814 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.SnapDiffCases1_3 2023-11-04T15:29:05.220 INFO:tasks.workunit.client.0.smithi130.stdout:24 vs. 26 2023-11-04T15:29:05.220 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 vs. snap3 diff listing for / 2023-11-04T15:29:05.223 INFO:tasks.workunit.client.0.smithi130.stdout:C snap 24 2023-11-04T15:29:05.224 INFO:tasks.workunit.client.0.smithi130.stdout:H snap 26 2023-11-04T15:29:05.225 INFO:tasks.workunit.client.0.smithi130.stdout:L snap 26 2023-11-04T15:29:05.225 INFO:tasks.workunit.client.0.smithi130.stdout:S snap 26 2023-11-04T15:29:05.225 INFO:tasks.workunit.client.0.smithi130.stdout:ff snap 24 2023-11-04T15:29:05.226 INFO:tasks.workunit.client.0.smithi130.stdout:T snap 26 2023-11-04T15:29:05.226 INFO:tasks.workunit.client.0.smithi130.stdout:d snap 26 2023-11-04T15:29:05.227 INFO:tasks.workunit.client.0.smithi130.stdout:G snap 24 2023-11-04T15:29:05.228 INFO:tasks.workunit.client.0.smithi130.stdout:G snap 26 2023-11-04T15:29:05.228 INFO:tasks.workunit.client.0.smithi130.stdout:l snap 26 2023-11-04T15:29:05.228 INFO:tasks.workunit.client.0.smithi130.stdout:e snap 24 2023-11-04T15:29:05.228 INFO:tasks.workunit.client.0.smithi130.stdout:~e snap 24 2023-11-04T15:29:05.228 INFO:tasks.workunit.client.0.smithi130.stdout:g snap 26 2023-11-04T15:29:05.229 INFO:tasks.workunit.client.0.smithi130.stdout:c snap 24 2023-11-04T15:29:05.229 INFO:tasks.workunit.client.0.smithi130.stdout:b snap 26 2023-11-04T15:29:05.229 INFO:tasks.workunit.client.0.smithi130.stdout:f snap 24 2023-11-04T15:29:05.229 INFO:tasks.workunit.client.0.smithi130.stdout:I snap 26 2023-11-04T15:29:05.229 INFO:tasks.workunit.client.0.smithi130.stdout:a snap 26 2023-11-04T15:29:05.230 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap3 vs. snap1 diff listing verification for / 2023-11-04T15:29:05.231 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap3 vs. snap1 diff listing verification for /S 2023-11-04T15:29:05.235 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap3 vs. snap1 diff listing verification for /T 2023-11-04T15:29:05.239 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap3 vs. snap1 diff listing verification for /C 2023-11-04T15:29:05.243 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap3 vs. snap1 diff listing verification for /C/CC 2023-11-04T15:29:05.248 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 vs. snap3 diff listing verification for /G 2023-11-04T15:29:05.251 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap3 vs. snap1 diff listing verification for /G 2023-11-04T15:29:05.254 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 vs. snap3 diff listing verification for /H 2023-11-04T15:29:05.258 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 vs. snap3 diff listing verification for /I 2023-11-04T15:29:05.262 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 vs. snap3 diff listing verification for /I/J 2023-11-04T15:29:05.266 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 vs. snap3 diff listing verification for /L 2023-11-04T15:29:05.270 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 vs. snap3 diff listing verification for /L/LL 2023-11-04T15:29:05.273 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 vs. snap3 diff listing verification for /L/LN 2023-11-04T15:29:05.277 INFO:tasks.workunit.client.0.smithi130.stdout:------------- 2023-11-04T15:29:05.845 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.SnapDiffCases1_3 (1031 ms) 2023-11-04T15:29:05.846 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.HugeSnapDiffSmallDelta 2023-11-04T15:29:25.419 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:29:25.422 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:29:25.424 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:29:43.441 INFO:tasks.workunit.client.0.smithi130.stdout:Seeding 10000 files... 2023-11-04T15:29:43.442 INFO:tasks.workunit.client.0.smithi130.stdout:30 vs. 31 2023-11-04T15:29:43.442 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 vs. snap2 diff listing verification for / 2023-11-04T15:29:43.470 INFO:tasks.workunit.client.0.smithi130.stdout:------------- closing ------------- 2023-11-04T15:29:55.575 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:29:55.578 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:29:55.580 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:30:08.527 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.HugeSnapDiffSmallDelta (62682 ms) 2023-11-04T15:30:08.527 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.HugeSnapDiffLargeDelta 2023-11-04T15:30:25.672 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:30:25.675 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:30:25.677 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:30:56.068 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:30:56.071 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:30:56.074 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:31:26.338 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:31:26.341 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:31:26.343 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:31:56.683 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:31:56.686 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:31:56.689 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:32:26.769 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:32:26.772 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:32:26.775 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:32:35.384 INFO:tasks.workunit.client.0.smithi130.stdout:Seeding 15100 files... 2023-11-04T15:32:35.384 INFO:tasks.workunit.client.0.smithi130.stdout:34 vs. 35 2023-11-04T15:32:35.385 INFO:tasks.workunit.client.0.smithi130.stdout:---------snap1 vs. snap2 diff listing verification for / 2023-11-04T15:32:36.836 INFO:tasks.workunit.client.0.smithi130.stdout:------------- closing ------------- 2023-11-04T15:32:57.127 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:32:57.130 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:32:57.133 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:33:15.095 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.HugeSnapDiffLargeDelta (186568 ms) 2023-11-04T15:33:15.096 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.LayoutVerifyDefaultLayout 2023-11-04T15:33:15.201 INFO:tasks.workunit.client.0.smithi130.stderr:layout:{"stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_name": "cephfs_data", "pool_id": 4, "pool_namespace": "", "inheritance": "@default"} 2023-11-04T15:33:15.220 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.LayoutVerifyDefaultLayout (125 ms) 2023-11-04T15:33:15.220 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.LayoutSetAndVerifyNewAndInheritedLayout 2023-11-04T15:33:15.244 INFO:tasks.workunit.client.0.smithi130.stderr:layout:{"stripe_unit": 65536, "stripe_count": 1, "object_size": 65536, "pool_name": "cephfs_data", "pool_id": 4, "pool_namespace": "", "inheritance": "@set"} 2023-11-04T15:33:15.244 INFO:tasks.workunit.client.0.smithi130.stderr:layout:{"stripe_unit": 65536, "stripe_count": 1, "object_size": 65536, "pool_name": "cephfs_data", "pool_id": 4, "pool_namespace": "", "inheritance": "@inherited"} 2023-11-04T15:33:15.261 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.LayoutSetAndVerifyNewAndInheritedLayout (41 ms) 2023-11-04T15:33:15.261 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.LayoutSetBadJSON 2023-11-04T15:33:15.301 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.LayoutSetBadJSON (40 ms) 2023-11-04T15:33:15.302 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.LayoutSetBadPoolName 2023-11-04T15:33:15.336 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.LayoutSetBadPoolName (36 ms) 2023-11-04T15:33:15.337 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.LayoutSetBadPoolId 2023-11-04T15:33:15.436 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.LayoutSetBadPoolId (99 ms) 2023-11-04T15:33:15.436 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.LayoutSetInvalidFieldName 2023-11-04T15:33:15.706 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.LayoutSetInvalidFieldName (270 ms) 2023-11-04T15:33:15.706 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.GetAndSetDirPin 2023-11-04T15:33:15.803 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.GetAndSetDirPin (97 ms) 2023-11-04T15:33:15.803 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.GetAndSetDirDistribution 2023-11-04T15:33:15.911 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.GetAndSetDirDistribution (108 ms) 2023-11-04T15:33:15.911 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.GetAndSetDirRandom 2023-11-04T15:33:16.009 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.GetAndSetDirRandom (98 ms) 2023-11-04T15:33:16.009 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.DelegMultiClient 2023-11-04T15:33:16.305 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.DelegMultiClient (297 ms) 2023-11-04T15:33:16.306 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.DelegSingleClient 2023-11-04T15:33:16.517 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.DelegSingleClient (211 ms) 2023-11-04T15:33:16.517 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.DelegTimeout 2023-11-04T15:33:18.655 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.DelegTimeout (2139 ms) 2023-11-04T15:33:18.656 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.RecalledGetattr 2023-11-04T15:33:18.755 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.RecalledGetattr (100 ms) 2023-11-04T15:33:18.755 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.BasicRecordLocking 2023-11-04T15:33:18.801 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.BasicRecordLocking (45 ms) 2023-11-04T15:33:18.801 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.ConcurrentRecordLocking 2023-11-04T15:33:18.864 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.ConcurrentRecordLocking (63 ms) 2023-11-04T15:33:18.864 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.ThreesomeRecordLocking 2023-11-04T15:33:18.945 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.ThreesomeRecordLocking (82 ms) 2023-11-04T15:33:18.946 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.BasicLocking 2023-11-04T15:33:19.003 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.BasicLocking (58 ms) 2023-11-04T15:33:19.004 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.ConcurrentLocking 2023-11-04T15:33:19.078 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.ConcurrentLocking (74 ms) 2023-11-04T15:33:19.078 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.ThreesomeLocking 2023-11-04T15:33:19.156 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.ThreesomeLocking (79 ms) 2023-11-04T15:33:19.157 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.MulticlientSimple 2023-11-04T15:33:19.512 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.MulticlientSimple (355 ms) 2023-11-04T15:33:19.512 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.MulticlientHoleEOF 2023-11-04T15:33:19.615 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.MulticlientHoleEOF (103 ms) 2023-11-04T15:33:19.615 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.MulticlientRevokeCaps 2023-11-04T15:33:27.202 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:33:27.207 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:33:27.209 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:33:57.515 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:33:57.518 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:33:57.520 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:34:20.653 INFO:tasks.workunit.client.0.smithi130.stdout: Will run test for 60 seconds! 2023-11-04T15:34:20.653 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.MulticlientRevokeCaps (61038 ms) 2023-11-04T15:34:20.654 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.ReaddirRCB 2023-11-04T15:34:20.692 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.ReaddirRCB (39 ms) 2023-11-04T15:34:20.692 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.OpenEmptyComponent 2023-11-04T15:34:20.977 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.OpenEmptyComponent (285 ms) 2023-11-04T15:34:20.977 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.OpenReadTruncate 2023-11-04T15:34:21.778 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.OpenReadTruncate (801 ms) 2023-11-04T15:34:21.778 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.OpenReadWrite 2023-11-04T15:34:21.812 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.OpenReadWrite (34 ms) 2023-11-04T15:34:21.812 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.MountNonExist 2023-11-04T15:34:21.832 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.MountNonExist (20 ms) 2023-11-04T15:34:21.832 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.MountDouble 2023-11-04T15:34:21.851 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.MountDouble (19 ms) 2023-11-04T15:34:21.852 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.MountRemount 2023-11-04T15:34:22.880 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.MountRemount (1029 ms) 2023-11-04T15:34:22.880 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.UnmountUnmounted 2023-11-04T15:34:22.889 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.UnmountUnmounted (9 ms) 2023-11-04T15:34:22.889 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.ReleaseUnmounted 2023-11-04T15:34:22.898 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.ReleaseUnmounted (9 ms) 2023-11-04T15:34:22.898 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.ReleaseMounted 2023-11-04T15:34:23.915 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.ReleaseMounted (1018 ms) 2023-11-04T15:34:23.916 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.UnmountRelease 2023-11-04T15:34:24.934 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.UnmountRelease (1019 ms) 2023-11-04T15:34:24.935 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Mount 2023-11-04T15:34:26.972 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Mount (2037 ms) 2023-11-04T15:34:26.973 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.OpenLayout 2023-11-04T15:34:27.032 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.OpenLayout (60 ms) 2023-11-04T15:34:27.032 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.DirLs 2023-11-04T15:34:27.593 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:34:27.596 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:34:27.598 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:34:27.652 INFO:tasks.ceph.mds.a.smithi019.stderr:2023-11-04T15:34:27.650+0000 7f0e291c7640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 89341) UID: 0 2023-11-04T15:34:38.918 INFO:tasks.workunit.client.0.smithi130.stdout:rand: 3055 2023-11-04T15:34:38.918 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.DirLs (11886 ms) 2023-11-04T15:34:38.918 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.ManyNestedDirs 2023-11-04T15:34:39.458 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.ManyNestedDirs (541 ms) 2023-11-04T15:34:39.459 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Xattrs 2023-11-04T15:34:39.504 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_a 2023-11-04T15:34:39.504 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_b 2023-11-04T15:34:39.504 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_c 2023-11-04T15:34:39.505 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_d 2023-11-04T15:34:39.505 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_e 2023-11-04T15:34:39.505 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_f 2023-11-04T15:34:39.506 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_g 2023-11-04T15:34:39.506 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_h 2023-11-04T15:34:39.506 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_i 2023-11-04T15:34:39.506 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_j 2023-11-04T15:34:39.507 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_k 2023-11-04T15:34:39.507 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_l 2023-11-04T15:34:39.507 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_m 2023-11-04T15:34:39.507 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_n 2023-11-04T15:34:39.508 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_o 2023-11-04T15:34:39.508 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_p 2023-11-04T15:34:39.508 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_q 2023-11-04T15:34:39.508 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_r 2023-11-04T15:34:39.508 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_s 2023-11-04T15:34:39.509 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_t 2023-11-04T15:34:39.509 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_u 2023-11-04T15:34:39.509 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_v 2023-11-04T15:34:39.509 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_w 2023-11-04T15:34:39.510 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_x 2023-11-04T15:34:39.510 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_y 2023-11-04T15:34:39.510 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_z 2023-11-04T15:34:39.537 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Xattrs (78 ms) 2023-11-04T15:34:39.537 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Xattrs_ll 2023-11-04T15:34:39.560 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Xattrs_ll (23 ms) 2023-11-04T15:34:39.561 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.LstatSlashdot 2023-11-04T15:34:39.579 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.LstatSlashdot (20 ms) 2023-11-04T15:34:39.580 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.StatDirNlink 2023-11-04T15:34:39.624 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.StatDirNlink (44 ms) 2023-11-04T15:34:39.624 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.DoubleChmod 2023-11-04T15:34:39.651 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.DoubleChmod (27 ms) 2023-11-04T15:34:39.651 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Fchmod 2023-11-04T15:34:39.676 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Fchmod (26 ms) 2023-11-04T15:34:39.677 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Lchmod 2023-11-04T15:34:39.709 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Lchmod (33 ms) 2023-11-04T15:34:39.710 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Fchown 2023-11-04T15:34:39.778 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Fchown (68 ms) 2023-11-04T15:34:39.778 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.FlagO_PATH 2023-11-04T15:34:39.963 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.FlagO_PATH (185 ms) 2023-11-04T15:34:39.963 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Symlinks 2023-11-04T15:34:40.048 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Symlinks (85 ms) 2023-11-04T15:34:40.048 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.DirSyms 2023-11-04T15:34:40.254 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.DirSyms (206 ms) 2023-11-04T15:34:40.254 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.LoopSyms 2023-11-04T15:34:40.475 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.LoopSyms (221 ms) 2023-11-04T15:34:40.475 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.HardlinkNoOriginal 2023-11-04T15:34:40.743 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.HardlinkNoOriginal (269 ms) 2023-11-04T15:34:40.744 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.BadArgument 2023-11-04T15:34:40.845 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.BadArgument (102 ms) 2023-11-04T15:34:40.846 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.BadFileDesc 2023-11-04T15:34:40.884 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.BadFileDesc (38 ms) 2023-11-04T15:34:40.884 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.ReadEmptyFile 2023-11-04T15:34:40.947 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.ReadEmptyFile (63 ms) 2023-11-04T15:34:40.947 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.PreadvPwritev 2023-11-04T15:34:41.964 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.PreadvPwritev (1017 ms) 2023-11-04T15:34:41.965 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.LlreadvLlwritev 2023-11-04T15:34:41.997 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.LlreadvLlwritev (33 ms) 2023-11-04T15:34:41.997 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.StripeUnitGran 2023-11-04T15:34:42.017 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.StripeUnitGran (20 ms) 2023-11-04T15:34:42.018 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Rename 2023-11-04T15:34:42.052 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Rename (35 ms) 2023-11-04T15:34:42.052 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.UseUnmounted 2023-11-04T15:34:42.061 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.UseUnmounted (9 ms) 2023-11-04T15:34:42.061 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.GetPoolId 2023-11-04T15:34:42.080 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.GetPoolId (19 ms) 2023-11-04T15:34:42.080 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.GetPoolReplication 2023-11-04T15:34:42.099 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.GetPoolReplication (20 ms) 2023-11-04T15:34:42.100 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.GetExtentOsds 2023-11-04T15:34:42.122 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.GetExtentOsds (22 ms) 2023-11-04T15:34:42.122 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.GetOsdCrushLocation 2023-11-04T15:34:42.146 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.GetOsdCrushLocation (24 ms) 2023-11-04T15:34:42.146 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.GetOsdAddr 2023-11-04T15:34:42.166 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.GetOsdAddr (21 ms) 2023-11-04T15:34:42.167 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.OpenNoClose 2023-11-04T15:34:42.197 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.OpenNoClose (31 ms) 2023-11-04T15:34:42.198 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Nlink 2023-11-04T15:34:42.352 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Nlink (154 ms) 2023-11-04T15:34:42.353 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.SlashDotDot 2023-11-04T15:34:44.521 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.SlashDotDot (2169 ms) 2023-11-04T15:34:44.521 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Btime 2023-11-04T15:34:45.554 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Btime (1030 ms) 2023-11-04T15:34:45.554 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.SetBtime 2023-11-04T15:34:45.579 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.SetBtime (29 ms) 2023-11-04T15:34:45.580 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.LazyStatx 2023-11-04T15:34:46.632 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.LazyStatx (1053 ms) 2023-11-04T15:34:46.633 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.ChangeAttr 2023-11-04T15:34:46.668 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.ChangeAttr (35 ms) 2023-11-04T15:34:46.669 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.DirChangeAttrCreateFile 2023-11-04T15:34:46.717 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.DirChangeAttrCreateFile (49 ms) 2023-11-04T15:34:46.717 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.DirChangeAttrRenameFile 2023-11-04T15:34:46.890 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.DirChangeAttrRenameFile (174 ms) 2023-11-04T15:34:46.891 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.DirChangeAttrRemoveFile 2023-11-04T15:34:47.073 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.DirChangeAttrRemoveFile (183 ms) 2023-11-04T15:34:47.074 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.SetSize 2023-11-04T15:34:47.229 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.SetSize (155 ms) 2023-11-04T15:34:47.229 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.OperationsOnRoot 2023-11-04T15:34:47.254 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.OperationsOnRoot (25 ms) 2023-11-04T15:34:47.254 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.ShutdownRace 2023-11-04T15:34:47.255 INFO:tasks.workunit.client.0.smithi130.stdout:Setting RLIMIT_NOFILE from 1024 to 16384 2023-11-04T15:35:20.082 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.ShutdownRace (32827 ms) 2023-11-04T15:35:20.082 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.TestUtime 2023-11-04T15:35:20.116 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.TestUtime (35 ms) 2023-11-04T15:35:20.116 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.TestUtimes 2023-11-04T15:35:20.158 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.TestUtimes (42 ms) 2023-11-04T15:35:20.159 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.TestFutimens 2023-11-04T15:35:20.194 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.TestFutimens (36 ms) 2023-11-04T15:35:20.194 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.OperationsOnDotDot 2023-11-04T15:35:20.231 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.OperationsOnDotDot (38 ms) 2023-11-04T15:35:20.232 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Caps_vxattr 2023-11-04T15:35:20.257 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Caps_vxattr (25 ms) 2023-11-04T15:35:20.257 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.SnapXattrs 2023-11-04T15:35:21.274 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.SnapXattrs (1018 ms) 2023-11-04T15:35:21.275 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Lseek 2023-11-04T15:35:21.310 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Lseek (36 ms) 2023-11-04T15:35:21.311 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.SnapInfoOnNonSnapshot 2023-11-04T15:35:22.329 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.SnapInfoOnNonSnapshot (1019 ms) 2023-11-04T15:35:22.330 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.EmptySnapInfo 2023-11-04T15:35:23.348 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.EmptySnapInfo (1018 ms) 2023-11-04T15:35:23.348 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.SnapInfo 2023-11-04T15:35:24.367 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.SnapInfo (1020 ms) 2023-11-04T15:35:24.368 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.LookupInoMDSDir 2023-11-04T15:35:24.389 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.LookupInoMDSDir (22 ms) 2023-11-04T15:35:24.390 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.LookupVino 2023-11-04T15:35:26.451 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.LookupVino (2062 ms) 2023-11-04T15:35:26.452 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Openat 2023-11-04T15:35:26.504 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Openat (52 ms) 2023-11-04T15:35:26.504 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Statxat 2023-11-04T15:35:26.686 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Statxat (182 ms) 2023-11-04T15:35:26.686 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.StatxatATFDCWD 2023-11-04T15:35:26.858 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.StatxatATFDCWD (172 ms) 2023-11-04T15:35:26.858 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Fdopendir 2023-11-04T15:35:27.066 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Fdopendir (208 ms) 2023-11-04T15:35:27.066 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.FdopendirATFDCWD 2023-11-04T15:35:27.260 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.FdopendirATFDCWD (194 ms) 2023-11-04T15:35:27.260 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.FdopendirReaddirTestWithDelete 2023-11-04T15:35:27.481 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.FdopendirReaddirTestWithDelete (221 ms) 2023-11-04T15:35:27.481 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.FdopendirOnNonDir 2023-11-04T15:35:27.688 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.FdopendirOnNonDir (208 ms) 2023-11-04T15:35:27.689 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Mkdirat 2023-11-04T15:35:27.864 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Mkdirat (175 ms) 2023-11-04T15:35:27.864 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.MkdiratATFDCWD 2023-11-04T15:35:27.907 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.MkdiratATFDCWD (43 ms) 2023-11-04T15:35:27.907 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Readlinkat 2023-11-04T15:35:27.955 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Readlinkat (48 ms) 2023-11-04T15:35:27.955 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.ReadlinkatATFDCWD 2023-11-04T15:35:28.125 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.ReadlinkatATFDCWD (169 ms) 2023-11-04T15:35:28.125 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Symlinkat 2023-11-04T15:35:28.308 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Symlinkat (183 ms) 2023-11-04T15:35:28.309 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.SymlinkatATFDCWD 2023-11-04T15:35:28.486 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.SymlinkatATFDCWD (178 ms) 2023-11-04T15:35:28.486 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Unlinkat 2023-11-04T15:35:28.636 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Unlinkat (150 ms) 2023-11-04T15:35:28.636 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.UnlinkatATFDCWD 2023-11-04T15:35:28.796 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.UnlinkatATFDCWD (160 ms) 2023-11-04T15:35:28.796 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Chownat 2023-11-04T15:35:28.941 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Chownat (145 ms) 2023-11-04T15:35:28.941 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.ChownatATFDCWD 2023-11-04T15:35:29.141 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.ChownatATFDCWD (200 ms) 2023-11-04T15:35:29.142 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Chmodat 2023-11-04T15:35:29.309 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Chmodat (168 ms) 2023-11-04T15:35:29.309 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.ChmodatATFDCWD 2023-11-04T15:35:29.484 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.ChmodatATFDCWD (175 ms) 2023-11-04T15:35:29.484 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Utimensat 2023-11-04T15:35:31.791 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Utimensat (2307 ms) 2023-11-04T15:35:31.792 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.UtimensatATFDCWD 2023-11-04T15:35:31.962 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.UtimensatATFDCWD (172 ms) 2023-11-04T15:35:31.963 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.LookupMdsPrivateInos 2023-11-04T15:35:32.338 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.LookupMdsPrivateInos (375 ms) 2023-11-04T15:35:32.338 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.SetMountTimeoutPostMount 2023-11-04T15:35:32.356 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.SetMountTimeoutPostMount (18 ms) 2023-11-04T15:35:32.356 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.SetMountTimeout 2023-11-04T15:35:33.373 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.SetMountTimeout (1017 ms) 2023-11-04T15:35:33.373 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.FsCrypt 2023-11-04T15:35:34.408 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.FsCrypt (1035 ms) 2023-11-04T15:35:34.408 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.SnapdirAttrs 2023-11-04T15:35:35.427 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.SnapdirAttrs (1019 ms) 2023-11-04T15:35:35.428 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.SnapdirAttrsOnSnapCreate 2023-11-04T15:35:36.446 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.SnapdirAttrsOnSnapCreate (1019 ms) 2023-11-04T15:35:36.447 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.SnapdirAttrsOnSnapDelete 2023-11-04T15:35:37.465 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.SnapdirAttrsOnSnapDelete (1018 ms) 2023-11-04T15:35:37.465 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.SnapdirAttrsOnSnapRename 2023-11-04T15:35:38.484 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.SnapdirAttrsOnSnapRename (1019 ms) 2023-11-04T15:35:38.484 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 124 tests from LibCephFS (415809 ms total) 2023-11-04T15:35:38.485 INFO:tasks.workunit.client.0.smithi130.stdout: 2023-11-04T15:35:38.485 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 3 tests from MonConfig 2023-11-04T15:35:38.485 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] MonConfig.MonAddrsMissing 2023-11-04T15:35:38.493 INFO:tasks.workunit.client.0.smithi130.stderr:failed to get an address for mon.a: error -2 2023-11-04T15:35:38.493 INFO:tasks.workunit.client.0.smithi130.stderr:failed to get an address for mon.b: error -2 2023-11-04T15:35:38.494 INFO:tasks.workunit.client.0.smithi130.stderr:failed to get an address for mon.c: error -2 2023-11-04T15:35:38.522 INFO:tasks.workunit.client.0.smithi130.stderr:unable to get monitor info from DNS SRV with service name: ceph-mon 2023-11-04T15:35:38.523 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] MonConfig.MonAddrsMissing (39 ms) 2023-11-04T15:35:38.523 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] MonConfig.MonAddrsInConfigProxy 2023-11-04T15:35:39.541 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] MonConfig.MonAddrsInConfigProxy (1018 ms) 2023-11-04T15:35:39.541 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] MonConfig.MonAddrsInCct 2023-11-04T15:35:40.572 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] MonConfig.MonAddrsInCct (1031 ms) 2023-11-04T15:35:40.572 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 3 tests from MonConfig (2088 ms total) 2023-11-04T15:35:40.572 INFO:tasks.workunit.client.0.smithi130.stdout: 2023-11-04T15:35:40.573 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 5 tests from ACL 2023-11-04T15:35:40.573 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] ACL.SetACL 2023-11-04T15:35:40.603 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] ACL.SetACL (31 ms) 2023-11-04T15:35:40.603 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] ACL.Chmod 2023-11-04T15:35:40.634 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] ACL.Chmod (31 ms) 2023-11-04T15:35:40.634 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] ACL.DefaultACL 2023-11-04T15:35:40.691 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] ACL.DefaultACL (57 ms) 2023-11-04T15:35:40.691 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] ACL.Disabled 2023-11-04T15:35:40.818 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] ACL.Disabled (127 ms) 2023-11-04T15:35:40.818 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] ACL.SnapdirACL 2023-11-04T15:35:41.833 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] ACL.SnapdirACL (1015 ms) 2023-11-04T15:35:41.834 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 5 tests from ACL (1261 ms total) 2023-11-04T15:35:41.834 INFO:tasks.workunit.client.0.smithi130.stdout: 2023-11-04T15:35:41.834 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 1 test from Caps 2023-11-04T15:35:41.834 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] Caps.ReadZero 2023-11-04T15:35:42.058 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] Caps.ReadZero (224 ms) 2023-11-04T15:35:42.059 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 1 test from Caps (224 ms total) 2023-11-04T15:35:42.059 INFO:tasks.workunit.client.0.smithi130.stdout: 2023-11-04T15:35:42.059 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment tear-down 2023-11-04T15:35:42.059 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] 133 tests from 4 test suites ran. (419383 ms total) 2023-11-04T15:35:42.059 INFO:tasks.workunit.client.0.smithi130.stdout:[ PASSED ] 133 tests. 2023-11-04T15:35:42.060 INFO:tasks.workunit.client.0.smithi130.stdout: 2023-11-04T15:35:42.060 INFO:tasks.workunit.client.0.smithi130.stdout: YOU HAVE 4 DISABLED TESTS 2023-11-04T15:35:42.060 INFO:tasks.workunit.client.0.smithi130.stdout: 2023-11-04T15:35:42.211 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] Running 98 tests from 2 test suites. 2023-11-04T15:35:42.211 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment set-up. 2023-11-04T15:35:42.212 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 4 tests from AccessTest 2023-11-04T15:35:42.212 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] AccessTest.Foo 2023-11-04T15:35:42.237 INFO:tasks.workunit.client.0.smithi130.stdout:out: [{"entity":"client.libcephfs_foo_test.1785236898","key":"AQDOZEZlzczrDRAA6qzJJOxS+dgNCB9M3x0nwA==","caps":{"mds":"allow rw","mon":"allow *","osd":"allow rw"}}] 2023-11-04T15:35:42.238 INFO:tasks.workunit.client.0.smithi130.stdout:key: AQDOZEZlzczrDRAA6qzJJOxS+dgNCB9M3x0nwA== 2023-11-04T15:35:43.264 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] AccessTest.Foo (1054 ms) 2023-11-04T15:35:43.265 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] AccessTest.Path 2023-11-04T15:35:43.301 INFO:tasks.workunit.client.0.smithi130.stdout:out: [{"entity":"client.libcephfs_path_test.2040477908","key":"AQDPZEZlVemfERAAulqf4AfuFt4k05WgmkwMhg==","caps":{"mds":"allow r, allow rw path=/ceph_test_libcephfs_access.597221372","mon":"allow r","osd":"allow rwx"}}] 2023-11-04T15:35:43.302 INFO:tasks.workunit.client.0.smithi130.stdout:key: AQDPZEZlVemfERAAulqf4AfuFt4k05WgmkwMhg== 2023-11-04T15:35:44.516 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] AccessTest.Path (1251 ms) 2023-11-04T15:35:44.516 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] AccessTest.ReadOnly 2023-11-04T15:35:44.675 INFO:tasks.workunit.client.0.smithi130.stdout:out: [{"entity":"client.libcephfs_readonly_test.538417113","key":"AQDQZEZl+kX5JxAAVY2i8GQYu5QxiaX98R/N/A==","caps":{"mds":"allow r","mon":"allow r","osd":"allow rw"}}] 2023-11-04T15:35:44.675 INFO:tasks.workunit.client.0.smithi130.stdout:key: AQDQZEZl+kX5JxAAVY2i8GQYu5QxiaX98R/N/A== 2023-11-04T15:35:44.738 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] AccessTest.ReadOnly (222 ms) 2023-11-04T15:35:44.738 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] AccessTest.User 2023-11-04T15:35:44.902 INFO:tasks.workunit.client.0.smithi130.stdout:out: [{"entity":"client.libcephfs_user_test.1397109406","key":"AQDQZEZlqr9qNRAAAkjqcmKuzTRfJfdWPISjlA==","caps":{"mds":"allow rw uid=123 gids=456,789","mon":"allow *","osd":"allow rw"}}] 2023-11-04T15:35:44.902 INFO:tasks.workunit.client.0.smithi130.stdout:key: AQDQZEZlqr9qNRAAAkjqcmKuzTRfJfdWPISjlA== 2023-11-04T15:35:45.055 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] AccessTest.User (317 ms) 2023-11-04T15:35:45.056 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 4 tests from AccessTest (2844 ms total) 2023-11-04T15:35:45.056 INFO:tasks.workunit.client.0.smithi130.stdout: 2023-11-04T15:35:45.056 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 94 tests from LibCephFS 2023-11-04T15:35:45.056 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.OpenEmptyComponent 2023-11-04T15:35:45.247 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.OpenEmptyComponent (192 ms) 2023-11-04T15:35:45.247 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.OpenReadTruncate 2023-11-04T15:35:46.778 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.OpenReadTruncate (1532 ms) 2023-11-04T15:35:46.779 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.OpenReadWrite 2023-11-04T15:35:46.815 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.OpenReadWrite (36 ms) 2023-11-04T15:35:46.815 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.MountNonExist 2023-11-04T15:35:46.836 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.MountNonExist (21 ms) 2023-11-04T15:35:46.836 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.MountDouble 2023-11-04T15:35:47.854 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.MountDouble (1018 ms) 2023-11-04T15:35:47.854 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.MountRemount 2023-11-04T15:35:48.884 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.MountRemount (1030 ms) 2023-11-04T15:35:48.885 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.UnmountUnmounted 2023-11-04T15:35:48.893 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.UnmountUnmounted (9 ms) 2023-11-04T15:35:48.893 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.ReleaseUnmounted 2023-11-04T15:35:48.901 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.ReleaseUnmounted (9 ms) 2023-11-04T15:35:48.901 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.ReleaseMounted 2023-11-04T15:35:49.921 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.ReleaseMounted (1019 ms) 2023-11-04T15:35:49.922 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.UnmountRelease 2023-11-04T15:35:50.944 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.UnmountRelease (1021 ms) 2023-11-04T15:35:50.945 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Mount 2023-11-04T15:35:52.980 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Mount (2038 ms) 2023-11-04T15:35:52.980 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.OpenLayout 2023-11-04T15:35:53.025 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.OpenLayout (45 ms) 2023-11-04T15:35:53.025 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.DirLs 2023-11-04T15:35:55.488 INFO:tasks.workunit.client.0.smithi130.stdout:rand: 552 2023-11-04T15:35:55.488 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.DirLs (2463 ms) 2023-11-04T15:35:55.488 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.ManyNestedDirs 2023-11-04T15:35:56.149 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.ManyNestedDirs (661 ms) 2023-11-04T15:35:56.149 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Xattrs 2023-11-04T15:35:56.198 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_a 2023-11-04T15:35:56.198 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_b 2023-11-04T15:35:56.199 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_c 2023-11-04T15:35:56.199 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_d 2023-11-04T15:35:56.199 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_e 2023-11-04T15:35:56.199 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_f 2023-11-04T15:35:56.199 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_g 2023-11-04T15:35:56.200 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_h 2023-11-04T15:35:56.200 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_i 2023-11-04T15:35:56.200 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_j 2023-11-04T15:35:56.200 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_k 2023-11-04T15:35:56.200 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_l 2023-11-04T15:35:56.201 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_m 2023-11-04T15:35:56.201 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_n 2023-11-04T15:35:56.201 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_o 2023-11-04T15:35:56.201 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_p 2023-11-04T15:35:56.201 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_q 2023-11-04T15:35:56.202 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_r 2023-11-04T15:35:56.202 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_s 2023-11-04T15:35:56.202 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_t 2023-11-04T15:35:56.202 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_u 2023-11-04T15:35:56.202 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_v 2023-11-04T15:35:56.203 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_w 2023-11-04T15:35:56.203 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_x 2023-11-04T15:35:56.203 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_y 2023-11-04T15:35:56.203 INFO:tasks.workunit.client.0.smithi130.stdout:getting attr user.test_xattr_z 2023-11-04T15:35:56.231 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Xattrs (82 ms) 2023-11-04T15:35:56.231 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Xattrs_ll 2023-11-04T15:35:56.252 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Xattrs_ll (21 ms) 2023-11-04T15:35:56.252 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.LstatSlashdot 2023-11-04T15:35:56.269 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.LstatSlashdot (17 ms) 2023-11-04T15:35:56.269 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.StatDirNlink 2023-11-04T15:35:56.310 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.StatDirNlink (41 ms) 2023-11-04T15:35:56.310 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.DoubleChmod 2023-11-04T15:35:57.328 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.DoubleChmod (1019 ms) 2023-11-04T15:35:57.329 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Fchmod 2023-11-04T15:35:57.363 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Fchmod (34 ms) 2023-11-04T15:35:57.363 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Lchmod 2023-11-04T15:35:57.399 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Lchmod (37 ms) 2023-11-04T15:35:57.400 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Fchown 2023-11-04T15:35:57.426 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Fchown (27 ms) 2023-11-04T15:35:57.427 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.FlagO_PATH 2023-11-04T15:35:57.450 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.FlagO_PATH (23 ms) 2023-11-04T15:35:57.451 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Symlinks 2023-11-04T15:35:57.485 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Symlinks (36 ms) 2023-11-04T15:35:57.486 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.DirSyms 2023-11-04T15:35:57.611 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.DirSyms (125 ms) 2023-11-04T15:35:57.611 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.LoopSyms 2023-11-04T15:35:57.697 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.LoopSyms (86 ms) 2023-11-04T15:35:57.698 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.HardlinkNoOriginal 2023-11-04T15:35:57.828 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.HardlinkNoOriginal (130 ms) 2023-11-04T15:35:57.828 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.BadArgument 2023-11-04T15:35:57.866 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.BadArgument (39 ms) 2023-11-04T15:35:57.867 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.BadFileDesc 2023-11-04T15:35:57.887 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.BadFileDesc (20 ms) 2023-11-04T15:35:57.888 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.ReadEmptyFile 2023-11-04T15:35:57.988 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.ReadEmptyFile (101 ms) 2023-11-04T15:35:57.988 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.PreadvPwritev 2023-11-04T15:35:59.004 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.PreadvPwritev (1017 ms) 2023-11-04T15:35:59.005 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.LlreadvLlwritev 2023-11-04T15:35:59.039 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.LlreadvLlwritev (34 ms) 2023-11-04T15:35:59.039 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.StripeUnitGran 2023-11-04T15:36:00.056 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.StripeUnitGran (1017 ms) 2023-11-04T15:36:00.056 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Rename 2023-11-04T15:36:00.092 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Rename (36 ms) 2023-11-04T15:36:00.092 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.UseUnmounted 2023-11-04T15:36:00.101 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.UseUnmounted (9 ms) 2023-11-04T15:36:00.101 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.GetPoolId 2023-11-04T15:36:00.120 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.GetPoolId (19 ms) 2023-11-04T15:36:00.120 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.GetPoolReplication 2023-11-04T15:36:01.137 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.GetPoolReplication (1017 ms) 2023-11-04T15:36:01.137 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.GetExtentOsds 2023-11-04T15:36:01.163 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.GetExtentOsds (26 ms) 2023-11-04T15:36:01.163 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.GetOsdCrushLocation 2023-11-04T15:36:01.186 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.GetOsdCrushLocation (23 ms) 2023-11-04T15:36:01.186 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.GetOsdAddr 2023-11-04T15:36:01.206 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.GetOsdAddr (20 ms) 2023-11-04T15:36:01.206 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.OpenNoClose 2023-11-04T15:36:01.247 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.OpenNoClose (42 ms) 2023-11-04T15:36:01.248 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Nlink 2023-11-04T15:36:01.367 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Nlink (120 ms) 2023-11-04T15:36:01.368 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.SlashDotDot 2023-11-04T15:36:03.451 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.SlashDotDot (2083 ms) 2023-11-04T15:36:03.452 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Btime 2023-11-04T15:36:04.479 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Btime (1028 ms) 2023-11-04T15:36:04.479 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.SetBtime 2023-11-04T15:36:04.506 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.SetBtime (27 ms) 2023-11-04T15:36:04.506 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.LazyStatx 2023-11-04T15:36:05.556 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.LazyStatx (1050 ms) 2023-11-04T15:36:05.557 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.ChangeAttr 2023-11-04T15:36:05.588 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.ChangeAttr (32 ms) 2023-11-04T15:36:05.588 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.DirChangeAttrCreateFile 2023-11-04T15:36:05.633 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.DirChangeAttrCreateFile (45 ms) 2023-11-04T15:36:05.634 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.DirChangeAttrRenameFile 2023-11-04T15:36:05.786 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.DirChangeAttrRenameFile (153 ms) 2023-11-04T15:36:05.786 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.DirChangeAttrRemoveFile 2023-11-04T15:36:05.997 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.DirChangeAttrRemoveFile (211 ms) 2023-11-04T15:36:05.997 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.SetSize 2023-11-04T15:36:06.166 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.SetSize (167 ms) 2023-11-04T15:36:06.166 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.OperationsOnRoot 2023-11-04T15:36:06.190 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.OperationsOnRoot (27 ms) 2023-11-04T15:36:06.193 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.ShutdownRace 2023-11-04T15:36:06.194 INFO:tasks.workunit.client.0.smithi130.stdout:Setting RLIMIT_NOFILE from 1024 to 16384 2023-11-04T15:36:39.244 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.ShutdownRace (33053 ms) 2023-11-04T15:36:39.244 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.TestUtime 2023-11-04T15:36:39.277 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.TestUtime (33 ms) 2023-11-04T15:36:39.277 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.TestUtimes 2023-11-04T15:36:39.318 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.TestUtimes (42 ms) 2023-11-04T15:36:39.319 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.TestFutimens 2023-11-04T15:36:39.353 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.TestFutimens (35 ms) 2023-11-04T15:36:39.354 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.OperationsOnDotDot 2023-11-04T15:36:39.391 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.OperationsOnDotDot (37 ms) 2023-11-04T15:36:39.391 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Caps_vxattr 2023-11-04T15:36:39.415 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Caps_vxattr (25 ms) 2023-11-04T15:36:39.416 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.SnapXattrs 2023-11-04T15:36:40.433 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.SnapXattrs (1018 ms) 2023-11-04T15:36:40.434 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Lseek 2023-11-04T15:36:40.471 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Lseek (37 ms) 2023-11-04T15:36:40.471 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.SnapInfoOnNonSnapshot 2023-11-04T15:36:41.490 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.SnapInfoOnNonSnapshot (1019 ms) 2023-11-04T15:36:41.490 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.EmptySnapInfo 2023-11-04T15:36:42.510 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.EmptySnapInfo (1020 ms) 2023-11-04T15:36:42.511 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.SnapInfo 2023-11-04T15:36:43.530 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.SnapInfo (1021 ms) 2023-11-04T15:36:43.531 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.LookupInoMDSDir 2023-11-04T15:36:43.553 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.LookupInoMDSDir (22 ms) 2023-11-04T15:36:43.553 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.LookupVino 2023-11-04T15:36:45.602 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.LookupVino (2049 ms) 2023-11-04T15:36:45.602 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Openat 2023-11-04T15:36:45.659 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Openat (57 ms) 2023-11-04T15:36:45.659 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Statxat 2023-11-04T15:36:45.839 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Statxat (180 ms) 2023-11-04T15:36:45.839 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.StatxatATFDCWD 2023-11-04T15:36:46.012 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.StatxatATFDCWD (173 ms) 2023-11-04T15:36:46.012 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Fdopendir 2023-11-04T15:36:46.183 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Fdopendir (172 ms) 2023-11-04T15:36:46.184 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.FdopendirATFDCWD 2023-11-04T15:36:46.345 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.FdopendirATFDCWD (161 ms) 2023-11-04T15:36:46.345 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.FdopendirReaddirTestWithDelete 2023-11-04T15:36:46.514 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.FdopendirReaddirTestWithDelete (170 ms) 2023-11-04T15:36:46.515 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.FdopendirOnNonDir 2023-11-04T15:36:46.676 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.FdopendirOnNonDir (161 ms) 2023-11-04T15:36:46.676 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Mkdirat 2023-11-04T15:36:46.855 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Mkdirat (179 ms) 2023-11-04T15:36:46.855 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.MkdiratATFDCWD 2023-11-04T15:36:46.895 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.MkdiratATFDCWD (41 ms) 2023-11-04T15:36:46.896 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Readlinkat 2023-11-04T15:36:46.937 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Readlinkat (41 ms) 2023-11-04T15:36:46.937 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.ReadlinkatATFDCWD 2023-11-04T15:36:47.102 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.ReadlinkatATFDCWD (165 ms) 2023-11-04T15:36:47.102 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Symlinkat 2023-11-04T15:36:47.262 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Symlinkat (161 ms) 2023-11-04T15:36:47.263 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.SymlinkatATFDCWD 2023-11-04T15:36:47.439 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.SymlinkatATFDCWD (176 ms) 2023-11-04T15:36:47.440 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Unlinkat 2023-11-04T15:36:47.620 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Unlinkat (180 ms) 2023-11-04T15:36:47.620 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.UnlinkatATFDCWD 2023-11-04T15:36:47.778 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.UnlinkatATFDCWD (158 ms) 2023-11-04T15:36:47.778 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Chownat 2023-11-04T15:36:47.958 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Chownat (180 ms) 2023-11-04T15:36:47.958 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.ChownatATFDCWD 2023-11-04T15:36:48.116 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.ChownatATFDCWD (158 ms) 2023-11-04T15:36:48.116 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Chmodat 2023-11-04T15:36:48.297 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Chmodat (181 ms) 2023-11-04T15:36:48.297 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.ChmodatATFDCWD 2023-11-04T15:36:48.476 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.ChmodatATFDCWD (179 ms) 2023-11-04T15:36:48.476 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.Utimensat 2023-11-04T15:36:48.648 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.Utimensat (173 ms) 2023-11-04T15:36:48.649 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.UtimensatATFDCWD 2023-11-04T15:36:48.815 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.UtimensatATFDCWD (167 ms) 2023-11-04T15:36:48.816 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.LookupMdsPrivateInos 2023-11-04T15:36:49.199 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.LookupMdsPrivateInos (383 ms) 2023-11-04T15:36:49.199 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.SetMountTimeoutPostMount 2023-11-04T15:36:49.218 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.SetMountTimeoutPostMount (20 ms) 2023-11-04T15:36:49.219 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.SetMountTimeout 2023-11-04T15:36:50.241 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.SetMountTimeout (1022 ms) 2023-11-04T15:36:50.241 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.FsCrypt 2023-11-04T15:36:51.283 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.FsCrypt (1043 ms) 2023-11-04T15:36:51.284 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.SnapdirAttrs 2023-11-04T15:36:52.302 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.SnapdirAttrs (1019 ms) 2023-11-04T15:36:52.303 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.SnapdirAttrsOnSnapCreate 2023-11-04T15:36:53.323 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.SnapdirAttrsOnSnapCreate (1020 ms) 2023-11-04T15:36:53.323 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.SnapdirAttrsOnSnapDelete 2023-11-04T15:36:54.342 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.SnapdirAttrsOnSnapDelete (1019 ms) 2023-11-04T15:36:54.342 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.SnapdirAttrsOnSnapRename 2023-11-04T15:36:55.362 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.SnapdirAttrsOnSnapRename (1020 ms) 2023-11-04T15:36:55.362 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 94 tests from LibCephFS (70307 ms total) 2023-11-04T15:36:55.362 INFO:tasks.workunit.client.0.smithi130.stdout: 2023-11-04T15:36:55.362 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment tear-down 2023-11-04T15:36:55.363 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] 98 tests from 2 test suites ran. (73151 ms total) 2023-11-04T15:36:55.363 INFO:tasks.workunit.client.0.smithi130.stdout:[ PASSED ] 98 tests. 2023-11-04T15:36:55.411 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] Running 1 test from 1 test suite. 2023-11-04T15:36:55.411 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment set-up. 2023-11-04T15:36:55.411 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 1 test from LibCephFS 2023-11-04T15:36:55.412 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.ReclaimReset 2023-11-04T15:36:57.787 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.ReclaimReset (2376 ms) 2023-11-04T15:36:57.787 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 1 test from LibCephFS (2376 ms total) 2023-11-04T15:36:57.788 INFO:tasks.workunit.client.0.smithi130.stdout: 2023-11-04T15:36:57.788 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment tear-down 2023-11-04T15:36:57.788 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] 1 test from 1 test suite ran. (2376 ms total) 2023-11-04T15:36:57.788 INFO:tasks.workunit.client.0.smithi130.stdout:[ PASSED ] 1 test. 2023-11-04T15:36:57.846 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] Running 5 tests from 1 test suite. 2023-11-04T15:36:57.847 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment set-up. 2023-11-04T15:36:57.847 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 5 tests from LibCephFS 2023-11-04T15:36:57.847 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.LazyIOOneWriterMulipleReaders 2023-11-04T15:36:57.923 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.LazyIOOneWriterMulipleReaders (77 ms) 2023-11-04T15:36:57.924 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.LazyIOMultipleWritersMulipleReaders 2023-11-04T15:36:58.005 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.LazyIOMultipleWritersMulipleReaders (81 ms) 2023-11-04T15:36:58.005 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.LazyIOMultipleWritersOneReader 2023-11-04T15:36:58.076 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.LazyIOMultipleWritersOneReader (71 ms) 2023-11-04T15:36:58.077 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.LazyIOSynchronizeFlush 2023-11-04T15:36:58.150 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.LazyIOSynchronizeFlush (75 ms) 2023-11-04T15:36:58.151 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.WithoutandWithLazyIO 2023-11-04T15:36:58.229 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.WithoutandWithLazyIO (78 ms) 2023-11-04T15:36:58.229 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 5 tests from LibCephFS (382 ms total) 2023-11-04T15:36:58.230 INFO:tasks.workunit.client.0.smithi130.stdout: 2023-11-04T15:36:58.230 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment tear-down 2023-11-04T15:36:58.230 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] 5 tests from 1 test suite ran. (382 ms total) 2023-11-04T15:36:58.230 INFO:tasks.workunit.client.0.smithi130.stdout:[ PASSED ] 5 tests. 2023-11-04T15:36:58.268 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] Running 1 test from 1 test suite. 2023-11-04T15:36:58.268 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment set-up. 2023-11-04T15:36:58.269 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 1 test from LibCephFS 2023-11-04T15:36:58.269 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.NewOPs 2023-11-04T15:36:58.299 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.NewOPs (32 ms) 2023-11-04T15:36:58.300 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 1 test from LibCephFS (32 ms total) 2023-11-04T15:36:58.300 INFO:tasks.workunit.client.0.smithi130.stdout: 2023-11-04T15:36:58.300 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment tear-down 2023-11-04T15:36:58.300 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] 1 test from 1 test suite ran. (32 ms total) 2023-11-04T15:36:58.301 INFO:tasks.workunit.client.0.smithi130.stdout:[ PASSED ] 1 test. 2023-11-04T15:36:58.351 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] Running 2 tests from 2 test suites. 2023-11-04T15:36:58.351 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment set-up. 2023-11-04T15:36:58.351 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 1 test from SuidsgidTest 2023-11-04T15:36:58.351 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] SuidsgidTest.WriteClearSetuid 2023-11-04T15:36:58.375 INFO:tasks.workunit.client.0.smithi130.stdout:out: [{"entity":"client.clear_suidsgid_903757981","key":"AQAaZUZlY0sfFhAATRQs01gQYtRGk+odph+Bhw==","caps":{"mds":"allow *","mgr":"allow *","mon":"allow *","osd":"allow *"}}] 2023-11-04T15:36:58.375 INFO:tasks.workunit.client.0.smithi130.stdout:key: AQAaZUZlY0sfFhAATRQs01gQYtRGk+odph+Bhw== 2023-11-04T15:36:58.404 INFO:tasks.workunit.client.0.smithi130.stdout:After ceph_fallocate, mode: 06666 -> 0666 2023-11-04T15:36:58.418 INFO:tasks.workunit.client.0.smithi130.stdout:After ceph_fallocate, mode: 06676 -> 0676 2023-11-04T15:36:58.431 INFO:tasks.workunit.client.0.smithi130.stdout:After ceph_fallocate, mode: 06766 -> 0766 2023-11-04T15:36:58.445 INFO:tasks.workunit.client.0.smithi130.stdout:After ceph_fallocate, mode: 06777 -> 0777 2023-11-04T15:36:58.460 INFO:tasks.workunit.client.0.smithi130.stdout:After ceph_fallocate, mode: 06666 -> 06666 2023-11-04T15:36:58.463 INFO:tasks.workunit.client.0.smithi130.stdout:After ceph_fallocate, mode: 06676 -> 06676 2023-11-04T15:36:58.466 INFO:tasks.workunit.client.0.smithi130.stdout:After ceph_fallocate, mode: 06766 -> 06766 2023-11-04T15:36:58.470 INFO:tasks.workunit.client.0.smithi130.stdout:After ceph_fallocate, mode: 06777 -> 06777 2023-11-04T15:36:58.483 INFO:tasks.workunit.client.0.smithi130.stdout:After ceph_fallocate, mode: 02676 -> 0676 2023-11-04T15:36:58.497 INFO:tasks.workunit.client.0.smithi130.stdout:After ceph_fallocate, mode: 02777 -> 0777 2023-11-04T15:36:58.508 INFO:tasks.workunit.client.0.smithi130.stdout:After ceph_write, mode: 06766 -> 06766 2023-11-04T15:36:58.519 INFO:tasks.workunit.client.0.smithi130.stdout:After ceph_write, mode: 06766 -> 0766 2023-11-04T15:36:58.535 INFO:tasks.workunit.client.0.smithi130.stdout:After ceph_truncate size 10000 mode: 06766 -> 06766 2023-11-04T15:36:58.550 INFO:tasks.workunit.client.0.smithi130.stdout:After ceph_truncate size 100 mode: 06766 -> 0766 2023-11-04T15:36:58.563 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] SuidsgidTest.WriteClearSetuid (213 ms) 2023-11-04T15:36:58.563 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 1 test from SuidsgidTest (213 ms total) 2023-11-04T15:36:58.564 INFO:tasks.workunit.client.0.smithi130.stdout: 2023-11-04T15:36:58.564 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 1 test from LibCephFS 2023-11-04T15:36:58.564 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibCephFS.ChownClearSetuid 2023-11-04T15:36:58.593 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibCephFS.ChownClearSetuid (29 ms) 2023-11-04T15:36:58.593 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 1 test from LibCephFS (29 ms total) 2023-11-04T15:36:58.593 INFO:tasks.workunit.client.0.smithi130.stdout: 2023-11-04T15:36:58.594 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment tear-down 2023-11-04T15:36:58.594 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] 2 tests from 2 test suites ran. (242 ms total) 2023-11-04T15:36:58.594 INFO:tasks.workunit.client.0.smithi130.stdout:[ PASSED ] 2 tests. 2023-11-04T15:36:58.596 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-11-04T15:36:58.597 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-11-04T15:36:58.628 INFO:tasks.workunit:Stopping ['libcephfs/test.sh'] on client.0... 2023-11-04T15:36:58.629 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-11-04T15:36:58.930 DEBUG:teuthology.parallel:result is None 2023-11-04T15:36:58.930 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-11-04T15:36:58.966 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-11-04T15:36:58.966 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-11-04T15:36:58.975 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-11-04T15:36:58.976 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-11-04T15:36:58.976 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T15:36:59.022 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-11-04T15:36:59.023 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T15:36:59.078 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T15:36:59.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.191+0000 7f4b329d3640 1 Processor -- start 2023-11-04T15:36:59.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.191+0000 7f4b329d3640 1 -- start start 2023-11-04T15:36:59.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.191+0000 7f4b329d3640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4b2c137270 0x7f4b2c0a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:36:59.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.191+0000 7f4b329d3640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4b2c0a3e90 0x7f4b2c139f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:36:59.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.191+0000 7f4b329d3640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b2c137650 0x7f4b2c13a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:36:59.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.191+0000 7f4b329d3640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2c0a3060 con 0x7f4b2c137270 2023-11-04T15:36:59.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.191+0000 7f4b329d3640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2c0a4c20 con 0x7f4b2c0a3e90 2023-11-04T15:36:59.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.191+0000 7f4b329d3640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c0a5080 con 0x7f4b2c137650 2023-11-04T15:36:59.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.192+0000 7f4b2bfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4b2c137270 0x7f4b2c0a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:36:59.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.192+0000 7f4b2bfff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4b2c137270 0x7f4b2c0a6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52868/0 (socket says 172.21.15.19:52868) 2023-11-04T15:36:59.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.192+0000 7f4b2bfff640 1 -- 172.21.15.19:0/3999442443 learned_addr learned my addr 172.21.15.19:0/3999442443 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:36:59.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.192+0000 7f4b2b7fe640 1 --2- 172.21.15.19:0/3999442443 >> v2:172.21.15.96:3300/0 conn(0x7f4b2c0a3e90 0x7f4b2c139f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:36:59.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.192+0000 7f4b30f70640 1 --2- 172.21.15.19:0/3999442443 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b2c137650 0x7f4b2c13a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:36:59.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.192+0000 7f4b2bfff640 1 -- 172.21.15.19:0/3999442443 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b2c137650 msgr2=0x7f4b2c13a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:36:59.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.192+0000 7f4b2bfff640 1 --2- 172.21.15.19:0/3999442443 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b2c137650 0x7f4b2c13a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:36:59.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.192+0000 7f4b2bfff640 1 -- 172.21.15.19:0/3999442443 >> v2:172.21.15.96:3300/0 conn(0x7f4b2c0a3e90 msgr2=0x7f4b2c139f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:36:59.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.192+0000 7f4b2bfff640 1 --2- 172.21.15.19:0/3999442443 >> v2:172.21.15.96:3300/0 conn(0x7f4b2c0a3e90 0x7f4b2c139f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:36:59.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.192+0000 7f4b2bfff640 1 -- 172.21.15.19:0/3999442443 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2c0a3440 con 0x7f4b2c137270 2023-11-04T15:36:59.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.193+0000 7f4b2bfff640 1 --2- 172.21.15.19:0/3999442443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b2c137270 0x7f4b2c0a6200 secure :-1 s=READY pgs=3710 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c0aa140 tx=0x7f4b1c02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d8e1dde845f46d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:36:59.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.193+0000 7f4b2affd640 1 -- 172.21.15.19:0/3999442443 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c031750 con 0x7f4b2c137270 2023-11-04T15:36:59.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.193+0000 7f4b2affd640 1 -- 172.21.15.19:0/3999442443 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1c0318b0 con 0x7f4b2c137270 2023-11-04T15:36:59.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.193+0000 7f4b2affd640 1 -- 172.21.15.19:0/3999442443 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c031c40 con 0x7f4b2c137270 2023-11-04T15:36:59.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.193+0000 7f4b329d3640 1 -- 172.21.15.19:0/3999442443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b2c137270 msgr2=0x7f4b2c0a6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:36:59.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.193+0000 7f4b329d3640 1 --2- 172.21.15.19:0/3999442443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b2c137270 0x7f4b2c0a6200 secure :-1 s=READY pgs=3710 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c0aa140 tx=0x7f4b1c02b7f0 comp rx=0 tx=0).stop 2023-11-04T15:36:59.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.193+0000 7f4b329d3640 1 -- 172.21.15.19:0/3999442443 shutdown_connections 2023-11-04T15:36:59.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.193+0000 7f4b329d3640 1 --2- 172.21.15.19:0/3999442443 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b2c137650 0x7f4b2c13a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:36:59.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.193+0000 7f4b329d3640 1 --2- 172.21.15.19:0/3999442443 >> v2:172.21.15.96:3300/0 conn(0x7f4b2c0a3e90 0x7f4b2c139f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:36:59.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.193+0000 7f4b329d3640 1 --2- 172.21.15.19:0/3999442443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b2c137270 0x7f4b2c0a6200 unknown :-1 s=CLOSED pgs=3710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:36:59.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.193+0000 7f4b329d3640 1 -- 172.21.15.19:0/3999442443 >> 172.21.15.19:0/3999442443 conn(0x7f4b2c0a8d70 msgr2=0x7f4b2c0a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:36:59.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.194+0000 7f4b329d3640 1 -- 172.21.15.19:0/3999442443 shutdown_connections 2023-11-04T15:36:59.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.194+0000 7f4b329d3640 1 -- 172.21.15.19:0/3999442443 wait complete. 2023-11-04T15:36:59.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.194+0000 7f4b329d3640 1 Processor -- start 2023-11-04T15:36:59.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.195+0000 7f4b329d3640 1 -- start start 2023-11-04T15:36:59.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.195+0000 7f4b329d3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b2c0a3e90 0x7f4b2c130d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:36:59.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.195+0000 7f4b329d3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b2c137270 0x7f4b2c131290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:36:59.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.195+0000 7f4b329d3640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b2c137650 0x7f4b2c1cf240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:36:59.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.195+0000 7f4b329d3640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c09ac60 con 0x7f4b2c0a3e90 2023-11-04T15:36:59.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.195+0000 7f4b329d3640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c09dd40 con 0x7f4b2c137270 2023-11-04T15:36:59.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.195+0000 7f4b329d3640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c09b750 con 0x7f4b2c137650 2023-11-04T15:36:59.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.195+0000 7f4b2bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b2c0a3e90 0x7f4b2c130d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:36:59.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.195+0000 7f4b2bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b2c0a3e90 0x7f4b2c130d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52882/0 (socket says 172.21.15.19:52882) 2023-11-04T15:36:59.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.195+0000 7f4b2bfff640 1 -- 172.21.15.19:0/1404069176 learned_addr learned my addr 172.21.15.19:0/1404069176 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:36:59.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.195+0000 7f4b30f70640 1 --2- 172.21.15.19:0/1404069176 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b2c137650 0x7f4b2c1cf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:36:59.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.195+0000 7f4b2b7fe640 1 --2- 172.21.15.19:0/1404069176 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b2c137270 0x7f4b2c131290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:36:59.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.195+0000 7f4b2bfff640 1 -- 172.21.15.19:0/1404069176 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b2c137650 msgr2=0x7f4b2c1cf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:36:59.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.195+0000 7f4b2bfff640 1 --2- 172.21.15.19:0/1404069176 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b2c137650 0x7f4b2c1cf240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:36:59.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.195+0000 7f4b2bfff640 1 -- 172.21.15.19:0/1404069176 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b2c137270 msgr2=0x7f4b2c131290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:36:59.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.195+0000 7f4b2bfff640 1 --2- 172.21.15.19:0/1404069176 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b2c137270 0x7f4b2c131290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:36:59.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.196+0000 7f4b2bfff640 1 -- 172.21.15.19:0/1404069176 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b1c0094d0 con 0x7f4b2c0a3e90 2023-11-04T15:36:59.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.196+0000 7f4b2b7fe640 1 --2- 172.21.15.19:0/1404069176 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b2c137270 0x7f4b2c131290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T15:36:59.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.196+0000 7f4b2bfff640 1 --2- 172.21.15.19:0/1404069176 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b2c0a3e90 0x7f4b2c130d50 secure :-1 s=READY pgs=3711 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c02b830 tx=0x7f4b1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:36:59.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.196+0000 7f4b28ff9640 1 -- 172.21.15.19:0/1404069176 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c033c80 con 0x7f4b2c0a3e90 2023-11-04T15:36:59.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.196+0000 7f4b28ff9640 1 -- 172.21.15.19:0/1404069176 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1c033e00 con 0x7f4b2c0a3e90 2023-11-04T15:36:59.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.196+0000 7f4b329d3640 1 -- 172.21.15.19:0/1404069176 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b2c09c840 con 0x7f4b2c0a3e90 2023-11-04T15:36:59.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.196+0000 7f4b28ff9640 1 -- 172.21.15.19:0/1404069176 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c03c640 con 0x7f4b2c0a3e90 2023-11-04T15:36:59.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.196+0000 7f4b329d3640 1 -- 172.21.15.19:0/1404069176 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b2c09ce80 con 0x7f4b2c0a3e90 2023-11-04T15:36:59.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.197+0000 7f4b329d3640 1 -- 172.21.15.19:0/1404069176 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b2c0abf70 con 0x7f4b2c0a3e90 2023-11-04T15:36:59.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.197+0000 7f4b28ff9640 1 -- 172.21.15.19:0/1404069176 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4b1c03a040 con 0x7f4b2c0a3e90 2023-11-04T15:36:59.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.198+0000 7f4b28ff9640 1 --2- 172.21.15.19:0/1404069176 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f4b1806a430 0x7f4b1806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:36:59.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.198+0000 7f4b28ff9640 1 -- 172.21.15.19:0/1404069176 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4462+0+0 (secure 0 0 0) 0x7f4b1c0aa0c0 con 0x7f4b2c0a3e90 2023-11-04T15:36:59.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.198+0000 7f4b2b7fe640 1 --2- 172.21.15.19:0/1404069176 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f4b1806a430 0x7f4b1806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:36:59.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.198+0000 7f4b2b7fe640 1 --2- 172.21.15.19:0/1404069176 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f4b1806a430 0x7f4b1806c8f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c136210 tx=0x7f4b20008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:36:59.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.202+0000 7f4b28ff9640 1 -- 172.21.15.19:0/1404069176 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4b1c075ca0 con 0x7f4b2c0a3e90 2023-11-04T15:36:59.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.385+0000 7f4b329d3640 1 -- 172.21.15.19:0/1404069176 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b2c073780 con 0x7f4b2c0a3e90 2023-11-04T15:36:59.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.386+0000 7f4b28ff9640 1 -- 172.21.15.19:0/1404069176 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+13397 (secure 0 0 0) 0x7f4b1c038020 con 0x7f4b2c0a3e90 2023-11-04T15:36:59.391 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:36:59.391 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":43,"fsid":"e87311d5-496a-4b07-9654-358fe5bbf950","created":"2023-11-04T15:27:14.865121+0000","modified":"2023-11-04T15:36:55.712975+0000","last_up_change":"2023-11-04T15:27:24.162282+0000","last_in_change":"2023-11-04T15:27:15.971035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T15:27:24.987312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-04T15:27:30.500235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-04T15:27:34.476271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-04T15:27:35.096759+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":65,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"34818469-ebf2-4dd4-8119-af19a0121036","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":82879},{"type":"v1","addr":"172.21.15.19:6801","nonce":82879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":82879},{"type":"v1","addr":"172.21.15.19:6803","nonce":82879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":82879},{"type":"v1","addr":"172.21.15.19:6807","nonce":82879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":82879},{"type":"v1","addr":"172.21.15.19:6805","nonce":82879}]},"public_addr":"172.21.15.19:6801/82879","cluster_addr":"172.21.15.19:6803/82879","heartbeat_back_addr":"172.21.15.19:6807/82879","heartbeat_front_addr":"172.21.15.19:6805/82879","state":["exists","up"]},{"osd":1,"uuid":"92dab290-7912-4eea-b6f6-c754c2480721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":82880},{"type":"v1","addr":"172.21.15.19:6809","nonce":82880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":82880},{"type":"v1","addr":"172.21.15.19:6811","nonce":82880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":82880},{"type":"v1","addr":"172.21.15.19:6815","nonce":82880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":82880},{"type":"v1","addr":"172.21.15.19:6813","nonce":82880}]},"public_addr":"172.21.15.19:6809/82880","cluster_addr":"172.21.15.19:6811/82880","heartbeat_back_addr":"172.21.15.19:6815/82880","heartbeat_front_addr":"172.21.15.19:6813/82880","state":["exists","up"]},{"osd":2,"uuid":"1be47db4-6dd1-4ce5-832b-bc6ad30c78c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":83458},{"type":"v1","addr":"172.21.15.96:6808","nonce":83458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":83458},{"type":"v1","addr":"172.21.15.96:6811","nonce":83458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":83458},{"type":"v1","addr":"172.21.15.96:6815","nonce":83458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":83458},{"type":"v1","addr":"172.21.15.96:6813","nonce":83458}]},"public_addr":"172.21.15.96:6808/83458","cluster_addr":"172.21.15.96:6811/83458","heartbeat_back_addr":"172.21.15.96:6815/83458","heartbeat_front_addr":"172.21.15.96:6813/83458","state":["exists","up"]},{"osd":3,"uuid":"46505800-d64f-49ef-b811-5b5979f48252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":83459},{"type":"v1","addr":"172.21.15.96:6801","nonce":83459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":83459},{"type":"v1","addr":"172.21.15.96:6803","nonce":83459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6807","nonce":83459},{"type":"v1","addr":"172.21.15.96:6809","nonce":83459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":83459},{"type":"v1","addr":"172.21.15.96:6805","nonce":83459}]},"public_addr":"172.21.15.96:6801/83459","cluster_addr":"172.21.15.96:6803/83459","heartbeat_back_addr":"172.21.15.96:6809/83459","heartbeat_front_addr":"172.21.15.96:6805/83459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.081547+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.132075+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.094919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.074106+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.24","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.130:0/185843238":"2023-11-04T16:36:55.500269+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":4,"snaps":[{"begin":60,"length":6}]}],"new_removed_snaps":[{"pool":4,"snaps":[{"begin":60,"length":6}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T15:36:59.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.388+0000 7f4b329d3640 1 -- 172.21.15.19:0/1404069176 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f4b1806a430 msgr2=0x7f4b1806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:36:59.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.388+0000 7f4b329d3640 1 --2- 172.21.15.19:0/1404069176 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f4b1806a430 0x7f4b1806c8f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c136210 tx=0x7f4b20008040 comp rx=0 tx=0).stop 2023-11-04T15:36:59.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.388+0000 7f4b329d3640 1 -- 172.21.15.19:0/1404069176 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b2c0a3e90 msgr2=0x7f4b2c130d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:36:59.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.388+0000 7f4b329d3640 1 --2- 172.21.15.19:0/1404069176 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b2c0a3e90 0x7f4b2c130d50 secure :-1 s=READY pgs=3711 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c02b830 tx=0x7f4b1c0046c0 comp rx=0 tx=0).stop 2023-11-04T15:36:59.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.388+0000 7f4b329d3640 1 -- 172.21.15.19:0/1404069176 shutdown_connections 2023-11-04T15:36:59.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.388+0000 7f4b329d3640 1 --2- 172.21.15.19:0/1404069176 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f4b1806a430 0x7f4b1806c8f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:36:59.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.388+0000 7f4b329d3640 1 --2- 172.21.15.19:0/1404069176 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b2c137650 0x7f4b2c1cf240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:36:59.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.388+0000 7f4b329d3640 1 --2- 172.21.15.19:0/1404069176 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b2c137270 0x7f4b2c131290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:36:59.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.388+0000 7f4b329d3640 1 --2- 172.21.15.19:0/1404069176 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b2c0a3e90 0x7f4b2c130d50 unknown :-1 s=CLOSED pgs=3711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:36:59.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.388+0000 7f4b329d3640 1 -- 172.21.15.19:0/1404069176 >> 172.21.15.19:0/1404069176 conn(0x7f4b2c0a8d70 msgr2=0x7f4b2c134ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:36:59.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.389+0000 7f4b329d3640 1 -- 172.21.15.19:0/1404069176 shutdown_connections 2023-11-04T15:36:59.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.389+0000 7f4b329d3640 1 -- 172.21.15.19:0/1404069176 wait complete. 2023-11-04T15:36:59.403 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T15:27:24.987312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-04T15:27:30.500235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T15:27:34.476271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T15:27:35.096759+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 65, 'snap_epoch': 43, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.190000057220459, 'score_stable': 1.190000057220459, 'optimal_score': 1, 'raw_score_acting': 1.190000057220459, 'raw_score_stable': 1.190000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T15:36:59.404 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T15:36:59.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.512+0000 7f123fcaf640 1 Processor -- start 2023-11-04T15:36:59.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.512+0000 7f123fcaf640 1 -- start start 2023-11-04T15:36:59.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.513+0000 7f123fcaf640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1238136090 0x7f1238136470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:36:59.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.513+0000 7f123fcaf640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12380a6370 0x7f123813a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:36:59.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.513+0000 7f123fcaf640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f123813a670 0x7f123813ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:36:59.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.513+0000 7f123fcaf640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12380a68d0 con 0x7f1238136090 2023-11-04T15:36:59.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.513+0000 7f123fcaf640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12380abe60 con 0x7f123813a670 2023-11-04T15:36:59.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.513+0000 7f123fcaf640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12380a30a0 con 0x7f12380a6370 2023-11-04T15:36:59.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.513+0000 7f123da4b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1238136090 0x7f1238136470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:36:59.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.513+0000 7f123da4b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1238136090 0x7f1238136470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52896/0 (socket says 172.21.15.19:52896) 2023-11-04T15:36:59.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.513+0000 7f123da4b640 1 -- 172.21.15.19:0/2474390012 learned_addr learned my addr 172.21.15.19:0/2474390012 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:36:59.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.513+0000 7f123e24c640 1 --2- 172.21.15.19:0/2474390012 >> v2:172.21.15.96:3300/0 conn(0x7f123813a670 0x7f123813ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:36:59.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.513+0000 7f123d24a640 1 --2- 172.21.15.19:0/2474390012 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12380a6370 0x7f123813a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:36:59.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.513+0000 7f123da4b640 1 -- 172.21.15.19:0/2474390012 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12380a6370 msgr2=0x7f123813a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:36:59.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.513+0000 7f123da4b640 1 --2- 172.21.15.19:0/2474390012 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12380a6370 0x7f123813a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:36:59.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.513+0000 7f123da4b640 1 -- 172.21.15.19:0/2474390012 >> v2:172.21.15.96:3300/0 conn(0x7f123813a670 msgr2=0x7f123813ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:36:59.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.513+0000 7f123da4b640 1 --2- 172.21.15.19:0/2474390012 >> v2:172.21.15.96:3300/0 conn(0x7f123813a670 0x7f123813ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:36:59.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.513+0000 7f123da4b640 1 -- 172.21.15.19:0/2474390012 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12380a4b90 con 0x7f1238136090 2023-11-04T15:36:59.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.513+0000 7f123e24c640 1 --2- 172.21.15.19:0/2474390012 >> v2:172.21.15.96:3300/0 conn(0x7f123813a670 0x7f123813ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T15:36:59.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.513+0000 7f123d24a640 1 --2- 172.21.15.19:0/2474390012 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12380a6370 0x7f123813a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T15:36:59.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.514+0000 7f123da4b640 1 --2- 172.21.15.19:0/2474390012 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1238136090 0x7f1238136470 secure :-1 s=READY pgs=3712 cs=0 l=1 rev1=1 crypto rx=0x7f12380ac290 tx=0x7f123002bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36a3c8641ae3d440 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:36:59.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.514+0000 7f123ca49640 1 -- 172.21.15.19:0/2474390012 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123002c950 con 0x7f1238136090 2023-11-04T15:36:59.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.514+0000 7f123ca49640 1 -- 172.21.15.19:0/2474390012 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123002cab0 con 0x7f1238136090 2023-11-04T15:36:59.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.514+0000 7f123ca49640 1 -- 172.21.15.19:0/2474390012 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123002ce40 con 0x7f1238136090 2023-11-04T15:36:59.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.515+0000 7f123fcaf640 1 -- 172.21.15.19:0/2474390012 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1238136090 msgr2=0x7f1238136470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:36:59.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.515+0000 7f123fcaf640 1 --2- 172.21.15.19:0/2474390012 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1238136090 0x7f1238136470 secure :-1 s=READY pgs=3712 cs=0 l=1 rev1=1 crypto rx=0x7f12380ac290 tx=0x7f123002bdb0 comp rx=0 tx=0).stop 2023-11-04T15:36:59.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.515+0000 7f123fcaf640 1 -- 172.21.15.19:0/2474390012 shutdown_connections 2023-11-04T15:36:59.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.515+0000 7f123fcaf640 1 --2- 172.21.15.19:0/2474390012 >> v2:172.21.15.96:3300/0 conn(0x7f123813a670 0x7f123813ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:36:59.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.515+0000 7f123fcaf640 1 --2- 172.21.15.19:0/2474390012 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12380a6370 0x7f123813a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:36:59.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.515+0000 7f123fcaf640 1 --2- 172.21.15.19:0/2474390012 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1238136090 0x7f1238136470 unknown :-1 s=CLOSED pgs=3712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:36:59.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.515+0000 7f123fcaf640 1 -- 172.21.15.19:0/2474390012 >> 172.21.15.19:0/2474390012 conn(0x7f12380ac3f0 msgr2=0x7f12380ac800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:36:59.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.515+0000 7f123fcaf640 1 -- 172.21.15.19:0/2474390012 shutdown_connections 2023-11-04T15:36:59.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.515+0000 7f123fcaf640 1 -- 172.21.15.19:0/2474390012 wait complete. 2023-11-04T15:36:59.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.516+0000 7f123fcaf640 1 Processor -- start 2023-11-04T15:36:59.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.516+0000 7f123fcaf640 1 -- start start 2023-11-04T15:36:59.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.516+0000 7f123fcaf640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12380a6370 0x7f123809d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:36:59.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.516+0000 7f123fcaf640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1238136090 0x7f12381cf020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:36:59.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.516+0000 7f123fcaf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f123813a670 0x7f12381cf560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:36:59.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.516+0000 7f123fcaf640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123809d5a0 con 0x7f123813a670 2023-11-04T15:36:59.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.516+0000 7f123fcaf640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123809b1c0 con 0x7f12380a6370 2023-11-04T15:36:59.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.516+0000 7f123fcaf640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123809c6a0 con 0x7f1238136090 2023-11-04T15:36:59.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.516+0000 7f123e24c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f123813a670 0x7f12381cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:36:59.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.516+0000 7f123e24c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f123813a670 0x7f12381cf560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52910/0 (socket says 172.21.15.19:52910) 2023-11-04T15:36:59.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.517+0000 7f123e24c640 1 -- 172.21.15.19:0/4218076383 learned_addr learned my addr 172.21.15.19:0/4218076383 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:36:59.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.517+0000 7f123d24a640 1 --2- 172.21.15.19:0/4218076383 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1238136090 0x7f12381cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:36:59.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.517+0000 7f123da4b640 1 --2- 172.21.15.19:0/4218076383 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12380a6370 0x7f123809d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:36:59.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.517+0000 7f123e24c640 1 -- 172.21.15.19:0/4218076383 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1238136090 msgr2=0x7f12381cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:36:59.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.517+0000 7f123e24c640 1 --2- 172.21.15.19:0/4218076383 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1238136090 0x7f12381cf020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:36:59.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.517+0000 7f123e24c640 1 -- 172.21.15.19:0/4218076383 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12380a6370 msgr2=0x7f123809d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:36:59.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.517+0000 7f123e24c640 1 --2- 172.21.15.19:0/4218076383 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12380a6370 0x7f123809d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:36:59.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.517+0000 7f123e24c640 1 -- 172.21.15.19:0/4218076383 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1230009b30 con 0x7f123813a670 2023-11-04T15:36:59.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.517+0000 7f123e24c640 1 --2- 172.21.15.19:0/4218076383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f123813a670 0x7f12381cf560 secure :-1 s=READY pgs=3713 cs=0 l=1 rev1=1 crypto rx=0x7f122800c7c0 tx=0x7f122800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:36:59.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.517+0000 7f12367fc640 1 -- 172.21.15.19:0/4218076383 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1228004230 con 0x7f123813a670 2023-11-04T15:36:59.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.517+0000 7f12367fc640 1 -- 172.21.15.19:0/4218076383 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1228004390 con 0x7f123813a670 2023-11-04T15:36:59.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.517+0000 7f12367fc640 1 -- 172.21.15.19:0/4218076383 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1228007860 con 0x7f123813a670 2023-11-04T15:36:59.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.517+0000 7f123fcaf640 1 -- 172.21.15.19:0/4218076383 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f123809a900 con 0x7f123813a670 2023-11-04T15:36:59.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.517+0000 7f123fcaf640 1 -- 172.21.15.19:0/4218076383 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f123809c240 con 0x7f123813a670 2023-11-04T15:36:59.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.518+0000 7f123fcaf640 1 -- 172.21.15.19:0/4218076383 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1238067d60 con 0x7f123813a670 2023-11-04T15:36:59.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.519+0000 7f12367fc640 1 -- 172.21.15.19:0/4218076383 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f12280079c0 con 0x7f123813a670 2023-11-04T15:36:59.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.519+0000 7f12367fc640 1 --2- 172.21.15.19:0/4218076383 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f122406a430 0x7f122406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:36:59.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.519+0000 7f12367fc640 1 -- 172.21.15.19:0/4218076383 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4462+0+0 (secure 0 0 0) 0x7f1228088430 con 0x7f123813a670 2023-11-04T15:36:59.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.519+0000 7f123da4b640 1 --2- 172.21.15.19:0/4218076383 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f122406a430 0x7f122406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:36:59.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.520+0000 7f123da4b640 1 --2- 172.21.15.19:0/4218076383 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f122406a430 0x7f122406c8f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1230035000 tx=0x7f1230030000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:36:59.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.523+0000 7f12367fc640 1 -- 172.21.15.19:0/4218076383 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1228054100 con 0x7f123813a670 2023-11-04T15:36:59.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.708+0000 7f123fcaf640 1 -- 172.21.15.19:0/4218076383 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f123809cc90 con 0x7f123813a670 2023-11-04T15:36:59.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.708+0000 7f12367fc640 1 -- 172.21.15.19:0/4218076383 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1228057720 con 0x7f123813a670 2023-11-04T15:36:59.710 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-11-04T15:36:59.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.710+0000 7f123fcaf640 1 -- 172.21.15.19:0/4218076383 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f122406a430 msgr2=0x7f122406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:36:59.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.710+0000 7f123fcaf640 1 --2- 172.21.15.19:0/4218076383 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f122406a430 0x7f122406c8f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1230035000 tx=0x7f1230030000 comp rx=0 tx=0).stop 2023-11-04T15:36:59.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.710+0000 7f123fcaf640 1 -- 172.21.15.19:0/4218076383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f123813a670 msgr2=0x7f12381cf560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:36:59.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.710+0000 7f123fcaf640 1 --2- 172.21.15.19:0/4218076383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f123813a670 0x7f12381cf560 secure :-1 s=READY pgs=3713 cs=0 l=1 rev1=1 crypto rx=0x7f122800c7c0 tx=0x7f122800cc80 comp rx=0 tx=0).stop 2023-11-04T15:36:59.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.710+0000 7f123fcaf640 1 -- 172.21.15.19:0/4218076383 shutdown_connections 2023-11-04T15:36:59.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.710+0000 7f123fcaf640 1 --2- 172.21.15.19:0/4218076383 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f122406a430 0x7f122406c8f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:36:59.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.710+0000 7f123fcaf640 1 --2- 172.21.15.19:0/4218076383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f123813a670 0x7f12381cf560 unknown :-1 s=CLOSED pgs=3713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:36:59.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.710+0000 7f123fcaf640 1 --2- 172.21.15.19:0/4218076383 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1238136090 0x7f12381cf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:36:59.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.710+0000 7f123fcaf640 1 --2- 172.21.15.19:0/4218076383 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12380a6370 0x7f123809d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:36:59.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.710+0000 7f123fcaf640 1 -- 172.21.15.19:0/4218076383 >> 172.21.15.19:0/4218076383 conn(0x7f12380ac3f0 msgr2=0x7f1238132460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:36:59.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.710+0000 7f123fcaf640 1 -- 172.21.15.19:0/4218076383 shutdown_connections 2023-11-04T15:36:59.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.710+0000 7f123fcaf640 1 -- 172.21.15.19:0/4218076383 wait complete. 2023-11-04T15:36:59.725 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-04T15:36:59.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.834+0000 7fc4aacbd640 1 Processor -- start 2023-11-04T15:36:59.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.834+0000 7fc4aacbd640 1 -- start start 2023-11-04T15:36:59.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.835+0000 7fc4aacbd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc4a40a6370 0x7fc4a413f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:36:59.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.835+0000 7fc4aacbd640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4a40abe60 con 0x7fc4a4136090 2023-11-04T15:36:59.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.835+0000 7fc4aacbd640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4a40a30a0 con 0x7fc4a413f990 2023-11-04T15:36:59.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.835+0000 7fc4aacbd640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4a40a68d0 con 0x7fc4a40a6370 2023-11-04T15:36:59.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.835+0000 7fc4a8a59640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc4a4136090 0x7fc4a4136470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57922/0 (socket says 172.21.15.19:57922) 2023-11-04T15:36:59.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.835+0000 7fc4a8a59640 1 -- 172.21.15.19:0/2467083850 learned_addr learned my addr 172.21.15.19:0/2467083850 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:36:59.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.835+0000 7fc4a3fff640 1 --2- 172.21.15.19:0/2467083850 >> v2:172.21.15.96:3300/0 conn(0x7fc4a40a6370 0x7fc4a413f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:36:59.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.835+0000 7fc4a37fe640 1 -- 172.21.15.19:0/2467083850 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3547247205 0 0) 0x7fc4a40abe60 con 0x7fc4a4136090 2023-11-04T15:36:59.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.835+0000 7fc4a37fe640 1 -- 172.21.15.19:0/2467083850 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc48c003520 con 0x7fc4a4136090 2023-11-04T15:36:59.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.835+0000 7fc4a37fe640 1 -- 172.21.15.19:0/2467083850 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1760072895 0 0) 0x7fc48c003520 con 0x7fc4a4136090 2023-11-04T15:36:59.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.835+0000 7fc4a37fe640 1 -- 172.21.15.19:0/2467083850 >> v2:172.21.15.96:3300/0 conn(0x7fc4a40a6370 msgr2=0x7fc4a413f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:36:59.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.835+0000 7fc4a37fe640 1 --2- 172.21.15.19:0/2467083850 >> v2:172.21.15.96:3300/0 conn(0x7fc4a40a6370 0x7fc4a413f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:36:59.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.835+0000 7fc4a37fe640 1 -- 172.21.15.19:0/2467083850 >> v1:172.21.15.96:6789/0 conn(0x7fc4a413f990 legacy=0x7fc4a4141d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:36:59.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.835+0000 7fc4a37fe640 1 -- 172.21.15.19:0/2467083850 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a40a4b90 con 0x7fc4a4136090 2023-11-04T15:36:59.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.835+0000 7fc4a37fe640 1 -- 172.21.15.19:0/2467083850 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3646097784 0 0) 0x7fc49c0019f0 con 0x7fc4a4136090 2023-11-04T15:36:59.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.836+0000 7fc4a37fe640 1 -- 172.21.15.19:0/2467083850 >> v1:172.21.15.19:6789/0 conn(0x7fc4a4136090 legacy=0x7fc4a4136470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:36:59.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.836+0000 7fc4a37fe640 1 --2- 172.21.15.19:0/2467083850 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc48c003970 0x7fc48c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:36:59.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.836+0000 7fc4a37fe640 1 --2- 172.21.15.19:0/2467083850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc48c0047c0 0x7fc48c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:36:59.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.836+0000 7fc4a37fe640 1 --2- 172.21.15.19:0/2467083850 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc48c0052a0 0x7fc48c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:36:59.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.836+0000 7fc4a37fe640 1 -- 172.21.15.19:0/2467083850 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a40a68d0 con 0x7fc48c0047c0 2023-11-04T15:36:59.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.836+0000 7fc4a37fe640 1 -- 172.21.15.19:0/2467083850 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c00c170 con 0x7fc48c003970 2023-11-04T15:36:59.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.836+0000 7fc4a37fe640 1 -- 172.21.15.19:0/2467083850 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c00c330 con 0x7fc48c0052a0 2023-11-04T15:36:59.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.836+0000 7fc4a3fff640 1 --2- 172.21.15.19:0/2467083850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc48c0047c0 0x7fc48c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:36:59.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.836+0000 7fc4a8a59640 1 --2- 172.21.15.19:0/2467083850 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc48c003970 0x7fc48c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:36:59.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.836+0000 7fc4a925a640 1 --2- 172.21.15.19:0/2467083850 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc48c0052a0 0x7fc48c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:36:59.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.836+0000 7fc4a3fff640 1 -- 172.21.15.19:0/2467083850 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc48c0052a0 msgr2=0x7fc48c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:36:59.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.836+0000 7fc4a3fff640 1 --2- 172.21.15.19:0/2467083850 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc48c0052a0 0x7fc48c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:36:59.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.836+0000 7fc4a3fff640 1 -- 172.21.15.19:0/2467083850 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc48c003970 msgr2=0x7fc48c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:36:59.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.836+0000 7fc4a3fff640 1 --2- 172.21.15.19:0/2467083850 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc48c003970 0x7fc48c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:36:59.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.836+0000 7fc4a3fff640 1 -- 172.21.15.19:0/2467083850 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48c003520 con 0x7fc48c0047c0 2023-11-04T15:36:59.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.836+0000 7fc4a925a640 1 -- 172.21.15.19:0/2467083850 reap_dead start 2023-11-04T15:36:59.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.837+0000 7fc4a3fff640 1 --2- 172.21.15.19:0/2467083850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc48c0047c0 0x7fc48c004c40 secure :-1 s=READY pgs=3715 cs=0 l=1 rev1=1 crypto rx=0x7fc498009a90 tx=0x7fc48c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df75d2f9e308e35 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:36:59.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.837+0000 7fc4a37fe640 1 -- 172.21.15.19:0/2467083850 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49802c680 con 0x7fc48c0047c0 2023-11-04T15:36:59.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.837+0000 7fc4a37fe640 1 -- 172.21.15.19:0/2467083850 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49802c7e0 con 0x7fc48c0047c0 2023-11-04T15:36:59.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.837+0000 7fc4a37fe640 1 -- 172.21.15.19:0/2467083850 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49802cb70 con 0x7fc48c0047c0 2023-11-04T15:36:59.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.837+0000 7fc4aacbd640 1 -- 172.21.15.19:0/2467083850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc48c0047c0 msgr2=0x7fc48c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:36:59.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.837+0000 7fc4aacbd640 1 --2- 172.21.15.19:0/2467083850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc48c0047c0 0x7fc48c004c40 secure :-1 s=READY pgs=3715 cs=0 l=1 rev1=1 crypto rx=0x7fc498009a90 tx=0x7fc48c0057f0 comp rx=0 tx=0).stop 2023-11-04T15:36:59.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.837+0000 7fc4aacbd640 1 -- 172.21.15.19:0/2467083850 shutdown_connections 2023-11-04T15:36:59.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.837+0000 7fc4aacbd640 1 --2- 172.21.15.19:0/2467083850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc48c0047c0 0x7fc48c004c40 unknown :-1 s=CLOSED pgs=3715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:36:59.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.837+0000 7fc4aacbd640 1 -- 172.21.15.19:0/2467083850 >> 172.21.15.19:0/2467083850 conn(0x7fc4a40ac3f0 msgr2=0x7fc4a40ac800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:36:59.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.838+0000 7fc4aacbd640 1 -- 172.21.15.19:0/2467083850 shutdown_connections 2023-11-04T15:36:59.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.838+0000 7fc4aacbd640 1 -- 172.21.15.19:0/2467083850 wait complete. 2023-11-04T15:36:59.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.838+0000 7fc4aacbd640 1 Processor -- start 2023-11-04T15:36:59.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.838+0000 7fc4aacbd640 1 -- start start 2023-11-04T15:36:59.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.839+0000 7fc4aacbd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc48c0047c0 0x7fc4a41ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:36:59.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.839+0000 7fc4aacbd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4a41cf0d0 0x7fc4a41cf530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:36:59.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.839+0000 7fc4aacbd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc4a412fb50 0x7fc4a412ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:36:59.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.839+0000 7fc4aacbd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a40a2110 con 0x7fc4a41cf0d0 2023-11-04T15:36:59.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.839+0000 7fc4aacbd640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a413a1d0 con 0x7fc48c0047c0 2023-11-04T15:36:59.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.839+0000 7fc4aacbd640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a413e060 con 0x7fc4a412fb50 2023-11-04T15:36:59.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.839+0000 7fc4a3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4a41cf0d0 0x7fc4a41cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:36:59.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.839+0000 7fc4a3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4a41cf0d0 0x7fc4a41cf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60290/0 (socket says 172.21.15.19:60290) 2023-11-04T15:36:59.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.839+0000 7fc4a3fff640 1 -- 172.21.15.19:0/3876980670 learned_addr learned my addr 172.21.15.19:0/3876980670 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:36:59.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.839+0000 7fc4a3fff640 1 -- 172.21.15.19:0/3876980670 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc4a412fb50 msgr2=0x7fc4a412ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:36:59.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.839+0000 7fc4a3fff640 1 --2- 172.21.15.19:0/3876980670 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc4a412fb50 0x7fc4a412ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:36:59.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.839+0000 7fc4a3fff640 1 -- 172.21.15.19:0/3876980670 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc48c0047c0 msgr2=0x7fc4a41ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:36:59.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.839+0000 7fc4a3fff640 1 --2- 172.21.15.19:0/3876980670 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc48c0047c0 0x7fc4a41ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:36:59.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.839+0000 7fc4a3fff640 1 -- 172.21.15.19:0/3876980670 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a413dc80 con 0x7fc4a41cf0d0 2023-11-04T15:36:59.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.840+0000 7fc4a3fff640 1 --2- 172.21.15.19:0/3876980670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4a41cf0d0 0x7fc4a41cf530 secure :-1 s=READY pgs=3716 cs=0 l=1 rev1=1 crypto rx=0x7fc498037040 tx=0x7fc498004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:36:59.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.840+0000 7fc4a17fa640 1 -- 172.21.15.19:0/3876980670 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc498003810 con 0x7fc4a41cf0d0 2023-11-04T15:36:59.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.840+0000 7fc4a17fa640 1 -- 172.21.15.19:0/3876980670 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc498003970 con 0x7fc4a41cf0d0 2023-11-04T15:36:59.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.840+0000 7fc4aacbd640 1 -- 172.21.15.19:0/3876980670 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a413e320 con 0x7fc4a41cf0d0 2023-11-04T15:36:59.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.840+0000 7fc4a17fa640 1 -- 172.21.15.19:0/3876980670 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc498003d00 con 0x7fc4a41cf0d0 2023-11-04T15:36:59.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.840+0000 7fc4aacbd640 1 -- 172.21.15.19:0/3876980670 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a413ada0 con 0x7fc4a41cf0d0 2023-11-04T15:36:59.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.841+0000 7fc4aacbd640 1 -- 172.21.15.19:0/3876980670 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a4067d60 con 0x7fc4a41cf0d0 2023-11-04T15:36:59.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.841+0000 7fc4a17fa640 1 -- 172.21.15.19:0/3876980670 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc498034440 con 0x7fc4a41cf0d0 2023-11-04T15:36:59.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.842+0000 7fc4a17fa640 1 --2- 172.21.15.19:0/3876980670 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc49006a430 0x7fc49006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:36:59.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.842+0000 7fc4a17fa640 1 -- 172.21.15.19:0/3876980670 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4462+0+0 (secure 0 0 0) 0x7fc4980aa350 con 0x7fc4a41cf0d0 2023-11-04T15:36:59.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.842+0000 7fc4a8a59640 1 --2- 172.21.15.19:0/3876980670 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc49006a430 0x7fc49006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:36:59.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.843+0000 7fc4a8a59640 1 --2- 172.21.15.19:0/3876980670 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc49006a430 0x7fc49006c8f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc49c001ee0 tx=0x7fc49c001e70 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:36:59.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:36:59.846+0000 7fc4a17fa640 1 -- 172.21.15.19:0/3876980670 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc498075ec0 con 0x7fc4a41cf0d0 2023-11-04T15:37:00.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.030+0000 7fc4aacbd640 1 -- 172.21.15.19:0/3876980670 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc4a40a8ad0 con 0x7fc4a41cf0d0 2023-11-04T15:37:00.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.030+0000 7fc4a17fa640 1 -- 172.21.15.19:0/3876980670 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v43) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc4980794e0 con 0x7fc4a41cf0d0 2023-11-04T15:37:00.033 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 8 2023-11-04T15:37:00.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.032+0000 7fc4aacbd640 1 -- 172.21.15.19:0/3876980670 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc49006a430 msgr2=0x7fc49006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:00.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.032+0000 7fc4aacbd640 1 --2- 172.21.15.19:0/3876980670 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc49006a430 0x7fc49006c8f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc49c001ee0 tx=0x7fc49c001e70 comp rx=0 tx=0).stop 2023-11-04T15:37:00.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.032+0000 7fc4aacbd640 1 -- 172.21.15.19:0/3876980670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4a41cf0d0 msgr2=0x7fc4a41cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:00.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.032+0000 7fc4aacbd640 1 --2- 172.21.15.19:0/3876980670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4a41cf0d0 0x7fc4a41cf530 secure :-1 s=READY pgs=3716 cs=0 l=1 rev1=1 crypto rx=0x7fc498037040 tx=0x7fc498004730 comp rx=0 tx=0).stop 2023-11-04T15:37:00.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.032+0000 7fc4aacbd640 1 -- 172.21.15.19:0/3876980670 shutdown_connections 2023-11-04T15:37:00.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.032+0000 7fc4aacbd640 1 --2- 172.21.15.19:0/3876980670 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fc49006a430 0x7fc49006c8f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:00.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.032+0000 7fc4aacbd640 1 --2- 172.21.15.19:0/3876980670 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc4a412fb50 0x7fc4a412ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:00.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.032+0000 7fc4aacbd640 1 --2- 172.21.15.19:0/3876980670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4a41cf0d0 0x7fc4a41cf530 unknown :-1 s=CLOSED pgs=3716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:00.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.032+0000 7fc4aacbd640 1 --2- 172.21.15.19:0/3876980670 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc48c0047c0 0x7fc4a41ceb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:00.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.032+0000 7fc4aacbd640 1 -- 172.21.15.19:0/3876980670 >> 172.21.15.19:0/3876980670 conn(0x7fc4a40ac3f0 msgr2=0x7fc4a40a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:00.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.032+0000 7fc4aacbd640 1 -- 172.21.15.19:0/3876980670 shutdown_connections 2023-11-04T15:37:00.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.032+0000 7fc4aacbd640 1 -- 172.21.15.19:0/3876980670 wait complete. 2023-11-04T15:37:00.047 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T15:37:00.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.155+0000 7fb695ac4640 1 Processor -- start 2023-11-04T15:37:00.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.155+0000 7fb695ac4640 1 -- start start 2023-11-04T15:37:00.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.155+0000 7fb695ac4640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6900a6370 0x7fb69013f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:00.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.155+0000 7fb695ac4640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6900abe60 con 0x7fb690136090 2023-11-04T15:37:00.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.155+0000 7fb695ac4640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6900a30a0 con 0x7fb69013f990 2023-11-04T15:37:00.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.155+0000 7fb695ac4640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6900a68d0 con 0x7fb6900a6370 2023-11-04T15:37:00.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.155+0000 7fb68f7fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb690136090 0x7fb690136470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57930/0 (socket says 172.21.15.19:57930) 2023-11-04T15:37:00.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.155+0000 7fb68f7fe640 1 -- 172.21.15.19:0/2305832440 learned_addr learned my addr 172.21.15.19:0/2305832440 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:37:00.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.156+0000 7fb68effd640 1 --2- 172.21.15.19:0/2305832440 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6900a6370 0x7fb69013f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:00.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.156+0000 7fb68e7fc640 1 -- 172.21.15.19:0/2305832440 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2819398355 0 0) 0x7fb6900abe60 con 0x7fb690136090 2023-11-04T15:37:00.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.156+0000 7fb68e7fc640 1 -- 172.21.15.19:0/2305832440 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb678003520 con 0x7fb690136090 2023-11-04T15:37:00.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.156+0000 7fb68e7fc640 1 -- 172.21.15.19:0/2305832440 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 522109645 0 0) 0x7fb6900a30a0 con 0x7fb69013f990 2023-11-04T15:37:00.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.156+0000 7fb68e7fc640 1 -- 172.21.15.19:0/2305832440 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6900abe60 con 0x7fb69013f990 2023-11-04T15:37:00.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.156+0000 7fb68e7fc640 1 -- 172.21.15.19:0/2305832440 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1661743030 0 0) 0x7fb678003520 con 0x7fb690136090 2023-11-04T15:37:00.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.156+0000 7fb68e7fc640 1 -- 172.21.15.19:0/2305832440 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6900a6370 msgr2=0x7fb69013f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:00.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.156+0000 7fb68e7fc640 1 --2- 172.21.15.19:0/2305832440 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6900a6370 0x7fb69013f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:00.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.156+0000 7fb68e7fc640 1 -- 172.21.15.19:0/2305832440 >> v1:172.21.15.96:6789/0 conn(0x7fb69013f990 legacy=0x7fb690141d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:00.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.156+0000 7fb68e7fc640 1 -- 172.21.15.19:0/2305832440 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6900a4b90 con 0x7fb690136090 2023-11-04T15:37:00.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.156+0000 7fb68e7fc640 1 -- 172.21.15.19:0/2305832440 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3646097784 0 0) 0x7fb6800019f0 con 0x7fb690136090 2023-11-04T15:37:00.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.156+0000 7fb68effd640 1 --2- 172.21.15.19:0/2305832440 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6900a6370 0x7fb69013f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T15:37:00.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.156+0000 7fb68e7fc640 1 -- 172.21.15.19:0/2305832440 >> v1:172.21.15.19:6789/0 conn(0x7fb690136090 legacy=0x7fb690136470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:00.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.156+0000 7fb68e7fc640 1 --2- 172.21.15.19:0/2305832440 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb678003b30 0x7fb678003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:00.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.156+0000 7fb68e7fc640 1 --2- 172.21.15.19:0/2305832440 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6900a6370 0x7fb6780047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:00.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.156+0000 7fb68e7fc640 1 --2- 172.21.15.19:0/2305832440 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb678004d00 0x7fb678005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:00.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.156+0000 7fb68e7fc640 1 -- 172.21.15.19:0/2305832440 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6900a68d0 con 0x7fb678003b30 2023-11-04T15:37:00.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.156+0000 7fb68e7fc640 1 -- 172.21.15.19:0/2305832440 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67800bb10 con 0x7fb678004d00 2023-11-04T15:37:00.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.156+0000 7fb68e7fc640 1 -- 172.21.15.19:0/2305832440 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb67800bcd0 con 0x7fb6900a6370 2023-11-04T15:37:00.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.156+0000 7fb68f7fe640 1 --2- 172.21.15.19:0/2305832440 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb678003b30 0x7fb678003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:00.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.156+0000 7fb68effd640 1 --2- 172.21.15.19:0/2305832440 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6900a6370 0x7fb6780047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:00.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.156+0000 7fb68ffff640 1 --2- 172.21.15.19:0/2305832440 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb678004d00 0x7fb678005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:00.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.156+0000 7fb68f7fe640 1 -- 172.21.15.19:0/2305832440 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6900a6370 msgr2=0x7fb6780047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:00.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.156+0000 7fb68f7fe640 1 --2- 172.21.15.19:0/2305832440 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6900a6370 0x7fb6780047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:00.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.156+0000 7fb68f7fe640 1 -- 172.21.15.19:0/2305832440 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb678004d00 msgr2=0x7fb678005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:00.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.156+0000 7fb68f7fe640 1 --2- 172.21.15.19:0/2305832440 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb678004d00 0x7fb678005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:00.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.156+0000 7fb68f7fe640 1 -- 172.21.15.19:0/2305832440 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb684009400 con 0x7fb678003b30 2023-11-04T15:37:00.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.156+0000 7fb68effd640 1 --2- 172.21.15.19:0/2305832440 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6900a6370 0x7fb6780047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:37:00.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.157+0000 7fb68f7fe640 1 --2- 172.21.15.19:0/2305832440 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb678003b30 0x7fb678003f30 secure :-1 s=READY pgs=3718 cs=0 l=1 rev1=1 crypto rx=0x7fb68000a7d0 tx=0x7fb6780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9d2ab594497c44b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:00.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.157+0000 7fb68e7fc640 1 -- 172.21.15.19:0/2305832440 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb680034630 con 0x7fb678003b30 2023-11-04T15:37:00.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.157+0000 7fb68e7fc640 1 -- 172.21.15.19:0/2305832440 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68002f070 con 0x7fb678003b30 2023-11-04T15:37:00.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.157+0000 7fb68e7fc640 1 -- 172.21.15.19:0/2305832440 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6800349f0 con 0x7fb678003b30 2023-11-04T15:37:00.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.158+0000 7fb695ac4640 1 -- 172.21.15.19:0/2305832440 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb678003b30 msgr2=0x7fb678003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:00.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.158+0000 7fb695ac4640 1 --2- 172.21.15.19:0/2305832440 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb678003b30 0x7fb678003f30 secure :-1 s=READY pgs=3718 cs=0 l=1 rev1=1 crypto rx=0x7fb68000a7d0 tx=0x7fb6780057f0 comp rx=0 tx=0).stop 2023-11-04T15:37:00.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.158+0000 7fb68ffff640 1 -- 172.21.15.19:0/2305832440 reap_dead start 2023-11-04T15:37:00.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.158+0000 7fb695ac4640 1 -- 172.21.15.19:0/2305832440 shutdown_connections 2023-11-04T15:37:00.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.158+0000 7fb695ac4640 1 -- 172.21.15.19:0/2305832440 >> 172.21.15.19:0/2305832440 conn(0x7fb6900ac3f0 msgr2=0x7fb6900ac800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:00.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.158+0000 7fb695ac4640 1 -- 172.21.15.19:0/2305832440 shutdown_connections 2023-11-04T15:37:00.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.158+0000 7fb695ac4640 1 -- 172.21.15.19:0/2305832440 wait complete. 2023-11-04T15:37:00.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.159+0000 7fb695ac4640 1 Processor -- start 2023-11-04T15:37:00.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.159+0000 7fb695ac4640 1 -- start start 2023-11-04T15:37:00.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.159+0000 7fb695ac4640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb678003b30 0x7fb69013b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:00.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.159+0000 7fb695ac4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb69013b760 0x7fb69013bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:00.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.159+0000 7fb695ac4640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb69012fb50 0x7fb690130000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:00.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.160+0000 7fb695ac4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69013c0e0 con 0x7fb69013b760 2023-11-04T15:37:00.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.160+0000 7fb695ac4640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb690097f40 con 0x7fb678003b30 2023-11-04T15:37:00.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.160+0000 7fb695ac4640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb69013e4a0 con 0x7fb69012fb50 2023-11-04T15:37:00.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.160+0000 7fb68effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb69013b760 0x7fb69013bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:00.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.160+0000 7fb68effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb69013b760 0x7fb69013bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60306/0 (socket says 172.21.15.19:60306) 2023-11-04T15:37:00.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.160+0000 7fb68effd640 1 -- 172.21.15.19:0/901684987 learned_addr learned my addr 172.21.15.19:0/901684987 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:37:00.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.160+0000 7fb68f7fe640 1 --2- 172.21.15.19:0/901684987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb678003b30 0x7fb69013b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:00.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.160+0000 7fb68ffff640 1 --2- 172.21.15.19:0/901684987 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb69012fb50 0x7fb690130000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:00.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.160+0000 7fb68effd640 1 -- 172.21.15.19:0/901684987 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb69012fb50 msgr2=0x7fb690130000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:00.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.160+0000 7fb68effd640 1 --2- 172.21.15.19:0/901684987 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb69012fb50 0x7fb690130000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:00.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.160+0000 7fb68effd640 1 -- 172.21.15.19:0/901684987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb678003b30 msgr2=0x7fb69013b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:00.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.160+0000 7fb68effd640 1 --2- 172.21.15.19:0/901684987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb678003b30 0x7fb69013b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:00.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.160+0000 7fb68effd640 1 -- 172.21.15.19:0/901684987 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb690097b80 con 0x7fb69013b760 2023-11-04T15:37:00.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.160+0000 7fb68ffff640 1 --2- 172.21.15.19:0/901684987 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb69012fb50 0x7fb690130000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T15:37:00.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.160+0000 7fb68effd640 1 --2- 172.21.15.19:0/901684987 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb69013b760 0x7fb69013bba0 secure :-1 s=READY pgs=3719 cs=0 l=1 rev1=1 crypto rx=0x7fb6840118d0 tx=0x7fb684011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:00.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.160+0000 7fb677fff640 1 -- 172.21.15.19:0/901684987 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68400fb70 con 0x7fb69013b760 2023-11-04T15:37:00.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.160+0000 7fb677fff640 1 -- 172.21.15.19:0/901684987 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68400fcd0 con 0x7fb69013b760 2023-11-04T15:37:00.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.160+0000 7fb695ac4640 1 -- 172.21.15.19:0/901684987 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6900a2980 con 0x7fb69013b760 2023-11-04T15:37:00.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.160+0000 7fb677fff640 1 -- 172.21.15.19:0/901684987 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb684015460 con 0x7fb69013b760 2023-11-04T15:37:00.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.160+0000 7fb695ac4640 1 -- 172.21.15.19:0/901684987 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb69013c430 con 0x7fb69013b760 2023-11-04T15:37:00.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.161+0000 7fb695ac4640 1 -- 172.21.15.19:0/901684987 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb690067d60 con 0x7fb69013b760 2023-11-04T15:37:00.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.162+0000 7fb677fff640 1 -- 172.21.15.19:0/901684987 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb6840155c0 con 0x7fb69013b760 2023-11-04T15:37:00.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.162+0000 7fb677fff640 1 --2- 172.21.15.19:0/901684987 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fb67c06a430 0x7fb67c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:00.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.162+0000 7fb677fff640 1 -- 172.21.15.19:0/901684987 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4462+0+0 (secure 0 0 0) 0x7fb684088de0 con 0x7fb69013b760 2023-11-04T15:37:00.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.162+0000 7fb68f7fe640 1 --2- 172.21.15.19:0/901684987 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fb67c06a430 0x7fb67c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:00.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.163+0000 7fb68f7fe640 1 --2- 172.21.15.19:0/901684987 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fb67c06a430 0x7fb67c06c8f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb680034000 tx=0x7fb680009030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:00.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.166+0000 7fb677fff640 1 -- 172.21.15.19:0/901684987 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb6840549e0 con 0x7fb69013b760 2023-11-04T15:37:00.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.346+0000 7fb695ac4640 1 -- 172.21.15.19:0/901684987 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb690135660 con 0x7fb69013b760 2023-11-04T15:37:00.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.346+0000 7fb677fff640 1 -- 172.21.15.19:0/901684987 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb684058000 con 0x7fb69013b760 2023-11-04T15:37:00.349 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-04T15:37:00.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.348+0000 7fb695ac4640 1 -- 172.21.15.19:0/901684987 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fb67c06a430 msgr2=0x7fb67c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:00.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.348+0000 7fb695ac4640 1 --2- 172.21.15.19:0/901684987 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fb67c06a430 0x7fb67c06c8f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb680034000 tx=0x7fb680009030 comp rx=0 tx=0).stop 2023-11-04T15:37:00.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.348+0000 7fb695ac4640 1 -- 172.21.15.19:0/901684987 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb69013b760 msgr2=0x7fb69013bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:00.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.348+0000 7fb695ac4640 1 --2- 172.21.15.19:0/901684987 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb69013b760 0x7fb69013bba0 secure :-1 s=READY pgs=3719 cs=0 l=1 rev1=1 crypto rx=0x7fb6840118d0 tx=0x7fb684011d90 comp rx=0 tx=0).stop 2023-11-04T15:37:00.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.348+0000 7fb695ac4640 1 -- 172.21.15.19:0/901684987 shutdown_connections 2023-11-04T15:37:00.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.348+0000 7fb695ac4640 1 --2- 172.21.15.19:0/901684987 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fb67c06a430 0x7fb67c06c8f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:00.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.348+0000 7fb695ac4640 1 --2- 172.21.15.19:0/901684987 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb69012fb50 0x7fb690130000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:00.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.348+0000 7fb695ac4640 1 --2- 172.21.15.19:0/901684987 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb69013b760 0x7fb69013bba0 unknown :-1 s=CLOSED pgs=3719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:00.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.348+0000 7fb695ac4640 1 --2- 172.21.15.19:0/901684987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb678003b30 0x7fb69013b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:00.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.348+0000 7fb695ac4640 1 -- 172.21.15.19:0/901684987 >> 172.21.15.19:0/901684987 conn(0x7fb6900ac3f0 msgr2=0x7fb6900a7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:00.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.349+0000 7fb695ac4640 1 -- 172.21.15.19:0/901684987 shutdown_connections 2023-11-04T15:37:00.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.349+0000 7fb695ac4640 1 -- 172.21.15.19:0/901684987 wait complete. 2023-11-04T15:37:00.363 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T15:37:00.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.471+0000 7fa254d59640 1 Processor -- start 2023-11-04T15:37:00.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.471+0000 7fa254d59640 1 -- start start 2023-11-04T15:37:00.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.472+0000 7fa254d59640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa2500a6370 0x7fa25013f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:00.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.472+0000 7fa254d59640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa25013f990 0x7fa250141d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:00.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.472+0000 7fa254d59640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2500abe60 con 0x7fa250136090 2023-11-04T15:37:00.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.472+0000 7fa254d59640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2500a68d0 con 0x7fa25013f990 2023-11-04T15:37:00.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.472+0000 7fa254d59640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2500a30a0 con 0x7fa2500a6370 2023-11-04T15:37:00.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.472+0000 7fa24e59c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa250136090 0x7fa250136470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57940/0 (socket says 172.21.15.19:57940) 2023-11-04T15:37:00.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.472+0000 7fa24e59c640 1 -- 172.21.15.19:0/1287132346 learned_addr learned my addr 172.21.15.19:0/1287132346 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:37:00.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.472+0000 7fa24dd9b640 1 -- 172.21.15.19:0/1287132346 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3448245556 0 0) 0x7fa2500abe60 con 0x7fa250136090 2023-11-04T15:37:00.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.472+0000 7fa24ed9d640 1 --2- 172.21.15.19:0/1287132346 >> v2:172.21.15.96:3300/0 conn(0x7fa25013f990 0x7fa250141d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:00.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.472+0000 7fa24dd9b640 1 -- 172.21.15.19:0/1287132346 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa23c003520 con 0x7fa250136090 2023-11-04T15:37:00.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.472+0000 7fa247fff640 1 --2- 172.21.15.19:0/1287132346 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa2500a6370 0x7fa25013f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:00.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.472+0000 7fa24dd9b640 1 -- 172.21.15.19:0/1287132346 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 292812478 0 0) 0x7fa23c003520 con 0x7fa250136090 2023-11-04T15:37:00.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.472+0000 7fa24dd9b640 1 -- 172.21.15.19:0/1287132346 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa2500a6370 msgr2=0x7fa25013f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:00.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.472+0000 7fa24dd9b640 1 --2- 172.21.15.19:0/1287132346 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa2500a6370 0x7fa25013f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:00.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.472+0000 7fa24dd9b640 1 -- 172.21.15.19:0/1287132346 >> v2:172.21.15.96:3300/0 conn(0x7fa25013f990 msgr2=0x7fa250141d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:00.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.472+0000 7fa24dd9b640 1 --2- 172.21.15.19:0/1287132346 >> v2:172.21.15.96:3300/0 conn(0x7fa25013f990 0x7fa250141d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:00.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.472+0000 7fa24dd9b640 1 -- 172.21.15.19:0/1287132346 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2500a4b90 con 0x7fa250136090 2023-11-04T15:37:00.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.472+0000 7fa24dd9b640 1 -- 172.21.15.19:0/1287132346 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3646097784 0 0) 0x7fa240001670 con 0x7fa250136090 2023-11-04T15:37:00.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.472+0000 7fa24dd9b640 1 -- 172.21.15.19:0/1287132346 >> v1:172.21.15.19:6789/0 conn(0x7fa250136090 legacy=0x7fa250136470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:00.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.472+0000 7fa24dd9b640 1 --2- 172.21.15.19:0/1287132346 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa23c003970 0x7fa23c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:00.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.472+0000 7fa24dd9b640 1 --2- 172.21.15.19:0/1287132346 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa23c0047c0 0x7fa23c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:00.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.472+0000 7fa24dd9b640 1 --2- 172.21.15.19:0/1287132346 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa2500a6370 0x7fa23c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:00.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.472+0000 7fa24dd9b640 1 -- 172.21.15.19:0/1287132346 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2500a68d0 con 0x7fa23c003970 2023-11-04T15:37:00.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.472+0000 7fa24dd9b640 1 -- 172.21.15.19:0/1287132346 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2500a30a0 con 0x7fa23c0047c0 2023-11-04T15:37:00.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.472+0000 7fa24dd9b640 1 -- 172.21.15.19:0/1287132346 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c00ba00 con 0x7fa2500a6370 2023-11-04T15:37:00.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.472+0000 7fa24e59c640 1 --2- 172.21.15.19:0/1287132346 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa23c003970 0x7fa23c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:00.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.472+0000 7fa247fff640 1 --2- 172.21.15.19:0/1287132346 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa23c0047c0 0x7fa23c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:00.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.472+0000 7fa24ed9d640 1 --2- 172.21.15.19:0/1287132346 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa2500a6370 0x7fa23c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:00.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.473+0000 7fa24e59c640 1 -- 172.21.15.19:0/1287132346 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa2500a6370 msgr2=0x7fa23c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:00.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.473+0000 7fa24e59c640 1 --2- 172.21.15.19:0/1287132346 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa2500a6370 0x7fa23c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:00.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.473+0000 7fa24e59c640 1 -- 172.21.15.19:0/1287132346 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa23c0047c0 msgr2=0x7fa23c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:00.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.473+0000 7fa24e59c640 1 --2- 172.21.15.19:0/1287132346 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa23c0047c0 0x7fa23c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:00.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.473+0000 7fa24e59c640 1 -- 172.21.15.19:0/1287132346 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23c003520 con 0x7fa23c003970 2023-11-04T15:37:00.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.473+0000 7fa24e59c640 1 --2- 172.21.15.19:0/1287132346 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa23c003970 0x7fa23c003d90 secure :-1 s=READY pgs=3721 cs=0 l=1 rev1=1 crypto rx=0x7fa24000c240 tx=0x7fa23c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bda5b9481fba782e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:00.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.474+0000 7fa24dd9b640 1 -- 172.21.15.19:0/1287132346 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24002cb00 con 0x7fa23c003970 2023-11-04T15:37:00.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.474+0000 7fa24dd9b640 1 -- 172.21.15.19:0/1287132346 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24002cc60 con 0x7fa23c003970 2023-11-04T15:37:00.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.474+0000 7fa24dd9b640 1 -- 172.21.15.19:0/1287132346 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2400058d0 con 0x7fa23c003970 2023-11-04T15:37:00.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.474+0000 7fa254d59640 1 -- 172.21.15.19:0/1287132346 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa23c003970 msgr2=0x7fa23c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:00.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.474+0000 7fa254d59640 1 --2- 172.21.15.19:0/1287132346 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa23c003970 0x7fa23c003d90 secure :-1 s=READY pgs=3721 cs=0 l=1 rev1=1 crypto rx=0x7fa24000c240 tx=0x7fa23c0057f0 comp rx=0 tx=0).stop 2023-11-04T15:37:00.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.474+0000 7fa24ed9d640 1 -- 172.21.15.19:0/1287132346 reap_dead start 2023-11-04T15:37:00.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.474+0000 7fa254d59640 1 -- 172.21.15.19:0/1287132346 shutdown_connections 2023-11-04T15:37:00.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.474+0000 7fa254d59640 1 -- 172.21.15.19:0/1287132346 >> 172.21.15.19:0/1287132346 conn(0x7fa2500ac3f0 msgr2=0x7fa2500ac800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:00.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.474+0000 7fa254d59640 1 -- 172.21.15.19:0/1287132346 shutdown_connections 2023-11-04T15:37:00.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.474+0000 7fa254d59640 1 -- 172.21.15.19:0/1287132346 wait complete. 2023-11-04T15:37:00.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.475+0000 7fa254d59640 1 Processor -- start 2023-11-04T15:37:00.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.475+0000 7fa254d59640 1 -- start start 2023-11-04T15:37:00.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.476+0000 7fa254d59640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa23c003970 0x7fa25013b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:00.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.476+0000 7fa254d59640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa25013aa70 0x7fa25013b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:00.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.476+0000 7fa254d59640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa25013bca0 0x7fa25012fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:00.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.476+0000 7fa254d59640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa250137d90 con 0x7fa23c003970 2023-11-04T15:37:00.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.476+0000 7fa254d59640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25013db90 con 0x7fa25013bca0 2023-11-04T15:37:00.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.476+0000 7fa254d59640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa25013c350 con 0x7fa25013aa70 2023-11-04T15:37:00.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.476+0000 7fa24e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa23c003970 0x7fa25013b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:00.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.476+0000 7fa24e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa23c003970 0x7fa25013b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60318/0 (socket says 172.21.15.19:60318) 2023-11-04T15:37:00.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.476+0000 7fa24e59c640 1 -- 172.21.15.19:0/2639155146 learned_addr learned my addr 172.21.15.19:0/2639155146 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:37:00.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.476+0000 7fa247fff640 1 --2- 172.21.15.19:0/2639155146 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa25013aa70 0x7fa25013b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:00.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.476+0000 7fa24ed9d640 1 --2- 172.21.15.19:0/2639155146 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa25013bca0 0x7fa25012fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:00.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.476+0000 7fa24e59c640 1 -- 172.21.15.19:0/2639155146 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa25013aa70 msgr2=0x7fa25013b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:00.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.476+0000 7fa24e59c640 1 --2- 172.21.15.19:0/2639155146 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa25013aa70 0x7fa25013b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:00.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.476+0000 7fa24e59c640 1 -- 172.21.15.19:0/2639155146 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa25013bca0 msgr2=0x7fa25012fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:00.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.476+0000 7fa24e59c640 1 --2- 172.21.15.19:0/2639155146 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa25013bca0 0x7fa25012fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:00.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.476+0000 7fa24e59c640 1 -- 172.21.15.19:0/2639155146 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa250137580 con 0x7fa23c003970 2023-11-04T15:37:00.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.476+0000 7fa24e59c640 1 --2- 172.21.15.19:0/2639155146 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa23c003970 0x7fa25013b220 secure :-1 s=READY pgs=3722 cs=0 l=1 rev1=1 crypto rx=0x7fa24002c4a0 tx=0x7fa2500a5960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:00.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.476+0000 7fa246ffd640 1 -- 172.21.15.19:0/2639155146 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa240039030 con 0x7fa23c003970 2023-11-04T15:37:00.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.477+0000 7fa246ffd640 1 -- 172.21.15.19:0/2639155146 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa240004bf0 con 0x7fa23c003970 2023-11-04T15:37:00.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.477+0000 7fa246ffd640 1 -- 172.21.15.19:0/2639155146 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24003c040 con 0x7fa23c003970 2023-11-04T15:37:00.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.477+0000 7fa254d59640 1 -- 172.21.15.19:0/2639155146 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2500a24a0 con 0x7fa23c003970 2023-11-04T15:37:00.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.477+0000 7fa254d59640 1 -- 172.21.15.19:0/2639155146 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa25013e340 con 0x7fa23c003970 2023-11-04T15:37:00.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.478+0000 7fa254d59640 1 -- 172.21.15.19:0/2639155146 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa250067d60 con 0x7fa23c003970 2023-11-04T15:37:00.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.478+0000 7fa246ffd640 1 -- 172.21.15.19:0/2639155146 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa240032070 con 0x7fa23c003970 2023-11-04T15:37:00.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.478+0000 7fa246ffd640 1 --2- 172.21.15.19:0/2639155146 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa23006a460 0x7fa23006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:00.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.478+0000 7fa246ffd640 1 -- 172.21.15.19:0/2639155146 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4462+0+0 (secure 0 0 0) 0x7fa2400a97c0 con 0x7fa23c003970 2023-11-04T15:37:00.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.478+0000 7fa247fff640 1 --2- 172.21.15.19:0/2639155146 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa23006a460 0x7fa23006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:00.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.479+0000 7fa247fff640 1 --2- 172.21.15.19:0/2639155146 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa23006a460 0x7fa23006c920 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa25013c930 tx=0x7fa238008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:00.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.483+0000 7fa246ffd640 1 -- 172.21.15.19:0/2639155146 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa240075320 con 0x7fa23c003970 2023-11-04T15:37:00.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.667+0000 7fa254d59640 1 -- 172.21.15.19:0/2639155146 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa2500a7190 con 0x7fa23c003970 2023-11-04T15:37:00.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.667+0000 7fa246ffd640 1 -- 172.21.15.19:0/2639155146 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa240078940 con 0x7fa23c003970 2023-11-04T15:37:00.670 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2023-11-04T15:37:00.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.670+0000 7fa254d59640 1 -- 172.21.15.19:0/2639155146 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa23006a460 msgr2=0x7fa23006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:00.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.670+0000 7fa254d59640 1 --2- 172.21.15.19:0/2639155146 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa23006a460 0x7fa23006c920 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa25013c930 tx=0x7fa238008040 comp rx=0 tx=0).stop 2023-11-04T15:37:00.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.670+0000 7fa254d59640 1 -- 172.21.15.19:0/2639155146 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa23c003970 msgr2=0x7fa25013b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:00.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.670+0000 7fa254d59640 1 --2- 172.21.15.19:0/2639155146 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa23c003970 0x7fa25013b220 secure :-1 s=READY pgs=3722 cs=0 l=1 rev1=1 crypto rx=0x7fa24002c4a0 tx=0x7fa2500a5960 comp rx=0 tx=0).stop 2023-11-04T15:37:00.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.670+0000 7fa254d59640 1 -- 172.21.15.19:0/2639155146 shutdown_connections 2023-11-04T15:37:00.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.670+0000 7fa254d59640 1 --2- 172.21.15.19:0/2639155146 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa23006a460 0x7fa23006c920 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:00.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.670+0000 7fa254d59640 1 --2- 172.21.15.19:0/2639155146 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa25013bca0 0x7fa25012fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:00.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.670+0000 7fa254d59640 1 --2- 172.21.15.19:0/2639155146 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa25013aa70 0x7fa25013b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:00.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.670+0000 7fa254d59640 1 --2- 172.21.15.19:0/2639155146 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa23c003970 0x7fa25013b220 unknown :-1 s=CLOSED pgs=3722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:00.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.670+0000 7fa254d59640 1 -- 172.21.15.19:0/2639155146 >> 172.21.15.19:0/2639155146 conn(0x7fa2500ac3f0 msgr2=0x7fa2500a7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:00.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.670+0000 7fa254d59640 1 -- 172.21.15.19:0/2639155146 shutdown_connections 2023-11-04T15:37:00.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.670+0000 7fa254d59640 1 -- 172.21.15.19:0/2639155146 wait complete. 2023-11-04T15:37:00.684 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T15:37:00.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.790+0000 7f64c74f7640 1 Processor -- start 2023-11-04T15:37:00.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.791+0000 7f64c74f7640 1 -- start start 2023-11-04T15:37:00.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.791+0000 7f64c74f7640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f64c013a600 0x7f64c013a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:00.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.791+0000 7f64c74f7640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f64c0065af0 0x7f64c0098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:00.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.791+0000 7f64c74f7640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64c006f930 con 0x7f64c006e2b0 2023-11-04T15:37:00.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.791+0000 7f64c74f7640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64c006fb50 con 0x7f64c013a600 2023-11-04T15:37:00.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.791+0000 7f64c74f7640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c006f4d0 con 0x7f64c0065af0 2023-11-04T15:37:00.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.791+0000 7f64c5293640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f64c013a600 0x7f64c013a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:00.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.791+0000 7f64c5a94640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f64c006e2b0 0x7f64c0098f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57942/0 (socket says 172.21.15.19:57942) 2023-11-04T15:37:00.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.791+0000 7f64c5a94640 1 -- 172.21.15.19:0/934762749 learned_addr learned my addr 172.21.15.19:0/934762749 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:37:00.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.791+0000 7f64c4a92640 1 --2- 172.21.15.19:0/934762749 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f64c0065af0 0x7f64c0098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:00.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.791+0000 7f64c5293640 1 -- 172.21.15.19:0/934762749 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f64c0065af0 msgr2=0x7f64c0098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:00.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.791+0000 7f64c5293640 1 --2- 172.21.15.19:0/934762749 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f64c0065af0 0x7f64c0098a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:00.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.792+0000 7f64c5293640 1 -- 172.21.15.19:0/934762749 >> v1:172.21.15.19:6789/0 conn(0x7f64c006e2b0 legacy=0x7f64c0098f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:00.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.792+0000 7f64c5293640 1 -- 172.21.15.19:0/934762749 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c006e7b0 con 0x7f64c013a600 2023-11-04T15:37:00.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.792+0000 7f64c5293640 1 --2- 172.21.15.19:0/934762749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64c013a600 0x7f64c013a9e0 secure :-1 s=READY pgs=3724 cs=0 l=1 rev1=1 crypto rx=0x7f64b80097a0 tx=0x7f64b802b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13acb696115bdf31 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:00.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.792+0000 7f64bffff640 1 -- 172.21.15.19:0/934762749 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b802f050 con 0x7f64c013a600 2023-11-04T15:37:00.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.792+0000 7f64bffff640 1 -- 172.21.15.19:0/934762749 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b8031700 con 0x7f64c013a600 2023-11-04T15:37:00.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.792+0000 7f64bffff640 1 -- 172.21.15.19:0/934762749 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b8031a90 con 0x7f64c013a600 2023-11-04T15:37:00.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.793+0000 7f64c74f7640 1 -- 172.21.15.19:0/934762749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64c013a600 msgr2=0x7f64c013a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:00.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.793+0000 7f64c74f7640 1 --2- 172.21.15.19:0/934762749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64c013a600 0x7f64c013a9e0 secure :-1 s=READY pgs=3724 cs=0 l=1 rev1=1 crypto rx=0x7f64b80097a0 tx=0x7f64b802b7a0 comp rx=0 tx=0).stop 2023-11-04T15:37:00.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.793+0000 7f64c74f7640 1 -- 172.21.15.19:0/934762749 shutdown_connections 2023-11-04T15:37:00.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.793+0000 7f64c74f7640 1 --2- 172.21.15.19:0/934762749 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f64c0065af0 0x7f64c0098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:00.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.793+0000 7f64c74f7640 1 --2- 172.21.15.19:0/934762749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64c013a600 0x7f64c013a9e0 unknown :-1 s=CLOSED pgs=3724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:00.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.793+0000 7f64c74f7640 1 -- 172.21.15.19:0/934762749 >> 172.21.15.19:0/934762749 conn(0x7f64c0069c70 msgr2=0x7f64c006a080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:00.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.793+0000 7f64c74f7640 1 -- 172.21.15.19:0/934762749 shutdown_connections 2023-11-04T15:37:00.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.793+0000 7f64c74f7640 1 -- 172.21.15.19:0/934762749 wait complete. 2023-11-04T15:37:00.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.794+0000 7f64c74f7640 1 Processor -- start 2023-11-04T15:37:00.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.794+0000 7f64c74f7640 1 -- start start 2023-11-04T15:37:00.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.794+0000 7f64c74f7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64c0065af0 0x7f64c01cede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:00.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.794+0000 7f64c74f7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64c006e2b0 0x7f64c01cf320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:00.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.794+0000 7f64c74f7640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f64c013a600 0x7f64c01cf860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:00.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.795+0000 7f64c74f7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c011fe50 con 0x7f64c0065af0 2023-11-04T15:37:00.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.795+0000 7f64c74f7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c011f990 con 0x7f64c006e2b0 2023-11-04T15:37:00.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.795+0000 7f64c74f7640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c00a51d0 con 0x7f64c013a600 2023-11-04T15:37:00.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.795+0000 7f64c5293640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64c0065af0 0x7f64c01cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:00.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.795+0000 7f64c5293640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64c0065af0 0x7f64c01cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60336/0 (socket says 172.21.15.19:60336) 2023-11-04T15:37:00.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.795+0000 7f64c5293640 1 -- 172.21.15.19:0/1337558763 learned_addr learned my addr 172.21.15.19:0/1337558763 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:37:00.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.795+0000 7f64c5a94640 1 --2- 172.21.15.19:0/1337558763 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f64c013a600 0x7f64c01cf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:00.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.795+0000 7f64c4a92640 1 --2- 172.21.15.19:0/1337558763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64c006e2b0 0x7f64c01cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:00.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.795+0000 7f64c5293640 1 -- 172.21.15.19:0/1337558763 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f64c013a600 msgr2=0x7f64c01cf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:00.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.795+0000 7f64c5293640 1 --2- 172.21.15.19:0/1337558763 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f64c013a600 0x7f64c01cf860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:00.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.795+0000 7f64c5293640 1 -- 172.21.15.19:0/1337558763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64c006e2b0 msgr2=0x7f64c01cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:00.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.795+0000 7f64c5293640 1 --2- 172.21.15.19:0/1337558763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64c006e2b0 0x7f64c01cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:00.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.795+0000 7f64c5293640 1 -- 172.21.15.19:0/1337558763 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b8009400 con 0x7f64c0065af0 2023-11-04T15:37:00.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.795+0000 7f64c4a92640 1 --2- 172.21.15.19:0/1337558763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64c006e2b0 0x7f64c01cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:37:00.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.795+0000 7f64c5293640 1 --2- 172.21.15.19:0/1337558763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64c0065af0 0x7f64c01cede0 secure :-1 s=READY pgs=3725 cs=0 l=1 rev1=1 crypto rx=0x7f64b8009890 tx=0x7f64b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:00.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.795+0000 7f64bdffb640 1 -- 172.21.15.19:0/1337558763 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b8033a60 con 0x7f64c0065af0 2023-11-04T15:37:00.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.795+0000 7f64bdffb640 1 -- 172.21.15.19:0/1337558763 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b8033be0 con 0x7f64c0065af0 2023-11-04T15:37:00.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.795+0000 7f64c74f7640 1 -- 172.21.15.19:0/1337558763 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64c0120380 con 0x7f64c0065af0 2023-11-04T15:37:00.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.795+0000 7f64bdffb640 1 -- 172.21.15.19:0/1337558763 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b8046410 con 0x7f64c0065af0 2023-11-04T15:37:00.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.796+0000 7f64c74f7640 1 -- 172.21.15.19:0/1337558763 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c00a48f0 con 0x7f64c0065af0 2023-11-04T15:37:00.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.797+0000 7f64c74f7640 1 -- 172.21.15.19:0/1337558763 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64c009bab0 con 0x7f64c0065af0 2023-11-04T15:37:00.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.797+0000 7f64bdffb640 1 -- 172.21.15.19:0/1337558763 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f64b803a070 con 0x7f64c0065af0 2023-11-04T15:37:00.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.797+0000 7f64bdffb640 1 --2- 172.21.15.19:0/1337558763 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f64ac06a430 0x7f64ac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:00.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.797+0000 7f64bdffb640 1 -- 172.21.15.19:0/1337558763 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4462+0+0 (secure 0 0 0) 0x7f64b80a9d40 con 0x7f64c0065af0 2023-11-04T15:37:00.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.798+0000 7f64c4a92640 1 --2- 172.21.15.19:0/1337558763 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f64ac06a430 0x7f64ac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:00.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.798+0000 7f64c4a92640 1 --2- 172.21.15.19:0/1337558763 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f64ac06a430 0x7f64ac06c8f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f64c00a4130 tx=0x7f64b4008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:00.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.802+0000 7f64bdffb640 1 -- 172.21.15.19:0/1337558763 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f64b8075800 con 0x7f64c0065af0 2023-11-04T15:37:00.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.996+0000 7f64c74f7640 1 -- 172.21.15.19:0/1337558763 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f64c0067d60 con 0x7f64c0065af0 2023-11-04T15:37:00.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.996+0000 7f64bdffb640 1 -- 172.21.15.19:0/1337558763 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 1 entries v43) v1 ==== 80+0+58 (secure 0 0 0) 0x7f64b8041050 con 0x7f64c0065af0 2023-11-04T15:37:00.999 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.130:0/185843238 2023-11-04T16:36:55.500269+0000 2023-11-04T15:37:00.999 INFO:teuthology.orchestra.run.smithi019.stderr:listed 1 entries 2023-11-04T15:37:01.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.998+0000 7f64c74f7640 1 -- 172.21.15.19:0/1337558763 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f64ac06a430 msgr2=0x7f64ac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:01.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.998+0000 7f64c74f7640 1 --2- 172.21.15.19:0/1337558763 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f64ac06a430 0x7f64ac06c8f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f64c00a4130 tx=0x7f64b4008040 comp rx=0 tx=0).stop 2023-11-04T15:37:01.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.998+0000 7f64c74f7640 1 -- 172.21.15.19:0/1337558763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64c0065af0 msgr2=0x7f64c01cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:01.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.998+0000 7f64c74f7640 1 --2- 172.21.15.19:0/1337558763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64c0065af0 0x7f64c01cede0 secure :-1 s=READY pgs=3725 cs=0 l=1 rev1=1 crypto rx=0x7f64b8009890 tx=0x7f64b80046c0 comp rx=0 tx=0).stop 2023-11-04T15:37:01.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.998+0000 7f64c74f7640 1 -- 172.21.15.19:0/1337558763 shutdown_connections 2023-11-04T15:37:01.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.998+0000 7f64c74f7640 1 --2- 172.21.15.19:0/1337558763 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f64ac06a430 0x7f64ac06c8f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:01.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.998+0000 7f64c74f7640 1 --2- 172.21.15.19:0/1337558763 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f64c013a600 0x7f64c01cf860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:01.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.998+0000 7f64c74f7640 1 --2- 172.21.15.19:0/1337558763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f64c006e2b0 0x7f64c01cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:01.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.998+0000 7f64c74f7640 1 --2- 172.21.15.19:0/1337558763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64c0065af0 0x7f64c01cede0 unknown :-1 s=CLOSED pgs=3725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:01.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.998+0000 7f64c74f7640 1 -- 172.21.15.19:0/1337558763 >> 172.21.15.19:0/1337558763 conn(0x7f64c0069c70 msgr2=0x7f64c00a8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:01.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.998+0000 7f64c74f7640 1 -- 172.21.15.19:0/1337558763 shutdown_connections 2023-11-04T15:37:01.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:00.998+0000 7f64c74f7640 1 -- 172.21.15.19:0/1337558763 wait complete. 2023-11-04T15:37:01.012 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-11-04T15:37:01.013 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T15:37:01.031 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T15:37:01.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.137+0000 7f12c5bab640 1 Processor -- start 2023-11-04T15:37:01.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.137+0000 7f12c5bab640 1 -- start start 2023-11-04T15:37:01.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.138+0000 7f12c5bab640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12c00a50b0 0x7f12c013d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:01.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.138+0000 7f12c5bab640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f12c013d790 0x7f12c013fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:01.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.138+0000 7f12c5bab640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12c00a5800 con 0x7f12c0131ce0 2023-11-04T15:37:01.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.138+0000 7f12c5bab640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12c009fec0 con 0x7f12c013d790 2023-11-04T15:37:01.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.138+0000 7f12c5bab640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c00a29d0 con 0x7f12c00a50b0 2023-11-04T15:37:01.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.138+0000 7f12bffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f12c013d790 0x7f12c013fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:01.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.138+0000 7f12bffff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f12c013d790 0x7f12c013fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60350/0 (socket says 172.21.15.19:60350) 2023-11-04T15:37:01.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.138+0000 7f12bffff640 1 -- 172.21.15.19:0/1447828210 learned_addr learned my addr 172.21.15.19:0/1447828210 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:37:01.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.138+0000 7f12beffd640 1 --2- 172.21.15.19:0/1447828210 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12c00a50b0 0x7f12c013d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:01.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.138+0000 7f12bffff640 1 -- 172.21.15.19:0/1447828210 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12c00a50b0 msgr2=0x7f12c013d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:01.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.138+0000 7f12bffff640 1 --2- 172.21.15.19:0/1447828210 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12c00a50b0 0x7f12c013d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:01.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.138+0000 7f12bffff640 1 -- 172.21.15.19:0/1447828210 >> v1:172.21.15.96:6789/0 conn(0x7f12c0131ce0 legacy=0x7f12c01320c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:01.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.138+0000 7f12bffff640 1 -- 172.21.15.19:0/1447828210 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c00a5540 con 0x7f12c013d790 2023-11-04T15:37:01.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.139+0000 7f12bffff640 1 --2- 172.21.15.19:0/1447828210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f12c013d790 0x7f12c013fb80 secure :-1 s=READY pgs=3726 cs=0 l=1 rev1=1 crypto rx=0x7f12b8009e50 tx=0x7f12b802bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dbd445e92b3d7a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:01.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.139+0000 7f12be7fc640 1 -- 172.21.15.19:0/1447828210 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b802c950 con 0x7f12c013d790 2023-11-04T15:37:01.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.139+0000 7f12be7fc640 1 -- 172.21.15.19:0/1447828210 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b802cab0 con 0x7f12c013d790 2023-11-04T15:37:01.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.139+0000 7f12be7fc640 1 -- 172.21.15.19:0/1447828210 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b802ce40 con 0x7f12c013d790 2023-11-04T15:37:01.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.140+0000 7f12c5bab640 1 -- 172.21.15.19:0/1447828210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f12c013d790 msgr2=0x7f12c013fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:01.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.140+0000 7f12c5bab640 1 --2- 172.21.15.19:0/1447828210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f12c013d790 0x7f12c013fb80 secure :-1 s=READY pgs=3726 cs=0 l=1 rev1=1 crypto rx=0x7f12b8009e50 tx=0x7f12b802bdb0 comp rx=0 tx=0).stop 2023-11-04T15:37:01.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.140+0000 7f12c5bab640 1 -- 172.21.15.19:0/1447828210 shutdown_connections 2023-11-04T15:37:01.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.140+0000 7f12c5bab640 1 --2- 172.21.15.19:0/1447828210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f12c013d790 0x7f12c013fb80 unknown :-1 s=CLOSED pgs=3726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:01.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.140+0000 7f12c5bab640 1 --2- 172.21.15.19:0/1447828210 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12c00a50b0 0x7f12c013d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:01.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.140+0000 7f12c5bab640 1 -- 172.21.15.19:0/1447828210 >> 172.21.15.19:0/1447828210 conn(0x7f12c00a5af0 msgr2=0x7f12c00a5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:01.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.140+0000 7f12c5bab640 1 -- 172.21.15.19:0/1447828210 shutdown_connections 2023-11-04T15:37:01.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.140+0000 7f12c5bab640 1 -- 172.21.15.19:0/1447828210 wait complete. 2023-11-04T15:37:01.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.141+0000 7f12c5bab640 1 Processor -- start 2023-11-04T15:37:01.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.141+0000 7f12c5bab640 1 -- start start 2023-11-04T15:37:01.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.142+0000 7f12c5bab640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12c0131ce0 0x7f12c0099110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:01.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.142+0000 7f12c5bab640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12c013d790 0x7f12c00a6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:01.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.142+0000 7f12c5bab640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f12c00a7390 0x7f12c00a7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:01.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.142+0000 7f12c5bab640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c0099650 con 0x7f12c00a7390 2023-11-04T15:37:01.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.142+0000 7f12c5bab640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c013d370 con 0x7f12c0131ce0 2023-11-04T15:37:01.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.142+0000 7f12c5bab640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c009f580 con 0x7f12c013d790 2023-11-04T15:37:01.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.142+0000 7f12bffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f12c00a7390 0x7f12c00a7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:01.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.142+0000 7f12bffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f12c00a7390 0x7f12c00a7810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60366/0 (socket says 172.21.15.19:60366) 2023-11-04T15:37:01.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.142+0000 7f12bffff640 1 -- 172.21.15.19:0/3315832883 learned_addr learned my addr 172.21.15.19:0/3315832883 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:37:01.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.142+0000 7f12beffd640 1 --2- 172.21.15.19:0/3315832883 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12c013d790 0x7f12c00a6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:01.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.142+0000 7f12bf7fe640 1 --2- 172.21.15.19:0/3315832883 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12c0131ce0 0x7f12c0099110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:01.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.142+0000 7f12bffff640 1 -- 172.21.15.19:0/3315832883 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12c013d790 msgr2=0x7f12c00a6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:01.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.142+0000 7f12bffff640 1 --2- 172.21.15.19:0/3315832883 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12c013d790 0x7f12c00a6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:01.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.142+0000 7f12bffff640 1 -- 172.21.15.19:0/3315832883 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12c0131ce0 msgr2=0x7f12c0099110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:01.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.142+0000 7f12bffff640 1 --2- 172.21.15.19:0/3315832883 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12c0131ce0 0x7f12c0099110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:01.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.142+0000 7f12bffff640 1 -- 172.21.15.19:0/3315832883 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b8009b30 con 0x7f12c00a7390 2023-11-04T15:37:01.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.142+0000 7f12bffff640 1 --2- 172.21.15.19:0/3315832883 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f12c00a7390 0x7f12c00a7810 secure :-1 s=READY pgs=3727 cs=0 l=1 rev1=1 crypto rx=0x7f12b8009e50 tx=0x7f12b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:01.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.142+0000 7f12a7fff640 1 -- 172.21.15.19:0/3315832883 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b8009510 con 0x7f12c00a7390 2023-11-04T15:37:01.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.142+0000 7f12a7fff640 1 -- 172.21.15.19:0/3315832883 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b803e450 con 0x7f12c00a7390 2023-11-04T15:37:01.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.142+0000 7f12c5bab640 1 -- 172.21.15.19:0/3315832883 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12c009f820 con 0x7f12c00a7390 2023-11-04T15:37:01.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.142+0000 7f12a7fff640 1 -- 172.21.15.19:0/3315832883 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b803e7e0 con 0x7f12c00a7390 2023-11-04T15:37:01.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.143+0000 7f12c5bab640 1 -- 172.21.15.19:0/3315832883 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c00989a0 con 0x7f12c00a7390 2023-11-04T15:37:01.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.143+0000 7f12c5bab640 1 -- 172.21.15.19:0/3315832883 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12c00a96e0 con 0x7f12c00a7390 2023-11-04T15:37:01.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.144+0000 7f12a7fff640 1 -- 172.21.15.19:0/3315832883 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f12b803e940 con 0x7f12c00a7390 2023-11-04T15:37:01.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.144+0000 7f12a7fff640 1 --2- 172.21.15.19:0/3315832883 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f12ac06a460 0x7f12ac06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:01.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.144+0000 7f12a7fff640 1 -- 172.21.15.19:0/3315832883 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4462+0+0 (secure 0 0 0) 0x7f12b80aacf0 con 0x7f12c00a7390 2023-11-04T15:37:01.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.145+0000 7f12bf7fe640 1 --2- 172.21.15.19:0/3315832883 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f12ac06a460 0x7f12ac06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:01.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.145+0000 7f12bf7fe640 1 --2- 172.21.15.19:0/3315832883 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f12ac06a460 0x7f12ac06c920 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f12b0004f60 tx=0x7f12b0007e30 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:01.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.149+0000 7f12a7fff640 1 -- 172.21.15.19:0/3315832883 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f12b80af070 con 0x7f12c00a7390 2023-11-04T15:37:01.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.330+0000 7f12c5bab640 1 -- 172.21.15.19:0/3315832883 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12c0067d60 con 0x7f12c00a7390 2023-11-04T15:37:01.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.331+0000 7f12a7fff640 1 -- 172.21.15.19:0/3315832883 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+13397 (secure 0 0 0) 0x7f12b8076900 con 0x7f12c00a7390 2023-11-04T15:37:01.334 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:37:01.334 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":43,"fsid":"e87311d5-496a-4b07-9654-358fe5bbf950","created":"2023-11-04T15:27:14.865121+0000","modified":"2023-11-04T15:36:55.712975+0000","last_up_change":"2023-11-04T15:27:24.162282+0000","last_in_change":"2023-11-04T15:27:15.971035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T15:27:24.987312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-04T15:27:30.500235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-04T15:27:34.476271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-04T15:27:35.096759+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":65,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"34818469-ebf2-4dd4-8119-af19a0121036","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":82879},{"type":"v1","addr":"172.21.15.19:6801","nonce":82879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":82879},{"type":"v1","addr":"172.21.15.19:6803","nonce":82879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":82879},{"type":"v1","addr":"172.21.15.19:6807","nonce":82879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":82879},{"type":"v1","addr":"172.21.15.19:6805","nonce":82879}]},"public_addr":"172.21.15.19:6801/82879","cluster_addr":"172.21.15.19:6803/82879","heartbeat_back_addr":"172.21.15.19:6807/82879","heartbeat_front_addr":"172.21.15.19:6805/82879","state":["exists","up"]},{"osd":1,"uuid":"92dab290-7912-4eea-b6f6-c754c2480721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":82880},{"type":"v1","addr":"172.21.15.19:6809","nonce":82880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":82880},{"type":"v1","addr":"172.21.15.19:6811","nonce":82880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":82880},{"type":"v1","addr":"172.21.15.19:6815","nonce":82880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":82880},{"type":"v1","addr":"172.21.15.19:6813","nonce":82880}]},"public_addr":"172.21.15.19:6809/82880","cluster_addr":"172.21.15.19:6811/82880","heartbeat_back_addr":"172.21.15.19:6815/82880","heartbeat_front_addr":"172.21.15.19:6813/82880","state":["exists","up"]},{"osd":2,"uuid":"1be47db4-6dd1-4ce5-832b-bc6ad30c78c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":83458},{"type":"v1","addr":"172.21.15.96:6808","nonce":83458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":83458},{"type":"v1","addr":"172.21.15.96:6811","nonce":83458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":83458},{"type":"v1","addr":"172.21.15.96:6815","nonce":83458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":83458},{"type":"v1","addr":"172.21.15.96:6813","nonce":83458}]},"public_addr":"172.21.15.96:6808/83458","cluster_addr":"172.21.15.96:6811/83458","heartbeat_back_addr":"172.21.15.96:6815/83458","heartbeat_front_addr":"172.21.15.96:6813/83458","state":["exists","up"]},{"osd":3,"uuid":"46505800-d64f-49ef-b811-5b5979f48252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":83459},{"type":"v1","addr":"172.21.15.96:6801","nonce":83459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":83459},{"type":"v1","addr":"172.21.15.96:6803","nonce":83459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6807","nonce":83459},{"type":"v1","addr":"172.21.15.96:6809","nonce":83459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":83459},{"type":"v1","addr":"172.21.15.96:6805","nonce":83459}]},"public_addr":"172.21.15.96:6801/83459","cluster_addr":"172.21.15.96:6803/83459","heartbeat_back_addr":"172.21.15.96:6809/83459","heartbeat_front_addr":"172.21.15.96:6805/83459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.081547+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.132075+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.094919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.074106+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.24","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.130:0/185843238":"2023-11-04T16:36:55.500269+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":4,"snaps":[{"begin":60,"length":6}]}],"new_removed_snaps":[{"pool":4,"snaps":[{"begin":60,"length":6}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T15:37:01.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.333+0000 7f12c5bab640 1 -- 172.21.15.19:0/3315832883 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f12ac06a460 msgr2=0x7f12ac06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:01.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.333+0000 7f12c5bab640 1 --2- 172.21.15.19:0/3315832883 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f12ac06a460 0x7f12ac06c920 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f12b0004f60 tx=0x7f12b0007e30 comp rx=0 tx=0).stop 2023-11-04T15:37:01.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.333+0000 7f12c5bab640 1 -- 172.21.15.19:0/3315832883 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f12c00a7390 msgr2=0x7f12c00a7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:01.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.333+0000 7f12c5bab640 1 --2- 172.21.15.19:0/3315832883 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f12c00a7390 0x7f12c00a7810 secure :-1 s=READY pgs=3727 cs=0 l=1 rev1=1 crypto rx=0x7f12b8009e50 tx=0x7f12b8004a40 comp rx=0 tx=0).stop 2023-11-04T15:37:01.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.333+0000 7f12c5bab640 1 -- 172.21.15.19:0/3315832883 shutdown_connections 2023-11-04T15:37:01.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.333+0000 7f12c5bab640 1 --2- 172.21.15.19:0/3315832883 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f12ac06a460 0x7f12ac06c920 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:01.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.333+0000 7f12c5bab640 1 --2- 172.21.15.19:0/3315832883 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f12c00a7390 0x7f12c00a7810 unknown :-1 s=CLOSED pgs=3727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:01.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.333+0000 7f12c5bab640 1 --2- 172.21.15.19:0/3315832883 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12c013d790 0x7f12c00a6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:01.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.333+0000 7f12c5bab640 1 --2- 172.21.15.19:0/3315832883 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12c0131ce0 0x7f12c0099110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:01.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.333+0000 7f12c5bab640 1 -- 172.21.15.19:0/3315832883 >> 172.21.15.19:0/3315832883 conn(0x7f12c00a5af0 msgr2=0x7f12c0135d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:01.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.333+0000 7f12c5bab640 1 -- 172.21.15.19:0/3315832883 shutdown_connections 2023-11-04T15:37:01.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.333+0000 7f12c5bab640 1 -- 172.21.15.19:0/3315832883 wait complete. 2023-11-04T15:37:01.348 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T15:27:24.987312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-04T15:27:30.500235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T15:27:34.476271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T15:27:35.096759+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 65, 'snap_epoch': 43, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.190000057220459, 'score_stable': 1.190000057220459, 'optimal_score': 1, 'raw_score_acting': 1.190000057220459, 'raw_score_stable': 1.190000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T15:37:01.349 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T15:37:01.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.457+0000 7fbbf0dbb640 1 Processor -- start 2023-11-04T15:37:01.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.457+0000 7fbbf0dbb640 1 -- start start 2023-11-04T15:37:01.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.458+0000 7fbbf0dbb640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbec136090 0x7fbbec136470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:01.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.458+0000 7fbbf0dbb640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbbec13a840 0x7fbbec142470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:01.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.458+0000 7fbbf0dbb640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbec0abe60 con 0x7fbbec0a6370 2023-11-04T15:37:01.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.458+0000 7fbbf0dbb640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbec0a30a0 con 0x7fbbec13a840 2023-11-04T15:37:01.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.458+0000 7fbbf0dbb640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec0a4b90 con 0x7fbbec136090 2023-11-04T15:37:01.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.458+0000 7fbbea59c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbec136090 0x7fbbec136470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:01.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.458+0000 7fbbead9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbbec13a840 0x7fbbec142470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:01.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.458+0000 7fbbe9d9b640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fbbec0a6370 0x7fbbec13a130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.19:37182/0 (socket says 172.21.15.19:37182) 2023-11-04T15:37:01.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.458+0000 7fbbe9d9b640 1 -- 172.21.15.19:0/255583108 learned_addr learned my addr 172.21.15.19:0/255583108 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:37:01.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.458+0000 7fbbe959a640 1 -- 172.21.15.19:0/255583108 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1375056030 0 0) 0x7fbbec0abe60 con 0x7fbbec0a6370 2023-11-04T15:37:01.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.458+0000 7fbbe959a640 1 -- 172.21.15.19:0/255583108 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbd4003520 con 0x7fbbec0a6370 2023-11-04T15:37:01.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.458+0000 7fbbead9d640 1 -- 172.21.15.19:0/255583108 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbec136090 msgr2=0x7fbbec136470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:01.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.458+0000 7fbbead9d640 1 --2- 172.21.15.19:0/255583108 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbec136090 0x7fbbec136470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:01.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.458+0000 7fbbead9d640 1 -- 172.21.15.19:0/255583108 >> v1:172.21.15.96:6789/0 conn(0x7fbbec0a6370 legacy=0x7fbbec13a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:01.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.458+0000 7fbbead9d640 1 -- 172.21.15.19:0/255583108 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbec0a51f0 con 0x7fbbec13a840 2023-11-04T15:37:01.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.458+0000 7fbbea59c640 1 --2- 172.21.15.19:0/255583108 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbec136090 0x7fbbec136470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T15:37:01.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.459+0000 7fbbead9d640 1 --2- 172.21.15.19:0/255583108 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbec13a840 0x7fbbec142470 secure :-1 s=READY pgs=2754 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40097a0 tx=0x7fbbe402b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d96b9b25698278d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:01.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.459+0000 7fbbe959a640 1 -- 172.21.15.19:0/255583108 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe402f050 con 0x7fbbec13a840 2023-11-04T15:37:01.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.459+0000 7fbbe959a640 1 -- 172.21.15.19:0/255583108 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe4031700 con 0x7fbbec13a840 2023-11-04T15:37:01.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.459+0000 7fbbe959a640 1 -- 172.21.15.19:0/255583108 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4031a90 con 0x7fbbec13a840 2023-11-04T15:37:01.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.460+0000 7fbbf0dbb640 1 -- 172.21.15.19:0/255583108 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbec13a840 msgr2=0x7fbbec142470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:01.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.460+0000 7fbbf0dbb640 1 --2- 172.21.15.19:0/255583108 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbec13a840 0x7fbbec142470 secure :-1 s=READY pgs=2754 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40097a0 tx=0x7fbbe402b7a0 comp rx=0 tx=0).stop 2023-11-04T15:37:01.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.460+0000 7fbbf0dbb640 1 -- 172.21.15.19:0/255583108 shutdown_connections 2023-11-04T15:37:01.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.460+0000 7fbbf0dbb640 1 --2- 172.21.15.19:0/255583108 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbec13a840 0x7fbbec142470 unknown :-1 s=CLOSED pgs=2754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:01.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.460+0000 7fbbf0dbb640 1 --2- 172.21.15.19:0/255583108 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbec136090 0x7fbbec136470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:01.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.460+0000 7fbbf0dbb640 1 -- 172.21.15.19:0/255583108 >> 172.21.15.19:0/255583108 conn(0x7fbbec0ac3f0 msgr2=0x7fbbec0ac800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:01.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.460+0000 7fbbf0dbb640 1 -- 172.21.15.19:0/255583108 shutdown_connections 2023-11-04T15:37:01.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.460+0000 7fbbf0dbb640 1 -- 172.21.15.19:0/255583108 wait complete. 2023-11-04T15:37:01.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.461+0000 7fbbf0dbb640 1 Processor -- start 2023-11-04T15:37:01.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.461+0000 7fbbf0dbb640 1 -- start start 2023-11-04T15:37:01.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.462+0000 7fbbf0dbb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbec0a6370 0x7fbbec1cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:01.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.462+0000 7fbbf0dbb640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbec136090 0x7fbbec1cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:01.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.462+0000 7fbbf0dbb640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbec13a840 0x7fbbec1ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:01.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.462+0000 7fbbf0dbb640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec09c210 con 0x7fbbec0a6370 2023-11-04T15:37:01.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.462+0000 7fbbf0dbb640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec1cb5b0 con 0x7fbbec13a840 2023-11-04T15:37:01.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.462+0000 7fbbf0dbb640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec1cb850 con 0x7fbbec136090 2023-11-04T15:37:01.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.462+0000 7fbbea59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbec0a6370 0x7fbbec1cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:01.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.462+0000 7fbbea59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbec0a6370 0x7fbbec1cbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60368/0 (socket says 172.21.15.19:60368) 2023-11-04T15:37:01.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.462+0000 7fbbea59c640 1 -- 172.21.15.19:0/2435925155 learned_addr learned my addr 172.21.15.19:0/2435925155 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:37:01.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.462+0000 7fbbead9d640 1 --2- 172.21.15.19:0/2435925155 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbec13a840 0x7fbbec1ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:01.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.462+0000 7fbbe9d9b640 1 --2- 172.21.15.19:0/2435925155 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbec136090 0x7fbbec1cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:01.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.462+0000 7fbbea59c640 1 -- 172.21.15.19:0/2435925155 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbec136090 msgr2=0x7fbbec1cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:01.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.462+0000 7fbbea59c640 1 --2- 172.21.15.19:0/2435925155 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbec136090 0x7fbbec1cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:01.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.462+0000 7fbbea59c640 1 -- 172.21.15.19:0/2435925155 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbec13a840 msgr2=0x7fbbec1ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:01.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.462+0000 7fbbea59c640 1 --2- 172.21.15.19:0/2435925155 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbec13a840 0x7fbbec1ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:01.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.462+0000 7fbbea59c640 1 -- 172.21.15.19:0/2435925155 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbdc009a70 con 0x7fbbec0a6370 2023-11-04T15:37:01.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.462+0000 7fbbe9d9b640 1 --2- 172.21.15.19:0/2435925155 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbec136090 0x7fbbec1cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T15:37:01.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.462+0000 7fbbea59c640 1 --2- 172.21.15.19:0/2435925155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbec0a6370 0x7fbbec1cbca0 secure :-1 s=READY pgs=3728 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc00efc0 tx=0x7fbbdc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:01.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.463+0000 7fbbdaffd640 1 -- 172.21.15.19:0/2435925155 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc014680 con 0x7fbbec0a6370 2023-11-04T15:37:01.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.463+0000 7fbbdaffd640 1 -- 172.21.15.19:0/2435925155 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbdc00f040 con 0x7fbbec0a6370 2023-11-04T15:37:01.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.463+0000 7fbbf0dbb640 1 -- 172.21.15.19:0/2435925155 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe4009400 con 0x7fbbec0a6370 2023-11-04T15:37:01.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.463+0000 7fbbdaffd640 1 -- 172.21.15.19:0/2435925155 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc014a00 con 0x7fbbec0a6370 2023-11-04T15:37:01.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.463+0000 7fbbf0dbb640 1 -- 172.21.15.19:0/2435925155 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbec09c480 con 0x7fbbec0a6370 2023-11-04T15:37:01.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.464+0000 7fbbf0dbb640 1 -- 172.21.15.19:0/2435925155 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbec067d60 con 0x7fbbec0a6370 2023-11-04T15:37:01.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.464+0000 7fbbdaffd640 1 -- 172.21.15.19:0/2435925155 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbbdc014b60 con 0x7fbbec0a6370 2023-11-04T15:37:01.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.464+0000 7fbbdaffd640 1 --2- 172.21.15.19:0/2435925155 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fbbcc06a430 0x7fbbcc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:01.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.465+0000 7fbbdaffd640 1 -- 172.21.15.19:0/2435925155 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4462+0+0 (secure 0 0 0) 0x7fbbdc089380 con 0x7fbbec0a6370 2023-11-04T15:37:01.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.465+0000 7fbbe9d9b640 1 --2- 172.21.15.19:0/2435925155 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fbbcc06a430 0x7fbbcc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:01.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.465+0000 7fbbe9d9b640 1 --2- 172.21.15.19:0/2435925155 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fbbcc06a430 0x7fbbcc06c8f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbbe00011e0 tx=0x7fbbe0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:01.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.469+0000 7fbbdaffd640 1 -- 172.21.15.19:0/2435925155 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbbdc054ee0 con 0x7fbbec0a6370 2023-11-04T15:37:01.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.650+0000 7fbbf0dbb640 1 -- 172.21.15.19:0/2435925155 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbbec0a34c0 con 0x7fbbec0a6370 2023-11-04T15:37:01.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.651+0000 7fbbdaffd640 1 -- 172.21.15.19:0/2435925155 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbbdc058500 con 0x7fbbec0a6370 2023-11-04T15:37:01.653 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-11-04T15:37:01.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.653+0000 7fbbf0dbb640 1 -- 172.21.15.19:0/2435925155 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fbbcc06a430 msgr2=0x7fbbcc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:01.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.653+0000 7fbbf0dbb640 1 --2- 172.21.15.19:0/2435925155 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fbbcc06a430 0x7fbbcc06c8f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbbe00011e0 tx=0x7fbbe0009040 comp rx=0 tx=0).stop 2023-11-04T15:37:01.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.653+0000 7fbbf0dbb640 1 -- 172.21.15.19:0/2435925155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbec0a6370 msgr2=0x7fbbec1cbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:01.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.653+0000 7fbbf0dbb640 1 --2- 172.21.15.19:0/2435925155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbec0a6370 0x7fbbec1cbca0 secure :-1 s=READY pgs=3728 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc00efc0 tx=0x7fbbdc00c490 comp rx=0 tx=0).stop 2023-11-04T15:37:01.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.653+0000 7fbbf0dbb640 1 -- 172.21.15.19:0/2435925155 shutdown_connections 2023-11-04T15:37:01.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.653+0000 7fbbf0dbb640 1 --2- 172.21.15.19:0/2435925155 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fbbcc06a430 0x7fbbcc06c8f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:01.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.653+0000 7fbbf0dbb640 1 --2- 172.21.15.19:0/2435925155 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbec13a840 0x7fbbec1ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:01.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.653+0000 7fbbf0dbb640 1 --2- 172.21.15.19:0/2435925155 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbec136090 0x7fbbec1cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:01.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.653+0000 7fbbf0dbb640 1 --2- 172.21.15.19:0/2435925155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbec0a6370 0x7fbbec1cbca0 unknown :-1 s=CLOSED pgs=3728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:01.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.653+0000 7fbbf0dbb640 1 -- 172.21.15.19:0/2435925155 >> 172.21.15.19:0/2435925155 conn(0x7fbbec0ac3f0 msgr2=0x7fbbec132460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:01.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.653+0000 7fbbf0dbb640 1 -- 172.21.15.19:0/2435925155 shutdown_connections 2023-11-04T15:37:01.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.653+0000 7fbbf0dbb640 1 -- 172.21.15.19:0/2435925155 wait complete. 2023-11-04T15:37:01.667 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-04T15:37:01.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.778+0000 7f22579a4640 1 Processor -- start 2023-11-04T15:37:01.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.778+0000 7f22579a4640 1 -- start start 2023-11-04T15:37:01.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.779+0000 7f22579a4640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2250133ba0 0x7f2250133f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:01.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.779+0000 7f22579a4640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2250070b50 con 0x7f22501344c0 2023-11-04T15:37:01.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.779+0000 7f22579a4640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f225006f9d0 con 0x7f225009a230 2023-11-04T15:37:01.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.779+0000 7f22579a4640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f225006ff70 con 0x7f2250133ba0 2023-11-04T15:37:01.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.779+0000 7f2254f3f640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f22501344c0 0x7f2250099b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57958/0 (socket says 172.21.15.19:57958) 2023-11-04T15:37:01.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.779+0000 7f2254f3f640 1 -- 172.21.15.19:0/2968978917 learned_addr learned my addr 172.21.15.19:0/2968978917 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:37:01.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.779+0000 7f2247fff640 1 -- 172.21.15.19:0/2968978917 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4051501016 0 0) 0x7f2250070b50 con 0x7f22501344c0 2023-11-04T15:37:01.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.779+0000 7f2247fff640 1 -- 172.21.15.19:0/2968978917 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f223c005730 con 0x7f22501344c0 2023-11-04T15:37:01.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.779+0000 7f2255740640 1 --2- 172.21.15.19:0/2968978917 >> v2:172.21.15.96:3300/0 conn(0x7f2250133ba0 0x7f2250133f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:01.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.780+0000 7f2247fff640 1 -- 172.21.15.19:0/2968978917 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 479091993 0 0) 0x7f223c005730 con 0x7f22501344c0 2023-11-04T15:37:01.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.780+0000 7f2247fff640 1 -- 172.21.15.19:0/2968978917 >> v2:172.21.15.96:3300/0 conn(0x7f2250133ba0 msgr2=0x7f2250133f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:01.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.780+0000 7f2247fff640 1 --2- 172.21.15.19:0/2968978917 >> v2:172.21.15.96:3300/0 conn(0x7f2250133ba0 0x7f2250133f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:01.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.780+0000 7f2247fff640 1 -- 172.21.15.19:0/2968978917 >> v1:172.21.15.96:6789/0 conn(0x7f225009a230 legacy=0x7f225013f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:01.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.780+0000 7f2247fff640 1 -- 172.21.15.19:0/2968978917 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225006f770 con 0x7f22501344c0 2023-11-04T15:37:01.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.780+0000 7f2247fff640 1 -- 172.21.15.19:0/2968978917 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3646097784 0 0) 0x7f2240001670 con 0x7f22501344c0 2023-11-04T15:37:01.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.780+0000 7f2247fff640 1 -- 172.21.15.19:0/2968978917 >> v1:172.21.15.19:6789/0 conn(0x7f22501344c0 legacy=0x7f2250099b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:01.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.780+0000 7f2247fff640 1 --2- 172.21.15.19:0/2968978917 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f223c005b80 0x7f223c005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:01.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.780+0000 7f2247fff640 1 --2- 172.21.15.19:0/2968978917 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f223c0069d0 0x7f223c006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:01.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.780+0000 7f2247fff640 1 --2- 172.21.15.19:0/2968978917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f223c0074b0 0x7f223c00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:01.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.780+0000 7f2247fff640 1 -- 172.21.15.19:0/2968978917 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225006ff70 con 0x7f223c0074b0 2023-11-04T15:37:01.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.780+0000 7f2247fff640 1 -- 172.21.15.19:0/2968978917 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c00e380 con 0x7f223c005b80 2023-11-04T15:37:01.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.780+0000 7f2247fff640 1 -- 172.21.15.19:0/2968978917 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f223c00e540 con 0x7f223c0069d0 2023-11-04T15:37:01.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.780+0000 7f2255f41640 1 --2- 172.21.15.19:0/2968978917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f223c0074b0 0x7f223c00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:01.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.780+0000 7f2255740640 1 --2- 172.21.15.19:0/2968978917 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f223c005b80 0x7f223c005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:01.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.780+0000 7f2254f3f640 1 --2- 172.21.15.19:0/2968978917 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f223c0069d0 0x7f223c006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:01.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.780+0000 7f2255f41640 1 -- 172.21.15.19:0/2968978917 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f223c0069d0 msgr2=0x7f223c006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:01.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.780+0000 7f2255f41640 1 --2- 172.21.15.19:0/2968978917 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f223c0069d0 0x7f223c006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:01.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.780+0000 7f2255f41640 1 -- 172.21.15.19:0/2968978917 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f223c005b80 msgr2=0x7f223c005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:01.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.780+0000 7f2255f41640 1 --2- 172.21.15.19:0/2968978917 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f223c005b80 0x7f223c005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:01.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.780+0000 7f2255f41640 1 -- 172.21.15.19:0/2968978917 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223c005730 con 0x7f223c0074b0 2023-11-04T15:37:01.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.781+0000 7f2255f41640 1 -- 172.21.15.19:0/2968978917 reap_dead start 2023-11-04T15:37:01.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.781+0000 7f2255f41640 1 --2- 172.21.15.19:0/2968978917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f223c0074b0 0x7f223c00db90 secure :-1 s=READY pgs=3730 cs=0 l=1 rev1=1 crypto rx=0x7f225006fb60 tx=0x7f223c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b52c7e94244e5a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:01.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.781+0000 7f2247fff640 1 -- 172.21.15.19:0/2968978917 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22480052d0 con 0x7f223c0074b0 2023-11-04T15:37:01.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.781+0000 7f2247fff640 1 -- 172.21.15.19:0/2968978917 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224802e050 con 0x7f223c0074b0 2023-11-04T15:37:01.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.781+0000 7f2247fff640 1 -- 172.21.15.19:0/2968978917 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22480035f0 con 0x7f223c0074b0 2023-11-04T15:37:01.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.782+0000 7f22579a4640 1 -- 172.21.15.19:0/2968978917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f223c0074b0 msgr2=0x7f223c00db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:01.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.782+0000 7f22579a4640 1 --2- 172.21.15.19:0/2968978917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f223c0074b0 0x7f223c00db90 secure :-1 s=READY pgs=3730 cs=0 l=1 rev1=1 crypto rx=0x7f225006fb60 tx=0x7f223c007a00 comp rx=0 tx=0).stop 2023-11-04T15:37:01.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.782+0000 7f22579a4640 1 -- 172.21.15.19:0/2968978917 shutdown_connections 2023-11-04T15:37:01.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.782+0000 7f22579a4640 1 --2- 172.21.15.19:0/2968978917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f223c0074b0 0x7f223c00db90 unknown :-1 s=CLOSED pgs=3730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:01.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.782+0000 7f22579a4640 1 -- 172.21.15.19:0/2968978917 >> 172.21.15.19:0/2968978917 conn(0x7f22500a8920 msgr2=0x7f22500a8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:01.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.782+0000 7f22579a4640 1 -- 172.21.15.19:0/2968978917 shutdown_connections 2023-11-04T15:37:01.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.782+0000 7f22579a4640 1 -- 172.21.15.19:0/2968978917 wait complete. 2023-11-04T15:37:01.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.783+0000 7f22579a4640 1 Processor -- start 2023-11-04T15:37:01.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.783+0000 7f22579a4640 1 -- start start 2023-11-04T15:37:01.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.783+0000 7f22579a4640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f223c0074b0 0x7f22501cab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:01.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.783+0000 7f22579a4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22501cb040 0x7f22501cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:01.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.783+0000 7f22579a4640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f225012f4f0 0x7f225012f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:01.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.783+0000 7f22579a4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22500a5770 con 0x7f22501cb040 2023-11-04T15:37:01.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.783+0000 7f22579a4640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22500a3d60 con 0x7f225012f4f0 2023-11-04T15:37:01.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.783+0000 7f22579a4640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22500a3480 con 0x7f223c0074b0 2023-11-04T15:37:01.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.783+0000 7f2254f3f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22501cb040 0x7f22501cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:01.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.783+0000 7f2254f3f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22501cb040 0x7f22501cb4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60384/0 (socket says 172.21.15.19:60384) 2023-11-04T15:37:01.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.783+0000 7f2254f3f640 1 -- 172.21.15.19:0/1843372626 learned_addr learned my addr 172.21.15.19:0/1843372626 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:37:01.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.783+0000 7f2255740640 1 --2- 172.21.15.19:0/1843372626 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f223c0074b0 0x7f22501cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:01.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.783+0000 7f2255f41640 1 --2- 172.21.15.19:0/1843372626 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f225012f4f0 0x7f225012f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:01.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.784+0000 7f2254f3f640 1 -- 172.21.15.19:0/1843372626 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f223c0074b0 msgr2=0x7f22501cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:01.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.784+0000 7f2254f3f640 1 --2- 172.21.15.19:0/1843372626 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f223c0074b0 0x7f22501cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:01.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.784+0000 7f2254f3f640 1 -- 172.21.15.19:0/1843372626 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f225012f4f0 msgr2=0x7f225012f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:01.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.784+0000 7f2254f3f640 1 --2- 172.21.15.19:0/1843372626 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f225012f4f0 0x7f225012f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:01.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.784+0000 7f2254f3f640 1 -- 172.21.15.19:0/1843372626 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22500a51d0 con 0x7f22501cb040 2023-11-04T15:37:01.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.784+0000 7f2254f3f640 1 --2- 172.21.15.19:0/1843372626 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22501cb040 0x7f22501cb4c0 secure :-1 s=READY pgs=3731 cs=0 l=1 rev1=1 crypto rx=0x7f22400072c0 tx=0x7f2240007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:01.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.784+0000 7f2245ffb640 1 -- 172.21.15.19:0/1843372626 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2240000ff0 con 0x7f22501cb040 2023-11-04T15:37:01.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.784+0000 7f2245ffb640 1 -- 172.21.15.19:0/1843372626 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22400015d0 con 0x7f22501cb040 2023-11-04T15:37:01.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.784+0000 7f22579a4640 1 -- 172.21.15.19:0/1843372626 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22500a3f90 con 0x7f22501cb040 2023-11-04T15:37:01.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.784+0000 7f2245ffb640 1 -- 172.21.15.19:0/1843372626 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224000fba0 con 0x7f22501cb040 2023-11-04T15:37:01.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.784+0000 7f22579a4640 1 -- 172.21.15.19:0/1843372626 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2250130a70 con 0x7f22501cb040 2023-11-04T15:37:01.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.785+0000 7f22579a4640 1 -- 172.21.15.19:0/1843372626 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2250130600 con 0x7f22501cb040 2023-11-04T15:37:01.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.785+0000 7f2245ffb640 1 -- 172.21.15.19:0/1843372626 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f224000fd00 con 0x7f22501cb040 2023-11-04T15:37:01.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.786+0000 7f2245ffb640 1 --2- 172.21.15.19:0/1843372626 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f223406a430 0x7f223406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:01.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.786+0000 7f2245ffb640 1 -- 172.21.15.19:0/1843372626 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4462+0+0 (secure 0 0 0) 0x7f2240088300 con 0x7f22501cb040 2023-11-04T15:37:01.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.786+0000 7f2255740640 1 --2- 172.21.15.19:0/1843372626 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f223406a430 0x7f223406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:01.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.787+0000 7f2255740640 1 --2- 172.21.15.19:0/1843372626 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f223406a430 0x7f223406c8f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f224c014450 tx=0x7f224c00b040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:01.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.790+0000 7f2245ffb640 1 -- 172.21.15.19:0/1843372626 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f22400579a0 con 0x7f22501cb040 2023-11-04T15:37:01.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.971+0000 7f22579a4640 1 -- 172.21.15.19:0/1843372626 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2250067d60 con 0x7f22501cb040 2023-11-04T15:37:01.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.972+0000 7f2245ffb640 1 -- 172.21.15.19:0/1843372626 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v43) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2240057530 con 0x7f22501cb040 2023-11-04T15:37:01.974 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 8 2023-11-04T15:37:01.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.974+0000 7f22579a4640 1 -- 172.21.15.19:0/1843372626 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f223406a430 msgr2=0x7f223406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:01.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.974+0000 7f22579a4640 1 --2- 172.21.15.19:0/1843372626 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f223406a430 0x7f223406c8f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f224c014450 tx=0x7f224c00b040 comp rx=0 tx=0).stop 2023-11-04T15:37:01.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.974+0000 7f22579a4640 1 -- 172.21.15.19:0/1843372626 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22501cb040 msgr2=0x7f22501cb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:01.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.974+0000 7f22579a4640 1 --2- 172.21.15.19:0/1843372626 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22501cb040 0x7f22501cb4c0 secure :-1 s=READY pgs=3731 cs=0 l=1 rev1=1 crypto rx=0x7f22400072c0 tx=0x7f2240007780 comp rx=0 tx=0).stop 2023-11-04T15:37:01.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.974+0000 7f22579a4640 1 -- 172.21.15.19:0/1843372626 shutdown_connections 2023-11-04T15:37:01.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.974+0000 7f22579a4640 1 --2- 172.21.15.19:0/1843372626 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f223406a430 0x7f223406c8f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:01.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.974+0000 7f22579a4640 1 --2- 172.21.15.19:0/1843372626 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f225012f4f0 0x7f225012f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:01.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.974+0000 7f22579a4640 1 --2- 172.21.15.19:0/1843372626 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22501cb040 0x7f22501cb4c0 unknown :-1 s=CLOSED pgs=3731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:01.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.974+0000 7f22579a4640 1 --2- 172.21.15.19:0/1843372626 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f223c0074b0 0x7f22501cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:01.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.974+0000 7f22579a4640 1 -- 172.21.15.19:0/1843372626 >> 172.21.15.19:0/1843372626 conn(0x7f22500a8920 msgr2=0x7f225009c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:01.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.974+0000 7f22579a4640 1 -- 172.21.15.19:0/1843372626 shutdown_connections 2023-11-04T15:37:01.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:01.974+0000 7f22579a4640 1 -- 172.21.15.19:0/1843372626 wait complete. 2023-11-04T15:37:01.988 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T15:37:02.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.097+0000 7fd1d7fdd640 1 Processor -- start 2023-11-04T15:37:02.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.097+0000 7fd1d7fdd640 1 -- start start 2023-11-04T15:37:02.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.098+0000 7fd1d7fdd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd1d0140b70 0x7fd1d0142f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:02.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.098+0000 7fd1d7fdd640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1d00abe60 con 0x7fd1d00a6370 2023-11-04T15:37:02.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.098+0000 7fd1d7fdd640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1d00a30a0 con 0x7fd1d0136090 2023-11-04T15:37:02.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.098+0000 7fd1d7fdd640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d00a68d0 con 0x7fd1d0140b70 2023-11-04T15:37:02.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.098+0000 7fd1d5578640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd1d00a6370 0x7fd1d013f450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57968/0 (socket says 172.21.15.19:57968) 2023-11-04T15:37:02.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.098+0000 7fd1d5578640 1 -- 172.21.15.19:0/1249417107 learned_addr learned my addr 172.21.15.19:0/1249417107 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:37:02.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.098+0000 7fd1d4d77640 1 -- 172.21.15.19:0/1249417107 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2280523455 0 0) 0x7fd1d00abe60 con 0x7fd1d00a6370 2023-11-04T15:37:02.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.098+0000 7fd1d4d77640 1 -- 172.21.15.19:0/1249417107 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1b8003520 con 0x7fd1d00a6370 2023-11-04T15:37:02.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.098+0000 7fd1d657a640 1 --2- 172.21.15.19:0/1249417107 >> v2:172.21.15.96:3300/0 conn(0x7fd1d0140b70 0x7fd1d0142f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:02.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.098+0000 7fd1d4d77640 1 -- 172.21.15.19:0/1249417107 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4162465239 0 0) 0x7fd1b8003520 con 0x7fd1d00a6370 2023-11-04T15:37:02.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.098+0000 7fd1d4d77640 1 -- 172.21.15.19:0/1249417107 >> v2:172.21.15.96:3300/0 conn(0x7fd1d0140b70 msgr2=0x7fd1d0142f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:02.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.098+0000 7fd1d4d77640 1 --2- 172.21.15.19:0/1249417107 >> v2:172.21.15.96:3300/0 conn(0x7fd1d0140b70 0x7fd1d0142f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:02.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.098+0000 7fd1d4d77640 1 -- 172.21.15.19:0/1249417107 >> v1:172.21.15.96:6789/0 conn(0x7fd1d0136090 legacy=0x7fd1d0136470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:02.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.098+0000 7fd1d4d77640 1 -- 172.21.15.19:0/1249417107 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d00a4b90 con 0x7fd1d00a6370 2023-11-04T15:37:02.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.098+0000 7fd1d4d77640 1 -- 172.21.15.19:0/1249417107 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3646097784 0 0) 0x7fd1c4001670 con 0x7fd1d00a6370 2023-11-04T15:37:02.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.098+0000 7fd1d4d77640 1 -- 172.21.15.19:0/1249417107 >> v1:172.21.15.19:6789/0 conn(0x7fd1d00a6370 legacy=0x7fd1d013f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:02.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.098+0000 7fd1d4d77640 1 --2- 172.21.15.19:0/1249417107 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1b8003970 0x7fd1b8003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:02.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.098+0000 7fd1d4d77640 1 --2- 172.21.15.19:0/1249417107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1b80047c0 0x7fd1b8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:02.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.098+0000 7fd1d4d77640 1 --2- 172.21.15.19:0/1249417107 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd1b8005180 0x7fd1b800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:02.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.098+0000 7fd1d4d77640 1 -- 172.21.15.19:0/1249417107 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d00a68d0 con 0x7fd1b80047c0 2023-11-04T15:37:02.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.098+0000 7fd1d4d77640 1 -- 172.21.15.19:0/1249417107 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b800c0d0 con 0x7fd1b8003970 2023-11-04T15:37:02.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.098+0000 7fd1d4d77640 1 -- 172.21.15.19:0/1249417107 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b800c290 con 0x7fd1b8005180 2023-11-04T15:37:02.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.099+0000 7fd1d5578640 1 --2- 172.21.15.19:0/1249417107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1b80047c0 0x7fd1b8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:02.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.099+0000 7fd1d5d79640 1 --2- 172.21.15.19:0/1249417107 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1b8003970 0x7fd1b8003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:02.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.099+0000 7fd1d657a640 1 --2- 172.21.15.19:0/1249417107 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd1b8005180 0x7fd1b800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:02.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.099+0000 7fd1d5578640 1 -- 172.21.15.19:0/1249417107 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd1b8005180 msgr2=0x7fd1b800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:02.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.099+0000 7fd1d5578640 1 --2- 172.21.15.19:0/1249417107 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd1b8005180 0x7fd1b800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:02.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.099+0000 7fd1d5578640 1 -- 172.21.15.19:0/1249417107 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1b8003970 msgr2=0x7fd1b8003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:02.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.099+0000 7fd1d5578640 1 --2- 172.21.15.19:0/1249417107 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1b8003970 0x7fd1b8003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:02.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.099+0000 7fd1d657a640 1 -- 172.21.15.19:0/1249417107 reap_dead start 2023-11-04T15:37:02.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.099+0000 7fd1d5578640 1 -- 172.21.15.19:0/1249417107 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b8003520 con 0x7fd1b80047c0 2023-11-04T15:37:02.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.100+0000 7fd1d5578640 1 --2- 172.21.15.19:0/1249417107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1b80047c0 0x7fd1b8004c40 secure :-1 s=READY pgs=3733 cs=0 l=1 rev1=1 crypto rx=0x7fd1c400c240 tx=0x7fd1b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=620b5813255adb4e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:02.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.100+0000 7fd1d4d77640 1 -- 172.21.15.19:0/1249417107 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4005ad0 con 0x7fd1b80047c0 2023-11-04T15:37:02.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.100+0000 7fd1d4d77640 1 -- 172.21.15.19:0/1249417107 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c4005c30 con 0x7fd1b80047c0 2023-11-04T15:37:02.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.100+0000 7fd1d4d77640 1 -- 172.21.15.19:0/1249417107 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c402c830 con 0x7fd1b80047c0 2023-11-04T15:37:02.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.100+0000 7fd1d7fdd640 1 -- 172.21.15.19:0/1249417107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1b80047c0 msgr2=0x7fd1b8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:02.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.100+0000 7fd1d7fdd640 1 --2- 172.21.15.19:0/1249417107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1b80047c0 0x7fd1b8004c40 secure :-1 s=READY pgs=3733 cs=0 l=1 rev1=1 crypto rx=0x7fd1c400c240 tx=0x7fd1b80057f0 comp rx=0 tx=0).stop 2023-11-04T15:37:02.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.100+0000 7fd1d7fdd640 1 -- 172.21.15.19:0/1249417107 shutdown_connections 2023-11-04T15:37:02.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.100+0000 7fd1d7fdd640 1 --2- 172.21.15.19:0/1249417107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1b80047c0 0x7fd1b8004c40 unknown :-1 s=CLOSED pgs=3733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:02.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.100+0000 7fd1d7fdd640 1 -- 172.21.15.19:0/1249417107 >> 172.21.15.19:0/1249417107 conn(0x7fd1d00ac3f0 msgr2=0x7fd1d00ac800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:02.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.100+0000 7fd1d7fdd640 1 -- 172.21.15.19:0/1249417107 shutdown_connections 2023-11-04T15:37:02.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.100+0000 7fd1d7fdd640 1 -- 172.21.15.19:0/1249417107 wait complete. 2023-11-04T15:37:02.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.101+0000 7fd1d7fdd640 1 Processor -- start 2023-11-04T15:37:02.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.102+0000 7fd1d7fdd640 1 -- start start 2023-11-04T15:37:02.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.102+0000 7fd1d7fdd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd1b80047c0 0x7fd1d01cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:02.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.102+0000 7fd1d7fdd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1d01cf230 0x7fd1d01cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:02.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.102+0000 7fd1d7fdd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1d013e870 0x7fd1d013ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:02.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.102+0000 7fd1d7fdd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d013f990 con 0x7fd1d013e870 2023-11-04T15:37:02.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.102+0000 7fd1d7fdd640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d013fc30 con 0x7fd1d01cf230 2023-11-04T15:37:02.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.102+0000 7fd1d7fdd640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d00996e0 con 0x7fd1b80047c0 2023-11-04T15:37:02.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.102+0000 7fd1d657a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1d013e870 0x7fd1d013ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:02.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.102+0000 7fd1d657a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1d013e870 0x7fd1d013ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60400/0 (socket says 172.21.15.19:60400) 2023-11-04T15:37:02.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.102+0000 7fd1d657a640 1 -- 172.21.15.19:0/2388531807 learned_addr learned my addr 172.21.15.19:0/2388531807 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:37:02.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.102+0000 7fd1d657a640 1 -- 172.21.15.19:0/2388531807 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd1b80047c0 msgr2=0x7fd1d01cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:02.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.102+0000 7fd1d657a640 1 --2- 172.21.15.19:0/2388531807 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd1b80047c0 0x7fd1d01cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:02.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.102+0000 7fd1d657a640 1 -- 172.21.15.19:0/2388531807 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1d01cf230 msgr2=0x7fd1d01cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:02.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.102+0000 7fd1d5578640 1 --2- 172.21.15.19:0/2388531807 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1d01cf230 0x7fd1d01cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:02.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.102+0000 7fd1d657a640 1 --2- 172.21.15.19:0/2388531807 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1d01cf230 0x7fd1d01cf6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:02.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.102+0000 7fd1d657a640 1 -- 172.21.15.19:0/2388531807 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d00999a0 con 0x7fd1d013e870 2023-11-04T15:37:02.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.103+0000 7fd1d657a640 1 --2- 172.21.15.19:0/2388531807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1d013e870 0x7fd1d013ed20 secure :-1 s=READY pgs=3734 cs=0 l=1 rev1=1 crypto rx=0x7fd1d00a6a30 tx=0x7fd1c000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:02.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.103+0000 7fd1ce7fc640 1 -- 172.21.15.19:0/2388531807 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c000e040 con 0x7fd1d013e870 2023-11-04T15:37:02.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.103+0000 7fd1ce7fc640 1 -- 172.21.15.19:0/2388531807 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c000f040 con 0x7fd1d013e870 2023-11-04T15:37:02.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.103+0000 7fd1d7fdd640 1 -- 172.21.15.19:0/2388531807 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1d0099c80 con 0x7fd1d013e870 2023-11-04T15:37:02.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.103+0000 7fd1ce7fc640 1 -- 172.21.15.19:0/2388531807 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c0015430 con 0x7fd1d013e870 2023-11-04T15:37:02.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.103+0000 7fd1d7fdd640 1 -- 172.21.15.19:0/2388531807 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d009a860 con 0x7fd1d013e870 2023-11-04T15:37:02.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.104+0000 7fd1d7fdd640 1 -- 172.21.15.19:0/2388531807 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1d0099500 con 0x7fd1d013e870 2023-11-04T15:37:02.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.104+0000 7fd1ce7fc640 1 -- 172.21.15.19:0/2388531807 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd1c0015590 con 0x7fd1d013e870 2023-11-04T15:37:02.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.105+0000 7fd1ce7fc640 1 --2- 172.21.15.19:0/2388531807 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fd1bc06a460 0x7fd1bc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:02.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.105+0000 7fd1ce7fc640 1 -- 172.21.15.19:0/2388531807 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4462+0+0 (secure 0 0 0) 0x7fd1c0089300 con 0x7fd1d013e870 2023-11-04T15:37:02.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.105+0000 7fd1d5d79640 1 --2- 172.21.15.19:0/2388531807 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fd1bc06a460 0x7fd1bc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:02.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.105+0000 7fd1d5d79640 1 --2- 172.21.15.19:0/2388531807 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fd1bc06a460 0x7fd1bc06c920 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0068900 tx=0x7fd1c8009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:02.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.109+0000 7fd1ce7fc640 1 -- 172.21.15.19:0/2388531807 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd1c0054dc0 con 0x7fd1d013e870 2023-11-04T15:37:02.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.289+0000 7fd1d7fdd640 1 -- 172.21.15.19:0/2388531807 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd1d0067d60 con 0x7fd1d013e870 2023-11-04T15:37:02.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.289+0000 7fd1ce7fc640 1 -- 172.21.15.19:0/2388531807 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd1c00583e0 con 0x7fd1d013e870 2023-11-04T15:37:02.292 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-11-04T15:37:02.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.291+0000 7fd1d7fdd640 1 -- 172.21.15.19:0/2388531807 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fd1bc06a460 msgr2=0x7fd1bc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:02.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.291+0000 7fd1d7fdd640 1 --2- 172.21.15.19:0/2388531807 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fd1bc06a460 0x7fd1bc06c920 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0068900 tx=0x7fd1c8009040 comp rx=0 tx=0).stop 2023-11-04T15:37:02.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.291+0000 7fd1d7fdd640 1 -- 172.21.15.19:0/2388531807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1d013e870 msgr2=0x7fd1d013ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:02.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.291+0000 7fd1d7fdd640 1 --2- 172.21.15.19:0/2388531807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1d013e870 0x7fd1d013ed20 secure :-1 s=READY pgs=3734 cs=0 l=1 rev1=1 crypto rx=0x7fd1d00a6a30 tx=0x7fd1c000f580 comp rx=0 tx=0).stop 2023-11-04T15:37:02.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.291+0000 7fd1d7fdd640 1 -- 172.21.15.19:0/2388531807 shutdown_connections 2023-11-04T15:37:02.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.291+0000 7fd1d7fdd640 1 --2- 172.21.15.19:0/2388531807 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fd1bc06a460 0x7fd1bc06c920 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:02.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.291+0000 7fd1d7fdd640 1 --2- 172.21.15.19:0/2388531807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1d013e870 0x7fd1d013ed20 unknown :-1 s=CLOSED pgs=3734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:02.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.291+0000 7fd1d7fdd640 1 --2- 172.21.15.19:0/2388531807 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1d01cf230 0x7fd1d01cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:02.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.291+0000 7fd1d7fdd640 1 --2- 172.21.15.19:0/2388531807 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd1b80047c0 0x7fd1d01cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:02.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.291+0000 7fd1d7fdd640 1 -- 172.21.15.19:0/2388531807 >> 172.21.15.19:0/2388531807 conn(0x7fd1d00ac3f0 msgr2=0x7fd1d00a7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:02.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.292+0000 7fd1d7fdd640 1 -- 172.21.15.19:0/2388531807 shutdown_connections 2023-11-04T15:37:02.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.292+0000 7fd1d7fdd640 1 -- 172.21.15.19:0/2388531807 wait complete. 2023-11-04T15:37:02.306 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T15:37:02.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.414+0000 7f6bd00c0640 1 Processor -- start 2023-11-04T15:37:02.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.415+0000 7f6bd00c0640 1 -- start start 2023-11-04T15:37:02.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.415+0000 7f6bd00c0640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6bc80a6370 0x7f6bc813f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:02.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.415+0000 7f6bd00c0640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6bc813f990 0x7f6bc8141d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:02.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.415+0000 7f6bd00c0640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc80abe60 con 0x7f6bc8136090 2023-11-04T15:37:02.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.415+0000 7f6bd00c0640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc80a68d0 con 0x7f6bc813f990 2023-11-04T15:37:02.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.415+0000 7f6bd00c0640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc80a30a0 con 0x7f6bc80a6370 2023-11-04T15:37:02.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.415+0000 7f6bce65d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6bc813f990 0x7f6bc8141d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:02.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.415+0000 7f6bce65d640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6bc813f990 0x7f6bc8141d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60412/0 (socket says 172.21.15.19:60412) 2023-11-04T15:37:02.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.415+0000 7f6bce65d640 1 -- 172.21.15.19:0/298536188 learned_addr learned my addr 172.21.15.19:0/298536188 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:37:02.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.416+0000 7f6bcd65b640 1 --2- 172.21.15.19:0/298536188 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6bc80a6370 0x7f6bc813f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:02.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.416+0000 7f6bce65d640 1 -- 172.21.15.19:0/298536188 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6bc80a6370 msgr2=0x7f6bc813f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:02.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.416+0000 7f6bce65d640 1 --2- 172.21.15.19:0/298536188 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6bc80a6370 0x7f6bc813f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:02.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.416+0000 7f6bce65d640 1 -- 172.21.15.19:0/298536188 >> v1:172.21.15.96:6789/0 conn(0x7f6bc8136090 legacy=0x7f6bc8136470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:02.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.416+0000 7f6bce65d640 1 -- 172.21.15.19:0/298536188 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc80a4b90 con 0x7f6bc813f990 2023-11-04T15:37:02.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.416+0000 7f6bce65d640 1 --2- 172.21.15.19:0/298536188 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bc813f990 0x7f6bc8141d80 secure :-1 s=READY pgs=3735 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0009e50 tx=0x7f6bc002bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ee66ca6385b63e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:02.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.417+0000 7f6bcce5a640 1 -- 172.21.15.19:0/298536188 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc002c950 con 0x7f6bc813f990 2023-11-04T15:37:02.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.417+0000 7f6bcce5a640 1 -- 172.21.15.19:0/298536188 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc002cab0 con 0x7f6bc813f990 2023-11-04T15:37:02.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.417+0000 7f6bcce5a640 1 -- 172.21.15.19:0/298536188 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc002ce40 con 0x7f6bc813f990 2023-11-04T15:37:02.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.417+0000 7f6bd00c0640 1 -- 172.21.15.19:0/298536188 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bc813f990 msgr2=0x7f6bc8141d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:02.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.417+0000 7f6bd00c0640 1 --2- 172.21.15.19:0/298536188 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bc813f990 0x7f6bc8141d80 secure :-1 s=READY pgs=3735 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0009e50 tx=0x7f6bc002bdb0 comp rx=0 tx=0).stop 2023-11-04T15:37:02.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.417+0000 7f6bd00c0640 1 -- 172.21.15.19:0/298536188 shutdown_connections 2023-11-04T15:37:02.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.417+0000 7f6bd00c0640 1 --2- 172.21.15.19:0/298536188 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bc813f990 0x7f6bc8141d80 unknown :-1 s=CLOSED pgs=3735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:02.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.417+0000 7f6bd00c0640 1 --2- 172.21.15.19:0/298536188 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6bc80a6370 0x7f6bc813f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:02.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.417+0000 7f6bd00c0640 1 -- 172.21.15.19:0/298536188 >> 172.21.15.19:0/298536188 conn(0x7f6bc80ac3f0 msgr2=0x7f6bc80ac800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:02.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.417+0000 7f6bd00c0640 1 -- 172.21.15.19:0/298536188 shutdown_connections 2023-11-04T15:37:02.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.417+0000 7f6bd00c0640 1 -- 172.21.15.19:0/298536188 wait complete. 2023-11-04T15:37:02.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.418+0000 7f6bd00c0640 1 Processor -- start 2023-11-04T15:37:02.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.418+0000 7f6bd00c0640 1 -- start start 2023-11-04T15:37:02.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.419+0000 7f6bd00c0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bc80a6370 0x7f6bc813b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:02.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.419+0000 7f6bd00c0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bc8136090 0x7f6bc813b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:02.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.419+0000 7f6bd00c0640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6bc813f990 0x7f6bc813bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:02.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.419+0000 7f6bd00c0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc813daa0 con 0x7f6bc8136090 2023-11-04T15:37:02.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.419+0000 7f6bd00c0640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc813e010 con 0x7f6bc80a6370 2023-11-04T15:37:02.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.419+0000 7f6bd00c0640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc813c270 con 0x7f6bc813f990 2023-11-04T15:37:02.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.419+0000 7f6bcd65b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bc8136090 0x7f6bc813b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:02.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.419+0000 7f6bcd65b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bc8136090 0x7f6bc813b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60418/0 (socket says 172.21.15.19:60418) 2023-11-04T15:37:02.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.419+0000 7f6bcd65b640 1 -- 172.21.15.19:0/1594700758 learned_addr learned my addr 172.21.15.19:0/1594700758 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:37:02.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.419+0000 7f6bce65d640 1 --2- 172.21.15.19:0/1594700758 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6bc813f990 0x7f6bc813bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:02.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.419+0000 7f6bcde5c640 1 --2- 172.21.15.19:0/1594700758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bc80a6370 0x7f6bc813b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:02.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.419+0000 7f6bcd65b640 1 -- 172.21.15.19:0/1594700758 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6bc813f990 msgr2=0x7f6bc813bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:02.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.419+0000 7f6bcd65b640 1 --2- 172.21.15.19:0/1594700758 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6bc813f990 0x7f6bc813bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:02.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.419+0000 7f6bcd65b640 1 -- 172.21.15.19:0/1594700758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bc80a6370 msgr2=0x7f6bc813b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:02.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.419+0000 7f6bcd65b640 1 --2- 172.21.15.19:0/1594700758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bc80a6370 0x7f6bc813b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:02.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.419+0000 7f6bcd65b640 1 -- 172.21.15.19:0/1594700758 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc0009b30 con 0x7f6bc8136090 2023-11-04T15:37:02.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.419+0000 7f6bce65d640 1 --2- 172.21.15.19:0/1594700758 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6bc813f990 0x7f6bc813bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:37:02.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.419+0000 7f6bcde5c640 1 --2- 172.21.15.19:0/1594700758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bc80a6370 0x7f6bc813b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:37:02.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.419+0000 7f6bcd65b640 1 --2- 172.21.15.19:0/1594700758 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bc8136090 0x7f6bc813b760 secure :-1 s=READY pgs=3736 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800d800 tx=0x7f6bb800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:02.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.419+0000 7f6bbe7fc640 1 -- 172.21.15.19:0/1594700758 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb800b6c0 con 0x7f6bc8136090 2023-11-04T15:37:02.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.419+0000 7f6bbe7fc640 1 -- 172.21.15.19:0/1594700758 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb800b820 con 0x7f6bc8136090 2023-11-04T15:37:02.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.420+0000 7f6bd00c0640 1 -- 172.21.15.19:0/1594700758 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc813d460 con 0x7f6bc8136090 2023-11-04T15:37:02.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.420+0000 7f6bbe7fc640 1 -- 172.21.15.19:0/1594700758 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb800bbb0 con 0x7f6bc8136090 2023-11-04T15:37:02.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.420+0000 7f6bd00c0640 1 -- 172.21.15.19:0/1594700758 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc813f190 con 0x7f6bc8136090 2023-11-04T15:37:02.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.421+0000 7f6bd00c0640 1 -- 172.21.15.19:0/1594700758 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc8067d60 con 0x7f6bc8136090 2023-11-04T15:37:02.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.421+0000 7f6bbe7fc640 1 -- 172.21.15.19:0/1594700758 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6bb800bd10 con 0x7f6bc8136090 2023-11-04T15:37:02.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.421+0000 7f6bbe7fc640 1 --2- 172.21.15.19:0/1594700758 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f6bac06a430 0x7f6bac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:02.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.421+0000 7f6bbe7fc640 1 -- 172.21.15.19:0/1594700758 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4462+0+0 (secure 0 0 0) 0x7f6bb80888f0 con 0x7f6bc8136090 2023-11-04T15:37:02.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.421+0000 7f6bcde5c640 1 --2- 172.21.15.19:0/1594700758 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f6bac06a430 0x7f6bac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:02.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.422+0000 7f6bcde5c640 1 --2- 172.21.15.19:0/1594700758 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f6bac06a430 0x7f6bac06c8f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4003eb0 tx=0x7f6bc4009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:02.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.426+0000 7f6bbe7fc640 1 -- 172.21.15.19:0/1594700758 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6bb8054450 con 0x7f6bc8136090 2023-11-04T15:37:02.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.604+0000 7f6bd00c0640 1 -- 172.21.15.19:0/1594700758 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6bc8072190 con 0x7f6bc8136090 2023-11-04T15:37:02.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.604+0000 7f6bbe7fc640 1 -- 172.21.15.19:0/1594700758 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6bb8057a70 con 0x7f6bc8136090 2023-11-04T15:37:02.607 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2023-11-04T15:37:02.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.606+0000 7f6bd00c0640 1 -- 172.21.15.19:0/1594700758 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f6bac06a430 msgr2=0x7f6bac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:02.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.606+0000 7f6bd00c0640 1 --2- 172.21.15.19:0/1594700758 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f6bac06a430 0x7f6bac06c8f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4003eb0 tx=0x7f6bc4009040 comp rx=0 tx=0).stop 2023-11-04T15:37:02.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.606+0000 7f6bd00c0640 1 -- 172.21.15.19:0/1594700758 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bc8136090 msgr2=0x7f6bc813b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:02.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.606+0000 7f6bd00c0640 1 --2- 172.21.15.19:0/1594700758 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bc8136090 0x7f6bc813b760 secure :-1 s=READY pgs=3736 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800d800 tx=0x7f6bb800dcc0 comp rx=0 tx=0).stop 2023-11-04T15:37:02.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.606+0000 7f6bd00c0640 1 -- 172.21.15.19:0/1594700758 shutdown_connections 2023-11-04T15:37:02.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.606+0000 7f6bd00c0640 1 --2- 172.21.15.19:0/1594700758 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f6bac06a430 0x7f6bac06c8f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:02.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.606+0000 7f6bd00c0640 1 --2- 172.21.15.19:0/1594700758 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6bc813f990 0x7f6bc813bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:02.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.606+0000 7f6bd00c0640 1 --2- 172.21.15.19:0/1594700758 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bc8136090 0x7f6bc813b760 unknown :-1 s=CLOSED pgs=3736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:02.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.606+0000 7f6bd00c0640 1 --2- 172.21.15.19:0/1594700758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bc80a6370 0x7f6bc813b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:02.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.606+0000 7f6bd00c0640 1 -- 172.21.15.19:0/1594700758 >> 172.21.15.19:0/1594700758 conn(0x7f6bc80ac3f0 msgr2=0x7f6bc80a7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:02.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.606+0000 7f6bd00c0640 1 -- 172.21.15.19:0/1594700758 shutdown_connections 2023-11-04T15:37:02.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.606+0000 7f6bd00c0640 1 -- 172.21.15.19:0/1594700758 wait complete. 2023-11-04T15:37:02.621 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T15:37:02.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.727+0000 7f35e4d73640 1 Processor -- start 2023-11-04T15:37:02.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.727+0000 7f35e4d73640 1 -- start start 2023-11-04T15:37:02.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.728+0000 7f35e4d73640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f35e0133cd0 0x7f35e01340b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:02.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.728+0000 7f35e4d73640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f35e00a39f0 0x7f35e00a3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:02.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.728+0000 7f35e4d73640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35e01345f0 con 0x7f35e00a4390 2023-11-04T15:37:02.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.728+0000 7f35e4d73640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35e00a0f50 con 0x7f35e0133cd0 2023-11-04T15:37:02.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.728+0000 7f35e4d73640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e00a5370 con 0x7f35e00a39f0 2023-11-04T15:37:02.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.728+0000 7f35ded9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f35e00a4390 0x7f35e0141280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57976/0 (socket says 172.21.15.19:57976) 2023-11-04T15:37:02.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.728+0000 7f35ded9d640 1 -- 172.21.15.19:0/2027445167 learned_addr learned my addr 172.21.15.19:0/2027445167 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:37:02.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.728+0000 7f35ddd9b640 1 --2- 172.21.15.19:0/2027445167 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f35e00a39f0 0x7f35e00a3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:02.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.728+0000 7f35de59c640 1 --2- 172.21.15.19:0/2027445167 >> v2:172.21.15.96:3300/0 conn(0x7f35e0133cd0 0x7f35e01340b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:02.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.728+0000 7f35dd59a640 1 -- 172.21.15.19:0/2027445167 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3145948345 0 0) 0x7f35d0001490 con 0x7f35e00a4390 2023-11-04T15:37:02.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.728+0000 7f35dd59a640 1 -- 172.21.15.19:0/2027445167 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35cc003520 con 0x7f35e00a4390 2023-11-04T15:37:02.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.728+0000 7f35dd59a640 1 -- 172.21.15.19:0/2027445167 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2969991573 0 0) 0x7f35cc003520 con 0x7f35e00a4390 2023-11-04T15:37:02.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.728+0000 7f35ddd9b640 1 -- 172.21.15.19:0/2027445167 >> v2:172.21.15.96:3300/0 conn(0x7f35e0133cd0 msgr2=0x7f35e01340b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:02.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.728+0000 7f35ddd9b640 1 --2- 172.21.15.19:0/2027445167 >> v2:172.21.15.96:3300/0 conn(0x7f35e0133cd0 0x7f35e01340b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:02.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.728+0000 7f35ddd9b640 1 -- 172.21.15.19:0/2027445167 >> v1:172.21.15.19:6789/0 conn(0x7f35e00a4390 legacy=0x7f35e0141280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:02.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.728+0000 7f35ddd9b640 1 -- 172.21.15.19:0/2027445167 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e00a04f0 con 0x7f35e00a39f0 2023-11-04T15:37:02.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.729+0000 7f35ddd9b640 1 --2- 172.21.15.19:0/2027445167 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f35e00a39f0 0x7f35e00a3e50 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f35c80097a0 tx=0x7f35c802b660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4226f70f0fb161ca server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:02.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.729+0000 7f35dd59a640 1 -- 172.21.15.19:0/2027445167 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d0001b80 con 0x7f35e00a39f0 2023-11-04T15:37:02.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.729+0000 7f35dd59a640 1 -- 172.21.15.19:0/2027445167 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c802e050 con 0x7f35e00a39f0 2023-11-04T15:37:02.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.729+0000 7f35dd59a640 1 -- 172.21.15.19:0/2027445167 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c8030730 con 0x7f35e00a39f0 2023-11-04T15:37:02.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.730+0000 7f35e4d73640 1 -- 172.21.15.19:0/2027445167 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f35e00a39f0 msgr2=0x7f35e00a3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:02.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.730+0000 7f35e4d73640 1 --2- 172.21.15.19:0/2027445167 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f35e00a39f0 0x7f35e00a3e50 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f35c80097a0 tx=0x7f35c802b660 comp rx=0 tx=0).stop 2023-11-04T15:37:02.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.730+0000 7f35e4d73640 1 -- 172.21.15.19:0/2027445167 shutdown_connections 2023-11-04T15:37:02.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.730+0000 7f35e4d73640 1 --2- 172.21.15.19:0/2027445167 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f35e00a39f0 0x7f35e00a3e50 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:02.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.730+0000 7f35e4d73640 1 --2- 172.21.15.19:0/2027445167 >> v2:172.21.15.96:3300/0 conn(0x7f35e0133cd0 0x7f35e01340b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:02.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.730+0000 7f35e4d73640 1 -- 172.21.15.19:0/2027445167 >> 172.21.15.19:0/2027445167 conn(0x7f35e00a8ff0 msgr2=0x7f35e00a9400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:02.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.730+0000 7f35e4d73640 1 -- 172.21.15.19:0/2027445167 shutdown_connections 2023-11-04T15:37:02.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.730+0000 7f35e4d73640 1 -- 172.21.15.19:0/2027445167 wait complete. 2023-11-04T15:37:02.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.731+0000 7f35e4d73640 1 Processor -- start 2023-11-04T15:37:02.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.731+0000 7f35e4d73640 1 -- start start 2023-11-04T15:37:02.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.732+0000 7f35e4d73640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35e00a39f0 0x7f35e01cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:02.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.732+0000 7f35e4d73640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f35e00a4390 0x7f35e01cf600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:02.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.732+0000 7f35e4d73640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35e0133cd0 0x7f35e01cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:02.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.732+0000 7f35e4d73640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e01c35e0 con 0x7f35e0133cd0 2023-11-04T15:37:02.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.732+0000 7f35e4d73640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e01c1b50 con 0x7f35e00a39f0 2023-11-04T15:37:02.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.732+0000 7f35e4d73640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e01c3880 con 0x7f35e00a4390 2023-11-04T15:37:02.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.732+0000 7f35ded9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35e0133cd0 0x7f35e01cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:02.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.732+0000 7f35ded9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35e0133cd0 0x7f35e01cfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60420/0 (socket says 172.21.15.19:60420) 2023-11-04T15:37:02.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.732+0000 7f35ded9d640 1 -- 172.21.15.19:0/2287764662 learned_addr learned my addr 172.21.15.19:0/2287764662 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:37:02.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.732+0000 7f35de59c640 1 --2- 172.21.15.19:0/2287764662 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35e00a39f0 0x7f35e01cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:02.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.732+0000 7f35ddd9b640 1 --2- 172.21.15.19:0/2287764662 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f35e00a4390 0x7f35e01cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:02.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.732+0000 7f35ded9d640 1 -- 172.21.15.19:0/2287764662 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f35e00a4390 msgr2=0x7f35e01cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:02.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.732+0000 7f35ded9d640 1 --2- 172.21.15.19:0/2287764662 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f35e00a4390 0x7f35e01cf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:02.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.732+0000 7f35ded9d640 1 -- 172.21.15.19:0/2287764662 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35e00a39f0 msgr2=0x7f35e01cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:02.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.732+0000 7f35ded9d640 1 --2- 172.21.15.19:0/2287764662 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35e00a39f0 0x7f35e01cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:02.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.732+0000 7f35ded9d640 1 -- 172.21.15.19:0/2287764662 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c8009400 con 0x7f35e0133cd0 2023-11-04T15:37:02.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.732+0000 7f35ded9d640 1 --2- 172.21.15.19:0/2287764662 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35e0133cd0 0x7f35e01cfb40 secure :-1 s=READY pgs=3738 cs=0 l=1 rev1=1 crypto rx=0x7f35d0001a20 tx=0x7f35d000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:02.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.732+0000 7f35d6ffd640 1 -- 172.21.15.19:0/2287764662 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d0012400 con 0x7f35e0133cd0 2023-11-04T15:37:02.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.732+0000 7f35d6ffd640 1 -- 172.21.15.19:0/2287764662 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d0012560 con 0x7f35e0133cd0 2023-11-04T15:37:02.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.732+0000 7f35e4d73640 1 -- 172.21.15.19:0/2287764662 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35e01c1e10 con 0x7f35e0133cd0 2023-11-04T15:37:02.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.732+0000 7f35d6ffd640 1 -- 172.21.15.19:0/2287764662 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d0012910 con 0x7f35e0133cd0 2023-11-04T15:37:02.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.733+0000 7f35e4d73640 1 -- 172.21.15.19:0/2287764662 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e013acc0 con 0x7f35e0133cd0 2023-11-04T15:37:02.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.733+0000 7f35e4d73640 1 -- 172.21.15.19:0/2287764662 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35e00a3550 con 0x7f35e0133cd0 2023-11-04T15:37:02.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.734+0000 7f35d6ffd640 1 -- 172.21.15.19:0/2287764662 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f35d0012a70 con 0x7f35e0133cd0 2023-11-04T15:37:02.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.734+0000 7f35d6ffd640 1 --2- 172.21.15.19:0/2287764662 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f35c006a430 0x7f35c006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:02.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.734+0000 7f35d6ffd640 1 -- 172.21.15.19:0/2287764662 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4462+0+0 (secure 0 0 0) 0x7f35d0088990 con 0x7f35e0133cd0 2023-11-04T15:37:02.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.734+0000 7f35de59c640 1 --2- 172.21.15.19:0/2287764662 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f35c006a430 0x7f35c006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:02.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.735+0000 7f35de59c640 1 --2- 172.21.15.19:0/2287764662 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f35c006a430 0x7f35c006c8f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f35d8009b40 tx=0x7f35d8009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:02.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.738+0000 7f35d6ffd640 1 -- 172.21.15.19:0/2287764662 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f35d0054500 con 0x7f35e0133cd0 2023-11-04T15:37:02.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.931+0000 7f35e4d73640 1 -- 172.21.15.19:0/2287764662 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f35e01345f0 con 0x7f35e0133cd0 2023-11-04T15:37:02.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.931+0000 7f35d6ffd640 1 -- 172.21.15.19:0/2287764662 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 1 entries v43) v1 ==== 80+0+58 (secure 0 0 0) 0x7f35e01345f0 con 0x7f35e0133cd0 2023-11-04T15:37:02.934 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.130:0/185843238 2023-11-04T16:36:55.500269+0000 2023-11-04T15:37:02.935 INFO:teuthology.orchestra.run.smithi019.stderr:listed 1 entries 2023-11-04T15:37:02.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.934+0000 7f35e4d73640 1 -- 172.21.15.19:0/2287764662 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f35c006a430 msgr2=0x7f35c006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:02.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.934+0000 7f35e4d73640 1 --2- 172.21.15.19:0/2287764662 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f35c006a430 0x7f35c006c8f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f35d8009b40 tx=0x7f35d8009190 comp rx=0 tx=0).stop 2023-11-04T15:37:02.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.934+0000 7f35e4d73640 1 -- 172.21.15.19:0/2287764662 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35e0133cd0 msgr2=0x7f35e01cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:02.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.934+0000 7f35e4d73640 1 --2- 172.21.15.19:0/2287764662 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35e0133cd0 0x7f35e01cfb40 secure :-1 s=READY pgs=3738 cs=0 l=1 rev1=1 crypto rx=0x7f35d0001a20 tx=0x7f35d000a430 comp rx=0 tx=0).stop 2023-11-04T15:37:02.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.934+0000 7f35e4d73640 1 -- 172.21.15.19:0/2287764662 shutdown_connections 2023-11-04T15:37:02.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.934+0000 7f35e4d73640 1 --2- 172.21.15.19:0/2287764662 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f35c006a430 0x7f35c006c8f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:02.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.934+0000 7f35e4d73640 1 --2- 172.21.15.19:0/2287764662 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35e0133cd0 0x7f35e01cfb40 unknown :-1 s=CLOSED pgs=3738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:02.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.934+0000 7f35e4d73640 1 --2- 172.21.15.19:0/2287764662 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f35e00a4390 0x7f35e01cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:02.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.934+0000 7f35e4d73640 1 --2- 172.21.15.19:0/2287764662 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35e00a39f0 0x7f35e01cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:02.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.934+0000 7f35e4d73640 1 -- 172.21.15.19:0/2287764662 >> 172.21.15.19:0/2287764662 conn(0x7f35e00a8ff0 msgr2=0x7f35e0070740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:02.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.934+0000 7f35e4d73640 1 -- 172.21.15.19:0/2287764662 shutdown_connections 2023-11-04T15:37:02.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:02.934+0000 7f35e4d73640 1 -- 172.21.15.19:0/2287764662 wait complete. 2023-11-04T15:37:02.948 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi130.front.sepia.ceph.com... 2023-11-04T15:37:02.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T15:37:02.950 DEBUG:teuthology.orchestra.run.smithi130:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T15:37:02.980 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi130.stderr:ceph-fuse[80056]: fuse finished with error 0 and tester_r 0 2023-11-04T15:37:02.982 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T15:37:03.047 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi130.front.sepia.ceph.com 2023-11-04T15:37:03.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T15:37:03.048 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T15:37:03.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T15:37:03.151 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2023-11-04T15:37:03.168 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T15:37:03.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T15:37:03.169 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T15:37:03.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T15:37:03.239 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link delete ceph-brx 2023-11-04T15:37:03.339 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-04T15:37:03.350 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-04T15:37:03.351 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T15:37:03.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.462+0000 7f206b192640 1 Processor -- start 2023-11-04T15:37:03.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.462+0000 7f206b192640 1 -- start start 2023-11-04T15:37:03.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.463+0000 7f206b192640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2064133e00 0x7f20641341e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:03.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.463+0000 7f206b192640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f20640a0cd0 0x7f2064136c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:03.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.463+0000 7f206b192640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20640a2300 con 0x7f2064137150 2023-11-04T15:37:03.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.463+0000 7f206b192640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20640a0240 con 0x7f2064133e00 2023-11-04T15:37:03.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.463+0000 7f206b192640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20640a5760 con 0x7f20640a0cd0 2023-11-04T15:37:03.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.463+0000 7f2068f2e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2064133e00 0x7f20641341e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:03.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.463+0000 7f206972f640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2064137150 0x7f206413df60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57988/0 (socket says 172.21.15.19:57988) 2023-11-04T15:37:03.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.463+0000 7f206972f640 1 -- 172.21.15.19:0/1762703960 learned_addr learned my addr 172.21.15.19:0/1762703960 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:37:03.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.463+0000 7f2068f2e640 1 --2- 172.21.15.19:0/1762703960 >> v2:172.21.15.19:3300/0 conn(0x7f2064133e00 0x7f20641341e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60430/0 (socket says 172.21.15.19:60430) 2023-11-04T15:37:03.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.463+0000 7f2063fff640 1 --2- 172.21.15.19:0/1762703960 >> v2:172.21.15.96:3300/0 conn(0x7f20640a0cd0 0x7f2064136c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:03.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.463+0000 7f2068f2e640 1 -- 172.21.15.19:0/1762703960 >> v2:172.21.15.96:3300/0 conn(0x7f20640a0cd0 msgr2=0x7f2064136c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:03.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.463+0000 7f2068f2e640 1 --2- 172.21.15.19:0/1762703960 >> v2:172.21.15.96:3300/0 conn(0x7f20640a0cd0 0x7f2064136c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:03.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.463+0000 7f2068f2e640 1 -- 172.21.15.19:0/1762703960 >> v1:172.21.15.19:6789/0 conn(0x7f2064137150 legacy=0x7f206413df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:03.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.463+0000 7f20637fe640 1 -- 172.21.15.19:0/1762703960 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2077163148 0 0) 0x7f20640a2300 con 0x7f2064137150 2023-11-04T15:37:03.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.463+0000 7f2068f2e640 1 -- 172.21.15.19:0/1762703960 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20640a2040 con 0x7f2064133e00 2023-11-04T15:37:03.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.464+0000 7f2068f2e640 1 --2- 172.21.15.19:0/1762703960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2064133e00 0x7f20641341e0 secure :-1 s=READY pgs=3740 cs=0 l=1 rev1=1 crypto rx=0x7f20640a14d0 tx=0x7f205c02dfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc79763b229f6e38 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:03.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.464+0000 7f20637fe640 1 -- 172.21.15.19:0/1762703960 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205c02e950 con 0x7f2064133e00 2023-11-04T15:37:03.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.464+0000 7f20637fe640 1 -- 172.21.15.19:0/1762703960 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f205c02eab0 con 0x7f2064133e00 2023-11-04T15:37:03.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.464+0000 7f20637fe640 1 -- 172.21.15.19:0/1762703960 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205c02ee40 con 0x7f2064133e00 2023-11-04T15:37:03.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.465+0000 7f206b192640 1 -- 172.21.15.19:0/1762703960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2064133e00 msgr2=0x7f20641341e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:03.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.465+0000 7f206b192640 1 --2- 172.21.15.19:0/1762703960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2064133e00 0x7f20641341e0 secure :-1 s=READY pgs=3740 cs=0 l=1 rev1=1 crypto rx=0x7f20640a14d0 tx=0x7f205c02dfb0 comp rx=0 tx=0).stop 2023-11-04T15:37:03.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.465+0000 7f206b192640 1 -- 172.21.15.19:0/1762703960 shutdown_connections 2023-11-04T15:37:03.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.465+0000 7f206b192640 1 --2- 172.21.15.19:0/1762703960 >> v2:172.21.15.96:3300/0 conn(0x7f20640a0cd0 0x7f2064136c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:03.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.465+0000 7f206b192640 1 --2- 172.21.15.19:0/1762703960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2064133e00 0x7f20641341e0 unknown :-1 s=CLOSED pgs=3740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:03.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.465+0000 7f206b192640 1 -- 172.21.15.19:0/1762703960 >> 172.21.15.19:0/1762703960 conn(0x7f20640a8ff0 msgr2=0x7f20640a9400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:03.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.465+0000 7f206b192640 1 -- 172.21.15.19:0/1762703960 shutdown_connections 2023-11-04T15:37:03.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.465+0000 7f206b192640 1 -- 172.21.15.19:0/1762703960 wait complete. 2023-11-04T15:37:03.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.466+0000 7f206b192640 1 Processor -- start 2023-11-04T15:37:03.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.466+0000 7f206b192640 1 -- start start 2023-11-04T15:37:03.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.466+0000 7f206b192640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20640a0cd0 0x7f206412ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:03.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.466+0000 7f206b192640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2064133e00 0x7f206412efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:03.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.466+0000 7f206b192640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2064137150 0x7f20641ca580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:03.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.466+0000 7f206b192640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20640998d0 con 0x7f2064133e00 2023-11-04T15:37:03.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.466+0000 7f206b192640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2064099330 con 0x7f20640a0cd0 2023-11-04T15:37:03.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.466+0000 7f206b192640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20640995f0 con 0x7f2064137150 2023-11-04T15:37:03.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.467+0000 7f2063fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2064133e00 0x7f206412efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:03.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.467+0000 7f2063fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2064133e00 0x7f206412efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60434/0 (socket says 172.21.15.19:60434) 2023-11-04T15:37:03.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.467+0000 7f2063fff640 1 -- 172.21.15.19:0/3929493640 learned_addr learned my addr 172.21.15.19:0/3929493640 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:37:03.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.467+0000 7f2068f2e640 1 --2- 172.21.15.19:0/3929493640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20640a0cd0 0x7f206412ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:03.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.467+0000 7f206972f640 1 --2- 172.21.15.19:0/3929493640 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2064137150 0x7f20641ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:03.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.467+0000 7f2063fff640 1 -- 172.21.15.19:0/3929493640 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2064137150 msgr2=0x7f20641ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:03.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.467+0000 7f2063fff640 1 --2- 172.21.15.19:0/3929493640 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2064137150 0x7f20641ca580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:03.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.467+0000 7f2063fff640 1 -- 172.21.15.19:0/3929493640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20640a0cd0 msgr2=0x7f206412ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:03.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.467+0000 7f2063fff640 1 --2- 172.21.15.19:0/3929493640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20640a0cd0 0x7f206412ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:03.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.467+0000 7f2063fff640 1 -- 172.21.15.19:0/3929493640 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f205c00bc80 con 0x7f2064133e00 2023-11-04T15:37:03.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.467+0000 7f2068f2e640 1 --2- 172.21.15.19:0/3929493640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20640a0cd0 0x7f206412ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:37:03.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.467+0000 7f2063fff640 1 --2- 172.21.15.19:0/3929493640 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2064133e00 0x7f206412efc0 secure :-1 s=READY pgs=3741 cs=0 l=1 rev1=1 crypto rx=0x7f205800c7f0 tx=0x7f205800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:03.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.467+0000 7f20617fa640 1 -- 172.21.15.19:0/3929493640 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2058004220 con 0x7f2064133e00 2023-11-04T15:37:03.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.467+0000 7f20617fa640 1 -- 172.21.15.19:0/3929493640 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2058004380 con 0x7f2064133e00 2023-11-04T15:37:03.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.467+0000 7f206b192640 1 -- 172.21.15.19:0/3929493640 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20640712b0 con 0x7f2064133e00 2023-11-04T15:37:03.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.467+0000 7f20617fa640 1 -- 172.21.15.19:0/3929493640 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2058007840 con 0x7f2064133e00 2023-11-04T15:37:03.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.467+0000 7f206b192640 1 -- 172.21.15.19:0/3929493640 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2064098ad0 con 0x7f2064133e00 2023-11-04T15:37:03.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.468+0000 7f206b192640 1 -- 172.21.15.19:0/3929493640 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2064067d60 con 0x7f2064133e00 2023-11-04T15:37:03.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.469+0000 7f20617fa640 1 -- 172.21.15.19:0/3929493640 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f20580079a0 con 0x7f2064133e00 2023-11-04T15:37:03.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.469+0000 7f20617fa640 1 --2- 172.21.15.19:0/3929493640 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f205006a430 0x7f205006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:03.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.469+0000 7f20617fa640 1 -- 172.21.15.19:0/3929493640 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4462+0+0 (secure 0 0 0) 0x7f2058088130 con 0x7f2064133e00 2023-11-04T15:37:03.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.469+0000 7f2068f2e640 1 --2- 172.21.15.19:0/3929493640 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f205006a430 0x7f205006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:03.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.470+0000 7f2068f2e640 1 --2- 172.21.15.19:0/3929493640 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f205006a430 0x7f205006c8f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f205c037000 tx=0x7f205c032000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:03.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.474+0000 7f20617fa640 1 -- 172.21.15.19:0/3929493640 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2058053c10 con 0x7f2064133e00 2023-11-04T15:37:03.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.654+0000 7f206b192640 1 -- 172.21.15.19:0/3929493640 --> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f20640a1be0 con 0x7f205006a430 2023-11-04T15:37:03.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.661+0000 7f20617fa640 1 -- 172.21.15.19:0/3929493640 <== mgr.4114 v2:172.21.15.96:6816/83123 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281183 (secure 0 0 0) 0x7f205c00b2e0 con 0x7f205006a430 2023-11-04T15:37:03.668 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:37:03.670 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-11-04T15:37:03.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.664+0000 7f206b192640 1 -- 172.21.15.19:0/3929493640 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f205006a430 msgr2=0x7f205006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:03.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.664+0000 7f206b192640 1 --2- 172.21.15.19:0/3929493640 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f205006a430 0x7f205006c8f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f205c037000 tx=0x7f205c032000 comp rx=0 tx=0).stop 2023-11-04T15:37:03.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.664+0000 7f206b192640 1 -- 172.21.15.19:0/3929493640 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2064133e00 msgr2=0x7f206412efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:03.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.664+0000 7f206b192640 1 --2- 172.21.15.19:0/3929493640 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2064133e00 0x7f206412efc0 secure :-1 s=READY pgs=3741 cs=0 l=1 rev1=1 crypto rx=0x7f205800c7f0 tx=0x7f205800ccb0 comp rx=0 tx=0).stop 2023-11-04T15:37:03.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.665+0000 7f206b192640 1 -- 172.21.15.19:0/3929493640 shutdown_connections 2023-11-04T15:37:03.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.665+0000 7f206b192640 1 --2- 172.21.15.19:0/3929493640 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f205006a430 0x7f205006c8f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:03.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.665+0000 7f206b192640 1 --2- 172.21.15.19:0/3929493640 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2064137150 0x7f20641ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:03.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.665+0000 7f206b192640 1 --2- 172.21.15.19:0/3929493640 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2064133e00 0x7f206412efc0 unknown :-1 s=CLOSED pgs=3741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:03.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.665+0000 7f206b192640 1 --2- 172.21.15.19:0/3929493640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20640a0cd0 0x7f206412ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:03.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.665+0000 7f206b192640 1 -- 172.21.15.19:0/3929493640 >> 172.21.15.19:0/3929493640 conn(0x7f20640a8ff0 msgr2=0x7f20640a38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:03.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.665+0000 7f206b192640 1 -- 172.21.15.19:0/3929493640 shutdown_connections 2023-11-04T15:37:03.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.665+0000 7f206b192640 1 -- 172.21.15.19:0/3929493640 wait complete. 2023-11-04T15:37:03.679 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2023-11-04T15:37:03.054758+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":431372061,"num_objects":220,"num_object_clones":25,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":8,"num_read":352,"num_read_kb":3468,"num_write":158428,"num_write_kb":940479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":307482,"ondisk_log_size":307482,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":3245160,"kb_used_data":844616,"kb_used_omap":0,"kb_used_meta":2400512,"kb_avail":374242200,"statfs":{"total":386547056640,"available":383224012800,"internally_reserved":0,"allocated":864886784,"data_stored":863450232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2458124288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3591427,"num_objects":12,"num_object_clones":6,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":189,"num_write_kb":3620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.340851"},"pg_stats":[{"pgid":"4.3f","version":"40'3514","reported_seq":2948,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.799825+0000","last_change":"2023-11-04T15:36:55.800606+0000","last_active":"2023-11-04T15:36:55.799825+0000","last_peered":"2023-11-04T15:36:55.799825+0000","last_clean":"2023-11-04T15:36:55.799825+0000","last_became_active":"2023-11-04T15:27:36.150296+0000","last_became_peered":"2023-11-04T15:27:36.150296+0000","last_unstale":"2023-11-04T15:36:55.799825+0000","last_undegraded":"2023-11-04T15:36:55.799825+0000","last_fullsized":"2023-11-04T15:36:55.799825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3514,"log_dups_size":0,"ondisk_log_size":3514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:41:32.995261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.074678280999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1112,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.3e","version":"43'3332","reported_seq":2781,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:57.912769+0000","last_change":"2023-11-04T15:36:55.781000+0000","last_active":"2023-11-04T15:36:57.912769+0000","last_peered":"2023-11-04T15:36:57.912769+0000","last_clean":"2023-11-04T15:36:57.912769+0000","last_became_active":"2023-11-04T15:27:36.148939+0000","last_became_peered":"2023-11-04T15:27:36.148939+0000","last_unstale":"2023-11-04T15:36:57.912769+0000","last_undegraded":"2023-11-04T15:36:57.912769+0000","last_fullsized":"2023-11-04T15:36:57.912769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3332,"log_dups_size":0,"ondisk_log_size":3332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:52:55.975636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059113046000000002,"stat_sum":{"num_bytes":35,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1118,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.3d","version":"40'3527","reported_seq":2997,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.821524+0000","last_change":"2023-11-04T15:36:55.822917+0000","last_active":"2023-11-04T15:36:55.821524+0000","last_peered":"2023-11-04T15:36:55.821524+0000","last_clean":"2023-11-04T15:36:55.821524+0000","last_became_active":"2023-11-04T15:27:36.149748+0000","last_became_peered":"2023-11-04T15:27:36.149748+0000","last_unstale":"2023-11-04T15:36:55.821524+0000","last_undegraded":"2023-11-04T15:36:55.821524+0000","last_fullsized":"2023-11-04T15:36:55.821524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3527,"log_dups_size":0,"ondisk_log_size":3527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:49:04.091063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101592565,"stat_sum":{"num_bytes":8206,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":1149,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.3c","version":"40'3602","reported_seq":2981,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.769537+0000","last_change":"2023-11-04T15:36:55.770578+0000","last_active":"2023-11-04T15:36:55.769537+0000","last_peered":"2023-11-04T15:36:55.769537+0000","last_clean":"2023-11-04T15:36:55.769537+0000","last_became_active":"2023-11-04T15:27:36.139761+0000","last_became_peered":"2023-11-04T15:27:36.139761+0000","last_unstale":"2023-11-04T15:36:55.769537+0000","last_undegraded":"2023-11-04T15:36:55.769537+0000","last_fullsized":"2023-11-04T15:36:55.769537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3602,"log_dups_size":0,"ondisk_log_size":3602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:38:30.379384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052924038,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1171,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.3b","version":"40'3725","reported_seq":3115,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.797163+0000","last_change":"2023-11-04T15:36:55.798093+0000","last_active":"2023-11-04T15:36:55.797163+0000","last_peered":"2023-11-04T15:36:55.797163+0000","last_clean":"2023-11-04T15:36:55.797163+0000","last_became_active":"2023-11-04T15:27:36.150017+0000","last_became_peered":"2023-11-04T15:27:36.150017+0000","last_unstale":"2023-11-04T15:36:55.797163+0000","last_undegraded":"2023-11-04T15:36:55.797163+0000","last_fullsized":"2023-11-04T15:36:55.797163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3725,"log_dups_size":0,"ondisk_log_size":3725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:47:40.350777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.073241305000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1192,"num_write_kb":641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.3a","version":"40'3327","reported_seq":2767,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.822971+0000","last_change":"2023-11-04T15:36:55.824394+0000","last_active":"2023-11-04T15:36:55.822971+0000","last_peered":"2023-11-04T15:36:55.822971+0000","last_clean":"2023-11-04T15:36:55.822971+0000","last_became_active":"2023-11-04T15:27:36.139036+0000","last_became_peered":"2023-11-04T15:27:36.139036+0000","last_unstale":"2023-11-04T15:36:55.822971+0000","last_undegraded":"2023-11-04T15:36:55.822971+0000","last_fullsized":"2023-11-04T15:36:55.822971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3327,"log_dups_size":0,"ondisk_log_size":3327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:05:44.093984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.102154117,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1074,"num_write_kb":603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.39","version":"43'3353","reported_seq":2801,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:58.060175+0000","last_change":"2023-11-04T15:36:55.820147+0000","last_active":"2023-11-04T15:36:58.060175+0000","last_peered":"2023-11-04T15:36:58.060175+0000","last_clean":"2023-11-04T15:36:58.060175+0000","last_became_active":"2023-11-04T15:27:36.139121+0000","last_became_peered":"2023-11-04T15:27:36.139121+0000","last_unstale":"2023-11-04T15:36:58.060175+0000","last_undegraded":"2023-11-04T15:36:58.060175+0000","last_fullsized":"2023-11-04T15:36:58.060175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3353,"log_dups_size":0,"ondisk_log_size":3353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:57:05.896392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.099827518000000004,"stat_sum":{"num_bytes":4117,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":2,"num_read_kb":1,"num_write":1086,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.38","version":"40'3425","reported_seq":2840,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.815196+0000","last_change":"2023-11-04T15:36:55.816551+0000","last_active":"2023-11-04T15:36:55.815196+0000","last_peered":"2023-11-04T15:36:55.815196+0000","last_clean":"2023-11-04T15:36:55.815196+0000","last_became_active":"2023-11-04T15:27:36.147050+0000","last_became_peered":"2023-11-04T15:27:36.147050+0000","last_unstale":"2023-11-04T15:36:55.815196+0000","last_undegraded":"2023-11-04T15:36:55.815196+0000","last_fullsized":"2023-11-04T15:36:55.815196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3425,"log_dups_size":0,"ondisk_log_size":3425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:40:36.811342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.098810337999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.37","version":"40'3561","reported_seq":2961,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.795099+0000","last_change":"2023-11-04T15:36:55.796038+0000","last_active":"2023-11-04T15:36:55.795099+0000","last_peered":"2023-11-04T15:36:55.795099+0000","last_clean":"2023-11-04T15:36:55.795099+0000","last_became_active":"2023-11-04T15:27:36.145825+0000","last_became_peered":"2023-11-04T15:27:36.145825+0000","last_unstale":"2023-11-04T15:36:55.795099+0000","last_undegraded":"2023-11-04T15:36:55.795099+0000","last_fullsized":"2023-11-04T15:36:55.795099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3561,"log_dups_size":0,"ondisk_log_size":3561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:52:55.975636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072094483000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.36","version":"40'3327","reported_seq":2840,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.816605+0000","last_change":"2023-11-04T15:36:55.817992+0000","last_active":"2023-11-04T15:36:55.816605+0000","last_peered":"2023-11-04T15:36:55.816605+0000","last_clean":"2023-11-04T15:36:55.816605+0000","last_became_active":"2023-11-04T15:27:36.150307+0000","last_became_peered":"2023-11-04T15:27:36.150307+0000","last_unstale":"2023-11-04T15:36:55.816605+0000","last_undegraded":"2023-11-04T15:36:55.816605+0000","last_fullsized":"2023-11-04T15:36:55.816605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3327,"log_dups_size":0,"ondisk_log_size":3327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:38:23.440792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10012518099999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1064,"num_write_kb":572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.35","version":"40'3202","reported_seq":2717,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.769477+0000","last_change":"2023-11-04T15:36:55.770571+0000","last_active":"2023-11-04T15:36:55.769477+0000","last_peered":"2023-11-04T15:36:55.769477+0000","last_clean":"2023-11-04T15:36:55.769477+0000","last_became_active":"2023-11-04T15:27:36.144988+0000","last_became_peered":"2023-11-04T15:27:36.144988+0000","last_unstale":"2023-11-04T15:36:55.769477+0000","last_undegraded":"2023-11-04T15:36:55.769477+0000","last_fullsized":"2023-11-04T15:36:55.769477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3202,"log_dups_size":0,"ondisk_log_size":3202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:41.544754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052379294999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1028,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.34","version":"40'3394","reported_seq":2819,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.780718+0000","last_change":"2023-11-04T15:36:55.782106+0000","last_active":"2023-11-04T15:36:55.780718+0000","last_peered":"2023-11-04T15:36:55.780718+0000","last_clean":"2023-11-04T15:36:55.780718+0000","last_became_active":"2023-11-04T15:27:36.149156+0000","last_became_peered":"2023-11-04T15:27:36.149156+0000","last_unstale":"2023-11-04T15:36:55.780718+0000","last_undegraded":"2023-11-04T15:36:55.780718+0000","last_fullsized":"2023-11-04T15:36:55.780718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3394,"log_dups_size":0,"ondisk_log_size":3394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:22:17.580120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.064372897999999998,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1159,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.33","version":"40'3255","reported_seq":2740,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.791655+0000","last_change":"2023-11-04T15:36:55.792591+0000","last_active":"2023-11-04T15:36:55.791655+0000","last_peered":"2023-11-04T15:36:55.791655+0000","last_clean":"2023-11-04T15:36:55.791655+0000","last_became_active":"2023-11-04T15:27:36.139824+0000","last_became_peered":"2023-11-04T15:27:36.139824+0000","last_unstale":"2023-11-04T15:36:55.791655+0000","last_undegraded":"2023-11-04T15:36:55.791655+0000","last_fullsized":"2023-11-04T15:36:55.791655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3255,"log_dups_size":0,"ondisk_log_size":3255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:28.095802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070068697999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1062,"num_write_kb":575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.32","version":"40'3538","reported_seq":2915,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.774374+0000","last_change":"2023-11-04T15:36:55.774374+0000","last_active":"2023-11-04T15:36:55.774374+0000","last_peered":"2023-11-04T15:36:55.774374+0000","last_clean":"2023-11-04T15:36:55.774374+0000","last_became_active":"2023-11-04T15:27:36.147273+0000","last_became_peered":"2023-11-04T15:27:36.147273+0000","last_unstale":"2023-11-04T15:36:55.774374+0000","last_undegraded":"2023-11-04T15:36:55.774374+0000","last_fullsized":"2023-11-04T15:36:55.774374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3538,"log_dups_size":0,"ondisk_log_size":3538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:22:17.580120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055716603000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.31","version":"40'3766","reported_seq":3156,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.780005+0000","last_change":"2023-11-04T15:36:55.780005+0000","last_active":"2023-11-04T15:36:55.780005+0000","last_peered":"2023-11-04T15:36:55.780005+0000","last_clean":"2023-11-04T15:36:55.780005+0000","last_became_active":"2023-11-04T15:27:36.148932+0000","last_became_peered":"2023-11-04T15:27:36.148932+0000","last_unstale":"2023-11-04T15:36:55.780005+0000","last_undegraded":"2023-11-04T15:36:55.780005+0000","last_fullsized":"2023-11-04T15:36:55.780005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3766,"log_dups_size":0,"ondisk_log_size":3766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:12:07.727740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062648212999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1209,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.30","version":"40'3538","reported_seq":2943,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.818096+0000","last_change":"2023-11-04T15:36:55.818096+0000","last_active":"2023-11-04T15:36:55.818096+0000","last_peered":"2023-11-04T15:36:55.818096+0000","last_clean":"2023-11-04T15:36:55.818096+0000","last_became_active":"2023-11-04T15:27:36.150856+0000","last_became_peered":"2023-11-04T15:27:36.150856+0000","last_unstale":"2023-11-04T15:36:55.818096+0000","last_undegraded":"2023-11-04T15:36:55.818096+0000","last_fullsized":"2023-11-04T15:36:55.818096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3538,"log_dups_size":0,"ondisk_log_size":3538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:51:31.442634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.099772735000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.2f","version":"40'3671","reported_seq":2997,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.797112+0000","last_change":"2023-11-04T15:36:55.797112+0000","last_active":"2023-11-04T15:36:55.797112+0000","last_peered":"2023-11-04T15:36:55.797112+0000","last_clean":"2023-11-04T15:36:55.797112+0000","last_became_active":"2023-11-04T15:27:36.144997+0000","last_became_peered":"2023-11-04T15:27:36.144997+0000","last_unstale":"2023-11-04T15:36:55.797112+0000","last_undegraded":"2023-11-04T15:36:55.797112+0000","last_fullsized":"2023-11-04T15:36:55.797112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3671,"log_dups_size":0,"ondisk_log_size":3671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:22:17.580120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072563297999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1270,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.2e","version":"40'3137","reported_seq":2640,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.820139+0000","last_change":"2023-11-04T15:36:55.820139+0000","last_active":"2023-11-04T15:36:55.820139+0000","last_peered":"2023-11-04T15:36:55.820139+0000","last_clean":"2023-11-04T15:36:55.820139+0000","last_became_active":"2023-11-04T15:27:36.150555+0000","last_became_peered":"2023-11-04T15:27:36.150555+0000","last_unstale":"2023-11-04T15:36:55.820139+0000","last_undegraded":"2023-11-04T15:36:55.820139+0000","last_fullsized":"2023-11-04T15:36:55.820139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3137,"log_dups_size":0,"ondisk_log_size":3137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:32:27.370984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101696772,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1042,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.2d","version":"40'3390","reported_seq":2810,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.794062+0000","last_change":"2023-11-04T15:36:55.795034+0000","last_active":"2023-11-04T15:36:55.794062+0000","last_peered":"2023-11-04T15:36:55.794062+0000","last_clean":"2023-11-04T15:36:55.794062+0000","last_became_active":"2023-11-04T15:27:36.147745+0000","last_became_peered":"2023-11-04T15:27:36.147745+0000","last_unstale":"2023-11-04T15:36:55.794062+0000","last_undegraded":"2023-11-04T15:36:55.794062+0000","last_fullsized":"2023-11-04T15:36:55.794062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3390,"log_dups_size":0,"ondisk_log_size":3390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:41:10.315016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071588252000000005,"stat_sum":{"num_bytes":4128,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1173,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.2c","version":"40'3505","reported_seq":2913,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.814083+0000","last_change":"2023-11-04T15:36:55.815381+0000","last_active":"2023-11-04T15:36:55.814083+0000","last_peered":"2023-11-04T15:36:55.814083+0000","last_clean":"2023-11-04T15:36:55.814083+0000","last_became_active":"2023-11-04T15:27:36.150687+0000","last_became_peered":"2023-11-04T15:27:36.150687+0000","last_unstale":"2023-11-04T15:36:55.814083+0000","last_undegraded":"2023-11-04T15:36:55.814083+0000","last_fullsized":"2023-11-04T15:36:55.814083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3505,"log_dups_size":0,"ondisk_log_size":3505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:56:24.790444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.097896176000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1154,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.2b","version":"43'3544","reported_seq":2979,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.776770+0000","last_change":"2023-11-04T15:36:55.776770+0000","last_active":"2023-11-04T15:36:55.776770+0000","last_peered":"2023-11-04T15:36:55.776770+0000","last_clean":"2023-11-04T15:36:55.776770+0000","last_became_active":"2023-11-04T15:27:36.143551+0000","last_became_peered":"2023-11-04T15:27:36.143551+0000","last_unstale":"2023-11-04T15:36:55.776770+0000","last_undegraded":"2023-11-04T15:36:55.776770+0000","last_fullsized":"2023-11-04T15:36:55.776770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3544,"log_dups_size":0,"ondisk_log_size":3544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:36:21.960547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056037475000000003,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1178,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.2a","version":"40'3728","reported_seq":3083,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.793582+0000","last_change":"2023-11-04T15:36:55.794625+0000","last_active":"2023-11-04T15:36:55.793582+0000","last_peered":"2023-11-04T15:36:55.793582+0000","last_clean":"2023-11-04T15:36:55.793582+0000","last_became_active":"2023-11-04T15:27:36.145943+0000","last_became_peered":"2023-11-04T15:27:36.145943+0000","last_unstale":"2023-11-04T15:36:55.793582+0000","last_undegraded":"2023-11-04T15:36:55.793582+0000","last_fullsized":"2023-11-04T15:36:55.793582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3728,"log_dups_size":0,"ondisk_log_size":3728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:48:58.102459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071549077000000003,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1242,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.29","version":"40'3454","reported_seq":2887,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.776581+0000","last_change":"2023-11-04T15:36:55.777772+0000","last_active":"2023-11-04T15:36:55.776581+0000","last_peered":"2023-11-04T15:36:55.776581+0000","last_clean":"2023-11-04T15:36:55.776581+0000","last_became_active":"2023-11-04T15:27:36.144083+0000","last_became_peered":"2023-11-04T15:27:36.144083+0000","last_unstale":"2023-11-04T15:36:55.776581+0000","last_undegraded":"2023-11-04T15:36:55.776581+0000","last_fullsized":"2023-11-04T15:36:55.776581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3454,"log_dups_size":0,"ondisk_log_size":3454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:32:27.370984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.060959410999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1127,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.28","version":"40'3632","reported_seq":2989,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.820178+0000","last_change":"2023-11-04T15:36:55.821483+0000","last_active":"2023-11-04T15:36:55.820178+0000","last_peered":"2023-11-04T15:36:55.820178+0000","last_clean":"2023-11-04T15:36:55.820178+0000","last_became_active":"2023-11-04T15:27:36.146546+0000","last_became_peered":"2023-11-04T15:27:36.146546+0000","last_unstale":"2023-11-04T15:36:55.820178+0000","last_undegraded":"2023-11-04T15:36:55.820178+0000","last_fullsized":"2023-11-04T15:36:55.820178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3632,"log_dups_size":0,"ondisk_log_size":3632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:41:10.315016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.102597439,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1222,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.27","version":"40'3166","reported_seq":2626,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.781930+0000","last_change":"2023-11-04T15:36:55.783207+0000","last_active":"2023-11-04T15:36:55.781930+0000","last_peered":"2023-11-04T15:36:55.781930+0000","last_clean":"2023-11-04T15:36:55.781930+0000","last_became_active":"2023-11-04T15:27:36.144047+0000","last_became_peered":"2023-11-04T15:27:36.144047+0000","last_unstale":"2023-11-04T15:36:55.781930+0000","last_undegraded":"2023-11-04T15:36:55.781930+0000","last_fullsized":"2023-11-04T15:36:55.781930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3166,"log_dups_size":0,"ondisk_log_size":3166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:36:21.960547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.064725415999999994,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1115,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.26","version":"40'3493","reported_seq":2891,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.783404+0000","last_change":"2023-11-04T15:36:55.784865+0000","last_active":"2023-11-04T15:36:55.783404+0000","last_peered":"2023-11-04T15:36:55.783404+0000","last_clean":"2023-11-04T15:36:55.783404+0000","last_became_active":"2023-11-04T15:27:36.144458+0000","last_became_peered":"2023-11-04T15:27:36.144458+0000","last_unstale":"2023-11-04T15:36:55.783404+0000","last_undegraded":"2023-11-04T15:36:55.783404+0000","last_fullsized":"2023-11-04T15:36:55.783404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3493,"log_dups_size":0,"ondisk_log_size":3493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:52:55.975636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.066118209999999997,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.25","version":"40'3386","reported_seq":2823,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.826414+0000","last_change":"2023-11-04T15:36:55.827764+0000","last_active":"2023-11-04T15:36:55.826414+0000","last_peered":"2023-11-04T15:36:55.826414+0000","last_clean":"2023-11-04T15:36:55.826414+0000","last_became_active":"2023-11-04T15:27:36.150270+0000","last_became_peered":"2023-11-04T15:27:36.150270+0000","last_unstale":"2023-11-04T15:36:55.826414+0000","last_undegraded":"2023-11-04T15:36:55.826414+0000","last_fullsized":"2023-11-04T15:36:55.826414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3386,"log_dups_size":0,"ondisk_log_size":3386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:18:00.808576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.104674168,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.24","version":"40'3286","reported_seq":2715,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.799791+0000","last_change":"2023-11-04T15:36:55.799791+0000","last_active":"2023-11-04T15:36:55.799791+0000","last_peered":"2023-11-04T15:36:55.799791+0000","last_clean":"2023-11-04T15:36:55.799791+0000","last_became_active":"2023-11-04T15:28:20.871378+0000","last_became_peered":"2023-11-04T15:28:20.871378+0000","last_unstale":"2023-11-04T15:36:55.799791+0000","last_undegraded":"2023-11-04T15:36:55.799791+0000","last_fullsized":"2023-11-04T15:36:55.799791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3286,"log_dups_size":0,"ondisk_log_size":3286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:50:26.736014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.074381663000000001,"stat_sum":{"num_bytes":9,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1152,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.23","version":"40'3578","reported_seq":3004,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.792948+0000","last_change":"2023-11-04T15:36:55.793946+0000","last_active":"2023-11-04T15:36:55.792948+0000","last_peered":"2023-11-04T15:36:55.792948+0000","last_clean":"2023-11-04T15:36:55.792948+0000","last_became_active":"2023-11-04T15:27:36.145392+0000","last_became_peered":"2023-11-04T15:27:36.145392+0000","last_unstale":"2023-11-04T15:36:55.792948+0000","last_undegraded":"2023-11-04T15:36:55.792948+0000","last_fullsized":"2023-11-04T15:36:55.792948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3578,"log_dups_size":0,"ondisk_log_size":3578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:12:07.727740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070714202000000004,"stat_sum":{"num_bytes":12288,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1167,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.22","version":"40'3386","reported_seq":2859,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.822944+0000","last_change":"2023-11-04T15:36:55.824211+0000","last_active":"2023-11-04T15:36:55.822944+0000","last_peered":"2023-11-04T15:36:55.822944+0000","last_clean":"2023-11-04T15:36:55.822944+0000","last_became_active":"2023-11-04T15:27:36.145273+0000","last_became_peered":"2023-11-04T15:27:36.145273+0000","last_unstale":"2023-11-04T15:36:55.822944+0000","last_undegraded":"2023-11-04T15:36:55.822944+0000","last_fullsized":"2023-11-04T15:36:55.822944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3386,"log_dups_size":0,"ondisk_log_size":3386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:27:25.258046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101784969,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1155,"num_write_kb":603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.21","version":"40'3889","reported_seq":3211,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.777444+0000","last_change":"2023-11-04T15:36:55.778888+0000","last_active":"2023-11-04T15:36:55.777444+0000","last_peered":"2023-11-04T15:36:55.777444+0000","last_clean":"2023-11-04T15:36:55.777444+0000","last_became_active":"2023-11-04T15:27:36.144053+0000","last_became_peered":"2023-11-04T15:27:36.144053+0000","last_unstale":"2023-11-04T15:36:55.777444+0000","last_undegraded":"2023-11-04T15:36:55.777444+0000","last_fullsized":"2023-11-04T15:36:55.777444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3889,"log_dups_size":0,"ondisk_log_size":3889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:41:10.315016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061944979999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1328,"num_write_kb":706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.20","version":"40'3720","reported_seq":3102,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.774434+0000","last_change":"2023-11-04T15:36:55.775709+0000","last_active":"2023-11-04T15:36:55.774434+0000","last_peered":"2023-11-04T15:36:55.774434+0000","last_clean":"2023-11-04T15:36:55.774434+0000","last_became_active":"2023-11-04T15:27:36.148342+0000","last_became_peered":"2023-11-04T15:27:36.148342+0000","last_unstale":"2023-11-04T15:36:55.774434+0000","last_undegraded":"2023-11-04T15:36:55.774434+0000","last_fullsized":"2023-11-04T15:36:55.774434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3720,"log_dups_size":0,"ondisk_log_size":3720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:47:40.350777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056486557999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.14","version":"40'3424","reported_seq":2823,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.784869+0000","last_change":"2023-11-04T15:36:55.784869+0000","last_active":"2023-11-04T15:36:55.784869+0000","last_peered":"2023-11-04T15:36:55.784869+0000","last_clean":"2023-11-04T15:36:55.784869+0000","last_became_active":"2023-11-04T15:27:36.148951+0000","last_became_peered":"2023-11-04T15:27:36.148951+0000","last_unstale":"2023-11-04T15:36:55.784869+0000","last_undegraded":"2023-11-04T15:36:55.784869+0000","last_fullsized":"2023-11-04T15:36:55.784869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3424,"log_dups_size":0,"ondisk_log_size":3424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:58:32.190696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.066218149000000004,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1176,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.13","version":"40'2984","reported_seq":3023,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.184473+0000","last_change":"2023-11-04T15:27:35.775931+0000","last_active":"2023-11-04T15:36:55.184473+0000","last_peered":"2023-11-04T15:36:55.184473+0000","last_clean":"2023-11-04T15:36:55.184473+0000","last_became_active":"2023-11-04T15:27:35.775616+0000","last_became_peered":"2023-11-04T15:27:35.775616+0000","last_unstale":"2023-11-04T15:36:55.184473+0000","last_undegraded":"2023-11-04T15:36:55.184473+0000","last_fullsized":"2023-11-04T15:36:55.184473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2984,"log_dups_size":0,"ondisk_log_size":2984,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:14:34.175377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2984,"num_write_kb":24202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"40'3308","reported_seq":2723,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.821616+0000","last_change":"2023-11-04T15:36:55.822910+0000","last_active":"2023-11-04T15:36:55.821616+0000","last_peered":"2023-11-04T15:36:55.821616+0000","last_clean":"2023-11-04T15:36:55.821616+0000","last_became_active":"2023-11-04T15:27:36.150276+0000","last_became_peered":"2023-11-04T15:27:36.150276+0000","last_unstale":"2023-11-04T15:36:55.821616+0000","last_undegraded":"2023-11-04T15:36:55.821616+0000","last_fullsized":"2023-11-04T15:36:55.821616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3308,"log_dups_size":0,"ondisk_log_size":3308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T22:54:18.576814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101095329,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1177,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.12","version":"37'462","reported_seq":501,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.221673+0000","last_change":"2023-11-04T15:27:35.776610+0000","last_active":"2023-11-04T15:36:55.221673+0000","last_peered":"2023-11-04T15:36:55.221673+0000","last_clean":"2023-11-04T15:36:55.221673+0000","last_became_active":"2023-11-04T15:27:35.776297+0000","last_became_peered":"2023-11-04T15:27:35.776297+0000","last_unstale":"2023-11-04T15:36:55.221673+0000","last_undegraded":"2023-11-04T15:36:55.221673+0000","last_fullsized":"2023-11-04T15:36:55.221673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:11:01.495068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":462,"num_write_kb":12396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"40'3485","reported_seq":2904,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.799120+0000","last_change":"2023-11-04T15:36:55.800080+0000","last_active":"2023-11-04T15:36:55.799120+0000","last_peered":"2023-11-04T15:36:55.799120+0000","last_clean":"2023-11-04T15:36:55.799120+0000","last_became_active":"2023-11-04T15:27:36.139580+0000","last_became_peered":"2023-11-04T15:27:36.139580+0000","last_unstale":"2023-11-04T15:36:55.799120+0000","last_undegraded":"2023-11-04T15:36:55.799120+0000","last_fullsized":"2023-11-04T15:36:55.799120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3485,"log_dups_size":0,"ondisk_log_size":3485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:38:30.379384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.074768939000000006,"stat_sum":{"num_bytes":8192,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1207,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.11","version":"40'717","reported_seq":756,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.184426+0000","last_change":"2023-11-04T15:27:35.775977+0000","last_active":"2023-11-04T15:36:55.184426+0000","last_peered":"2023-11-04T15:36:55.184426+0000","last_clean":"2023-11-04T15:36:55.184426+0000","last_became_active":"2023-11-04T15:27:35.775486+0000","last_became_peered":"2023-11-04T15:27:35.775486+0000","last_unstale":"2023-11-04T15:36:55.184426+0000","last_undegraded":"2023-11-04T15:36:55.184426+0000","last_fullsized":"2023-11-04T15:36:55.184426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:44:09.266115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":707,"num_write_kb":16815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"40'3443","reported_seq":2872,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.798148+0000","last_change":"2023-11-04T15:36:55.799083+0000","last_active":"2023-11-04T15:36:55.798148+0000","last_peered":"2023-11-04T15:36:55.798148+0000","last_clean":"2023-11-04T15:36:55.798148+0000","last_became_active":"2023-11-04T15:27:36.139789+0000","last_became_peered":"2023-11-04T15:27:36.139789+0000","last_unstale":"2023-11-04T15:36:55.798148+0000","last_undegraded":"2023-11-04T15:36:55.798148+0000","last_fullsized":"2023-11-04T15:36:55.798148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3443,"log_dups_size":0,"ondisk_log_size":3443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:55:13.470788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.073936136,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.10","version":"37'1614","reported_seq":1653,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.184371+0000","last_change":"2023-11-04T15:27:35.776168+0000","last_active":"2023-11-04T15:36:55.184371+0000","last_peered":"2023-11-04T15:36:55.184371+0000","last_clean":"2023-11-04T15:36:55.184371+0000","last_became_active":"2023-11-04T15:27:35.775895+0000","last_became_peered":"2023-11-04T15:27:35.775895+0000","last_unstale":"2023-11-04T15:36:55.184371+0000","last_undegraded":"2023-11-04T15:36:55.184371+0000","last_fullsized":"2023-11-04T15:36:55.184371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1614,"log_dups_size":0,"ondisk_log_size":1614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:02:27.460776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":1625,"num_write_kb":22714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"43'1198","reported_seq":1237,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.717728+0000","last_change":"2023-11-04T15:27:35.767890+0000","last_active":"2023-11-04T15:36:55.717728+0000","last_peered":"2023-11-04T15:36:55.717728+0000","last_clean":"2023-11-04T15:36:55.717728+0000","last_became_active":"2023-11-04T15:27:35.767594+0000","last_became_peered":"2023-11-04T15:27:35.767594+0000","last_unstale":"2023-11-04T15:36:55.717728+0000","last_undegraded":"2023-11-04T15:36:55.717728+0000","last_fullsized":"2023-11-04T15:36:55.717728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1198,"log_dups_size":0,"ondisk_log_size":1198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:11:01.495068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1190,"num_write_kb":15478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"40'3688","reported_seq":3048,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.820227+0000","last_change":"2023-11-04T15:36:55.821576+0000","last_active":"2023-11-04T15:36:55.820227+0000","last_peered":"2023-11-04T15:36:55.820227+0000","last_clean":"2023-11-04T15:36:55.820227+0000","last_became_active":"2023-11-04T15:27:36.148282+0000","last_became_peered":"2023-11-04T15:27:36.148282+0000","last_unstale":"2023-11-04T15:36:55.820227+0000","last_undegraded":"2023-11-04T15:36:55.820227+0000","last_fullsized":"2023-11-04T15:36:55.820227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3688,"log_dups_size":0,"ondisk_log_size":3688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:28:21.024990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.102136719,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1244,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.e","version":"37'2392","reported_seq":2431,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.718563+0000","last_change":"2023-11-04T15:27:35.771839+0000","last_active":"2023-11-04T15:36:54.718563+0000","last_peered":"2023-11-04T15:36:54.718563+0000","last_clean":"2023-11-04T15:36:54.718563+0000","last_became_active":"2023-11-04T15:27:35.771554+0000","last_became_peered":"2023-11-04T15:27:35.771554+0000","last_unstale":"2023-11-04T15:36:54.718563+0000","last_undegraded":"2023-11-04T15:36:54.718563+0000","last_fullsized":"2023-11-04T15:36:54.718563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2392,"log_dups_size":0,"ondisk_log_size":2392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:02:11.972760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2386,"num_write_kb":21701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"40'3600","reported_seq":2983,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.777887+0000","last_change":"2023-11-04T15:36:55.779143+0000","last_active":"2023-11-04T15:36:55.777887+0000","last_peered":"2023-11-04T15:36:55.777887+0000","last_clean":"2023-11-04T15:36:55.777887+0000","last_became_active":"2023-11-04T15:27:36.149146+0000","last_became_peered":"2023-11-04T15:27:36.149146+0000","last_unstale":"2023-11-04T15:36:55.777887+0000","last_undegraded":"2023-11-04T15:36:55.777887+0000","last_fullsized":"2023-11-04T15:36:55.777887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3600,"log_dups_size":0,"ondisk_log_size":3600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:14:54.847413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055767874000000002,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.d","version":"40'3587","reported_seq":3626,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.719438+0000","last_change":"2023-11-04T15:27:35.773978+0000","last_active":"2023-11-04T15:36:54.719438+0000","last_peered":"2023-11-04T15:36:54.719438+0000","last_clean":"2023-11-04T15:36:54.719438+0000","last_became_active":"2023-11-04T15:27:35.773689+0000","last_became_peered":"2023-11-04T15:27:35.773689+0000","last_unstale":"2023-11-04T15:36:54.719438+0000","last_undegraded":"2023-11-04T15:36:54.719438+0000","last_fullsized":"2023-11-04T15:36:54.719438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3587,"log_dups_size":0,"ondisk_log_size":3587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:52:13.268866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582982,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3581,"num_write_kb":38716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"40'3511","reported_seq":2895,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.776611+0000","last_change":"2023-11-04T15:36:55.777637+0000","last_active":"2023-11-04T15:36:55.776611+0000","last_peered":"2023-11-04T15:36:55.776611+0000","last_clean":"2023-11-04T15:36:55.776611+0000","last_became_active":"2023-11-04T15:27:36.141695+0000","last_became_peered":"2023-11-04T15:27:36.141695+0000","last_unstale":"2023-11-04T15:36:55.776611+0000","last_undegraded":"2023-11-04T15:36:55.776611+0000","last_fullsized":"2023-11-04T15:36:55.776611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3511,"log_dups_size":0,"ondisk_log_size":3511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:45:22.367523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057953993000000002,"stat_sum":{"num_bytes":4107,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1230,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.c","version":"40'1577","reported_seq":1616,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.718956+0000","last_change":"2023-11-04T15:27:35.774108+0000","last_active":"2023-11-04T15:36:54.718956+0000","last_peered":"2023-11-04T15:36:54.718956+0000","last_clean":"2023-11-04T15:36:54.718956+0000","last_became_active":"2023-11-04T15:27:35.773818+0000","last_became_peered":"2023-11-04T15:27:35.773818+0000","last_unstale":"2023-11-04T15:36:54.718956+0000","last_undegraded":"2023-11-04T15:36:54.718956+0000","last_fullsized":"2023-11-04T15:36:54.718956+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1577,"log_dups_size":0,"ondisk_log_size":1577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:42:49.218866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1569,"num_write_kb":30603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"40'3300","reported_seq":2746,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.792637+0000","last_change":"2023-11-04T15:36:55.793529+0000","last_active":"2023-11-04T15:36:55.792637+0000","last_peered":"2023-11-04T15:36:55.792637+0000","last_clean":"2023-11-04T15:36:55.792637+0000","last_became_active":"2023-11-04T15:27:36.150653+0000","last_became_peered":"2023-11-04T15:27:36.150653+0000","last_unstale":"2023-11-04T15:36:55.792637+0000","last_undegraded":"2023-11-04T15:36:55.792637+0000","last_fullsized":"2023-11-04T15:36:55.792637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3300,"log_dups_size":0,"ondisk_log_size":3300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:36:21.960547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070970674999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1129,"num_write_kb":600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.b","version":"37'4021","reported_seq":4060,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.716556+0000","last_change":"2023-11-04T15:27:35.773128+0000","last_active":"2023-11-04T15:36:54.716556+0000","last_peered":"2023-11-04T15:36:54.716556+0000","last_clean":"2023-11-04T15:36:54.716556+0000","last_became_active":"2023-11-04T15:27:35.772815+0000","last_became_peered":"2023-11-04T15:27:35.772815+0000","last_unstale":"2023-11-04T15:36:54.716556+0000","last_undegraded":"2023-11-04T15:36:54.716556+0000","last_fullsized":"2023-11-04T15:36:54.716556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":4021,"log_dups_size":0,"ondisk_log_size":4021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:42:49.218866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4019,"num_write_kb":36923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"40'3784","reported_seq":3126,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.815424+0000","last_change":"2023-11-04T15:36:55.816749+0000","last_active":"2023-11-04T15:36:55.815424+0000","last_peered":"2023-11-04T15:36:55.815424+0000","last_clean":"2023-11-04T15:36:55.815424+0000","last_became_active":"2023-11-04T15:27:36.150667+0000","last_became_peered":"2023-11-04T15:27:36.150667+0000","last_unstale":"2023-11-04T15:36:55.815424+0000","last_undegraded":"2023-11-04T15:36:55.815424+0000","last_fullsized":"2023-11-04T15:36:55.815424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3784,"log_dups_size":0,"ondisk_log_size":3784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:55:13.470788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.098687114000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1287,"num_write_kb":684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.a","version":"37'2125","reported_seq":2164,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.718032+0000","last_change":"2023-11-04T15:27:35.775559+0000","last_active":"2023-11-04T15:36:54.718032+0000","last_peered":"2023-11-04T15:36:54.718032+0000","last_clean":"2023-11-04T15:36:54.718032+0000","last_became_active":"2023-11-04T15:27:35.775063+0000","last_became_peered":"2023-11-04T15:27:35.775063+0000","last_unstale":"2023-11-04T15:36:54.718032+0000","last_undegraded":"2023-11-04T15:36:54.718032+0000","last_fullsized":"2023-11-04T15:36:54.718032+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2125,"log_dups_size":0,"ondisk_log_size":2125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:30:45.293294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2118,"num_write_kb":30816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"40'3317","reported_seq":2785,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.824273+0000","last_change":"2023-11-04T15:36:55.826358+0000","last_active":"2023-11-04T15:36:55.824273+0000","last_peered":"2023-11-04T15:36:55.824273+0000","last_clean":"2023-11-04T15:36:55.824273+0000","last_became_active":"2023-11-04T15:27:36.139103+0000","last_became_peered":"2023-11-04T15:27:36.139103+0000","last_unstale":"2023-11-04T15:36:55.824273+0000","last_undegraded":"2023-11-04T15:36:55.824273+0000","last_fullsized":"2023-11-04T15:36:55.824273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3317,"log_dups_size":0,"ondisk_log_size":3317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:59:35.340281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10468400899999999,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1091,"num_write_kb":593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.9","version":"37'1934","reported_seq":1973,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.717552+0000","last_change":"2023-11-04T15:27:35.773686+0000","last_active":"2023-11-04T15:36:54.717552+0000","last_peered":"2023-11-04T15:36:54.717552+0000","last_clean":"2023-11-04T15:36:54.717552+0000","last_became_active":"2023-11-04T15:27:35.773449+0000","last_became_peered":"2023-11-04T15:27:35.773449+0000","last_unstale":"2023-11-04T15:36:54.717552+0000","last_undegraded":"2023-11-04T15:36:54.717552+0000","last_fullsized":"2023-11-04T15:36:54.717552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1934,"log_dups_size":0,"ondisk_log_size":1934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:17:14.527023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1929,"num_write_kb":17119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"40'3519","reported_seq":2939,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.780060+0000","last_change":"2023-11-04T15:36:55.781058+0000","last_active":"2023-11-04T15:36:55.780060+0000","last_peered":"2023-11-04T15:36:55.780060+0000","last_clean":"2023-11-04T15:36:55.780060+0000","last_became_active":"2023-11-04T15:27:36.141086+0000","last_became_peered":"2023-11-04T15:27:36.141086+0000","last_unstale":"2023-11-04T15:36:55.780060+0000","last_undegraded":"2023-11-04T15:36:55.780060+0000","last_fullsized":"2023-11-04T15:36:55.780060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3519,"log_dups_size":0,"ondisk_log_size":3519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:28:45.715407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059170119,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1142,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.8","version":"37'655","reported_seq":694,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.716231+0000","last_change":"2023-11-04T15:27:35.770858+0000","last_active":"2023-11-04T15:36:54.716231+0000","last_peered":"2023-11-04T15:36:54.716231+0000","last_clean":"2023-11-04T15:36:54.716231+0000","last_became_active":"2023-11-04T15:27:35.769001+0000","last_became_peered":"2023-11-04T15:27:35.769001+0000","last_unstale":"2023-11-04T15:36:54.716231+0000","last_undegraded":"2023-11-04T15:36:54.716231+0000","last_fullsized":"2023-11-04T15:36:54.716231+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:01:29.923726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":656,"num_write_kb":15166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"43'3665","reported_seq":3079,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:58.541361+0000","last_change":"2023-11-04T15:36:55.783360+0000","last_active":"2023-11-04T15:36:58.541361+0000","last_peered":"2023-11-04T15:36:58.541361+0000","last_clean":"2023-11-04T15:36:58.541361+0000","last_became_active":"2023-11-04T15:27:36.147034+0000","last_became_peered":"2023-11-04T15:27:36.147034+0000","last_unstale":"2023-11-04T15:36:58.541361+0000","last_undegraded":"2023-11-04T15:36:58.541361+0000","last_fullsized":"2023-11-04T15:36:58.541361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3665,"log_dups_size":0,"ondisk_log_size":3665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:14:54.847413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.064750725999999995,"stat_sum":{"num_bytes":4196,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1197,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"1.0","version":"12'117","reported_seq":195,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.718305+0000","last_change":"2023-11-04T15:27:26.267129+0000","last_active":"2023-11-04T15:36:54.718305+0000","last_peered":"2023-11-04T15:36:54.718305+0000","last_clean":"2023-11-04T15:36:54.718305+0000","last_became_active":"2023-11-04T15:27:26.266242+0000","last_became_peered":"2023-11-04T15:27:26.266242+0000","last_unstale":"2023-11-04T15:36:54.718305+0000","last_undegraded":"2023-11-04T15:36:54.718305+0000","last_fullsized":"2023-11-04T15:36:54.718305+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:25.163848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:25.163848+0000","last_clean_scrub_stamp":"2023-11-04T15:27:25.163848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:54:55.231471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":42,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.718437+0000","last_change":"2023-11-04T15:27:31.620178+0000","last_active":"2023-11-04T15:36:54.718437+0000","last_peered":"2023-11-04T15:36:54.718437+0000","last_clean":"2023-11-04T15:36:54.718437+0000","last_became_active":"2023-11-04T15:27:31.619798+0000","last_became_peered":"2023-11-04T15:27:31.619798+0000","last_unstale":"2023-11-04T15:36:54.718437+0000","last_undegraded":"2023-11-04T15:36:54.718437+0000","last_fullsized":"2023-11-04T15:36:54.718437+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:50:31.717109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"39'3629","reported_seq":3668,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.716613+0000","last_change":"2023-11-04T15:27:35.769689+0000","last_active":"2023-11-04T15:36:54.716613+0000","last_peered":"2023-11-04T15:36:54.716613+0000","last_clean":"2023-11-04T15:36:54.716613+0000","last_became_active":"2023-11-04T15:27:35.769150+0000","last_became_peered":"2023-11-04T15:27:35.769150+0000","last_unstale":"2023-11-04T15:36:54.716613+0000","last_undegraded":"2023-11-04T15:36:54.716613+0000","last_fullsized":"2023-11-04T15:36:54.716613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3629,"log_dups_size":0,"ondisk_log_size":3629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:15:19.151223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3620,"num_write_kb":52059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"40'3668","reported_seq":3072,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.826646+0000","last_change":"2023-11-04T15:36:55.827884+0000","last_active":"2023-11-04T15:36:55.826646+0000","last_peered":"2023-11-04T15:36:55.826646+0000","last_clean":"2023-11-04T15:36:55.826646+0000","last_became_active":"2023-11-04T15:27:36.140619+0000","last_became_peered":"2023-11-04T15:27:36.140619+0000","last_unstale":"2023-11-04T15:36:55.826646+0000","last_undegraded":"2023-11-04T15:36:55.826646+0000","last_fullsized":"2023-11-04T15:36:55.826646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3668,"log_dups_size":0,"ondisk_log_size":3668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:42:12.902707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10532783499999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.718479+0000","last_change":"2023-11-04T15:27:31.622106+0000","last_active":"2023-11-04T15:36:54.718479+0000","last_peered":"2023-11-04T15:36:54.718479+0000","last_clean":"2023-11-04T15:36:54.718479+0000","last_became_active":"2023-11-04T15:27:31.621889+0000","last_became_peered":"2023-11-04T15:27:31.621889+0000","last_unstale":"2023-11-04T15:36:54.718479+0000","last_undegraded":"2023-11-04T15:36:54.718479+0000","last_fullsized":"2023-11-04T15:36:54.718479+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:11:00.327441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"43'3684","reported_seq":3889,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:58.873189+0000","last_change":"2023-11-04T15:27:35.771207+0000","last_active":"2023-11-04T15:36:58.873189+0000","last_peered":"2023-11-04T15:36:58.873189+0000","last_clean":"2023-11-04T15:36:58.873189+0000","last_became_active":"2023-11-04T15:27:35.770364+0000","last_became_peered":"2023-11-04T15:27:35.770364+0000","last_unstale":"2023-11-04T15:36:58.873189+0000","last_undegraded":"2023-11-04T15:36:58.873189+0000","last_fullsized":"2023-11-04T15:36:58.873189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3684,"log_dups_size":0,"ondisk_log_size":3684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:23:45.371175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15883313,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":166,"num_read_kb":3338,"num_write":3668,"num_write_kb":29714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"40'3551","reported_seq":2981,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.795654+0000","last_change":"2023-11-04T15:36:55.796697+0000","last_active":"2023-11-04T15:36:55.795654+0000","last_peered":"2023-11-04T15:36:55.795654+0000","last_clean":"2023-11-04T15:36:55.795654+0000","last_became_active":"2023-11-04T15:27:36.144459+0000","last_became_peered":"2023-11-04T15:27:36.144459+0000","last_unstale":"2023-11-04T15:36:55.795654+0000","last_undegraded":"2023-11-04T15:36:55.795654+0000","last_fullsized":"2023-11-04T15:36:55.795654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3551,"log_dups_size":0,"ondisk_log_size":3551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:28:45.715407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072685394,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.716248+0000","last_change":"2023-11-04T15:27:31.622710+0000","last_active":"2023-11-04T15:36:54.716248+0000","last_peered":"2023-11-04T15:36:54.716248+0000","last_clean":"2023-11-04T15:36:54.716248+0000","last_became_active":"2023-11-04T15:27:31.622378+0000","last_became_peered":"2023-11-04T15:27:31.622378+0000","last_unstale":"2023-11-04T15:36:54.716248+0000","last_undegraded":"2023-11-04T15:36:54.716248+0000","last_fullsized":"2023-11-04T15:36:54.716248+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:49:04.803105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"40'6079","reported_seq":6118,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.716977+0000","last_change":"2023-11-04T15:27:35.774630+0000","last_active":"2023-11-04T15:36:54.716977+0000","last_peered":"2023-11-04T15:36:54.716977+0000","last_clean":"2023-11-04T15:36:54.716977+0000","last_became_active":"2023-11-04T15:27:35.774339+0000","last_became_peered":"2023-11-04T15:27:35.774339+0000","last_unstale":"2023-11-04T15:36:54.716977+0000","last_undegraded":"2023-11-04T15:36:54.716977+0000","last_fullsized":"2023-11-04T15:36:54.716977+0000","mapping_epoch":16,"log_start":"26'400","ondisk_log_start":"26'400","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":5679,"log_dups_size":0,"ondisk_log_size":5679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:44:38.690122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6078,"num_write_kb":43849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"40'3172","reported_seq":2635,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.785037+0000","last_change":"2023-11-04T15:36:55.786394+0000","last_active":"2023-11-04T15:36:55.785037+0000","last_peered":"2023-11-04T15:36:55.785037+0000","last_clean":"2023-11-04T15:36:55.785037+0000","last_became_active":"2023-11-04T15:27:36.146930+0000","last_became_peered":"2023-11-04T15:27:36.146930+0000","last_unstale":"2023-11-04T15:36:55.785037+0000","last_undegraded":"2023-11-04T15:36:55.785037+0000","last_fullsized":"2023-11-04T15:36:55.785037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3172,"log_dups_size":0,"ondisk_log_size":3172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:28:45.715407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067233409999999993,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1111,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.717699+0000","last_change":"2023-11-04T15:27:31.622105+0000","last_active":"2023-11-04T15:36:54.717699+0000","last_peered":"2023-11-04T15:36:54.717699+0000","last_clean":"2023-11-04T15:36:54.717699+0000","last_became_active":"2023-11-04T15:27:31.621849+0000","last_became_peered":"2023-11-04T15:27:31.621849+0000","last_unstale":"2023-11-04T15:36:54.717699+0000","last_undegraded":"2023-11-04T15:36:54.717699+0000","last_fullsized":"2023-11-04T15:36:54.717699+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:20:41.777316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"40'3275","reported_seq":3314,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.716912+0000","last_change":"2023-11-04T15:27:35.770188+0000","last_active":"2023-11-04T15:36:54.716912+0000","last_peered":"2023-11-04T15:36:54.716912+0000","last_clean":"2023-11-04T15:36:54.716912+0000","last_became_active":"2023-11-04T15:27:35.769730+0000","last_became_peered":"2023-11-04T15:27:35.769730+0000","last_unstale":"2023-11-04T15:36:54.716912+0000","last_undegraded":"2023-11-04T15:36:54.716912+0000","last_fullsized":"2023-11-04T15:36:54.716912+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3275,"log_dups_size":0,"ondisk_log_size":3275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:08:22.991334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3258,"num_write_kb":30072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"40'3431","reported_seq":2846,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.784956+0000","last_change":"2023-11-04T15:36:55.786213+0000","last_active":"2023-11-04T15:36:55.784956+0000","last_peered":"2023-11-04T15:36:55.784956+0000","last_clean":"2023-11-04T15:36:55.784956+0000","last_became_active":"2023-11-04T15:27:36.144417+0000","last_became_peered":"2023-11-04T15:27:36.144417+0000","last_unstale":"2023-11-04T15:36:55.784956+0000","last_undegraded":"2023-11-04T15:36:55.784956+0000","last_fullsized":"2023-11-04T15:36:55.784956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3431,"log_dups_size":0,"ondisk_log_size":3431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:41:32.995261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067418286999999993,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.5","version":"37'3105","reported_seq":3144,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.717735+0000","last_change":"2023-11-04T15:27:35.770033+0000","last_active":"2023-11-04T15:36:54.717735+0000","last_peered":"2023-11-04T15:36:54.717735+0000","last_clean":"2023-11-04T15:36:54.717735+0000","last_became_active":"2023-11-04T15:27:35.769772+0000","last_became_peered":"2023-11-04T15:27:35.769772+0000","last_unstale":"2023-11-04T15:36:54.717735+0000","last_undegraded":"2023-11-04T15:36:54.717735+0000","last_fullsized":"2023-11-04T15:36:54.717735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3105,"log_dups_size":0,"ondisk_log_size":3105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:00:20.246822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3101,"num_write_kb":32806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.716947+0000","last_change":"2023-11-04T15:27:31.622663+0000","last_active":"2023-11-04T15:36:54.716947+0000","last_peered":"2023-11-04T15:36:54.716947+0000","last_clean":"2023-11-04T15:36:54.716947+0000","last_became_active":"2023-11-04T15:27:31.622350+0000","last_became_peered":"2023-11-04T15:27:31.622350+0000","last_unstale":"2023-11-04T15:36:54.716947+0000","last_undegraded":"2023-11-04T15:36:54.716947+0000","last_fullsized":"2023-11-04T15:36:54.716947+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:31:02.273249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"43'3419","reported_seq":2891,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:57.990406+0000","last_change":"2023-11-04T15:36:55.780107+0000","last_active":"2023-11-04T15:36:57.990406+0000","last_peered":"2023-11-04T15:36:57.990406+0000","last_clean":"2023-11-04T15:36:57.990406+0000","last_became_active":"2023-11-04T15:27:36.143991+0000","last_became_peered":"2023-11-04T15:27:36.143991+0000","last_unstale":"2023-11-04T15:36:57.990406+0000","last_undegraded":"2023-11-04T15:36:57.990406+0000","last_fullsized":"2023-11-04T15:36:57.990406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3419,"log_dups_size":0,"ondisk_log_size":3419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:48:58.102459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062728023999999993,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":1116,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.4","version":"40'4464","reported_seq":4503,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.716896+0000","last_change":"2023-11-04T15:27:35.769416+0000","last_active":"2023-11-04T15:36:54.716896+0000","last_peered":"2023-11-04T15:36:54.716896+0000","last_clean":"2023-11-04T15:36:54.716896+0000","last_became_active":"2023-11-04T15:27:35.769095+0000","last_became_peered":"2023-11-04T15:27:35.769095+0000","last_unstale":"2023-11-04T15:36:54.716896+0000","last_undegraded":"2023-11-04T15:36:54.716896+0000","last_fullsized":"2023-11-04T15:36:54.716896+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":4464,"log_dups_size":0,"ondisk_log_size":4464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T22:02:04.025848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4451,"num_write_kb":27035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.719534+0000","last_change":"2023-11-04T15:27:31.619973+0000","last_active":"2023-11-04T15:36:54.719534+0000","last_peered":"2023-11-04T15:36:54.719534+0000","last_clean":"2023-11-04T15:36:54.719534+0000","last_became_active":"2023-11-04T15:27:31.619702+0000","last_became_peered":"2023-11-04T15:27:31.619702+0000","last_unstale":"2023-11-04T15:36:54.719534+0000","last_undegraded":"2023-11-04T15:36:54.719534+0000","last_fullsized":"2023-11-04T15:36:54.719534+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:24:34.782619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"40'3558","reported_seq":2941,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.797743+0000","last_change":"2023-11-04T15:36:55.798708+0000","last_active":"2023-11-04T15:36:55.797743+0000","last_peered":"2023-11-04T15:36:55.797743+0000","last_clean":"2023-11-04T15:36:55.797743+0000","last_became_active":"2023-11-04T15:27:36.139707+0000","last_became_peered":"2023-11-04T15:27:36.139707+0000","last_unstale":"2023-11-04T15:36:55.797743+0000","last_undegraded":"2023-11-04T15:36:55.797743+0000","last_fullsized":"2023-11-04T15:36:55.797743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3558,"log_dups_size":0,"ondisk_log_size":3558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:58:32.190696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.073815121999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.7","version":"37'1214","reported_seq":1253,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.717366+0000","last_change":"2023-11-04T15:27:35.768818+0000","last_active":"2023-11-04T15:36:54.717366+0000","last_peered":"2023-11-04T15:36:54.717366+0000","last_clean":"2023-11-04T15:36:54.717366+0000","last_became_active":"2023-11-04T15:27:35.768320+0000","last_became_peered":"2023-11-04T15:27:35.768320+0000","last_unstale":"2023-11-04T15:36:54.717366+0000","last_undegraded":"2023-11-04T15:36:54.717366+0000","last_fullsized":"2023-11-04T15:36:54.717366+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1214,"log_dups_size":0,"ondisk_log_size":1214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:14:58.601545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1211,"num_write_kb":18003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.716888+0000","last_change":"2023-11-04T15:27:31.624625+0000","last_active":"2023-11-04T15:36:54.716888+0000","last_peered":"2023-11-04T15:36:54.716888+0000","last_clean":"2023-11-04T15:36:54.716888+0000","last_became_active":"2023-11-04T15:27:31.624347+0000","last_became_peered":"2023-11-04T15:27:31.624347+0000","last_unstale":"2023-11-04T15:36:54.716888+0000","last_undegraded":"2023-11-04T15:36:54.716888+0000","last_fullsized":"2023-11-04T15:36:54.716888+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:53:45.131692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"40'3608","reported_seq":3010,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.791046+0000","last_change":"2023-11-04T15:36:55.791977+0000","last_active":"2023-11-04T15:36:55.791046+0000","last_peered":"2023-11-04T15:36:55.791046+0000","last_clean":"2023-11-04T15:36:55.791046+0000","last_became_active":"2023-11-04T15:27:36.137897+0000","last_became_peered":"2023-11-04T15:27:36.137897+0000","last_unstale":"2023-11-04T15:36:55.791046+0000","last_undegraded":"2023-11-04T15:36:55.791046+0000","last_fullsized":"2023-11-04T15:36:55.791046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3608,"log_dups_size":0,"ondisk_log_size":3608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:53:25.907251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.069534850999999995,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.6","version":"43'827","reported_seq":866,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.725882+0000","last_change":"2023-11-04T15:27:35.772416+0000","last_active":"2023-11-04T15:36:55.725882+0000","last_peered":"2023-11-04T15:36:55.725882+0000","last_clean":"2023-11-04T15:36:55.725882+0000","last_became_active":"2023-11-04T15:27:35.772121+0000","last_became_peered":"2023-11-04T15:27:35.772121+0000","last_unstale":"2023-11-04T15:36:55.725882+0000","last_undegraded":"2023-11-04T15:36:55.725882+0000","last_fullsized":"2023-11-04T15:36:55.725882+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:58:09.475936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":956,"num_write_kb":25975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.719152+0000","last_change":"2023-11-04T15:27:31.620235+0000","last_active":"2023-11-04T15:36:54.719152+0000","last_peered":"2023-11-04T15:36:54.719152+0000","last_clean":"2023-11-04T15:36:54.719152+0000","last_became_active":"2023-11-04T15:27:31.619831+0000","last_became_peered":"2023-11-04T15:27:31.619831+0000","last_unstale":"2023-11-04T15:36:54.719152+0000","last_undegraded":"2023-11-04T15:36:54.719152+0000","last_fullsized":"2023-11-04T15:36:54.719152+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:44:07.412379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"40'3480","reported_seq":2921,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.779195+0000","last_change":"2023-11-04T15:36:55.780069+0000","last_active":"2023-11-04T15:36:55.779195+0000","last_peered":"2023-11-04T15:36:55.779195+0000","last_clean":"2023-11-04T15:36:55.779195+0000","last_became_active":"2023-11-04T15:27:36.140871+0000","last_became_peered":"2023-11-04T15:27:36.140871+0000","last_unstale":"2023-11-04T15:36:55.779195+0000","last_undegraded":"2023-11-04T15:36:55.779195+0000","last_fullsized":"2023-11-04T15:36:55.779195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3480,"log_dups_size":0,"ondisk_log_size":3480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:28.095802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058381362999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.13","version":"40'3644","reported_seq":3045,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.777837+0000","last_change":"2023-11-04T15:36:55.777837+0000","last_active":"2023-11-04T15:36:55.777837+0000","last_peered":"2023-11-04T15:36:55.777837+0000","last_clean":"2023-11-04T15:36:55.777837+0000","last_became_active":"2023-11-04T15:27:36.139487+0000","last_became_peered":"2023-11-04T15:27:36.139487+0000","last_unstale":"2023-11-04T15:36:55.777837+0000","last_undegraded":"2023-11-04T15:36:55.777837+0000","last_fullsized":"2023-11-04T15:36:55.777837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3644,"log_dups_size":0,"ondisk_log_size":3644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:47:58.380308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056621590999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.14","version":"41'2770","reported_seq":2809,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.184520+0000","last_change":"2023-11-04T15:27:35.775665+0000","last_active":"2023-11-04T15:36:55.184520+0000","last_peered":"2023-11-04T15:36:55.184520+0000","last_clean":"2023-11-04T15:36:55.184520+0000","last_became_active":"2023-11-04T15:27:35.775356+0000","last_became_peered":"2023-11-04T15:27:35.775356+0000","last_unstale":"2023-11-04T15:36:55.184520+0000","last_undegraded":"2023-11-04T15:36:55.184520+0000","last_fullsized":"2023-11-04T15:36:55.184520+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2770,"log_dups_size":0,"ondisk_log_size":2770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:36:12.941030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2769,"num_write_kb":31341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"40'3525","reported_seq":2930,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.781878+0000","last_change":"2023-11-04T15:36:55.781878+0000","last_active":"2023-11-04T15:36:55.781878+0000","last_peered":"2023-11-04T15:36:55.781878+0000","last_clean":"2023-11-04T15:36:55.781878+0000","last_became_active":"2023-11-04T15:27:36.146464+0000","last_became_peered":"2023-11-04T15:27:36.146464+0000","last_unstale":"2023-11-04T15:36:55.781878+0000","last_undegraded":"2023-11-04T15:36:55.781878+0000","last_fullsized":"2023-11-04T15:36:55.781878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3525,"log_dups_size":0,"ondisk_log_size":3525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:47:40.350777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.064516859999999995,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.15","version":"43'3742","reported_seq":3780,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.718800+0000","last_change":"2023-11-04T15:27:35.770401+0000","last_active":"2023-11-04T15:36:55.718800+0000","last_peered":"2023-11-04T15:36:55.718800+0000","last_clean":"2023-11-04T15:36:55.718800+0000","last_became_active":"2023-11-04T15:27:35.769904+0000","last_became_peered":"2023-11-04T15:27:35.769904+0000","last_unstale":"2023-11-04T15:36:55.718800+0000","last_undegraded":"2023-11-04T15:36:55.718800+0000","last_fullsized":"2023-11-04T15:36:55.718800+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3742,"log_dups_size":0,"ondisk_log_size":3742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:58:09.475936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3740,"num_write_kb":21755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"40'3554","reported_seq":3592,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.718496+0000","last_change":"2023-11-04T15:27:35.768689+0000","last_active":"2023-11-04T15:36:54.718496+0000","last_peered":"2023-11-04T15:36:54.718496+0000","last_clean":"2023-11-04T15:36:54.718496+0000","last_became_active":"2023-11-04T15:27:35.768413+0000","last_became_peered":"2023-11-04T15:27:35.768413+0000","last_unstale":"2023-11-04T15:36:54.718496+0000","last_undegraded":"2023-11-04T15:36:54.718496+0000","last_fullsized":"2023-11-04T15:36:54.718496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3554,"log_dups_size":0,"ondisk_log_size":3554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:23:45.371175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3537,"num_write_kb":29647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"40'3937","reported_seq":3318,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.790992+0000","last_change":"2023-11-04T15:36:55.790992+0000","last_active":"2023-11-04T15:36:55.790992+0000","last_peered":"2023-11-04T15:36:55.790992+0000","last_clean":"2023-11-04T15:36:55.790992+0000","last_became_active":"2023-11-04T15:27:36.139524+0000","last_became_peered":"2023-11-04T15:27:36.139524+0000","last_unstale":"2023-11-04T15:36:55.790992+0000","last_undegraded":"2023-11-04T15:36:55.790992+0000","last_fullsized":"2023-11-04T15:36:55.790992+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3937,"log_dups_size":0,"ondisk_log_size":3937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:27:25.258046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.068494678000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1248,"num_write_kb":670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.17","version":"37'1637","reported_seq":1675,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.782076+0000","last_change":"2023-11-04T15:27:35.776242+0000","last_active":"2023-11-04T15:36:54.782076+0000","last_peered":"2023-11-04T15:36:54.782076+0000","last_clean":"2023-11-04T15:36:54.782076+0000","last_became_active":"2023-11-04T15:27:35.775917+0000","last_became_peered":"2023-11-04T15:27:35.775917+0000","last_unstale":"2023-11-04T15:36:54.782076+0000","last_undegraded":"2023-11-04T15:36:54.782076+0000","last_fullsized":"2023-11-04T15:36:54.782076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1637,"log_dups_size":0,"ondisk_log_size":1637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:14:58.601545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1634,"num_write_kb":25426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"40'3472","reported_seq":2891,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.779428+0000","last_change":"2023-11-04T15:36:55.779428+0000","last_active":"2023-11-04T15:36:55.779428+0000","last_peered":"2023-11-04T15:36:55.779428+0000","last_clean":"2023-11-04T15:36:55.779428+0000","last_became_active":"2023-11-04T15:27:36.150557+0000","last_became_peered":"2023-11-04T15:27:36.150557+0000","last_unstale":"2023-11-04T15:36:55.779428+0000","last_undegraded":"2023-11-04T15:36:55.779428+0000","last_fullsized":"2023-11-04T15:36:55.779428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3472,"log_dups_size":0,"ondisk_log_size":3472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:12:07.727740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062631718000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.1f","version":"40'3228","reported_seq":2708,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.824445+0000","last_change":"2023-11-04T15:36:55.826604+0000","last_active":"2023-11-04T15:36:55.824445+0000","last_peered":"2023-11-04T15:36:55.824445+0000","last_clean":"2023-11-04T15:36:55.824445+0000","last_became_active":"2023-11-04T15:27:36.149831+0000","last_became_peered":"2023-11-04T15:27:36.149831+0000","last_unstale":"2023-11-04T15:36:55.824445+0000","last_undegraded":"2023-11-04T15:36:55.824445+0000","last_fullsized":"2023-11-04T15:36:55.824445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3228,"log_dups_size":0,"ondisk_log_size":3228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:16:09.862958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.103639325,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1060,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.18","version":"43'4769","reported_seq":4807,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:58.591433+0000","last_change":"2023-11-04T15:27:35.770634+0000","last_active":"2023-11-04T15:36:58.591433+0000","last_peered":"2023-11-04T15:36:58.591433+0000","last_clean":"2023-11-04T15:36:58.591433+0000","last_became_active":"2023-11-04T15:27:35.770022+0000","last_became_peered":"2023-11-04T15:27:35.770022+0000","last_unstale":"2023-11-04T15:36:58.591433+0000","last_undegraded":"2023-11-04T15:36:58.591433+0000","last_fullsized":"2023-11-04T15:36:58.591433+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":4769,"log_dups_size":0,"ondisk_log_size":4769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:03:49.354013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28893509,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4768,"num_write_kb":50662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"43'3333","reported_seq":2774,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:58.141007+0000","last_change":"2023-11-04T15:36:55.797686+0000","last_active":"2023-11-04T15:36:58.141007+0000","last_peered":"2023-11-04T15:36:58.141007+0000","last_clean":"2023-11-04T15:36:58.141007+0000","last_became_active":"2023-11-04T15:27:36.138908+0000","last_became_peered":"2023-11-04T15:27:36.138908+0000","last_unstale":"2023-11-04T15:36:58.141007+0000","last_undegraded":"2023-11-04T15:36:58.141007+0000","last_fullsized":"2023-11-04T15:36:58.141007+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3333,"log_dups_size":0,"ondisk_log_size":3333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:32:27.370984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.073000567000000002,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":1157,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.19","version":"31'780","reported_seq":818,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.715533+0000","last_change":"2023-11-04T15:27:35.768190+0000","last_active":"2023-11-04T15:36:54.715533+0000","last_peered":"2023-11-04T15:36:54.715533+0000","last_clean":"2023-11-04T15:36:54.715533+0000","last_became_active":"2023-11-04T15:27:35.767858+0000","last_became_peered":"2023-11-04T15:27:35.767858+0000","last_unstale":"2023-11-04T15:36:54.715533+0000","last_undegraded":"2023-11-04T15:36:54.715533+0000","last_fullsized":"2023-11-04T15:36:54.715533+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:55:22.956180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":779,"num_write_kb":20966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"40'3359","reported_seq":2780,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.794676+0000","last_change":"2023-11-04T15:36:55.795596+0000","last_active":"2023-11-04T15:36:55.794676+0000","last_peered":"2023-11-04T15:36:55.794676+0000","last_clean":"2023-11-04T15:36:55.794676+0000","last_became_active":"2023-11-04T15:27:36.143442+0000","last_became_peered":"2023-11-04T15:27:36.143442+0000","last_unstale":"2023-11-04T15:36:55.794676+0000","last_undegraded":"2023-11-04T15:36:55.794676+0000","last_fullsized":"2023-11-04T15:36:55.794676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3359,"log_dups_size":0,"ondisk_log_size":3359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:45:22.367523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072078296,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1167,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1a","version":"37'3778","reported_seq":3816,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.717883+0000","last_change":"2023-11-04T15:27:35.771653+0000","last_active":"2023-11-04T15:36:54.717883+0000","last_peered":"2023-11-04T15:36:54.717883+0000","last_clean":"2023-11-04T15:36:54.717883+0000","last_became_active":"2023-11-04T15:27:35.770539+0000","last_became_peered":"2023-11-04T15:27:35.770539+0000","last_unstale":"2023-11-04T15:36:54.717883+0000","last_undegraded":"2023-11-04T15:36:54.717883+0000","last_fullsized":"2023-11-04T15:36:54.717883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3778,"log_dups_size":0,"ondisk_log_size":3778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:14:58.601545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3770,"num_write_kb":38321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"40'3791","reported_seq":3143,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.779484+0000","last_change":"2023-11-04T15:36:55.780664+0000","last_active":"2023-11-04T15:36:55.779484+0000","last_peered":"2023-11-04T15:36:55.779484+0000","last_clean":"2023-11-04T15:36:55.779484+0000","last_became_active":"2023-11-04T15:27:36.146477+0000","last_became_peered":"2023-11-04T15:27:36.146477+0000","last_unstale":"2023-11-04T15:36:55.779484+0000","last_undegraded":"2023-11-04T15:36:55.779484+0000","last_fullsized":"2023-11-04T15:36:55.779484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3791,"log_dups_size":0,"ondisk_log_size":3791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:53:25.907251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063144525000000007,"stat_sum":{"num_bytes":8192,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1270,"num_write_kb":694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1b","version":"40'2943","reported_seq":2981,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.781525+0000","last_change":"2023-11-04T15:27:35.772092+0000","last_active":"2023-11-04T15:36:54.781525+0000","last_peered":"2023-11-04T15:36:54.781525+0000","last_clean":"2023-11-04T15:36:54.781525+0000","last_became_active":"2023-11-04T15:27:35.771316+0000","last_became_peered":"2023-11-04T15:27:35.771316+0000","last_unstale":"2023-11-04T15:36:54.781525+0000","last_undegraded":"2023-11-04T15:36:54.781525+0000","last_fullsized":"2023-11-04T15:36:54.781525+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2943,"log_dups_size":0,"ondisk_log_size":2943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:00:20.246822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2943,"num_write_kb":28401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"40'3595","reported_seq":3002,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.777689+0000","last_change":"2023-11-04T15:36:55.778980+0000","last_active":"2023-11-04T15:36:55.777689+0000","last_peered":"2023-11-04T15:36:55.777689+0000","last_clean":"2023-11-04T15:36:55.777689+0000","last_became_active":"2023-11-04T15:27:36.144066+0000","last_became_peered":"2023-11-04T15:27:36.144066+0000","last_unstale":"2023-11-04T15:36:55.777689+0000","last_undegraded":"2023-11-04T15:36:55.777689+0000","last_fullsized":"2023-11-04T15:36:55.777689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3595,"log_dups_size":0,"ondisk_log_size":3595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:41:32.995261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057889772999999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1118,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1c","version":"41'926","reported_seq":964,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.717175+0000","last_change":"2023-11-04T15:27:35.768679+0000","last_active":"2023-11-04T15:36:54.717175+0000","last_peered":"2023-11-04T15:36:54.717175+0000","last_clean":"2023-11-04T15:36:54.717175+0000","last_became_active":"2023-11-04T15:27:35.767852+0000","last_became_peered":"2023-11-04T15:27:35.767852+0000","last_unstale":"2023-11-04T15:36:54.717175+0000","last_undegraded":"2023-11-04T15:36:54.717175+0000","last_fullsized":"2023-11-04T15:36:54.717175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":926,"log_dups_size":0,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:47:47.130490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":923,"num_write_kb":21087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"40'3552","reported_seq":2970,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.775568+0000","last_change":"2023-11-04T15:36:55.776553+0000","last_active":"2023-11-04T15:36:55.775568+0000","last_peered":"2023-11-04T15:36:55.775568+0000","last_clean":"2023-11-04T15:36:55.775568+0000","last_became_active":"2023-11-04T15:27:36.141167+0000","last_became_peered":"2023-11-04T15:27:36.141167+0000","last_unstale":"2023-11-04T15:36:55.775568+0000","last_undegraded":"2023-11-04T15:36:55.775568+0000","last_fullsized":"2023-11-04T15:36:55.775568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3552,"log_dups_size":0,"ondisk_log_size":3552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:22:21.262360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057363947999999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1127,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1d","version":"37'3225","reported_seq":3263,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.719175+0000","last_change":"2023-11-04T15:27:35.775629+0000","last_active":"2023-11-04T15:36:54.719175+0000","last_peered":"2023-11-04T15:36:54.719175+0000","last_clean":"2023-11-04T15:36:54.719175+0000","last_became_active":"2023-11-04T15:27:35.775171+0000","last_became_peered":"2023-11-04T15:27:35.775171+0000","last_unstale":"2023-11-04T15:36:54.719175+0000","last_undegraded":"2023-11-04T15:36:54.719175+0000","last_fullsized":"2023-11-04T15:36:54.719175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3225,"log_dups_size":0,"ondisk_log_size":3225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:13:42.865721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3214,"num_write_kb":42509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"43'3487","reported_seq":2929,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:58.220450+0000","last_change":"2023-11-04T15:36:55.792895+0000","last_active":"2023-11-04T15:36:58.220450+0000","last_peered":"2023-11-04T15:36:58.220450+0000","last_clean":"2023-11-04T15:36:58.220450+0000","last_became_active":"2023-11-04T15:27:36.145560+0000","last_became_peered":"2023-11-04T15:27:36.145560+0000","last_unstale":"2023-11-04T15:36:58.220450+0000","last_undegraded":"2023-11-04T15:36:58.220450+0000","last_fullsized":"2023-11-04T15:36:58.220450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3487,"log_dups_size":0,"ondisk_log_size":3487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:14:54.847413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.07011676,"stat_sum":{"num_bytes":4151,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":1159,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1e","version":"40'4214","reported_seq":4253,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.781727+0000","last_change":"2023-11-04T15:27:35.771225+0000","last_active":"2023-11-04T15:36:54.781727+0000","last_peered":"2023-11-04T15:36:54.781727+0000","last_clean":"2023-11-04T15:36:54.781727+0000","last_became_active":"2023-11-04T15:27:35.770873+0000","last_became_peered":"2023-11-04T15:27:35.770873+0000","last_unstale":"2023-11-04T15:36:54.781727+0000","last_undegraded":"2023-11-04T15:36:54.781727+0000","last_fullsized":"2023-11-04T15:36:54.781727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":4214,"log_dups_size":0,"ondisk_log_size":4214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:02:11.972760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4214,"num_write_kb":32525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"40'4090","reported_seq":3390,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.774510+0000","last_change":"2023-11-04T15:36:55.775512+0000","last_active":"2023-11-04T15:36:55.774510+0000","last_peered":"2023-11-04T15:36:55.774510+0000","last_clean":"2023-11-04T15:36:55.774510+0000","last_became_active":"2023-11-04T15:27:36.147535+0000","last_became_peered":"2023-11-04T15:27:36.147535+0000","last_unstale":"2023-11-04T15:36:55.774510+0000","last_undegraded":"2023-11-04T15:36:55.774510+0000","last_fullsized":"2023-11-04T15:36:55.774510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":4090,"log_dups_size":0,"ondisk_log_size":4090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:48:58.102459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055801837,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1294,"num_write_kb":719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1f","version":"40'1589","reported_seq":1628,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.781927+0000","last_change":"2023-11-04T15:27:35.776315+0000","last_active":"2023-11-04T15:36:54.781927+0000","last_peered":"2023-11-04T15:36:54.781927+0000","last_clean":"2023-11-04T15:36:54.781927+0000","last_became_active":"2023-11-04T15:27:35.775918+0000","last_became_peered":"2023-11-04T15:27:35.775918+0000","last_unstale":"2023-11-04T15:36:54.781927+0000","last_undegraded":"2023-11-04T15:36:54.781927+0000","last_fullsized":"2023-11-04T15:36:54.781927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1589,"log_dups_size":0,"ondisk_log_size":1589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:08:22.991334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1587,"num_write_kb":12658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":127433,"num_objects":92,"num_object_clones":25,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":8,"num_read":46,"num_read_kb":30,"num_write":74822,"num_write_kb":40603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":254672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224295,"ondisk_log_size":224295,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":430654260,"num_objects":126,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":126,"num_whiteouts":0,"num_read":190,"num_read_kb":3338,"num_write":83447,"num_write_kb":897460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":861372416,"data_stored":861308520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83070,"ondisk_log_size":83070,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705783,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":659540,"kb_used_data":173196,"kb_used_omap":0,"kb_used_meta":486336,"kb_avail":93712300,"statfs":{"total":96636764160,"available":95961395200,"internally_reserved":0,"allocated":177352704,"data_stored":176994799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":498008064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.435,"15min":0.40000000000000002},"min":{"1min":0.23000000000000001,"5min":0.17000000000000001,"15min":0.156},"max":{"1min":10.488,"5min":10.488,"15min":10.488},"last":0.442},{"interface":"front","average":{"1min":1.0509999999999999,"5min":0.58399999999999996,"15min":0.45500000000000002},"min":{"1min":0.21199999999999999,"5min":0.186,"15min":0.186},"max":{"1min":11.621,"5min":13.055,"15min":13.055},"last":0.53000000000000003}]},{"osd":1,"last update":"Sat Nov 4 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.496,"15min":0.433},"min":{"1min":0.219,"5min":0.188,"15min":0.188},"max":{"1min":12.347,"5min":12.347,"15min":12.347},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.48999999999999999,"15min":0.438},"min":{"1min":0.23699999999999999,"5min":0.21299999999999999,"15min":0.186},"max":{"1min":12.853999999999999,"5min":12.853999999999999,"15min":12.853999999999999},"last":0.51800000000000002}]},{"osd":2,"last update":"Sat Nov 4 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.41299999999999998,"15min":0.34499999999999997},"min":{"1min":0.16900000000000001,"5min":0.153,"15min":0.153},"max":{"1min":11.709,"5min":11.709,"15min":11.709},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.40300000000000002,"15min":0.35599999999999998},"min":{"1min":0.19500000000000001,"5min":0.14899999999999999,"15min":0.14899999999999999},"max":{"1min":9.2629999999999999,"5min":9.2629999999999999,"15min":9.2629999999999999},"last":0.32000000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705782,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":952412,"kb_used_data":245460,"kb_used_omap":0,"kb_used_meta":706944,"kb_avail":93419428,"statfs":{"total":96636764160,"available":95661494272,"internally_reserved":0,"allocated":251351040,"data_stored":250986928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":723910656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 15:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.41199999999999998,"15min":0.40100000000000002},"min":{"1min":0.20499999999999999,"5min":0.153,"15min":0.151},"max":{"1min":0.52900000000000003,"5min":14.584,"15min":14.584},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.35799999999999998,"15min":0.376},"min":{"1min":0.22,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.45600000000000002,"5min":7.2670000000000003,"15min":7.2670000000000003},"last":0.46800000000000003}]},{"osd":1,"last update":"Sat Nov 4 15:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32700000000000001,"15min":0.39000000000000001},"min":{"1min":0.23499999999999999,"5min":0.185,"15min":0.17100000000000001},"max":{"1min":0.48399999999999999,"5min":0.877,"15min":1.266},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.34699999999999998,"15min":0.40899999999999997},"min":{"1min":0.27500000000000002,"5min":0.20899999999999999,"15min":0.20399999999999999},"max":{"1min":0.54100000000000004,"5min":0.88600000000000001,"15min":1.2829999999999999},"last":0.55800000000000005}]},{"osd":3,"last update":"Sat Nov 4 15:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.28000000000000003,"15min":0.314},"min":{"1min":0.23699999999999999,"5min":0.14999999999999999,"15min":0.14699999999999999},"max":{"1min":0.41399999999999998,"5min":1.653,"15min":1.653},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.30599999999999999,"15min":0.34000000000000002},"min":{"1min":0.23000000000000001,"5min":0.159,"15min":0.14899999999999999},"max":{"1min":0.501,"5min":0.52400000000000002,"15min":1.304},"last":0.26700000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705781,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":715088,"kb_used_data":188552,"kb_used_omap":0,"kb_used_meta":526528,"kb_avail":93656752,"statfs":{"total":96636764160,"available":95904514048,"internally_reserved":0,"allocated":193077248,"data_stored":192721880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":539164672},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.40699999999999997,"15min":0.318},"min":{"1min":0.17100000000000001,"5min":0.14399999999999999,"15min":0.14399999999999999},"max":{"1min":1.012,"5min":12.768000000000001,"15min":12.768000000000001},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.248,"5min":0.30399999999999999,"15min":0.29499999999999998},"min":{"1min":0.19,"5min":0.14399999999999999,"15min":0.14399999999999999},"max":{"1min":0.377,"5min":8.609,"15min":8.609},"last":0.252}]},{"osd":2,"last update":"Sat Nov 4 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.40400000000000003,"15min":0.44},"min":{"1min":0.28499999999999998,"5min":0.19600000000000001,"15min":0.189},"max":{"1min":1.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.39000000000000001,"15min":0.42399999999999999},"min":{"1min":0.29599999999999999,"5min":0.19600000000000001,"15min":0.192},"max":{"1min":0.98199999999999998,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.41699999999999998}]},{"osd":3,"last update":"Sat Nov 4 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.42099999999999999,"15min":0.438},"min":{"1min":0.309,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.65200000000000002,"5min":6.7679999999999998,"15min":6.7679999999999998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.41999999999999998,"15min":0.45000000000000001},"min":{"1min":0.32100000000000001,"5min":0.249,"15min":0.24299999999999999},"max":{"1min":1.446,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.54300000000000004}]}]},{"osd":0,"up_from":9,"seq":38654705782,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":918120,"kb_used_data":237408,"kb_used_omap":0,"kb_used_meta":680704,"kb_avail":93453720,"statfs":{"total":96636764160,"available":95696609280,"internally_reserved":0,"allocated":243105792,"data_stored":242746625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":697040896},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 15:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.312,"15min":0.27900000000000003},"min":{"1min":0.14999999999999999,"5min":0.14399999999999999,"15min":0.13500000000000001},"max":{"1min":4.4059999999999997,"5min":6.4340000000000002,"15min":6.4340000000000002},"last":0.187},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.28000000000000003,"15min":0.27500000000000002},"min":{"1min":0.17299999999999999,"5min":0.155,"15min":0.155},"max":{"1min":1.1299999999999999,"5min":4.1200000000000001,"15min":4.1200000000000001},"last":0.20999999999999999}]},{"osd":2,"last update":"Sat Nov 4 15:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.40400000000000003,"15min":0.42599999999999999},"min":{"1min":0.251,"5min":0.17999999999999999,"15min":0.17599999999999999},"max":{"1min":2.5129999999999999,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.252},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.371,"15min":0.41899999999999998},"min":{"1min":0.28000000000000003,"5min":0.187,"15min":0.187},"max":{"1min":1.157,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.26600000000000001}]},{"osd":3,"last update":"Sat Nov 4 15:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.438,"15min":0.443},"min":{"1min":0.23899999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":2.6520000000000001,"5min":6.4660000000000002,"15min":6.4660000000000002},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.44600000000000001,"15min":0.44800000000000001},"min":{"1min":0.26800000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":2.621,"5min":6.3540000000000001,"15min":6.3540000000000001},"last":0.30599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":241926144,"data_stored":241909852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":192475136,"data_stored":192471365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":250785792,"data_stored":250765155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":176185344,"data_stored":176162148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":69829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":73939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":45197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":65707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T15:37:03.689 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T15:37:03.752 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:37:03.765 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:37:03.768 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:37:03.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.828+0000 7fcb1d950640 1 Processor -- start 2023-11-04T15:37:03.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.828+0000 7fcb1d950640 1 -- start start 2023-11-04T15:37:03.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.828+0000 7fcb1d950640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcb18137650 0x7fcb180a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:03.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.828+0000 7fcb1d950640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb180a4c20 con 0x7fcb180a3e90 2023-11-04T15:37:03.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.828+0000 7fcb1d950640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb1813ad80 con 0x7fcb18137270 2023-11-04T15:37:03.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.828+0000 7fcb1d950640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb180a3060 con 0x7fcb18137650 2023-11-04T15:37:03.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.828+0000 7fcb0e7fc640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fcb180a3e90 0x7fcb1813a670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58004/0 (socket says 172.21.15.19:58004) 2023-11-04T15:37:03.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.828+0000 7fcb0e7fc640 1 -- 172.21.15.19:0/224717209 learned_addr learned my addr 172.21.15.19:0/224717209 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:37:03.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.829+0000 7fcb177fe640 1 --2- 172.21.15.19:0/224717209 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcb18137650 0x7fcb180a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:03.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.829+0000 7fcb167fc640 1 -- 172.21.15.19:0/224717209 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155918222 0 0) 0x7fcb180a4c20 con 0x7fcb180a3e90 2023-11-04T15:37:03.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.829+0000 7fcb167fc640 1 -- 172.21.15.19:0/224717209 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb04003520 con 0x7fcb180a3e90 2023-11-04T15:37:03.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.829+0000 7fcb167fc640 1 -- 172.21.15.19:0/224717209 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3098789135 0 0) 0x7fcb04003520 con 0x7fcb180a3e90 2023-11-04T15:37:03.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.829+0000 7fcb167fc640 1 -- 172.21.15.19:0/224717209 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcb18137650 msgr2=0x7fcb180a6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:03.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.829+0000 7fcb167fc640 1 --2- 172.21.15.19:0/224717209 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcb18137650 0x7fcb180a6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:03.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.829+0000 7fcb167fc640 1 -- 172.21.15.19:0/224717209 >> v1:172.21.15.96:6789/0 conn(0x7fcb18137270 legacy=0x7fcb18139f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:03.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.829+0000 7fcb167fc640 1 -- 172.21.15.19:0/224717209 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb180a5080 con 0x7fcb180a3e90 2023-11-04T15:37:03.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.829+0000 7fcb167fc640 1 -- 172.21.15.19:0/224717209 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3646097784 0 0) 0x7fcb00001690 con 0x7fcb180a3e90 2023-11-04T15:37:03.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.829+0000 7fcb167fc640 1 -- 172.21.15.19:0/224717209 >> v1:172.21.15.19:6789/0 conn(0x7fcb180a3e90 legacy=0x7fcb1813a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:03.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.829+0000 7fcb167fc640 1 --2- 172.21.15.19:0/224717209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb040039a0 0x7fcb04003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:03.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.829+0000 7fcb167fc640 1 --2- 172.21.15.19:0/224717209 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcb18137650 0x7fcb040047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:03.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.829+0000 7fcb167fc640 1 --2- 172.21.15.19:0/224717209 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb04004d00 0x7fcb04005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:03.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.829+0000 7fcb167fc640 1 -- 172.21.15.19:0/224717209 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb180a3060 con 0x7fcb040039a0 2023-11-04T15:37:03.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.829+0000 7fcb167fc640 1 -- 172.21.15.19:0/224717209 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0400bb10 con 0x7fcb04004d00 2023-11-04T15:37:03.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.829+0000 7fcb167fc640 1 -- 172.21.15.19:0/224717209 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0400bcd0 con 0x7fcb18137650 2023-11-04T15:37:03.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.829+0000 7fcb16ffd640 1 --2- 172.21.15.19:0/224717209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb040039a0 0x7fcb04003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:03.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.829+0000 7fcb0e7fc640 1 --2- 172.21.15.19:0/224717209 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcb18137650 0x7fcb040047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:03.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.829+0000 7fcb177fe640 1 --2- 172.21.15.19:0/224717209 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb04004d00 0x7fcb04005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:03.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.829+0000 7fcb16ffd640 1 -- 172.21.15.19:0/224717209 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcb18137650 msgr2=0x7fcb040047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:03.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.829+0000 7fcb16ffd640 1 --2- 172.21.15.19:0/224717209 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcb18137650 0x7fcb040047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:03.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.829+0000 7fcb16ffd640 1 -- 172.21.15.19:0/224717209 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb04004d00 msgr2=0x7fcb04005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:03.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.829+0000 7fcb16ffd640 1 --2- 172.21.15.19:0/224717209 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb04004d00 0x7fcb04005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:03.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.829+0000 7fcb16ffd640 1 -- 172.21.15.19:0/224717209 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb04003520 con 0x7fcb040039a0 2023-11-04T15:37:03.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.830+0000 7fcb16ffd640 1 --2- 172.21.15.19:0/224717209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb040039a0 0x7fcb04003da0 secure :-1 s=READY pgs=3743 cs=0 l=1 rev1=1 crypto rx=0x7fcb08001860 tx=0x7fcb040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792faf52ee81eb8b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:03.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.830+0000 7fcb167fc640 1 -- 172.21.15.19:0/224717209 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb08033630 con 0x7fcb040039a0 2023-11-04T15:37:03.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.830+0000 7fcb167fc640 1 -- 172.21.15.19:0/224717209 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb080337b0 con 0x7fcb040039a0 2023-11-04T15:37:03.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.830+0000 7fcb167fc640 1 -- 172.21.15.19:0/224717209 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb08033b60 con 0x7fcb040039a0 2023-11-04T15:37:03.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.831+0000 7fcb1d950640 1 -- 172.21.15.19:0/224717209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb040039a0 msgr2=0x7fcb04003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:03.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.831+0000 7fcb1d950640 1 --2- 172.21.15.19:0/224717209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb040039a0 0x7fcb04003da0 secure :-1 s=READY pgs=3743 cs=0 l=1 rev1=1 crypto rx=0x7fcb08001860 tx=0x7fcb040057f0 comp rx=0 tx=0).stop 2023-11-04T15:37:03.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.831+0000 7fcb177fe640 1 -- 172.21.15.19:0/224717209 reap_dead start 2023-11-04T15:37:03.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.831+0000 7fcb1d950640 1 -- 172.21.15.19:0/224717209 shutdown_connections 2023-11-04T15:37:03.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.831+0000 7fcb1d950640 1 -- 172.21.15.19:0/224717209 >> 172.21.15.19:0/224717209 conn(0x7fcb180a8d70 msgr2=0x7fcb180a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:03.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.831+0000 7fcb1d950640 1 -- 172.21.15.19:0/224717209 shutdown_connections 2023-11-04T15:37:03.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.831+0000 7fcb1d950640 1 -- 172.21.15.19:0/224717209 wait complete. 2023-11-04T15:37:03.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.832+0000 7fcb1d950640 1 Processor -- start 2023-11-04T15:37:03.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.832+0000 7fcb1d950640 1 -- start start 2023-11-04T15:37:03.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.833+0000 7fcb1d950640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb040039a0 0x7fcb181cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:03.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.833+0000 7fcb1d950640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcb181cf4e0 0x7fcb181cb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:03.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.833+0000 7fcb1d950640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb181cb8b0 0x7fcb181cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:03.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.833+0000 7fcb1d950640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb181cc270 con 0x7fcb040039a0 2023-11-04T15:37:03.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.833+0000 7fcb1d950640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb181ce920 con 0x7fcb181cb8b0 2023-11-04T15:37:03.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.833+0000 7fcb1d950640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb18098ed0 con 0x7fcb181cf4e0 2023-11-04T15:37:03.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.833+0000 7fcb16ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb040039a0 0x7fcb181cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:03.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.833+0000 7fcb16ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb040039a0 0x7fcb181cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60450/0 (socket says 172.21.15.19:60450) 2023-11-04T15:37:03.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.833+0000 7fcb16ffd640 1 -- 172.21.15.19:0/1236052262 learned_addr learned my addr 172.21.15.19:0/1236052262 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:37:03.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.833+0000 7fcb0e7fc640 1 --2- 172.21.15.19:0/1236052262 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcb181cf4e0 0x7fcb181cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:03.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.833+0000 7fcb177fe640 1 --2- 172.21.15.19:0/1236052262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb181cb8b0 0x7fcb181cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:03.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.833+0000 7fcb16ffd640 1 -- 172.21.15.19:0/1236052262 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcb181cf4e0 msgr2=0x7fcb181cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:03.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.833+0000 7fcb16ffd640 1 --2- 172.21.15.19:0/1236052262 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcb181cf4e0 0x7fcb181cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:03.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.833+0000 7fcb16ffd640 1 -- 172.21.15.19:0/1236052262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb181cb8b0 msgr2=0x7fcb181cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:03.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.833+0000 7fcb16ffd640 1 --2- 172.21.15.19:0/1236052262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb181cb8b0 0x7fcb181cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:03.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.833+0000 7fcb16ffd640 1 -- 172.21.15.19:0/1236052262 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb18137b50 con 0x7fcb040039a0 2023-11-04T15:37:03.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.833+0000 7fcb0e7fc640 1 --2- 172.21.15.19:0/1236052262 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcb181cf4e0 0x7fcb181cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:37:03.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.833+0000 7fcb177fe640 1 --2- 172.21.15.19:0/1236052262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb181cb8b0 0x7fcb181cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:37:03.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.833+0000 7fcb16ffd640 1 --2- 172.21.15.19:0/1236052262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb040039a0 0x7fcb181cefa0 secure :-1 s=READY pgs=3744 cs=0 l=1 rev1=1 crypto rx=0x7fcb0802bdf0 tx=0x7fcb08001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:03.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.833+0000 7fcb14ff9640 1 -- 172.21.15.19:0/1236052262 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb080035f0 con 0x7fcb040039a0 2023-11-04T15:37:03.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.833+0000 7fcb14ff9640 1 -- 172.21.15.19:0/1236052262 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb08003750 con 0x7fcb040039a0 2023-11-04T15:37:03.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.833+0000 7fcb1d950640 1 -- 172.21.15.19:0/1236052262 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb181ceb50 con 0x7fcb040039a0 2023-11-04T15:37:03.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.833+0000 7fcb14ff9640 1 -- 172.21.15.19:0/1236052262 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb08003ac0 con 0x7fcb040039a0 2023-11-04T15:37:03.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.833+0000 7fcb1d950640 1 -- 172.21.15.19:0/1236052262 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb180995e0 con 0x7fcb040039a0 2023-11-04T15:37:03.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.834+0000 7fcb1d950640 1 -- 172.21.15.19:0/1236052262 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb18067d60 con 0x7fcb040039a0 2023-11-04T15:37:03.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.835+0000 7fcb14ff9640 1 -- 172.21.15.19:0/1236052262 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcb08003c20 con 0x7fcb040039a0 2023-11-04T15:37:03.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.835+0000 7fcb14ff9640 1 --2- 172.21.15.19:0/1236052262 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fcaf806a430 0x7fcaf806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:03.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.835+0000 7fcb14ff9640 1 -- 172.21.15.19:0/1236052262 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4462+0+0 (secure 0 0 0) 0x7fcb080aa1b0 con 0x7fcb040039a0 2023-11-04T15:37:03.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.836+0000 7fcb0e7fc640 1 --2- 172.21.15.19:0/1236052262 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fcaf806a430 0x7fcaf806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:03.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.836+0000 7fcb0e7fc640 1 --2- 172.21.15.19:0/1236052262 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fcaf806a430 0x7fcaf806c8f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcb180a48f0 tx=0x7fcb00009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:03.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:03.840+0000 7fcb14ff9640 1 -- 172.21.15.19:0/1236052262 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcb08075d10 con 0x7fcb040039a0 2023-11-04T15:37:04.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.016+0000 7fcb1d950640 1 -- 172.21.15.19:0/1236052262 --> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcb180a5340 con 0x7fcaf806a430 2023-11-04T15:37:04.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.023+0000 7fcb14ff9640 1 -- 172.21.15.19:0/1236052262 <== mgr.4114 v2:172.21.15.96:6816/83123 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281183 (secure 0 0 0) 0x7fcb00001570 con 0x7fcaf806a430 2023-11-04T15:37:04.030 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:37:04.032 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-11-04T15:37:04.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.027+0000 7fcb1d950640 1 -- 172.21.15.19:0/1236052262 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fcaf806a430 msgr2=0x7fcaf806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:04.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.027+0000 7fcb1d950640 1 --2- 172.21.15.19:0/1236052262 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fcaf806a430 0x7fcaf806c8f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcb180a48f0 tx=0x7fcb00009040 comp rx=0 tx=0).stop 2023-11-04T15:37:04.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.027+0000 7fcb1d950640 1 -- 172.21.15.19:0/1236052262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb040039a0 msgr2=0x7fcb181cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:04.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.027+0000 7fcb1d950640 1 --2- 172.21.15.19:0/1236052262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb040039a0 0x7fcb181cefa0 secure :-1 s=READY pgs=3744 cs=0 l=1 rev1=1 crypto rx=0x7fcb0802bdf0 tx=0x7fcb08001230 comp rx=0 tx=0).stop 2023-11-04T15:37:04.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.027+0000 7fcb1d950640 1 -- 172.21.15.19:0/1236052262 shutdown_connections 2023-11-04T15:37:04.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.027+0000 7fcb1d950640 1 --2- 172.21.15.19:0/1236052262 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fcaf806a430 0x7fcaf806c8f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:04.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.027+0000 7fcb1d950640 1 --2- 172.21.15.19:0/1236052262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb181cb8b0 0x7fcb181cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:04.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.027+0000 7fcb1d950640 1 --2- 172.21.15.19:0/1236052262 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcb181cf4e0 0x7fcb181cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:04.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.027+0000 7fcb1d950640 1 --2- 172.21.15.19:0/1236052262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb040039a0 0x7fcb181cefa0 unknown :-1 s=CLOSED pgs=3744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:04.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.027+0000 7fcb1d950640 1 -- 172.21.15.19:0/1236052262 >> 172.21.15.19:0/1236052262 conn(0x7fcb180a8d70 msgr2=0x7fcb18134420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:04.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.027+0000 7fcb1d950640 1 -- 172.21.15.19:0/1236052262 shutdown_connections 2023-11-04T15:37:04.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.027+0000 7fcb1d950640 1 -- 172.21.15.19:0/1236052262 wait complete. 2023-11-04T15:37:04.042 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2023-11-04T15:37:03.054758+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":431372061,"num_objects":220,"num_object_clones":25,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":8,"num_read":352,"num_read_kb":3468,"num_write":158428,"num_write_kb":940479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":307482,"ondisk_log_size":307482,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":3245160,"kb_used_data":844616,"kb_used_omap":0,"kb_used_meta":2400512,"kb_avail":374242200,"statfs":{"total":386547056640,"available":383224012800,"internally_reserved":0,"allocated":864886784,"data_stored":863450232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2458124288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3591427,"num_objects":12,"num_object_clones":6,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":189,"num_write_kb":3620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.340851"},"pg_stats":[{"pgid":"4.3f","version":"40'3514","reported_seq":2948,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.799825+0000","last_change":"2023-11-04T15:36:55.800606+0000","last_active":"2023-11-04T15:36:55.799825+0000","last_peered":"2023-11-04T15:36:55.799825+0000","last_clean":"2023-11-04T15:36:55.799825+0000","last_became_active":"2023-11-04T15:27:36.150296+0000","last_became_peered":"2023-11-04T15:27:36.150296+0000","last_unstale":"2023-11-04T15:36:55.799825+0000","last_undegraded":"2023-11-04T15:36:55.799825+0000","last_fullsized":"2023-11-04T15:36:55.799825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3514,"log_dups_size":0,"ondisk_log_size":3514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:41:32.995261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.074678280999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1112,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.3e","version":"43'3332","reported_seq":2781,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:57.912769+0000","last_change":"2023-11-04T15:36:55.781000+0000","last_active":"2023-11-04T15:36:57.912769+0000","last_peered":"2023-11-04T15:36:57.912769+0000","last_clean":"2023-11-04T15:36:57.912769+0000","last_became_active":"2023-11-04T15:27:36.148939+0000","last_became_peered":"2023-11-04T15:27:36.148939+0000","last_unstale":"2023-11-04T15:36:57.912769+0000","last_undegraded":"2023-11-04T15:36:57.912769+0000","last_fullsized":"2023-11-04T15:36:57.912769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3332,"log_dups_size":0,"ondisk_log_size":3332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:52:55.975636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059113046000000002,"stat_sum":{"num_bytes":35,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1118,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.3d","version":"40'3527","reported_seq":2997,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.821524+0000","last_change":"2023-11-04T15:36:55.822917+0000","last_active":"2023-11-04T15:36:55.821524+0000","last_peered":"2023-11-04T15:36:55.821524+0000","last_clean":"2023-11-04T15:36:55.821524+0000","last_became_active":"2023-11-04T15:27:36.149748+0000","last_became_peered":"2023-11-04T15:27:36.149748+0000","last_unstale":"2023-11-04T15:36:55.821524+0000","last_undegraded":"2023-11-04T15:36:55.821524+0000","last_fullsized":"2023-11-04T15:36:55.821524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3527,"log_dups_size":0,"ondisk_log_size":3527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:49:04.091063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101592565,"stat_sum":{"num_bytes":8206,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":1149,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.3c","version":"40'3602","reported_seq":2981,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.769537+0000","last_change":"2023-11-04T15:36:55.770578+0000","last_active":"2023-11-04T15:36:55.769537+0000","last_peered":"2023-11-04T15:36:55.769537+0000","last_clean":"2023-11-04T15:36:55.769537+0000","last_became_active":"2023-11-04T15:27:36.139761+0000","last_became_peered":"2023-11-04T15:27:36.139761+0000","last_unstale":"2023-11-04T15:36:55.769537+0000","last_undegraded":"2023-11-04T15:36:55.769537+0000","last_fullsized":"2023-11-04T15:36:55.769537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3602,"log_dups_size":0,"ondisk_log_size":3602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:38:30.379384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052924038,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1171,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.3b","version":"40'3725","reported_seq":3115,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.797163+0000","last_change":"2023-11-04T15:36:55.798093+0000","last_active":"2023-11-04T15:36:55.797163+0000","last_peered":"2023-11-04T15:36:55.797163+0000","last_clean":"2023-11-04T15:36:55.797163+0000","last_became_active":"2023-11-04T15:27:36.150017+0000","last_became_peered":"2023-11-04T15:27:36.150017+0000","last_unstale":"2023-11-04T15:36:55.797163+0000","last_undegraded":"2023-11-04T15:36:55.797163+0000","last_fullsized":"2023-11-04T15:36:55.797163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3725,"log_dups_size":0,"ondisk_log_size":3725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:47:40.350777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.073241305000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1192,"num_write_kb":641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.3a","version":"40'3327","reported_seq":2767,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.822971+0000","last_change":"2023-11-04T15:36:55.824394+0000","last_active":"2023-11-04T15:36:55.822971+0000","last_peered":"2023-11-04T15:36:55.822971+0000","last_clean":"2023-11-04T15:36:55.822971+0000","last_became_active":"2023-11-04T15:27:36.139036+0000","last_became_peered":"2023-11-04T15:27:36.139036+0000","last_unstale":"2023-11-04T15:36:55.822971+0000","last_undegraded":"2023-11-04T15:36:55.822971+0000","last_fullsized":"2023-11-04T15:36:55.822971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3327,"log_dups_size":0,"ondisk_log_size":3327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:05:44.093984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.102154117,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1074,"num_write_kb":603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.39","version":"43'3353","reported_seq":2801,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:58.060175+0000","last_change":"2023-11-04T15:36:55.820147+0000","last_active":"2023-11-04T15:36:58.060175+0000","last_peered":"2023-11-04T15:36:58.060175+0000","last_clean":"2023-11-04T15:36:58.060175+0000","last_became_active":"2023-11-04T15:27:36.139121+0000","last_became_peered":"2023-11-04T15:27:36.139121+0000","last_unstale":"2023-11-04T15:36:58.060175+0000","last_undegraded":"2023-11-04T15:36:58.060175+0000","last_fullsized":"2023-11-04T15:36:58.060175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3353,"log_dups_size":0,"ondisk_log_size":3353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:57:05.896392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.099827518000000004,"stat_sum":{"num_bytes":4117,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":2,"num_read_kb":1,"num_write":1086,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.38","version":"40'3425","reported_seq":2840,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.815196+0000","last_change":"2023-11-04T15:36:55.816551+0000","last_active":"2023-11-04T15:36:55.815196+0000","last_peered":"2023-11-04T15:36:55.815196+0000","last_clean":"2023-11-04T15:36:55.815196+0000","last_became_active":"2023-11-04T15:27:36.147050+0000","last_became_peered":"2023-11-04T15:27:36.147050+0000","last_unstale":"2023-11-04T15:36:55.815196+0000","last_undegraded":"2023-11-04T15:36:55.815196+0000","last_fullsized":"2023-11-04T15:36:55.815196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3425,"log_dups_size":0,"ondisk_log_size":3425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:40:36.811342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.098810337999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.37","version":"40'3561","reported_seq":2961,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.795099+0000","last_change":"2023-11-04T15:36:55.796038+0000","last_active":"2023-11-04T15:36:55.795099+0000","last_peered":"2023-11-04T15:36:55.795099+0000","last_clean":"2023-11-04T15:36:55.795099+0000","last_became_active":"2023-11-04T15:27:36.145825+0000","last_became_peered":"2023-11-04T15:27:36.145825+0000","last_unstale":"2023-11-04T15:36:55.795099+0000","last_undegraded":"2023-11-04T15:36:55.795099+0000","last_fullsized":"2023-11-04T15:36:55.795099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3561,"log_dups_size":0,"ondisk_log_size":3561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:52:55.975636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072094483000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.36","version":"40'3327","reported_seq":2840,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.816605+0000","last_change":"2023-11-04T15:36:55.817992+0000","last_active":"2023-11-04T15:36:55.816605+0000","last_peered":"2023-11-04T15:36:55.816605+0000","last_clean":"2023-11-04T15:36:55.816605+0000","last_became_active":"2023-11-04T15:27:36.150307+0000","last_became_peered":"2023-11-04T15:27:36.150307+0000","last_unstale":"2023-11-04T15:36:55.816605+0000","last_undegraded":"2023-11-04T15:36:55.816605+0000","last_fullsized":"2023-11-04T15:36:55.816605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3327,"log_dups_size":0,"ondisk_log_size":3327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:38:23.440792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10012518099999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1064,"num_write_kb":572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.35","version":"40'3202","reported_seq":2717,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.769477+0000","last_change":"2023-11-04T15:36:55.770571+0000","last_active":"2023-11-04T15:36:55.769477+0000","last_peered":"2023-11-04T15:36:55.769477+0000","last_clean":"2023-11-04T15:36:55.769477+0000","last_became_active":"2023-11-04T15:27:36.144988+0000","last_became_peered":"2023-11-04T15:27:36.144988+0000","last_unstale":"2023-11-04T15:36:55.769477+0000","last_undegraded":"2023-11-04T15:36:55.769477+0000","last_fullsized":"2023-11-04T15:36:55.769477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3202,"log_dups_size":0,"ondisk_log_size":3202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:41.544754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052379294999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1028,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.34","version":"40'3394","reported_seq":2819,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.780718+0000","last_change":"2023-11-04T15:36:55.782106+0000","last_active":"2023-11-04T15:36:55.780718+0000","last_peered":"2023-11-04T15:36:55.780718+0000","last_clean":"2023-11-04T15:36:55.780718+0000","last_became_active":"2023-11-04T15:27:36.149156+0000","last_became_peered":"2023-11-04T15:27:36.149156+0000","last_unstale":"2023-11-04T15:36:55.780718+0000","last_undegraded":"2023-11-04T15:36:55.780718+0000","last_fullsized":"2023-11-04T15:36:55.780718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3394,"log_dups_size":0,"ondisk_log_size":3394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:22:17.580120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.064372897999999998,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1159,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.33","version":"40'3255","reported_seq":2740,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.791655+0000","last_change":"2023-11-04T15:36:55.792591+0000","last_active":"2023-11-04T15:36:55.791655+0000","last_peered":"2023-11-04T15:36:55.791655+0000","last_clean":"2023-11-04T15:36:55.791655+0000","last_became_active":"2023-11-04T15:27:36.139824+0000","last_became_peered":"2023-11-04T15:27:36.139824+0000","last_unstale":"2023-11-04T15:36:55.791655+0000","last_undegraded":"2023-11-04T15:36:55.791655+0000","last_fullsized":"2023-11-04T15:36:55.791655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3255,"log_dups_size":0,"ondisk_log_size":3255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:28.095802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070068697999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1062,"num_write_kb":575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.32","version":"40'3538","reported_seq":2915,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.774374+0000","last_change":"2023-11-04T15:36:55.774374+0000","last_active":"2023-11-04T15:36:55.774374+0000","last_peered":"2023-11-04T15:36:55.774374+0000","last_clean":"2023-11-04T15:36:55.774374+0000","last_became_active":"2023-11-04T15:27:36.147273+0000","last_became_peered":"2023-11-04T15:27:36.147273+0000","last_unstale":"2023-11-04T15:36:55.774374+0000","last_undegraded":"2023-11-04T15:36:55.774374+0000","last_fullsized":"2023-11-04T15:36:55.774374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3538,"log_dups_size":0,"ondisk_log_size":3538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:22:17.580120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055716603000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.31","version":"40'3766","reported_seq":3156,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.780005+0000","last_change":"2023-11-04T15:36:55.780005+0000","last_active":"2023-11-04T15:36:55.780005+0000","last_peered":"2023-11-04T15:36:55.780005+0000","last_clean":"2023-11-04T15:36:55.780005+0000","last_became_active":"2023-11-04T15:27:36.148932+0000","last_became_peered":"2023-11-04T15:27:36.148932+0000","last_unstale":"2023-11-04T15:36:55.780005+0000","last_undegraded":"2023-11-04T15:36:55.780005+0000","last_fullsized":"2023-11-04T15:36:55.780005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3766,"log_dups_size":0,"ondisk_log_size":3766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:12:07.727740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062648212999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1209,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.30","version":"40'3538","reported_seq":2943,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.818096+0000","last_change":"2023-11-04T15:36:55.818096+0000","last_active":"2023-11-04T15:36:55.818096+0000","last_peered":"2023-11-04T15:36:55.818096+0000","last_clean":"2023-11-04T15:36:55.818096+0000","last_became_active":"2023-11-04T15:27:36.150856+0000","last_became_peered":"2023-11-04T15:27:36.150856+0000","last_unstale":"2023-11-04T15:36:55.818096+0000","last_undegraded":"2023-11-04T15:36:55.818096+0000","last_fullsized":"2023-11-04T15:36:55.818096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3538,"log_dups_size":0,"ondisk_log_size":3538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:51:31.442634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.099772735000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.2f","version":"40'3671","reported_seq":2997,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.797112+0000","last_change":"2023-11-04T15:36:55.797112+0000","last_active":"2023-11-04T15:36:55.797112+0000","last_peered":"2023-11-04T15:36:55.797112+0000","last_clean":"2023-11-04T15:36:55.797112+0000","last_became_active":"2023-11-04T15:27:36.144997+0000","last_became_peered":"2023-11-04T15:27:36.144997+0000","last_unstale":"2023-11-04T15:36:55.797112+0000","last_undegraded":"2023-11-04T15:36:55.797112+0000","last_fullsized":"2023-11-04T15:36:55.797112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3671,"log_dups_size":0,"ondisk_log_size":3671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:22:17.580120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072563297999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1270,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.2e","version":"40'3137","reported_seq":2640,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.820139+0000","last_change":"2023-11-04T15:36:55.820139+0000","last_active":"2023-11-04T15:36:55.820139+0000","last_peered":"2023-11-04T15:36:55.820139+0000","last_clean":"2023-11-04T15:36:55.820139+0000","last_became_active":"2023-11-04T15:27:36.150555+0000","last_became_peered":"2023-11-04T15:27:36.150555+0000","last_unstale":"2023-11-04T15:36:55.820139+0000","last_undegraded":"2023-11-04T15:36:55.820139+0000","last_fullsized":"2023-11-04T15:36:55.820139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3137,"log_dups_size":0,"ondisk_log_size":3137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:32:27.370984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101696772,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1042,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.2d","version":"40'3390","reported_seq":2810,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.794062+0000","last_change":"2023-11-04T15:36:55.795034+0000","last_active":"2023-11-04T15:36:55.794062+0000","last_peered":"2023-11-04T15:36:55.794062+0000","last_clean":"2023-11-04T15:36:55.794062+0000","last_became_active":"2023-11-04T15:27:36.147745+0000","last_became_peered":"2023-11-04T15:27:36.147745+0000","last_unstale":"2023-11-04T15:36:55.794062+0000","last_undegraded":"2023-11-04T15:36:55.794062+0000","last_fullsized":"2023-11-04T15:36:55.794062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3390,"log_dups_size":0,"ondisk_log_size":3390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:41:10.315016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071588252000000005,"stat_sum":{"num_bytes":4128,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1173,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.2c","version":"40'3505","reported_seq":2913,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.814083+0000","last_change":"2023-11-04T15:36:55.815381+0000","last_active":"2023-11-04T15:36:55.814083+0000","last_peered":"2023-11-04T15:36:55.814083+0000","last_clean":"2023-11-04T15:36:55.814083+0000","last_became_active":"2023-11-04T15:27:36.150687+0000","last_became_peered":"2023-11-04T15:27:36.150687+0000","last_unstale":"2023-11-04T15:36:55.814083+0000","last_undegraded":"2023-11-04T15:36:55.814083+0000","last_fullsized":"2023-11-04T15:36:55.814083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3505,"log_dups_size":0,"ondisk_log_size":3505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:56:24.790444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.097896176000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1154,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.2b","version":"43'3544","reported_seq":2979,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.776770+0000","last_change":"2023-11-04T15:36:55.776770+0000","last_active":"2023-11-04T15:36:55.776770+0000","last_peered":"2023-11-04T15:36:55.776770+0000","last_clean":"2023-11-04T15:36:55.776770+0000","last_became_active":"2023-11-04T15:27:36.143551+0000","last_became_peered":"2023-11-04T15:27:36.143551+0000","last_unstale":"2023-11-04T15:36:55.776770+0000","last_undegraded":"2023-11-04T15:36:55.776770+0000","last_fullsized":"2023-11-04T15:36:55.776770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3544,"log_dups_size":0,"ondisk_log_size":3544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:36:21.960547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056037475000000003,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1178,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.2a","version":"40'3728","reported_seq":3083,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.793582+0000","last_change":"2023-11-04T15:36:55.794625+0000","last_active":"2023-11-04T15:36:55.793582+0000","last_peered":"2023-11-04T15:36:55.793582+0000","last_clean":"2023-11-04T15:36:55.793582+0000","last_became_active":"2023-11-04T15:27:36.145943+0000","last_became_peered":"2023-11-04T15:27:36.145943+0000","last_unstale":"2023-11-04T15:36:55.793582+0000","last_undegraded":"2023-11-04T15:36:55.793582+0000","last_fullsized":"2023-11-04T15:36:55.793582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3728,"log_dups_size":0,"ondisk_log_size":3728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:48:58.102459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071549077000000003,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1242,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.29","version":"40'3454","reported_seq":2887,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.776581+0000","last_change":"2023-11-04T15:36:55.777772+0000","last_active":"2023-11-04T15:36:55.776581+0000","last_peered":"2023-11-04T15:36:55.776581+0000","last_clean":"2023-11-04T15:36:55.776581+0000","last_became_active":"2023-11-04T15:27:36.144083+0000","last_became_peered":"2023-11-04T15:27:36.144083+0000","last_unstale":"2023-11-04T15:36:55.776581+0000","last_undegraded":"2023-11-04T15:36:55.776581+0000","last_fullsized":"2023-11-04T15:36:55.776581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3454,"log_dups_size":0,"ondisk_log_size":3454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:32:27.370984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.060959410999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1127,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.28","version":"40'3632","reported_seq":2989,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.820178+0000","last_change":"2023-11-04T15:36:55.821483+0000","last_active":"2023-11-04T15:36:55.820178+0000","last_peered":"2023-11-04T15:36:55.820178+0000","last_clean":"2023-11-04T15:36:55.820178+0000","last_became_active":"2023-11-04T15:27:36.146546+0000","last_became_peered":"2023-11-04T15:27:36.146546+0000","last_unstale":"2023-11-04T15:36:55.820178+0000","last_undegraded":"2023-11-04T15:36:55.820178+0000","last_fullsized":"2023-11-04T15:36:55.820178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3632,"log_dups_size":0,"ondisk_log_size":3632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:41:10.315016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.102597439,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1222,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.27","version":"40'3166","reported_seq":2626,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.781930+0000","last_change":"2023-11-04T15:36:55.783207+0000","last_active":"2023-11-04T15:36:55.781930+0000","last_peered":"2023-11-04T15:36:55.781930+0000","last_clean":"2023-11-04T15:36:55.781930+0000","last_became_active":"2023-11-04T15:27:36.144047+0000","last_became_peered":"2023-11-04T15:27:36.144047+0000","last_unstale":"2023-11-04T15:36:55.781930+0000","last_undegraded":"2023-11-04T15:36:55.781930+0000","last_fullsized":"2023-11-04T15:36:55.781930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3166,"log_dups_size":0,"ondisk_log_size":3166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:36:21.960547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.064725415999999994,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1115,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.26","version":"40'3493","reported_seq":2891,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.783404+0000","last_change":"2023-11-04T15:36:55.784865+0000","last_active":"2023-11-04T15:36:55.783404+0000","last_peered":"2023-11-04T15:36:55.783404+0000","last_clean":"2023-11-04T15:36:55.783404+0000","last_became_active":"2023-11-04T15:27:36.144458+0000","last_became_peered":"2023-11-04T15:27:36.144458+0000","last_unstale":"2023-11-04T15:36:55.783404+0000","last_undegraded":"2023-11-04T15:36:55.783404+0000","last_fullsized":"2023-11-04T15:36:55.783404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3493,"log_dups_size":0,"ondisk_log_size":3493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:52:55.975636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.066118209999999997,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.25","version":"40'3386","reported_seq":2823,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.826414+0000","last_change":"2023-11-04T15:36:55.827764+0000","last_active":"2023-11-04T15:36:55.826414+0000","last_peered":"2023-11-04T15:36:55.826414+0000","last_clean":"2023-11-04T15:36:55.826414+0000","last_became_active":"2023-11-04T15:27:36.150270+0000","last_became_peered":"2023-11-04T15:27:36.150270+0000","last_unstale":"2023-11-04T15:36:55.826414+0000","last_undegraded":"2023-11-04T15:36:55.826414+0000","last_fullsized":"2023-11-04T15:36:55.826414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3386,"log_dups_size":0,"ondisk_log_size":3386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:18:00.808576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.104674168,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.24","version":"40'3286","reported_seq":2715,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.799791+0000","last_change":"2023-11-04T15:36:55.799791+0000","last_active":"2023-11-04T15:36:55.799791+0000","last_peered":"2023-11-04T15:36:55.799791+0000","last_clean":"2023-11-04T15:36:55.799791+0000","last_became_active":"2023-11-04T15:28:20.871378+0000","last_became_peered":"2023-11-04T15:28:20.871378+0000","last_unstale":"2023-11-04T15:36:55.799791+0000","last_undegraded":"2023-11-04T15:36:55.799791+0000","last_fullsized":"2023-11-04T15:36:55.799791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3286,"log_dups_size":0,"ondisk_log_size":3286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:50:26.736014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.074381663000000001,"stat_sum":{"num_bytes":9,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1152,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.23","version":"40'3578","reported_seq":3004,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.792948+0000","last_change":"2023-11-04T15:36:55.793946+0000","last_active":"2023-11-04T15:36:55.792948+0000","last_peered":"2023-11-04T15:36:55.792948+0000","last_clean":"2023-11-04T15:36:55.792948+0000","last_became_active":"2023-11-04T15:27:36.145392+0000","last_became_peered":"2023-11-04T15:27:36.145392+0000","last_unstale":"2023-11-04T15:36:55.792948+0000","last_undegraded":"2023-11-04T15:36:55.792948+0000","last_fullsized":"2023-11-04T15:36:55.792948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3578,"log_dups_size":0,"ondisk_log_size":3578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:12:07.727740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070714202000000004,"stat_sum":{"num_bytes":12288,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1167,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.22","version":"40'3386","reported_seq":2859,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.822944+0000","last_change":"2023-11-04T15:36:55.824211+0000","last_active":"2023-11-04T15:36:55.822944+0000","last_peered":"2023-11-04T15:36:55.822944+0000","last_clean":"2023-11-04T15:36:55.822944+0000","last_became_active":"2023-11-04T15:27:36.145273+0000","last_became_peered":"2023-11-04T15:27:36.145273+0000","last_unstale":"2023-11-04T15:36:55.822944+0000","last_undegraded":"2023-11-04T15:36:55.822944+0000","last_fullsized":"2023-11-04T15:36:55.822944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3386,"log_dups_size":0,"ondisk_log_size":3386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:27:25.258046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101784969,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1155,"num_write_kb":603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.21","version":"40'3889","reported_seq":3211,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.777444+0000","last_change":"2023-11-04T15:36:55.778888+0000","last_active":"2023-11-04T15:36:55.777444+0000","last_peered":"2023-11-04T15:36:55.777444+0000","last_clean":"2023-11-04T15:36:55.777444+0000","last_became_active":"2023-11-04T15:27:36.144053+0000","last_became_peered":"2023-11-04T15:27:36.144053+0000","last_unstale":"2023-11-04T15:36:55.777444+0000","last_undegraded":"2023-11-04T15:36:55.777444+0000","last_fullsized":"2023-11-04T15:36:55.777444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3889,"log_dups_size":0,"ondisk_log_size":3889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:41:10.315016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061944979999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1328,"num_write_kb":706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.20","version":"40'3720","reported_seq":3102,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.774434+0000","last_change":"2023-11-04T15:36:55.775709+0000","last_active":"2023-11-04T15:36:55.774434+0000","last_peered":"2023-11-04T15:36:55.774434+0000","last_clean":"2023-11-04T15:36:55.774434+0000","last_became_active":"2023-11-04T15:27:36.148342+0000","last_became_peered":"2023-11-04T15:27:36.148342+0000","last_unstale":"2023-11-04T15:36:55.774434+0000","last_undegraded":"2023-11-04T15:36:55.774434+0000","last_fullsized":"2023-11-04T15:36:55.774434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3720,"log_dups_size":0,"ondisk_log_size":3720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:47:40.350777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056486557999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.14","version":"40'3424","reported_seq":2823,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.784869+0000","last_change":"2023-11-04T15:36:55.784869+0000","last_active":"2023-11-04T15:36:55.784869+0000","last_peered":"2023-11-04T15:36:55.784869+0000","last_clean":"2023-11-04T15:36:55.784869+0000","last_became_active":"2023-11-04T15:27:36.148951+0000","last_became_peered":"2023-11-04T15:27:36.148951+0000","last_unstale":"2023-11-04T15:36:55.784869+0000","last_undegraded":"2023-11-04T15:36:55.784869+0000","last_fullsized":"2023-11-04T15:36:55.784869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3424,"log_dups_size":0,"ondisk_log_size":3424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:58:32.190696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.066218149000000004,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1176,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.13","version":"40'2984","reported_seq":3023,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.184473+0000","last_change":"2023-11-04T15:27:35.775931+0000","last_active":"2023-11-04T15:36:55.184473+0000","last_peered":"2023-11-04T15:36:55.184473+0000","last_clean":"2023-11-04T15:36:55.184473+0000","last_became_active":"2023-11-04T15:27:35.775616+0000","last_became_peered":"2023-11-04T15:27:35.775616+0000","last_unstale":"2023-11-04T15:36:55.184473+0000","last_undegraded":"2023-11-04T15:36:55.184473+0000","last_fullsized":"2023-11-04T15:36:55.184473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2984,"log_dups_size":0,"ondisk_log_size":2984,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:14:34.175377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2984,"num_write_kb":24202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"40'3308","reported_seq":2723,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.821616+0000","last_change":"2023-11-04T15:36:55.822910+0000","last_active":"2023-11-04T15:36:55.821616+0000","last_peered":"2023-11-04T15:36:55.821616+0000","last_clean":"2023-11-04T15:36:55.821616+0000","last_became_active":"2023-11-04T15:27:36.150276+0000","last_became_peered":"2023-11-04T15:27:36.150276+0000","last_unstale":"2023-11-04T15:36:55.821616+0000","last_undegraded":"2023-11-04T15:36:55.821616+0000","last_fullsized":"2023-11-04T15:36:55.821616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3308,"log_dups_size":0,"ondisk_log_size":3308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T22:54:18.576814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101095329,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1177,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.12","version":"37'462","reported_seq":501,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.221673+0000","last_change":"2023-11-04T15:27:35.776610+0000","last_active":"2023-11-04T15:36:55.221673+0000","last_peered":"2023-11-04T15:36:55.221673+0000","last_clean":"2023-11-04T15:36:55.221673+0000","last_became_active":"2023-11-04T15:27:35.776297+0000","last_became_peered":"2023-11-04T15:27:35.776297+0000","last_unstale":"2023-11-04T15:36:55.221673+0000","last_undegraded":"2023-11-04T15:36:55.221673+0000","last_fullsized":"2023-11-04T15:36:55.221673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:11:01.495068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":462,"num_write_kb":12396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"40'3485","reported_seq":2904,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.799120+0000","last_change":"2023-11-04T15:36:55.800080+0000","last_active":"2023-11-04T15:36:55.799120+0000","last_peered":"2023-11-04T15:36:55.799120+0000","last_clean":"2023-11-04T15:36:55.799120+0000","last_became_active":"2023-11-04T15:27:36.139580+0000","last_became_peered":"2023-11-04T15:27:36.139580+0000","last_unstale":"2023-11-04T15:36:55.799120+0000","last_undegraded":"2023-11-04T15:36:55.799120+0000","last_fullsized":"2023-11-04T15:36:55.799120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3485,"log_dups_size":0,"ondisk_log_size":3485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:38:30.379384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.074768939000000006,"stat_sum":{"num_bytes":8192,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1207,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.11","version":"40'717","reported_seq":756,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.184426+0000","last_change":"2023-11-04T15:27:35.775977+0000","last_active":"2023-11-04T15:36:55.184426+0000","last_peered":"2023-11-04T15:36:55.184426+0000","last_clean":"2023-11-04T15:36:55.184426+0000","last_became_active":"2023-11-04T15:27:35.775486+0000","last_became_peered":"2023-11-04T15:27:35.775486+0000","last_unstale":"2023-11-04T15:36:55.184426+0000","last_undegraded":"2023-11-04T15:36:55.184426+0000","last_fullsized":"2023-11-04T15:36:55.184426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:44:09.266115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":707,"num_write_kb":16815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"40'3443","reported_seq":2872,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.798148+0000","last_change":"2023-11-04T15:36:55.799083+0000","last_active":"2023-11-04T15:36:55.798148+0000","last_peered":"2023-11-04T15:36:55.798148+0000","last_clean":"2023-11-04T15:36:55.798148+0000","last_became_active":"2023-11-04T15:27:36.139789+0000","last_became_peered":"2023-11-04T15:27:36.139789+0000","last_unstale":"2023-11-04T15:36:55.798148+0000","last_undegraded":"2023-11-04T15:36:55.798148+0000","last_fullsized":"2023-11-04T15:36:55.798148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3443,"log_dups_size":0,"ondisk_log_size":3443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:55:13.470788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.073936136,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.10","version":"37'1614","reported_seq":1653,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.184371+0000","last_change":"2023-11-04T15:27:35.776168+0000","last_active":"2023-11-04T15:36:55.184371+0000","last_peered":"2023-11-04T15:36:55.184371+0000","last_clean":"2023-11-04T15:36:55.184371+0000","last_became_active":"2023-11-04T15:27:35.775895+0000","last_became_peered":"2023-11-04T15:27:35.775895+0000","last_unstale":"2023-11-04T15:36:55.184371+0000","last_undegraded":"2023-11-04T15:36:55.184371+0000","last_fullsized":"2023-11-04T15:36:55.184371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1614,"log_dups_size":0,"ondisk_log_size":1614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:02:27.460776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":1625,"num_write_kb":22714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"43'1198","reported_seq":1237,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.717728+0000","last_change":"2023-11-04T15:27:35.767890+0000","last_active":"2023-11-04T15:36:55.717728+0000","last_peered":"2023-11-04T15:36:55.717728+0000","last_clean":"2023-11-04T15:36:55.717728+0000","last_became_active":"2023-11-04T15:27:35.767594+0000","last_became_peered":"2023-11-04T15:27:35.767594+0000","last_unstale":"2023-11-04T15:36:55.717728+0000","last_undegraded":"2023-11-04T15:36:55.717728+0000","last_fullsized":"2023-11-04T15:36:55.717728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1198,"log_dups_size":0,"ondisk_log_size":1198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:11:01.495068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1190,"num_write_kb":15478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"40'3688","reported_seq":3048,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.820227+0000","last_change":"2023-11-04T15:36:55.821576+0000","last_active":"2023-11-04T15:36:55.820227+0000","last_peered":"2023-11-04T15:36:55.820227+0000","last_clean":"2023-11-04T15:36:55.820227+0000","last_became_active":"2023-11-04T15:27:36.148282+0000","last_became_peered":"2023-11-04T15:27:36.148282+0000","last_unstale":"2023-11-04T15:36:55.820227+0000","last_undegraded":"2023-11-04T15:36:55.820227+0000","last_fullsized":"2023-11-04T15:36:55.820227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3688,"log_dups_size":0,"ondisk_log_size":3688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:28:21.024990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.102136719,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1244,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.e","version":"37'2392","reported_seq":2431,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.718563+0000","last_change":"2023-11-04T15:27:35.771839+0000","last_active":"2023-11-04T15:36:54.718563+0000","last_peered":"2023-11-04T15:36:54.718563+0000","last_clean":"2023-11-04T15:36:54.718563+0000","last_became_active":"2023-11-04T15:27:35.771554+0000","last_became_peered":"2023-11-04T15:27:35.771554+0000","last_unstale":"2023-11-04T15:36:54.718563+0000","last_undegraded":"2023-11-04T15:36:54.718563+0000","last_fullsized":"2023-11-04T15:36:54.718563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2392,"log_dups_size":0,"ondisk_log_size":2392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:02:11.972760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2386,"num_write_kb":21701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"40'3600","reported_seq":2983,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.777887+0000","last_change":"2023-11-04T15:36:55.779143+0000","last_active":"2023-11-04T15:36:55.777887+0000","last_peered":"2023-11-04T15:36:55.777887+0000","last_clean":"2023-11-04T15:36:55.777887+0000","last_became_active":"2023-11-04T15:27:36.149146+0000","last_became_peered":"2023-11-04T15:27:36.149146+0000","last_unstale":"2023-11-04T15:36:55.777887+0000","last_undegraded":"2023-11-04T15:36:55.777887+0000","last_fullsized":"2023-11-04T15:36:55.777887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3600,"log_dups_size":0,"ondisk_log_size":3600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:14:54.847413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055767874000000002,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.d","version":"40'3587","reported_seq":3626,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.719438+0000","last_change":"2023-11-04T15:27:35.773978+0000","last_active":"2023-11-04T15:36:54.719438+0000","last_peered":"2023-11-04T15:36:54.719438+0000","last_clean":"2023-11-04T15:36:54.719438+0000","last_became_active":"2023-11-04T15:27:35.773689+0000","last_became_peered":"2023-11-04T15:27:35.773689+0000","last_unstale":"2023-11-04T15:36:54.719438+0000","last_undegraded":"2023-11-04T15:36:54.719438+0000","last_fullsized":"2023-11-04T15:36:54.719438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3587,"log_dups_size":0,"ondisk_log_size":3587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:52:13.268866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582982,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3581,"num_write_kb":38716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"40'3511","reported_seq":2895,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.776611+0000","last_change":"2023-11-04T15:36:55.777637+0000","last_active":"2023-11-04T15:36:55.776611+0000","last_peered":"2023-11-04T15:36:55.776611+0000","last_clean":"2023-11-04T15:36:55.776611+0000","last_became_active":"2023-11-04T15:27:36.141695+0000","last_became_peered":"2023-11-04T15:27:36.141695+0000","last_unstale":"2023-11-04T15:36:55.776611+0000","last_undegraded":"2023-11-04T15:36:55.776611+0000","last_fullsized":"2023-11-04T15:36:55.776611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3511,"log_dups_size":0,"ondisk_log_size":3511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:45:22.367523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057953993000000002,"stat_sum":{"num_bytes":4107,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1230,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.c","version":"40'1577","reported_seq":1616,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.718956+0000","last_change":"2023-11-04T15:27:35.774108+0000","last_active":"2023-11-04T15:36:54.718956+0000","last_peered":"2023-11-04T15:36:54.718956+0000","last_clean":"2023-11-04T15:36:54.718956+0000","last_became_active":"2023-11-04T15:27:35.773818+0000","last_became_peered":"2023-11-04T15:27:35.773818+0000","last_unstale":"2023-11-04T15:36:54.718956+0000","last_undegraded":"2023-11-04T15:36:54.718956+0000","last_fullsized":"2023-11-04T15:36:54.718956+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1577,"log_dups_size":0,"ondisk_log_size":1577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:42:49.218866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1569,"num_write_kb":30603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"40'3300","reported_seq":2746,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.792637+0000","last_change":"2023-11-04T15:36:55.793529+0000","last_active":"2023-11-04T15:36:55.792637+0000","last_peered":"2023-11-04T15:36:55.792637+0000","last_clean":"2023-11-04T15:36:55.792637+0000","last_became_active":"2023-11-04T15:27:36.150653+0000","last_became_peered":"2023-11-04T15:27:36.150653+0000","last_unstale":"2023-11-04T15:36:55.792637+0000","last_undegraded":"2023-11-04T15:36:55.792637+0000","last_fullsized":"2023-11-04T15:36:55.792637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3300,"log_dups_size":0,"ondisk_log_size":3300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:36:21.960547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070970674999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1129,"num_write_kb":600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.b","version":"37'4021","reported_seq":4060,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.716556+0000","last_change":"2023-11-04T15:27:35.773128+0000","last_active":"2023-11-04T15:36:54.716556+0000","last_peered":"2023-11-04T15:36:54.716556+0000","last_clean":"2023-11-04T15:36:54.716556+0000","last_became_active":"2023-11-04T15:27:35.772815+0000","last_became_peered":"2023-11-04T15:27:35.772815+0000","last_unstale":"2023-11-04T15:36:54.716556+0000","last_undegraded":"2023-11-04T15:36:54.716556+0000","last_fullsized":"2023-11-04T15:36:54.716556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":4021,"log_dups_size":0,"ondisk_log_size":4021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:42:49.218866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4019,"num_write_kb":36923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"40'3784","reported_seq":3126,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.815424+0000","last_change":"2023-11-04T15:36:55.816749+0000","last_active":"2023-11-04T15:36:55.815424+0000","last_peered":"2023-11-04T15:36:55.815424+0000","last_clean":"2023-11-04T15:36:55.815424+0000","last_became_active":"2023-11-04T15:27:36.150667+0000","last_became_peered":"2023-11-04T15:27:36.150667+0000","last_unstale":"2023-11-04T15:36:55.815424+0000","last_undegraded":"2023-11-04T15:36:55.815424+0000","last_fullsized":"2023-11-04T15:36:55.815424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3784,"log_dups_size":0,"ondisk_log_size":3784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:55:13.470788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.098687114000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1287,"num_write_kb":684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.a","version":"37'2125","reported_seq":2164,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.718032+0000","last_change":"2023-11-04T15:27:35.775559+0000","last_active":"2023-11-04T15:36:54.718032+0000","last_peered":"2023-11-04T15:36:54.718032+0000","last_clean":"2023-11-04T15:36:54.718032+0000","last_became_active":"2023-11-04T15:27:35.775063+0000","last_became_peered":"2023-11-04T15:27:35.775063+0000","last_unstale":"2023-11-04T15:36:54.718032+0000","last_undegraded":"2023-11-04T15:36:54.718032+0000","last_fullsized":"2023-11-04T15:36:54.718032+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2125,"log_dups_size":0,"ondisk_log_size":2125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:30:45.293294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2118,"num_write_kb":30816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"40'3317","reported_seq":2785,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.824273+0000","last_change":"2023-11-04T15:36:55.826358+0000","last_active":"2023-11-04T15:36:55.824273+0000","last_peered":"2023-11-04T15:36:55.824273+0000","last_clean":"2023-11-04T15:36:55.824273+0000","last_became_active":"2023-11-04T15:27:36.139103+0000","last_became_peered":"2023-11-04T15:27:36.139103+0000","last_unstale":"2023-11-04T15:36:55.824273+0000","last_undegraded":"2023-11-04T15:36:55.824273+0000","last_fullsized":"2023-11-04T15:36:55.824273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3317,"log_dups_size":0,"ondisk_log_size":3317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:59:35.340281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10468400899999999,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1091,"num_write_kb":593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.9","version":"37'1934","reported_seq":1973,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.717552+0000","last_change":"2023-11-04T15:27:35.773686+0000","last_active":"2023-11-04T15:36:54.717552+0000","last_peered":"2023-11-04T15:36:54.717552+0000","last_clean":"2023-11-04T15:36:54.717552+0000","last_became_active":"2023-11-04T15:27:35.773449+0000","last_became_peered":"2023-11-04T15:27:35.773449+0000","last_unstale":"2023-11-04T15:36:54.717552+0000","last_undegraded":"2023-11-04T15:36:54.717552+0000","last_fullsized":"2023-11-04T15:36:54.717552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1934,"log_dups_size":0,"ondisk_log_size":1934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:17:14.527023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1929,"num_write_kb":17119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"40'3519","reported_seq":2939,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.780060+0000","last_change":"2023-11-04T15:36:55.781058+0000","last_active":"2023-11-04T15:36:55.780060+0000","last_peered":"2023-11-04T15:36:55.780060+0000","last_clean":"2023-11-04T15:36:55.780060+0000","last_became_active":"2023-11-04T15:27:36.141086+0000","last_became_peered":"2023-11-04T15:27:36.141086+0000","last_unstale":"2023-11-04T15:36:55.780060+0000","last_undegraded":"2023-11-04T15:36:55.780060+0000","last_fullsized":"2023-11-04T15:36:55.780060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3519,"log_dups_size":0,"ondisk_log_size":3519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:28:45.715407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059170119,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1142,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.8","version":"37'655","reported_seq":694,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.716231+0000","last_change":"2023-11-04T15:27:35.770858+0000","last_active":"2023-11-04T15:36:54.716231+0000","last_peered":"2023-11-04T15:36:54.716231+0000","last_clean":"2023-11-04T15:36:54.716231+0000","last_became_active":"2023-11-04T15:27:35.769001+0000","last_became_peered":"2023-11-04T15:27:35.769001+0000","last_unstale":"2023-11-04T15:36:54.716231+0000","last_undegraded":"2023-11-04T15:36:54.716231+0000","last_fullsized":"2023-11-04T15:36:54.716231+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:01:29.923726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":656,"num_write_kb":15166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"43'3665","reported_seq":3079,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:58.541361+0000","last_change":"2023-11-04T15:36:55.783360+0000","last_active":"2023-11-04T15:36:58.541361+0000","last_peered":"2023-11-04T15:36:58.541361+0000","last_clean":"2023-11-04T15:36:58.541361+0000","last_became_active":"2023-11-04T15:27:36.147034+0000","last_became_peered":"2023-11-04T15:27:36.147034+0000","last_unstale":"2023-11-04T15:36:58.541361+0000","last_undegraded":"2023-11-04T15:36:58.541361+0000","last_fullsized":"2023-11-04T15:36:58.541361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3665,"log_dups_size":0,"ondisk_log_size":3665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:14:54.847413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.064750725999999995,"stat_sum":{"num_bytes":4196,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1197,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"1.0","version":"12'117","reported_seq":195,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.718305+0000","last_change":"2023-11-04T15:27:26.267129+0000","last_active":"2023-11-04T15:36:54.718305+0000","last_peered":"2023-11-04T15:36:54.718305+0000","last_clean":"2023-11-04T15:36:54.718305+0000","last_became_active":"2023-11-04T15:27:26.266242+0000","last_became_peered":"2023-11-04T15:27:26.266242+0000","last_unstale":"2023-11-04T15:36:54.718305+0000","last_undegraded":"2023-11-04T15:36:54.718305+0000","last_fullsized":"2023-11-04T15:36:54.718305+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:25.163848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:25.163848+0000","last_clean_scrub_stamp":"2023-11-04T15:27:25.163848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:54:55.231471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":42,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.718437+0000","last_change":"2023-11-04T15:27:31.620178+0000","last_active":"2023-11-04T15:36:54.718437+0000","last_peered":"2023-11-04T15:36:54.718437+0000","last_clean":"2023-11-04T15:36:54.718437+0000","last_became_active":"2023-11-04T15:27:31.619798+0000","last_became_peered":"2023-11-04T15:27:31.619798+0000","last_unstale":"2023-11-04T15:36:54.718437+0000","last_undegraded":"2023-11-04T15:36:54.718437+0000","last_fullsized":"2023-11-04T15:36:54.718437+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:50:31.717109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"39'3629","reported_seq":3668,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.716613+0000","last_change":"2023-11-04T15:27:35.769689+0000","last_active":"2023-11-04T15:36:54.716613+0000","last_peered":"2023-11-04T15:36:54.716613+0000","last_clean":"2023-11-04T15:36:54.716613+0000","last_became_active":"2023-11-04T15:27:35.769150+0000","last_became_peered":"2023-11-04T15:27:35.769150+0000","last_unstale":"2023-11-04T15:36:54.716613+0000","last_undegraded":"2023-11-04T15:36:54.716613+0000","last_fullsized":"2023-11-04T15:36:54.716613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3629,"log_dups_size":0,"ondisk_log_size":3629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:15:19.151223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3620,"num_write_kb":52059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"40'3668","reported_seq":3072,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.826646+0000","last_change":"2023-11-04T15:36:55.827884+0000","last_active":"2023-11-04T15:36:55.826646+0000","last_peered":"2023-11-04T15:36:55.826646+0000","last_clean":"2023-11-04T15:36:55.826646+0000","last_became_active":"2023-11-04T15:27:36.140619+0000","last_became_peered":"2023-11-04T15:27:36.140619+0000","last_unstale":"2023-11-04T15:36:55.826646+0000","last_undegraded":"2023-11-04T15:36:55.826646+0000","last_fullsized":"2023-11-04T15:36:55.826646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3668,"log_dups_size":0,"ondisk_log_size":3668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:42:12.902707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10532783499999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.718479+0000","last_change":"2023-11-04T15:27:31.622106+0000","last_active":"2023-11-04T15:36:54.718479+0000","last_peered":"2023-11-04T15:36:54.718479+0000","last_clean":"2023-11-04T15:36:54.718479+0000","last_became_active":"2023-11-04T15:27:31.621889+0000","last_became_peered":"2023-11-04T15:27:31.621889+0000","last_unstale":"2023-11-04T15:36:54.718479+0000","last_undegraded":"2023-11-04T15:36:54.718479+0000","last_fullsized":"2023-11-04T15:36:54.718479+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:11:00.327441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"43'3684","reported_seq":3889,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:58.873189+0000","last_change":"2023-11-04T15:27:35.771207+0000","last_active":"2023-11-04T15:36:58.873189+0000","last_peered":"2023-11-04T15:36:58.873189+0000","last_clean":"2023-11-04T15:36:58.873189+0000","last_became_active":"2023-11-04T15:27:35.770364+0000","last_became_peered":"2023-11-04T15:27:35.770364+0000","last_unstale":"2023-11-04T15:36:58.873189+0000","last_undegraded":"2023-11-04T15:36:58.873189+0000","last_fullsized":"2023-11-04T15:36:58.873189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3684,"log_dups_size":0,"ondisk_log_size":3684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:23:45.371175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15883313,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":166,"num_read_kb":3338,"num_write":3668,"num_write_kb":29714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"40'3551","reported_seq":2981,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.795654+0000","last_change":"2023-11-04T15:36:55.796697+0000","last_active":"2023-11-04T15:36:55.795654+0000","last_peered":"2023-11-04T15:36:55.795654+0000","last_clean":"2023-11-04T15:36:55.795654+0000","last_became_active":"2023-11-04T15:27:36.144459+0000","last_became_peered":"2023-11-04T15:27:36.144459+0000","last_unstale":"2023-11-04T15:36:55.795654+0000","last_undegraded":"2023-11-04T15:36:55.795654+0000","last_fullsized":"2023-11-04T15:36:55.795654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3551,"log_dups_size":0,"ondisk_log_size":3551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:28:45.715407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072685394,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.716248+0000","last_change":"2023-11-04T15:27:31.622710+0000","last_active":"2023-11-04T15:36:54.716248+0000","last_peered":"2023-11-04T15:36:54.716248+0000","last_clean":"2023-11-04T15:36:54.716248+0000","last_became_active":"2023-11-04T15:27:31.622378+0000","last_became_peered":"2023-11-04T15:27:31.622378+0000","last_unstale":"2023-11-04T15:36:54.716248+0000","last_undegraded":"2023-11-04T15:36:54.716248+0000","last_fullsized":"2023-11-04T15:36:54.716248+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:49:04.803105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"40'6079","reported_seq":6118,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.716977+0000","last_change":"2023-11-04T15:27:35.774630+0000","last_active":"2023-11-04T15:36:54.716977+0000","last_peered":"2023-11-04T15:36:54.716977+0000","last_clean":"2023-11-04T15:36:54.716977+0000","last_became_active":"2023-11-04T15:27:35.774339+0000","last_became_peered":"2023-11-04T15:27:35.774339+0000","last_unstale":"2023-11-04T15:36:54.716977+0000","last_undegraded":"2023-11-04T15:36:54.716977+0000","last_fullsized":"2023-11-04T15:36:54.716977+0000","mapping_epoch":16,"log_start":"26'400","ondisk_log_start":"26'400","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":5679,"log_dups_size":0,"ondisk_log_size":5679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:44:38.690122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6078,"num_write_kb":43849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"40'3172","reported_seq":2635,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.785037+0000","last_change":"2023-11-04T15:36:55.786394+0000","last_active":"2023-11-04T15:36:55.785037+0000","last_peered":"2023-11-04T15:36:55.785037+0000","last_clean":"2023-11-04T15:36:55.785037+0000","last_became_active":"2023-11-04T15:27:36.146930+0000","last_became_peered":"2023-11-04T15:27:36.146930+0000","last_unstale":"2023-11-04T15:36:55.785037+0000","last_undegraded":"2023-11-04T15:36:55.785037+0000","last_fullsized":"2023-11-04T15:36:55.785037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3172,"log_dups_size":0,"ondisk_log_size":3172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:28:45.715407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067233409999999993,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1111,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.717699+0000","last_change":"2023-11-04T15:27:31.622105+0000","last_active":"2023-11-04T15:36:54.717699+0000","last_peered":"2023-11-04T15:36:54.717699+0000","last_clean":"2023-11-04T15:36:54.717699+0000","last_became_active":"2023-11-04T15:27:31.621849+0000","last_became_peered":"2023-11-04T15:27:31.621849+0000","last_unstale":"2023-11-04T15:36:54.717699+0000","last_undegraded":"2023-11-04T15:36:54.717699+0000","last_fullsized":"2023-11-04T15:36:54.717699+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:20:41.777316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"40'3275","reported_seq":3314,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.716912+0000","last_change":"2023-11-04T15:27:35.770188+0000","last_active":"2023-11-04T15:36:54.716912+0000","last_peered":"2023-11-04T15:36:54.716912+0000","last_clean":"2023-11-04T15:36:54.716912+0000","last_became_active":"2023-11-04T15:27:35.769730+0000","last_became_peered":"2023-11-04T15:27:35.769730+0000","last_unstale":"2023-11-04T15:36:54.716912+0000","last_undegraded":"2023-11-04T15:36:54.716912+0000","last_fullsized":"2023-11-04T15:36:54.716912+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3275,"log_dups_size":0,"ondisk_log_size":3275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:08:22.991334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3258,"num_write_kb":30072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"40'3431","reported_seq":2846,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.784956+0000","last_change":"2023-11-04T15:36:55.786213+0000","last_active":"2023-11-04T15:36:55.784956+0000","last_peered":"2023-11-04T15:36:55.784956+0000","last_clean":"2023-11-04T15:36:55.784956+0000","last_became_active":"2023-11-04T15:27:36.144417+0000","last_became_peered":"2023-11-04T15:27:36.144417+0000","last_unstale":"2023-11-04T15:36:55.784956+0000","last_undegraded":"2023-11-04T15:36:55.784956+0000","last_fullsized":"2023-11-04T15:36:55.784956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3431,"log_dups_size":0,"ondisk_log_size":3431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:41:32.995261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067418286999999993,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.5","version":"37'3105","reported_seq":3144,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.717735+0000","last_change":"2023-11-04T15:27:35.770033+0000","last_active":"2023-11-04T15:36:54.717735+0000","last_peered":"2023-11-04T15:36:54.717735+0000","last_clean":"2023-11-04T15:36:54.717735+0000","last_became_active":"2023-11-04T15:27:35.769772+0000","last_became_peered":"2023-11-04T15:27:35.769772+0000","last_unstale":"2023-11-04T15:36:54.717735+0000","last_undegraded":"2023-11-04T15:36:54.717735+0000","last_fullsized":"2023-11-04T15:36:54.717735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3105,"log_dups_size":0,"ondisk_log_size":3105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:00:20.246822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3101,"num_write_kb":32806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.716947+0000","last_change":"2023-11-04T15:27:31.622663+0000","last_active":"2023-11-04T15:36:54.716947+0000","last_peered":"2023-11-04T15:36:54.716947+0000","last_clean":"2023-11-04T15:36:54.716947+0000","last_became_active":"2023-11-04T15:27:31.622350+0000","last_became_peered":"2023-11-04T15:27:31.622350+0000","last_unstale":"2023-11-04T15:36:54.716947+0000","last_undegraded":"2023-11-04T15:36:54.716947+0000","last_fullsized":"2023-11-04T15:36:54.716947+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:31:02.273249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"43'3419","reported_seq":2891,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:57.990406+0000","last_change":"2023-11-04T15:36:55.780107+0000","last_active":"2023-11-04T15:36:57.990406+0000","last_peered":"2023-11-04T15:36:57.990406+0000","last_clean":"2023-11-04T15:36:57.990406+0000","last_became_active":"2023-11-04T15:27:36.143991+0000","last_became_peered":"2023-11-04T15:27:36.143991+0000","last_unstale":"2023-11-04T15:36:57.990406+0000","last_undegraded":"2023-11-04T15:36:57.990406+0000","last_fullsized":"2023-11-04T15:36:57.990406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3419,"log_dups_size":0,"ondisk_log_size":3419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:48:58.102459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062728023999999993,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":1116,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.4","version":"40'4464","reported_seq":4503,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.716896+0000","last_change":"2023-11-04T15:27:35.769416+0000","last_active":"2023-11-04T15:36:54.716896+0000","last_peered":"2023-11-04T15:36:54.716896+0000","last_clean":"2023-11-04T15:36:54.716896+0000","last_became_active":"2023-11-04T15:27:35.769095+0000","last_became_peered":"2023-11-04T15:27:35.769095+0000","last_unstale":"2023-11-04T15:36:54.716896+0000","last_undegraded":"2023-11-04T15:36:54.716896+0000","last_fullsized":"2023-11-04T15:36:54.716896+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":4464,"log_dups_size":0,"ondisk_log_size":4464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T22:02:04.025848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4451,"num_write_kb":27035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.719534+0000","last_change":"2023-11-04T15:27:31.619973+0000","last_active":"2023-11-04T15:36:54.719534+0000","last_peered":"2023-11-04T15:36:54.719534+0000","last_clean":"2023-11-04T15:36:54.719534+0000","last_became_active":"2023-11-04T15:27:31.619702+0000","last_became_peered":"2023-11-04T15:27:31.619702+0000","last_unstale":"2023-11-04T15:36:54.719534+0000","last_undegraded":"2023-11-04T15:36:54.719534+0000","last_fullsized":"2023-11-04T15:36:54.719534+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:24:34.782619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"40'3558","reported_seq":2941,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.797743+0000","last_change":"2023-11-04T15:36:55.798708+0000","last_active":"2023-11-04T15:36:55.797743+0000","last_peered":"2023-11-04T15:36:55.797743+0000","last_clean":"2023-11-04T15:36:55.797743+0000","last_became_active":"2023-11-04T15:27:36.139707+0000","last_became_peered":"2023-11-04T15:27:36.139707+0000","last_unstale":"2023-11-04T15:36:55.797743+0000","last_undegraded":"2023-11-04T15:36:55.797743+0000","last_fullsized":"2023-11-04T15:36:55.797743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3558,"log_dups_size":0,"ondisk_log_size":3558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:58:32.190696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.073815121999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.7","version":"37'1214","reported_seq":1253,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.717366+0000","last_change":"2023-11-04T15:27:35.768818+0000","last_active":"2023-11-04T15:36:54.717366+0000","last_peered":"2023-11-04T15:36:54.717366+0000","last_clean":"2023-11-04T15:36:54.717366+0000","last_became_active":"2023-11-04T15:27:35.768320+0000","last_became_peered":"2023-11-04T15:27:35.768320+0000","last_unstale":"2023-11-04T15:36:54.717366+0000","last_undegraded":"2023-11-04T15:36:54.717366+0000","last_fullsized":"2023-11-04T15:36:54.717366+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1214,"log_dups_size":0,"ondisk_log_size":1214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:14:58.601545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1211,"num_write_kb":18003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.716888+0000","last_change":"2023-11-04T15:27:31.624625+0000","last_active":"2023-11-04T15:36:54.716888+0000","last_peered":"2023-11-04T15:36:54.716888+0000","last_clean":"2023-11-04T15:36:54.716888+0000","last_became_active":"2023-11-04T15:27:31.624347+0000","last_became_peered":"2023-11-04T15:27:31.624347+0000","last_unstale":"2023-11-04T15:36:54.716888+0000","last_undegraded":"2023-11-04T15:36:54.716888+0000","last_fullsized":"2023-11-04T15:36:54.716888+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:53:45.131692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"40'3608","reported_seq":3010,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.791046+0000","last_change":"2023-11-04T15:36:55.791977+0000","last_active":"2023-11-04T15:36:55.791046+0000","last_peered":"2023-11-04T15:36:55.791046+0000","last_clean":"2023-11-04T15:36:55.791046+0000","last_became_active":"2023-11-04T15:27:36.137897+0000","last_became_peered":"2023-11-04T15:27:36.137897+0000","last_unstale":"2023-11-04T15:36:55.791046+0000","last_undegraded":"2023-11-04T15:36:55.791046+0000","last_fullsized":"2023-11-04T15:36:55.791046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3608,"log_dups_size":0,"ondisk_log_size":3608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:53:25.907251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.069534850999999995,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.6","version":"43'827","reported_seq":866,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.725882+0000","last_change":"2023-11-04T15:27:35.772416+0000","last_active":"2023-11-04T15:36:55.725882+0000","last_peered":"2023-11-04T15:36:55.725882+0000","last_clean":"2023-11-04T15:36:55.725882+0000","last_became_active":"2023-11-04T15:27:35.772121+0000","last_became_peered":"2023-11-04T15:27:35.772121+0000","last_unstale":"2023-11-04T15:36:55.725882+0000","last_undegraded":"2023-11-04T15:36:55.725882+0000","last_fullsized":"2023-11-04T15:36:55.725882+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:58:09.475936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":956,"num_write_kb":25975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.719152+0000","last_change":"2023-11-04T15:27:31.620235+0000","last_active":"2023-11-04T15:36:54.719152+0000","last_peered":"2023-11-04T15:36:54.719152+0000","last_clean":"2023-11-04T15:36:54.719152+0000","last_became_active":"2023-11-04T15:27:31.619831+0000","last_became_peered":"2023-11-04T15:27:31.619831+0000","last_unstale":"2023-11-04T15:36:54.719152+0000","last_undegraded":"2023-11-04T15:36:54.719152+0000","last_fullsized":"2023-11-04T15:36:54.719152+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:44:07.412379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"40'3480","reported_seq":2921,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.779195+0000","last_change":"2023-11-04T15:36:55.780069+0000","last_active":"2023-11-04T15:36:55.779195+0000","last_peered":"2023-11-04T15:36:55.779195+0000","last_clean":"2023-11-04T15:36:55.779195+0000","last_became_active":"2023-11-04T15:27:36.140871+0000","last_became_peered":"2023-11-04T15:27:36.140871+0000","last_unstale":"2023-11-04T15:36:55.779195+0000","last_undegraded":"2023-11-04T15:36:55.779195+0000","last_fullsized":"2023-11-04T15:36:55.779195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3480,"log_dups_size":0,"ondisk_log_size":3480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:28.095802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058381362999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.13","version":"40'3644","reported_seq":3045,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.777837+0000","last_change":"2023-11-04T15:36:55.777837+0000","last_active":"2023-11-04T15:36:55.777837+0000","last_peered":"2023-11-04T15:36:55.777837+0000","last_clean":"2023-11-04T15:36:55.777837+0000","last_became_active":"2023-11-04T15:27:36.139487+0000","last_became_peered":"2023-11-04T15:27:36.139487+0000","last_unstale":"2023-11-04T15:36:55.777837+0000","last_undegraded":"2023-11-04T15:36:55.777837+0000","last_fullsized":"2023-11-04T15:36:55.777837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3644,"log_dups_size":0,"ondisk_log_size":3644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:47:58.380308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056621590999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.14","version":"41'2770","reported_seq":2809,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.184520+0000","last_change":"2023-11-04T15:27:35.775665+0000","last_active":"2023-11-04T15:36:55.184520+0000","last_peered":"2023-11-04T15:36:55.184520+0000","last_clean":"2023-11-04T15:36:55.184520+0000","last_became_active":"2023-11-04T15:27:35.775356+0000","last_became_peered":"2023-11-04T15:27:35.775356+0000","last_unstale":"2023-11-04T15:36:55.184520+0000","last_undegraded":"2023-11-04T15:36:55.184520+0000","last_fullsized":"2023-11-04T15:36:55.184520+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2770,"log_dups_size":0,"ondisk_log_size":2770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:36:12.941030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2769,"num_write_kb":31341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"40'3525","reported_seq":2930,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.781878+0000","last_change":"2023-11-04T15:36:55.781878+0000","last_active":"2023-11-04T15:36:55.781878+0000","last_peered":"2023-11-04T15:36:55.781878+0000","last_clean":"2023-11-04T15:36:55.781878+0000","last_became_active":"2023-11-04T15:27:36.146464+0000","last_became_peered":"2023-11-04T15:27:36.146464+0000","last_unstale":"2023-11-04T15:36:55.781878+0000","last_undegraded":"2023-11-04T15:36:55.781878+0000","last_fullsized":"2023-11-04T15:36:55.781878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3525,"log_dups_size":0,"ondisk_log_size":3525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:47:40.350777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.064516859999999995,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.15","version":"43'3742","reported_seq":3780,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.718800+0000","last_change":"2023-11-04T15:27:35.770401+0000","last_active":"2023-11-04T15:36:55.718800+0000","last_peered":"2023-11-04T15:36:55.718800+0000","last_clean":"2023-11-04T15:36:55.718800+0000","last_became_active":"2023-11-04T15:27:35.769904+0000","last_became_peered":"2023-11-04T15:27:35.769904+0000","last_unstale":"2023-11-04T15:36:55.718800+0000","last_undegraded":"2023-11-04T15:36:55.718800+0000","last_fullsized":"2023-11-04T15:36:55.718800+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3742,"log_dups_size":0,"ondisk_log_size":3742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:58:09.475936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3740,"num_write_kb":21755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"40'3554","reported_seq":3592,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.718496+0000","last_change":"2023-11-04T15:27:35.768689+0000","last_active":"2023-11-04T15:36:54.718496+0000","last_peered":"2023-11-04T15:36:54.718496+0000","last_clean":"2023-11-04T15:36:54.718496+0000","last_became_active":"2023-11-04T15:27:35.768413+0000","last_became_peered":"2023-11-04T15:27:35.768413+0000","last_unstale":"2023-11-04T15:36:54.718496+0000","last_undegraded":"2023-11-04T15:36:54.718496+0000","last_fullsized":"2023-11-04T15:36:54.718496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3554,"log_dups_size":0,"ondisk_log_size":3554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:23:45.371175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3537,"num_write_kb":29647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"40'3937","reported_seq":3318,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.790992+0000","last_change":"2023-11-04T15:36:55.790992+0000","last_active":"2023-11-04T15:36:55.790992+0000","last_peered":"2023-11-04T15:36:55.790992+0000","last_clean":"2023-11-04T15:36:55.790992+0000","last_became_active":"2023-11-04T15:27:36.139524+0000","last_became_peered":"2023-11-04T15:27:36.139524+0000","last_unstale":"2023-11-04T15:36:55.790992+0000","last_undegraded":"2023-11-04T15:36:55.790992+0000","last_fullsized":"2023-11-04T15:36:55.790992+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3937,"log_dups_size":0,"ondisk_log_size":3937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:27:25.258046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.068494678000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1248,"num_write_kb":670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.17","version":"37'1637","reported_seq":1675,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.782076+0000","last_change":"2023-11-04T15:27:35.776242+0000","last_active":"2023-11-04T15:36:54.782076+0000","last_peered":"2023-11-04T15:36:54.782076+0000","last_clean":"2023-11-04T15:36:54.782076+0000","last_became_active":"2023-11-04T15:27:35.775917+0000","last_became_peered":"2023-11-04T15:27:35.775917+0000","last_unstale":"2023-11-04T15:36:54.782076+0000","last_undegraded":"2023-11-04T15:36:54.782076+0000","last_fullsized":"2023-11-04T15:36:54.782076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1637,"log_dups_size":0,"ondisk_log_size":1637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:14:58.601545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1634,"num_write_kb":25426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"40'3472","reported_seq":2891,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.779428+0000","last_change":"2023-11-04T15:36:55.779428+0000","last_active":"2023-11-04T15:36:55.779428+0000","last_peered":"2023-11-04T15:36:55.779428+0000","last_clean":"2023-11-04T15:36:55.779428+0000","last_became_active":"2023-11-04T15:27:36.150557+0000","last_became_peered":"2023-11-04T15:27:36.150557+0000","last_unstale":"2023-11-04T15:36:55.779428+0000","last_undegraded":"2023-11-04T15:36:55.779428+0000","last_fullsized":"2023-11-04T15:36:55.779428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3472,"log_dups_size":0,"ondisk_log_size":3472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:12:07.727740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062631718000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.1f","version":"40'3228","reported_seq":2708,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.824445+0000","last_change":"2023-11-04T15:36:55.826604+0000","last_active":"2023-11-04T15:36:55.824445+0000","last_peered":"2023-11-04T15:36:55.824445+0000","last_clean":"2023-11-04T15:36:55.824445+0000","last_became_active":"2023-11-04T15:27:36.149831+0000","last_became_peered":"2023-11-04T15:27:36.149831+0000","last_unstale":"2023-11-04T15:36:55.824445+0000","last_undegraded":"2023-11-04T15:36:55.824445+0000","last_fullsized":"2023-11-04T15:36:55.824445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3228,"log_dups_size":0,"ondisk_log_size":3228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:16:09.862958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.103639325,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1060,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.18","version":"43'4769","reported_seq":4807,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:58.591433+0000","last_change":"2023-11-04T15:27:35.770634+0000","last_active":"2023-11-04T15:36:58.591433+0000","last_peered":"2023-11-04T15:36:58.591433+0000","last_clean":"2023-11-04T15:36:58.591433+0000","last_became_active":"2023-11-04T15:27:35.770022+0000","last_became_peered":"2023-11-04T15:27:35.770022+0000","last_unstale":"2023-11-04T15:36:58.591433+0000","last_undegraded":"2023-11-04T15:36:58.591433+0000","last_fullsized":"2023-11-04T15:36:58.591433+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":4769,"log_dups_size":0,"ondisk_log_size":4769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:03:49.354013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28893509,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4768,"num_write_kb":50662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"43'3333","reported_seq":2774,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:58.141007+0000","last_change":"2023-11-04T15:36:55.797686+0000","last_active":"2023-11-04T15:36:58.141007+0000","last_peered":"2023-11-04T15:36:58.141007+0000","last_clean":"2023-11-04T15:36:58.141007+0000","last_became_active":"2023-11-04T15:27:36.138908+0000","last_became_peered":"2023-11-04T15:27:36.138908+0000","last_unstale":"2023-11-04T15:36:58.141007+0000","last_undegraded":"2023-11-04T15:36:58.141007+0000","last_fullsized":"2023-11-04T15:36:58.141007+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3333,"log_dups_size":0,"ondisk_log_size":3333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:32:27.370984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.073000567000000002,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":1157,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.19","version":"31'780","reported_seq":818,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.715533+0000","last_change":"2023-11-04T15:27:35.768190+0000","last_active":"2023-11-04T15:36:54.715533+0000","last_peered":"2023-11-04T15:36:54.715533+0000","last_clean":"2023-11-04T15:36:54.715533+0000","last_became_active":"2023-11-04T15:27:35.767858+0000","last_became_peered":"2023-11-04T15:27:35.767858+0000","last_unstale":"2023-11-04T15:36:54.715533+0000","last_undegraded":"2023-11-04T15:36:54.715533+0000","last_fullsized":"2023-11-04T15:36:54.715533+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:55:22.956180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":779,"num_write_kb":20966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"40'3359","reported_seq":2780,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.794676+0000","last_change":"2023-11-04T15:36:55.795596+0000","last_active":"2023-11-04T15:36:55.794676+0000","last_peered":"2023-11-04T15:36:55.794676+0000","last_clean":"2023-11-04T15:36:55.794676+0000","last_became_active":"2023-11-04T15:27:36.143442+0000","last_became_peered":"2023-11-04T15:27:36.143442+0000","last_unstale":"2023-11-04T15:36:55.794676+0000","last_undegraded":"2023-11-04T15:36:55.794676+0000","last_fullsized":"2023-11-04T15:36:55.794676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3359,"log_dups_size":0,"ondisk_log_size":3359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:45:22.367523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072078296,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1167,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1a","version":"37'3778","reported_seq":3816,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.717883+0000","last_change":"2023-11-04T15:27:35.771653+0000","last_active":"2023-11-04T15:36:54.717883+0000","last_peered":"2023-11-04T15:36:54.717883+0000","last_clean":"2023-11-04T15:36:54.717883+0000","last_became_active":"2023-11-04T15:27:35.770539+0000","last_became_peered":"2023-11-04T15:27:35.770539+0000","last_unstale":"2023-11-04T15:36:54.717883+0000","last_undegraded":"2023-11-04T15:36:54.717883+0000","last_fullsized":"2023-11-04T15:36:54.717883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3778,"log_dups_size":0,"ondisk_log_size":3778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:14:58.601545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3770,"num_write_kb":38321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"40'3791","reported_seq":3143,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.779484+0000","last_change":"2023-11-04T15:36:55.780664+0000","last_active":"2023-11-04T15:36:55.779484+0000","last_peered":"2023-11-04T15:36:55.779484+0000","last_clean":"2023-11-04T15:36:55.779484+0000","last_became_active":"2023-11-04T15:27:36.146477+0000","last_became_peered":"2023-11-04T15:27:36.146477+0000","last_unstale":"2023-11-04T15:36:55.779484+0000","last_undegraded":"2023-11-04T15:36:55.779484+0000","last_fullsized":"2023-11-04T15:36:55.779484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3791,"log_dups_size":0,"ondisk_log_size":3791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:53:25.907251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063144525000000007,"stat_sum":{"num_bytes":8192,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1270,"num_write_kb":694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1b","version":"40'2943","reported_seq":2981,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.781525+0000","last_change":"2023-11-04T15:27:35.772092+0000","last_active":"2023-11-04T15:36:54.781525+0000","last_peered":"2023-11-04T15:36:54.781525+0000","last_clean":"2023-11-04T15:36:54.781525+0000","last_became_active":"2023-11-04T15:27:35.771316+0000","last_became_peered":"2023-11-04T15:27:35.771316+0000","last_unstale":"2023-11-04T15:36:54.781525+0000","last_undegraded":"2023-11-04T15:36:54.781525+0000","last_fullsized":"2023-11-04T15:36:54.781525+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2943,"log_dups_size":0,"ondisk_log_size":2943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:00:20.246822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2943,"num_write_kb":28401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"40'3595","reported_seq":3002,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.777689+0000","last_change":"2023-11-04T15:36:55.778980+0000","last_active":"2023-11-04T15:36:55.777689+0000","last_peered":"2023-11-04T15:36:55.777689+0000","last_clean":"2023-11-04T15:36:55.777689+0000","last_became_active":"2023-11-04T15:27:36.144066+0000","last_became_peered":"2023-11-04T15:27:36.144066+0000","last_unstale":"2023-11-04T15:36:55.777689+0000","last_undegraded":"2023-11-04T15:36:55.777689+0000","last_fullsized":"2023-11-04T15:36:55.777689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3595,"log_dups_size":0,"ondisk_log_size":3595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:41:32.995261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057889772999999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1118,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1c","version":"41'926","reported_seq":964,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.717175+0000","last_change":"2023-11-04T15:27:35.768679+0000","last_active":"2023-11-04T15:36:54.717175+0000","last_peered":"2023-11-04T15:36:54.717175+0000","last_clean":"2023-11-04T15:36:54.717175+0000","last_became_active":"2023-11-04T15:27:35.767852+0000","last_became_peered":"2023-11-04T15:27:35.767852+0000","last_unstale":"2023-11-04T15:36:54.717175+0000","last_undegraded":"2023-11-04T15:36:54.717175+0000","last_fullsized":"2023-11-04T15:36:54.717175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":926,"log_dups_size":0,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:47:47.130490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":923,"num_write_kb":21087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"40'3552","reported_seq":2970,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.775568+0000","last_change":"2023-11-04T15:36:55.776553+0000","last_active":"2023-11-04T15:36:55.775568+0000","last_peered":"2023-11-04T15:36:55.775568+0000","last_clean":"2023-11-04T15:36:55.775568+0000","last_became_active":"2023-11-04T15:27:36.141167+0000","last_became_peered":"2023-11-04T15:27:36.141167+0000","last_unstale":"2023-11-04T15:36:55.775568+0000","last_undegraded":"2023-11-04T15:36:55.775568+0000","last_fullsized":"2023-11-04T15:36:55.775568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3552,"log_dups_size":0,"ondisk_log_size":3552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:22:21.262360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057363947999999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1127,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1d","version":"37'3225","reported_seq":3263,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.719175+0000","last_change":"2023-11-04T15:27:35.775629+0000","last_active":"2023-11-04T15:36:54.719175+0000","last_peered":"2023-11-04T15:36:54.719175+0000","last_clean":"2023-11-04T15:36:54.719175+0000","last_became_active":"2023-11-04T15:27:35.775171+0000","last_became_peered":"2023-11-04T15:27:35.775171+0000","last_unstale":"2023-11-04T15:36:54.719175+0000","last_undegraded":"2023-11-04T15:36:54.719175+0000","last_fullsized":"2023-11-04T15:36:54.719175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3225,"log_dups_size":0,"ondisk_log_size":3225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:13:42.865721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3214,"num_write_kb":42509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"43'3487","reported_seq":2929,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:58.220450+0000","last_change":"2023-11-04T15:36:55.792895+0000","last_active":"2023-11-04T15:36:58.220450+0000","last_peered":"2023-11-04T15:36:58.220450+0000","last_clean":"2023-11-04T15:36:58.220450+0000","last_became_active":"2023-11-04T15:27:36.145560+0000","last_became_peered":"2023-11-04T15:27:36.145560+0000","last_unstale":"2023-11-04T15:36:58.220450+0000","last_undegraded":"2023-11-04T15:36:58.220450+0000","last_fullsized":"2023-11-04T15:36:58.220450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3487,"log_dups_size":0,"ondisk_log_size":3487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:14:54.847413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.07011676,"stat_sum":{"num_bytes":4151,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":1159,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1e","version":"40'4214","reported_seq":4253,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.781727+0000","last_change":"2023-11-04T15:27:35.771225+0000","last_active":"2023-11-04T15:36:54.781727+0000","last_peered":"2023-11-04T15:36:54.781727+0000","last_clean":"2023-11-04T15:36:54.781727+0000","last_became_active":"2023-11-04T15:27:35.770873+0000","last_became_peered":"2023-11-04T15:27:35.770873+0000","last_unstale":"2023-11-04T15:36:54.781727+0000","last_undegraded":"2023-11-04T15:36:54.781727+0000","last_fullsized":"2023-11-04T15:36:54.781727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":4214,"log_dups_size":0,"ondisk_log_size":4214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:02:11.972760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4214,"num_write_kb":32525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"40'4090","reported_seq":3390,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.774510+0000","last_change":"2023-11-04T15:36:55.775512+0000","last_active":"2023-11-04T15:36:55.774510+0000","last_peered":"2023-11-04T15:36:55.774510+0000","last_clean":"2023-11-04T15:36:55.774510+0000","last_became_active":"2023-11-04T15:27:36.147535+0000","last_became_peered":"2023-11-04T15:27:36.147535+0000","last_unstale":"2023-11-04T15:36:55.774510+0000","last_undegraded":"2023-11-04T15:36:55.774510+0000","last_fullsized":"2023-11-04T15:36:55.774510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":4090,"log_dups_size":0,"ondisk_log_size":4090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:48:58.102459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055801837,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1294,"num_write_kb":719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1f","version":"40'1589","reported_seq":1628,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.781927+0000","last_change":"2023-11-04T15:27:35.776315+0000","last_active":"2023-11-04T15:36:54.781927+0000","last_peered":"2023-11-04T15:36:54.781927+0000","last_clean":"2023-11-04T15:36:54.781927+0000","last_became_active":"2023-11-04T15:27:35.775918+0000","last_became_peered":"2023-11-04T15:27:35.775918+0000","last_unstale":"2023-11-04T15:36:54.781927+0000","last_undegraded":"2023-11-04T15:36:54.781927+0000","last_fullsized":"2023-11-04T15:36:54.781927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1589,"log_dups_size":0,"ondisk_log_size":1589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:08:22.991334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1587,"num_write_kb":12658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":127433,"num_objects":92,"num_object_clones":25,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":8,"num_read":46,"num_read_kb":30,"num_write":74822,"num_write_kb":40603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":254672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224295,"ondisk_log_size":224295,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":430654260,"num_objects":126,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":126,"num_whiteouts":0,"num_read":190,"num_read_kb":3338,"num_write":83447,"num_write_kb":897460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":861372416,"data_stored":861308520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83070,"ondisk_log_size":83070,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705783,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":659540,"kb_used_data":173196,"kb_used_omap":0,"kb_used_meta":486336,"kb_avail":93712300,"statfs":{"total":96636764160,"available":95961395200,"internally_reserved":0,"allocated":177352704,"data_stored":176994799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":498008064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.435,"15min":0.40000000000000002},"min":{"1min":0.23000000000000001,"5min":0.17000000000000001,"15min":0.156},"max":{"1min":10.488,"5min":10.488,"15min":10.488},"last":0.442},{"interface":"front","average":{"1min":1.0509999999999999,"5min":0.58399999999999996,"15min":0.45500000000000002},"min":{"1min":0.21199999999999999,"5min":0.186,"15min":0.186},"max":{"1min":11.621,"5min":13.055,"15min":13.055},"last":0.53000000000000003}]},{"osd":1,"last update":"Sat Nov 4 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.496,"15min":0.433},"min":{"1min":0.219,"5min":0.188,"15min":0.188},"max":{"1min":12.347,"5min":12.347,"15min":12.347},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.48999999999999999,"15min":0.438},"min":{"1min":0.23699999999999999,"5min":0.21299999999999999,"15min":0.186},"max":{"1min":12.853999999999999,"5min":12.853999999999999,"15min":12.853999999999999},"last":0.51800000000000002}]},{"osd":2,"last update":"Sat Nov 4 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.41299999999999998,"15min":0.34499999999999997},"min":{"1min":0.16900000000000001,"5min":0.153,"15min":0.153},"max":{"1min":11.709,"5min":11.709,"15min":11.709},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.40300000000000002,"15min":0.35599999999999998},"min":{"1min":0.19500000000000001,"5min":0.14899999999999999,"15min":0.14899999999999999},"max":{"1min":9.2629999999999999,"5min":9.2629999999999999,"15min":9.2629999999999999},"last":0.32000000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705782,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":952412,"kb_used_data":245460,"kb_used_omap":0,"kb_used_meta":706944,"kb_avail":93419428,"statfs":{"total":96636764160,"available":95661494272,"internally_reserved":0,"allocated":251351040,"data_stored":250986928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":723910656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 15:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.41199999999999998,"15min":0.40100000000000002},"min":{"1min":0.20499999999999999,"5min":0.153,"15min":0.151},"max":{"1min":0.52900000000000003,"5min":14.584,"15min":14.584},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.35799999999999998,"15min":0.376},"min":{"1min":0.22,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.45600000000000002,"5min":7.2670000000000003,"15min":7.2670000000000003},"last":0.46800000000000003}]},{"osd":1,"last update":"Sat Nov 4 15:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32700000000000001,"15min":0.39000000000000001},"min":{"1min":0.23499999999999999,"5min":0.185,"15min":0.17100000000000001},"max":{"1min":0.48399999999999999,"5min":0.877,"15min":1.266},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.34699999999999998,"15min":0.40899999999999997},"min":{"1min":0.27500000000000002,"5min":0.20899999999999999,"15min":0.20399999999999999},"max":{"1min":0.54100000000000004,"5min":0.88600000000000001,"15min":1.2829999999999999},"last":0.55800000000000005}]},{"osd":3,"last update":"Sat Nov 4 15:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.28000000000000003,"15min":0.314},"min":{"1min":0.23699999999999999,"5min":0.14999999999999999,"15min":0.14699999999999999},"max":{"1min":0.41399999999999998,"5min":1.653,"15min":1.653},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.30599999999999999,"15min":0.34000000000000002},"min":{"1min":0.23000000000000001,"5min":0.159,"15min":0.14899999999999999},"max":{"1min":0.501,"5min":0.52400000000000002,"15min":1.304},"last":0.26700000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705781,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":715088,"kb_used_data":188552,"kb_used_omap":0,"kb_used_meta":526528,"kb_avail":93656752,"statfs":{"total":96636764160,"available":95904514048,"internally_reserved":0,"allocated":193077248,"data_stored":192721880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":539164672},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.40699999999999997,"15min":0.318},"min":{"1min":0.17100000000000001,"5min":0.14399999999999999,"15min":0.14399999999999999},"max":{"1min":1.012,"5min":12.768000000000001,"15min":12.768000000000001},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.248,"5min":0.30399999999999999,"15min":0.29499999999999998},"min":{"1min":0.19,"5min":0.14399999999999999,"15min":0.14399999999999999},"max":{"1min":0.377,"5min":8.609,"15min":8.609},"last":0.252}]},{"osd":2,"last update":"Sat Nov 4 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.40400000000000003,"15min":0.44},"min":{"1min":0.28499999999999998,"5min":0.19600000000000001,"15min":0.189},"max":{"1min":1.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.39000000000000001,"15min":0.42399999999999999},"min":{"1min":0.29599999999999999,"5min":0.19600000000000001,"15min":0.192},"max":{"1min":0.98199999999999998,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.41699999999999998}]},{"osd":3,"last update":"Sat Nov 4 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.42099999999999999,"15min":0.438},"min":{"1min":0.309,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.65200000000000002,"5min":6.7679999999999998,"15min":6.7679999999999998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.41999999999999998,"15min":0.45000000000000001},"min":{"1min":0.32100000000000001,"5min":0.249,"15min":0.24299999999999999},"max":{"1min":1.446,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.54300000000000004}]}]},{"osd":0,"up_from":9,"seq":38654705782,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":918120,"kb_used_data":237408,"kb_used_omap":0,"kb_used_meta":680704,"kb_avail":93453720,"statfs":{"total":96636764160,"available":95696609280,"internally_reserved":0,"allocated":243105792,"data_stored":242746625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":697040896},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 15:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.312,"15min":0.27900000000000003},"min":{"1min":0.14999999999999999,"5min":0.14399999999999999,"15min":0.13500000000000001},"max":{"1min":4.4059999999999997,"5min":6.4340000000000002,"15min":6.4340000000000002},"last":0.187},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.28000000000000003,"15min":0.27500000000000002},"min":{"1min":0.17299999999999999,"5min":0.155,"15min":0.155},"max":{"1min":1.1299999999999999,"5min":4.1200000000000001,"15min":4.1200000000000001},"last":0.20999999999999999}]},{"osd":2,"last update":"Sat Nov 4 15:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.40400000000000003,"15min":0.42599999999999999},"min":{"1min":0.251,"5min":0.17999999999999999,"15min":0.17599999999999999},"max":{"1min":2.5129999999999999,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.252},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.371,"15min":0.41899999999999998},"min":{"1min":0.28000000000000003,"5min":0.187,"15min":0.187},"max":{"1min":1.157,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.26600000000000001}]},{"osd":3,"last update":"Sat Nov 4 15:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.438,"15min":0.443},"min":{"1min":0.23899999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":2.6520000000000001,"5min":6.4660000000000002,"15min":6.4660000000000002},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.44600000000000001,"15min":0.44800000000000001},"min":{"1min":0.26800000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":2.621,"5min":6.3540000000000001,"15min":6.3540000000000001},"last":0.30599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":241926144,"data_stored":241909852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":192475136,"data_stored":192471365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":250785792,"data_stored":250765155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":176185344,"data_stored":176162148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":69829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":73939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":45197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":65707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T15:37:04.052 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-04T15:37:04.053 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T15:37:04.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.188+0000 7f877538b640 1 Processor -- start 2023-11-04T15:37:04.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.188+0000 7f877538b640 1 -- start start 2023-11-04T15:37:04.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.189+0000 7f877538b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8770135420 0x7f8770135800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:04.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.189+0000 7f877538b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f87700705e0 0x7f8770138150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:04.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.189+0000 7f877538b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8770138690 0x7f8770138b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:04.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.189+0000 7f877538b640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87700a1060 con 0x7f8770135420 2023-11-04T15:37:04.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.189+0000 7f877538b640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87700716d0 con 0x7f87700705e0 2023-11-04T15:37:04.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.189+0000 7f877538b640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877006f860 con 0x7f8770138690 2023-11-04T15:37:04.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.189+0000 7f876effd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8770135420 0x7f8770135800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:04.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.189+0000 7f876effd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8770135420 0x7f8770135800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60464/0 (socket says 172.21.15.19:60464) 2023-11-04T15:37:04.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.189+0000 7f876effd640 1 -- 172.21.15.19:0/4135361867 learned_addr learned my addr 172.21.15.19:0/4135361867 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:37:04.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.189+0000 7f876e7fc640 1 --2- 172.21.15.19:0/4135361867 >> v2:172.21.15.96:3300/0 conn(0x7f87700705e0 0x7f8770138150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:04.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.189+0000 7f876f7fe640 1 --2- 172.21.15.19:0/4135361867 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8770138690 0x7f8770138b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:04.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.189+0000 7f876effd640 1 -- 172.21.15.19:0/4135361867 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8770138690 msgr2=0x7f8770138b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:04.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.189+0000 7f876effd640 1 --2- 172.21.15.19:0/4135361867 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8770138690 0x7f8770138b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:04.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.189+0000 7f876effd640 1 -- 172.21.15.19:0/4135361867 >> v2:172.21.15.96:3300/0 conn(0x7f87700705e0 msgr2=0x7f8770138150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:04.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.189+0000 7f876effd640 1 --2- 172.21.15.19:0/4135361867 >> v2:172.21.15.96:3300/0 conn(0x7f87700705e0 0x7f8770138150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:04.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.189+0000 7f876effd640 1 -- 172.21.15.19:0/4135361867 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8770135200 con 0x7f8770135420 2023-11-04T15:37:04.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.189+0000 7f876f7fe640 1 --2- 172.21.15.19:0/4135361867 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8770138690 0x7f8770138b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:37:04.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.190+0000 7f876effd640 1 --2- 172.21.15.19:0/4135361867 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8770135420 0x7f8770135800 secure :-1 s=READY pgs=3745 cs=0 l=1 rev1=1 crypto rx=0x7f877006d060 tx=0x7f876002bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb85f56241a662 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:04.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.190+0000 7f876dffb640 1 -- 172.21.15.19:0/4135361867 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876002c950 con 0x7f8770135420 2023-11-04T15:37:04.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.190+0000 7f876dffb640 1 -- 172.21.15.19:0/4135361867 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f876002cab0 con 0x7f8770135420 2023-11-04T15:37:04.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.190+0000 7f876dffb640 1 -- 172.21.15.19:0/4135361867 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876002ce40 con 0x7f8770135420 2023-11-04T15:37:04.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.191+0000 7f877538b640 1 -- 172.21.15.19:0/4135361867 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8770135420 msgr2=0x7f8770135800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:04.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.191+0000 7f877538b640 1 --2- 172.21.15.19:0/4135361867 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8770135420 0x7f8770135800 secure :-1 s=READY pgs=3745 cs=0 l=1 rev1=1 crypto rx=0x7f877006d060 tx=0x7f876002bdb0 comp rx=0 tx=0).stop 2023-11-04T15:37:04.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.191+0000 7f877538b640 1 -- 172.21.15.19:0/4135361867 shutdown_connections 2023-11-04T15:37:04.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.191+0000 7f877538b640 1 --2- 172.21.15.19:0/4135361867 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8770138690 0x7f8770138b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:04.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.191+0000 7f877538b640 1 --2- 172.21.15.19:0/4135361867 >> v2:172.21.15.96:3300/0 conn(0x7f87700705e0 0x7f8770138150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:04.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.191+0000 7f877538b640 1 --2- 172.21.15.19:0/4135361867 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8770135420 0x7f8770135800 unknown :-1 s=CLOSED pgs=3745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:04.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.191+0000 7f877538b640 1 -- 172.21.15.19:0/4135361867 >> 172.21.15.19:0/4135361867 conn(0x7f87700aa590 msgr2=0x7f87700aa9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:04.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.191+0000 7f877538b640 1 -- 172.21.15.19:0/4135361867 shutdown_connections 2023-11-04T15:37:04.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.191+0000 7f877538b640 1 -- 172.21.15.19:0/4135361867 wait complete. 2023-11-04T15:37:04.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.192+0000 7f877538b640 1 Processor -- start 2023-11-04T15:37:04.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.192+0000 7f877538b640 1 -- start start 2023-11-04T15:37:04.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.192+0000 7f877538b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87700705e0 0x7f87701ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:04.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.193+0000 7f877538b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8770135420 0x7f87701cd020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:04.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.193+0000 7f877538b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8770138690 0x7f87701cd560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:04.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.193+0000 7f877538b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877009ea10 con 0x7f87700705e0 2023-11-04T15:37:04.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.193+0000 7f877538b640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877009e7e0 con 0x7f8770138690 2023-11-04T15:37:04.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.193+0000 7f877538b640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877009e070 con 0x7f8770135420 2023-11-04T15:37:04.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.193+0000 7f876effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87700705e0 0x7f87701ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:04.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.193+0000 7f876effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87700705e0 0x7f87701ccae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60476/0 (socket says 172.21.15.19:60476) 2023-11-04T15:37:04.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.193+0000 7f876effd640 1 -- 172.21.15.19:0/1804584804 learned_addr learned my addr 172.21.15.19:0/1804584804 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:37:04.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.193+0000 7f876e7fc640 1 --2- 172.21.15.19:0/1804584804 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8770135420 0x7f87701cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:04.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.193+0000 7f876f7fe640 1 --2- 172.21.15.19:0/1804584804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8770138690 0x7f87701cd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:04.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.193+0000 7f876effd640 1 -- 172.21.15.19:0/1804584804 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8770135420 msgr2=0x7f87701cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:04.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.193+0000 7f876effd640 1 --2- 172.21.15.19:0/1804584804 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8770135420 0x7f87701cd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:04.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.193+0000 7f876effd640 1 -- 172.21.15.19:0/1804584804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8770138690 msgr2=0x7f87701cd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:04.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.193+0000 7f876effd640 1 --2- 172.21.15.19:0/1804584804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8770138690 0x7f87701cd560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:04.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.193+0000 7f876effd640 1 -- 172.21.15.19:0/1804584804 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8760009b30 con 0x7f87700705e0 2023-11-04T15:37:04.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.193+0000 7f876effd640 1 --2- 172.21.15.19:0/1804584804 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87700705e0 0x7f87701ccae0 secure :-1 s=READY pgs=3746 cs=0 l=1 rev1=1 crypto rx=0x7f8760036040 tx=0x7f8760004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:04.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.193+0000 7f87677fe640 1 -- 172.21.15.19:0/1804584804 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8760009510 con 0x7f87700705e0 2023-11-04T15:37:04.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.193+0000 7f87677fe640 1 -- 172.21.15.19:0/1804584804 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f876003e450 con 0x7f87700705e0 2023-11-04T15:37:04.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.193+0000 7f877538b640 1 -- 172.21.15.19:0/1804584804 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f877009f040 con 0x7f87700705e0 2023-11-04T15:37:04.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.193+0000 7f87677fe640 1 -- 172.21.15.19:0/1804584804 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876003e7e0 con 0x7f87700705e0 2023-11-04T15:37:04.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.193+0000 7f877538b640 1 -- 172.21.15.19:0/1804584804 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f877009f6f0 con 0x7f87700705e0 2023-11-04T15:37:04.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.195+0000 7f877538b640 1 -- 172.21.15.19:0/1804584804 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8770067d60 con 0x7f87700705e0 2023-11-04T15:37:04.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.195+0000 7f87677fe640 1 -- 172.21.15.19:0/1804584804 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f876003e940 con 0x7f87700705e0 2023-11-04T15:37:04.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.195+0000 7f87677fe640 1 --2- 172.21.15.19:0/1804584804 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f875006a430 0x7f875006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:04.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.195+0000 7f87677fe640 1 -- 172.21.15.19:0/1804584804 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4462+0+0 (secure 0 0 0) 0x7f87600ab1f0 con 0x7f87700705e0 2023-11-04T15:37:04.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.195+0000 7f876e7fc640 1 --2- 172.21.15.19:0/1804584804 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f875006a430 0x7f875006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:04.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.196+0000 7f876e7fc640 1 --2- 172.21.15.19:0/1804584804 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f875006a430 0x7f875006c8f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8770071050 tx=0x7f8758008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:04.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.199+0000 7f87677fe640 1 -- 172.21.15.19:0/1804584804 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8760076cd0 con 0x7f87700705e0 2023-11-04T15:37:04.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.381+0000 7f877538b640 1 -- 172.21.15.19:0/1804584804 --> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8770071400 con 0x7f875006a430 2023-11-04T15:37:04.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.388+0000 7f87677fe640 1 -- 172.21.15.19:0/1804584804 <== mgr.4114 v2:172.21.15.96:6816/83123 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281183 (secure 0 0 0) 0x7f87580118b0 con 0x7f875006a430 2023-11-04T15:37:04.394 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:37:04.396 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-11-04T15:37:04.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.391+0000 7f877538b640 1 -- 172.21.15.19:0/1804584804 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f875006a430 msgr2=0x7f875006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:04.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.391+0000 7f877538b640 1 --2- 172.21.15.19:0/1804584804 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f875006a430 0x7f875006c8f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8770071050 tx=0x7f8758008040 comp rx=0 tx=0).stop 2023-11-04T15:37:04.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.391+0000 7f877538b640 1 -- 172.21.15.19:0/1804584804 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87700705e0 msgr2=0x7f87701ccae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:04.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.391+0000 7f877538b640 1 --2- 172.21.15.19:0/1804584804 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87700705e0 0x7f87701ccae0 secure :-1 s=READY pgs=3746 cs=0 l=1 rev1=1 crypto rx=0x7f8760036040 tx=0x7f8760004a40 comp rx=0 tx=0).stop 2023-11-04T15:37:04.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.391+0000 7f877538b640 1 -- 172.21.15.19:0/1804584804 shutdown_connections 2023-11-04T15:37:04.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.391+0000 7f877538b640 1 --2- 172.21.15.19:0/1804584804 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f875006a430 0x7f875006c8f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:04.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.391+0000 7f877538b640 1 --2- 172.21.15.19:0/1804584804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8770138690 0x7f87701cd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:04.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.391+0000 7f877538b640 1 --2- 172.21.15.19:0/1804584804 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8770135420 0x7f87701cd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:04.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.391+0000 7f877538b640 1 --2- 172.21.15.19:0/1804584804 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87700705e0 0x7f87701ccae0 unknown :-1 s=CLOSED pgs=3746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:04.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.391+0000 7f877538b640 1 -- 172.21.15.19:0/1804584804 >> 172.21.15.19:0/1804584804 conn(0x7f87700aa590 msgr2=0x7f87700a7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:04.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.391+0000 7f877538b640 1 -- 172.21.15.19:0/1804584804 shutdown_connections 2023-11-04T15:37:04.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.391+0000 7f877538b640 1 -- 172.21.15.19:0/1804584804 wait complete. 2023-11-04T15:37:04.406 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2023-11-04T15:37:03.054758+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":431372061,"num_objects":220,"num_object_clones":25,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":8,"num_read":352,"num_read_kb":3468,"num_write":158428,"num_write_kb":940479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":307482,"ondisk_log_size":307482,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":3245160,"kb_used_data":844616,"kb_used_omap":0,"kb_used_meta":2400512,"kb_avail":374242200,"statfs":{"total":386547056640,"available":383224012800,"internally_reserved":0,"allocated":864886784,"data_stored":863450232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2458124288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3591427,"num_objects":12,"num_object_clones":6,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":189,"num_write_kb":3620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.340851"},"pg_stats":[{"pgid":"4.3f","version":"40'3514","reported_seq":2948,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.799825+0000","last_change":"2023-11-04T15:36:55.800606+0000","last_active":"2023-11-04T15:36:55.799825+0000","last_peered":"2023-11-04T15:36:55.799825+0000","last_clean":"2023-11-04T15:36:55.799825+0000","last_became_active":"2023-11-04T15:27:36.150296+0000","last_became_peered":"2023-11-04T15:27:36.150296+0000","last_unstale":"2023-11-04T15:36:55.799825+0000","last_undegraded":"2023-11-04T15:36:55.799825+0000","last_fullsized":"2023-11-04T15:36:55.799825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3514,"log_dups_size":0,"ondisk_log_size":3514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:41:32.995261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.074678280999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1112,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.3e","version":"43'3332","reported_seq":2781,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:57.912769+0000","last_change":"2023-11-04T15:36:55.781000+0000","last_active":"2023-11-04T15:36:57.912769+0000","last_peered":"2023-11-04T15:36:57.912769+0000","last_clean":"2023-11-04T15:36:57.912769+0000","last_became_active":"2023-11-04T15:27:36.148939+0000","last_became_peered":"2023-11-04T15:27:36.148939+0000","last_unstale":"2023-11-04T15:36:57.912769+0000","last_undegraded":"2023-11-04T15:36:57.912769+0000","last_fullsized":"2023-11-04T15:36:57.912769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3332,"log_dups_size":0,"ondisk_log_size":3332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:52:55.975636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059113046000000002,"stat_sum":{"num_bytes":35,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1118,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.3d","version":"40'3527","reported_seq":2997,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.821524+0000","last_change":"2023-11-04T15:36:55.822917+0000","last_active":"2023-11-04T15:36:55.821524+0000","last_peered":"2023-11-04T15:36:55.821524+0000","last_clean":"2023-11-04T15:36:55.821524+0000","last_became_active":"2023-11-04T15:27:36.149748+0000","last_became_peered":"2023-11-04T15:27:36.149748+0000","last_unstale":"2023-11-04T15:36:55.821524+0000","last_undegraded":"2023-11-04T15:36:55.821524+0000","last_fullsized":"2023-11-04T15:36:55.821524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3527,"log_dups_size":0,"ondisk_log_size":3527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:49:04.091063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101592565,"stat_sum":{"num_bytes":8206,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":1149,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.3c","version":"40'3602","reported_seq":2981,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.769537+0000","last_change":"2023-11-04T15:36:55.770578+0000","last_active":"2023-11-04T15:36:55.769537+0000","last_peered":"2023-11-04T15:36:55.769537+0000","last_clean":"2023-11-04T15:36:55.769537+0000","last_became_active":"2023-11-04T15:27:36.139761+0000","last_became_peered":"2023-11-04T15:27:36.139761+0000","last_unstale":"2023-11-04T15:36:55.769537+0000","last_undegraded":"2023-11-04T15:36:55.769537+0000","last_fullsized":"2023-11-04T15:36:55.769537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3602,"log_dups_size":0,"ondisk_log_size":3602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:38:30.379384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052924038,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1171,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.3b","version":"40'3725","reported_seq":3115,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.797163+0000","last_change":"2023-11-04T15:36:55.798093+0000","last_active":"2023-11-04T15:36:55.797163+0000","last_peered":"2023-11-04T15:36:55.797163+0000","last_clean":"2023-11-04T15:36:55.797163+0000","last_became_active":"2023-11-04T15:27:36.150017+0000","last_became_peered":"2023-11-04T15:27:36.150017+0000","last_unstale":"2023-11-04T15:36:55.797163+0000","last_undegraded":"2023-11-04T15:36:55.797163+0000","last_fullsized":"2023-11-04T15:36:55.797163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3725,"log_dups_size":0,"ondisk_log_size":3725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:47:40.350777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.073241305000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1192,"num_write_kb":641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.3a","version":"40'3327","reported_seq":2767,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.822971+0000","last_change":"2023-11-04T15:36:55.824394+0000","last_active":"2023-11-04T15:36:55.822971+0000","last_peered":"2023-11-04T15:36:55.822971+0000","last_clean":"2023-11-04T15:36:55.822971+0000","last_became_active":"2023-11-04T15:27:36.139036+0000","last_became_peered":"2023-11-04T15:27:36.139036+0000","last_unstale":"2023-11-04T15:36:55.822971+0000","last_undegraded":"2023-11-04T15:36:55.822971+0000","last_fullsized":"2023-11-04T15:36:55.822971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3327,"log_dups_size":0,"ondisk_log_size":3327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:05:44.093984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.102154117,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1074,"num_write_kb":603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.39","version":"43'3353","reported_seq":2801,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:58.060175+0000","last_change":"2023-11-04T15:36:55.820147+0000","last_active":"2023-11-04T15:36:58.060175+0000","last_peered":"2023-11-04T15:36:58.060175+0000","last_clean":"2023-11-04T15:36:58.060175+0000","last_became_active":"2023-11-04T15:27:36.139121+0000","last_became_peered":"2023-11-04T15:27:36.139121+0000","last_unstale":"2023-11-04T15:36:58.060175+0000","last_undegraded":"2023-11-04T15:36:58.060175+0000","last_fullsized":"2023-11-04T15:36:58.060175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3353,"log_dups_size":0,"ondisk_log_size":3353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:57:05.896392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.099827518000000004,"stat_sum":{"num_bytes":4117,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":2,"num_read_kb":1,"num_write":1086,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.38","version":"40'3425","reported_seq":2840,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.815196+0000","last_change":"2023-11-04T15:36:55.816551+0000","last_active":"2023-11-04T15:36:55.815196+0000","last_peered":"2023-11-04T15:36:55.815196+0000","last_clean":"2023-11-04T15:36:55.815196+0000","last_became_active":"2023-11-04T15:27:36.147050+0000","last_became_peered":"2023-11-04T15:27:36.147050+0000","last_unstale":"2023-11-04T15:36:55.815196+0000","last_undegraded":"2023-11-04T15:36:55.815196+0000","last_fullsized":"2023-11-04T15:36:55.815196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3425,"log_dups_size":0,"ondisk_log_size":3425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:40:36.811342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.098810337999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.37","version":"40'3561","reported_seq":2961,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.795099+0000","last_change":"2023-11-04T15:36:55.796038+0000","last_active":"2023-11-04T15:36:55.795099+0000","last_peered":"2023-11-04T15:36:55.795099+0000","last_clean":"2023-11-04T15:36:55.795099+0000","last_became_active":"2023-11-04T15:27:36.145825+0000","last_became_peered":"2023-11-04T15:27:36.145825+0000","last_unstale":"2023-11-04T15:36:55.795099+0000","last_undegraded":"2023-11-04T15:36:55.795099+0000","last_fullsized":"2023-11-04T15:36:55.795099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3561,"log_dups_size":0,"ondisk_log_size":3561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:52:55.975636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072094483000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.36","version":"40'3327","reported_seq":2840,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.816605+0000","last_change":"2023-11-04T15:36:55.817992+0000","last_active":"2023-11-04T15:36:55.816605+0000","last_peered":"2023-11-04T15:36:55.816605+0000","last_clean":"2023-11-04T15:36:55.816605+0000","last_became_active":"2023-11-04T15:27:36.150307+0000","last_became_peered":"2023-11-04T15:27:36.150307+0000","last_unstale":"2023-11-04T15:36:55.816605+0000","last_undegraded":"2023-11-04T15:36:55.816605+0000","last_fullsized":"2023-11-04T15:36:55.816605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3327,"log_dups_size":0,"ondisk_log_size":3327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:38:23.440792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10012518099999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1064,"num_write_kb":572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.35","version":"40'3202","reported_seq":2717,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.769477+0000","last_change":"2023-11-04T15:36:55.770571+0000","last_active":"2023-11-04T15:36:55.769477+0000","last_peered":"2023-11-04T15:36:55.769477+0000","last_clean":"2023-11-04T15:36:55.769477+0000","last_became_active":"2023-11-04T15:27:36.144988+0000","last_became_peered":"2023-11-04T15:27:36.144988+0000","last_unstale":"2023-11-04T15:36:55.769477+0000","last_undegraded":"2023-11-04T15:36:55.769477+0000","last_fullsized":"2023-11-04T15:36:55.769477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3202,"log_dups_size":0,"ondisk_log_size":3202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:41.544754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052379294999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1028,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.34","version":"40'3394","reported_seq":2819,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.780718+0000","last_change":"2023-11-04T15:36:55.782106+0000","last_active":"2023-11-04T15:36:55.780718+0000","last_peered":"2023-11-04T15:36:55.780718+0000","last_clean":"2023-11-04T15:36:55.780718+0000","last_became_active":"2023-11-04T15:27:36.149156+0000","last_became_peered":"2023-11-04T15:27:36.149156+0000","last_unstale":"2023-11-04T15:36:55.780718+0000","last_undegraded":"2023-11-04T15:36:55.780718+0000","last_fullsized":"2023-11-04T15:36:55.780718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3394,"log_dups_size":0,"ondisk_log_size":3394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:22:17.580120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.064372897999999998,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1159,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.33","version":"40'3255","reported_seq":2740,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.791655+0000","last_change":"2023-11-04T15:36:55.792591+0000","last_active":"2023-11-04T15:36:55.791655+0000","last_peered":"2023-11-04T15:36:55.791655+0000","last_clean":"2023-11-04T15:36:55.791655+0000","last_became_active":"2023-11-04T15:27:36.139824+0000","last_became_peered":"2023-11-04T15:27:36.139824+0000","last_unstale":"2023-11-04T15:36:55.791655+0000","last_undegraded":"2023-11-04T15:36:55.791655+0000","last_fullsized":"2023-11-04T15:36:55.791655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3255,"log_dups_size":0,"ondisk_log_size":3255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:28.095802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070068697999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1062,"num_write_kb":575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.32","version":"40'3538","reported_seq":2915,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.774374+0000","last_change":"2023-11-04T15:36:55.774374+0000","last_active":"2023-11-04T15:36:55.774374+0000","last_peered":"2023-11-04T15:36:55.774374+0000","last_clean":"2023-11-04T15:36:55.774374+0000","last_became_active":"2023-11-04T15:27:36.147273+0000","last_became_peered":"2023-11-04T15:27:36.147273+0000","last_unstale":"2023-11-04T15:36:55.774374+0000","last_undegraded":"2023-11-04T15:36:55.774374+0000","last_fullsized":"2023-11-04T15:36:55.774374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3538,"log_dups_size":0,"ondisk_log_size":3538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:22:17.580120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055716603000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.31","version":"40'3766","reported_seq":3156,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.780005+0000","last_change":"2023-11-04T15:36:55.780005+0000","last_active":"2023-11-04T15:36:55.780005+0000","last_peered":"2023-11-04T15:36:55.780005+0000","last_clean":"2023-11-04T15:36:55.780005+0000","last_became_active":"2023-11-04T15:27:36.148932+0000","last_became_peered":"2023-11-04T15:27:36.148932+0000","last_unstale":"2023-11-04T15:36:55.780005+0000","last_undegraded":"2023-11-04T15:36:55.780005+0000","last_fullsized":"2023-11-04T15:36:55.780005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3766,"log_dups_size":0,"ondisk_log_size":3766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:12:07.727740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062648212999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1209,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.30","version":"40'3538","reported_seq":2943,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.818096+0000","last_change":"2023-11-04T15:36:55.818096+0000","last_active":"2023-11-04T15:36:55.818096+0000","last_peered":"2023-11-04T15:36:55.818096+0000","last_clean":"2023-11-04T15:36:55.818096+0000","last_became_active":"2023-11-04T15:27:36.150856+0000","last_became_peered":"2023-11-04T15:27:36.150856+0000","last_unstale":"2023-11-04T15:36:55.818096+0000","last_undegraded":"2023-11-04T15:36:55.818096+0000","last_fullsized":"2023-11-04T15:36:55.818096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3538,"log_dups_size":0,"ondisk_log_size":3538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:51:31.442634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.099772735000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.2f","version":"40'3671","reported_seq":2997,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.797112+0000","last_change":"2023-11-04T15:36:55.797112+0000","last_active":"2023-11-04T15:36:55.797112+0000","last_peered":"2023-11-04T15:36:55.797112+0000","last_clean":"2023-11-04T15:36:55.797112+0000","last_became_active":"2023-11-04T15:27:36.144997+0000","last_became_peered":"2023-11-04T15:27:36.144997+0000","last_unstale":"2023-11-04T15:36:55.797112+0000","last_undegraded":"2023-11-04T15:36:55.797112+0000","last_fullsized":"2023-11-04T15:36:55.797112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3671,"log_dups_size":0,"ondisk_log_size":3671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:22:17.580120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072563297999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1270,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.2e","version":"40'3137","reported_seq":2640,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.820139+0000","last_change":"2023-11-04T15:36:55.820139+0000","last_active":"2023-11-04T15:36:55.820139+0000","last_peered":"2023-11-04T15:36:55.820139+0000","last_clean":"2023-11-04T15:36:55.820139+0000","last_became_active":"2023-11-04T15:27:36.150555+0000","last_became_peered":"2023-11-04T15:27:36.150555+0000","last_unstale":"2023-11-04T15:36:55.820139+0000","last_undegraded":"2023-11-04T15:36:55.820139+0000","last_fullsized":"2023-11-04T15:36:55.820139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3137,"log_dups_size":0,"ondisk_log_size":3137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:32:27.370984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101696772,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1042,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.2d","version":"40'3390","reported_seq":2810,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.794062+0000","last_change":"2023-11-04T15:36:55.795034+0000","last_active":"2023-11-04T15:36:55.794062+0000","last_peered":"2023-11-04T15:36:55.794062+0000","last_clean":"2023-11-04T15:36:55.794062+0000","last_became_active":"2023-11-04T15:27:36.147745+0000","last_became_peered":"2023-11-04T15:27:36.147745+0000","last_unstale":"2023-11-04T15:36:55.794062+0000","last_undegraded":"2023-11-04T15:36:55.794062+0000","last_fullsized":"2023-11-04T15:36:55.794062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3390,"log_dups_size":0,"ondisk_log_size":3390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:41:10.315016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071588252000000005,"stat_sum":{"num_bytes":4128,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1173,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.2c","version":"40'3505","reported_seq":2913,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.814083+0000","last_change":"2023-11-04T15:36:55.815381+0000","last_active":"2023-11-04T15:36:55.814083+0000","last_peered":"2023-11-04T15:36:55.814083+0000","last_clean":"2023-11-04T15:36:55.814083+0000","last_became_active":"2023-11-04T15:27:36.150687+0000","last_became_peered":"2023-11-04T15:27:36.150687+0000","last_unstale":"2023-11-04T15:36:55.814083+0000","last_undegraded":"2023-11-04T15:36:55.814083+0000","last_fullsized":"2023-11-04T15:36:55.814083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3505,"log_dups_size":0,"ondisk_log_size":3505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:56:24.790444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.097896176000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1154,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.2b","version":"43'3544","reported_seq":2979,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.776770+0000","last_change":"2023-11-04T15:36:55.776770+0000","last_active":"2023-11-04T15:36:55.776770+0000","last_peered":"2023-11-04T15:36:55.776770+0000","last_clean":"2023-11-04T15:36:55.776770+0000","last_became_active":"2023-11-04T15:27:36.143551+0000","last_became_peered":"2023-11-04T15:27:36.143551+0000","last_unstale":"2023-11-04T15:36:55.776770+0000","last_undegraded":"2023-11-04T15:36:55.776770+0000","last_fullsized":"2023-11-04T15:36:55.776770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3544,"log_dups_size":0,"ondisk_log_size":3544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:36:21.960547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056037475000000003,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1178,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.2a","version":"40'3728","reported_seq":3083,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.793582+0000","last_change":"2023-11-04T15:36:55.794625+0000","last_active":"2023-11-04T15:36:55.793582+0000","last_peered":"2023-11-04T15:36:55.793582+0000","last_clean":"2023-11-04T15:36:55.793582+0000","last_became_active":"2023-11-04T15:27:36.145943+0000","last_became_peered":"2023-11-04T15:27:36.145943+0000","last_unstale":"2023-11-04T15:36:55.793582+0000","last_undegraded":"2023-11-04T15:36:55.793582+0000","last_fullsized":"2023-11-04T15:36:55.793582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3728,"log_dups_size":0,"ondisk_log_size":3728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:48:58.102459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071549077000000003,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1242,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.29","version":"40'3454","reported_seq":2887,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.776581+0000","last_change":"2023-11-04T15:36:55.777772+0000","last_active":"2023-11-04T15:36:55.776581+0000","last_peered":"2023-11-04T15:36:55.776581+0000","last_clean":"2023-11-04T15:36:55.776581+0000","last_became_active":"2023-11-04T15:27:36.144083+0000","last_became_peered":"2023-11-04T15:27:36.144083+0000","last_unstale":"2023-11-04T15:36:55.776581+0000","last_undegraded":"2023-11-04T15:36:55.776581+0000","last_fullsized":"2023-11-04T15:36:55.776581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3454,"log_dups_size":0,"ondisk_log_size":3454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:32:27.370984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.060959410999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1127,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.28","version":"40'3632","reported_seq":2989,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.820178+0000","last_change":"2023-11-04T15:36:55.821483+0000","last_active":"2023-11-04T15:36:55.820178+0000","last_peered":"2023-11-04T15:36:55.820178+0000","last_clean":"2023-11-04T15:36:55.820178+0000","last_became_active":"2023-11-04T15:27:36.146546+0000","last_became_peered":"2023-11-04T15:27:36.146546+0000","last_unstale":"2023-11-04T15:36:55.820178+0000","last_undegraded":"2023-11-04T15:36:55.820178+0000","last_fullsized":"2023-11-04T15:36:55.820178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3632,"log_dups_size":0,"ondisk_log_size":3632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:41:10.315016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.102597439,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1222,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.27","version":"40'3166","reported_seq":2626,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.781930+0000","last_change":"2023-11-04T15:36:55.783207+0000","last_active":"2023-11-04T15:36:55.781930+0000","last_peered":"2023-11-04T15:36:55.781930+0000","last_clean":"2023-11-04T15:36:55.781930+0000","last_became_active":"2023-11-04T15:27:36.144047+0000","last_became_peered":"2023-11-04T15:27:36.144047+0000","last_unstale":"2023-11-04T15:36:55.781930+0000","last_undegraded":"2023-11-04T15:36:55.781930+0000","last_fullsized":"2023-11-04T15:36:55.781930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3166,"log_dups_size":0,"ondisk_log_size":3166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:36:21.960547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.064725415999999994,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1115,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.26","version":"40'3493","reported_seq":2891,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.783404+0000","last_change":"2023-11-04T15:36:55.784865+0000","last_active":"2023-11-04T15:36:55.783404+0000","last_peered":"2023-11-04T15:36:55.783404+0000","last_clean":"2023-11-04T15:36:55.783404+0000","last_became_active":"2023-11-04T15:27:36.144458+0000","last_became_peered":"2023-11-04T15:27:36.144458+0000","last_unstale":"2023-11-04T15:36:55.783404+0000","last_undegraded":"2023-11-04T15:36:55.783404+0000","last_fullsized":"2023-11-04T15:36:55.783404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3493,"log_dups_size":0,"ondisk_log_size":3493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:52:55.975636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.066118209999999997,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.25","version":"40'3386","reported_seq":2823,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.826414+0000","last_change":"2023-11-04T15:36:55.827764+0000","last_active":"2023-11-04T15:36:55.826414+0000","last_peered":"2023-11-04T15:36:55.826414+0000","last_clean":"2023-11-04T15:36:55.826414+0000","last_became_active":"2023-11-04T15:27:36.150270+0000","last_became_peered":"2023-11-04T15:27:36.150270+0000","last_unstale":"2023-11-04T15:36:55.826414+0000","last_undegraded":"2023-11-04T15:36:55.826414+0000","last_fullsized":"2023-11-04T15:36:55.826414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3386,"log_dups_size":0,"ondisk_log_size":3386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:18:00.808576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.104674168,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.24","version":"40'3286","reported_seq":2715,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.799791+0000","last_change":"2023-11-04T15:36:55.799791+0000","last_active":"2023-11-04T15:36:55.799791+0000","last_peered":"2023-11-04T15:36:55.799791+0000","last_clean":"2023-11-04T15:36:55.799791+0000","last_became_active":"2023-11-04T15:28:20.871378+0000","last_became_peered":"2023-11-04T15:28:20.871378+0000","last_unstale":"2023-11-04T15:36:55.799791+0000","last_undegraded":"2023-11-04T15:36:55.799791+0000","last_fullsized":"2023-11-04T15:36:55.799791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3286,"log_dups_size":0,"ondisk_log_size":3286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:50:26.736014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.074381663000000001,"stat_sum":{"num_bytes":9,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1152,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.23","version":"40'3578","reported_seq":3004,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.792948+0000","last_change":"2023-11-04T15:36:55.793946+0000","last_active":"2023-11-04T15:36:55.792948+0000","last_peered":"2023-11-04T15:36:55.792948+0000","last_clean":"2023-11-04T15:36:55.792948+0000","last_became_active":"2023-11-04T15:27:36.145392+0000","last_became_peered":"2023-11-04T15:27:36.145392+0000","last_unstale":"2023-11-04T15:36:55.792948+0000","last_undegraded":"2023-11-04T15:36:55.792948+0000","last_fullsized":"2023-11-04T15:36:55.792948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3578,"log_dups_size":0,"ondisk_log_size":3578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:12:07.727740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070714202000000004,"stat_sum":{"num_bytes":12288,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1167,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.22","version":"40'3386","reported_seq":2859,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.822944+0000","last_change":"2023-11-04T15:36:55.824211+0000","last_active":"2023-11-04T15:36:55.822944+0000","last_peered":"2023-11-04T15:36:55.822944+0000","last_clean":"2023-11-04T15:36:55.822944+0000","last_became_active":"2023-11-04T15:27:36.145273+0000","last_became_peered":"2023-11-04T15:27:36.145273+0000","last_unstale":"2023-11-04T15:36:55.822944+0000","last_undegraded":"2023-11-04T15:36:55.822944+0000","last_fullsized":"2023-11-04T15:36:55.822944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3386,"log_dups_size":0,"ondisk_log_size":3386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:27:25.258046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101784969,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1155,"num_write_kb":603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.21","version":"40'3889","reported_seq":3211,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.777444+0000","last_change":"2023-11-04T15:36:55.778888+0000","last_active":"2023-11-04T15:36:55.777444+0000","last_peered":"2023-11-04T15:36:55.777444+0000","last_clean":"2023-11-04T15:36:55.777444+0000","last_became_active":"2023-11-04T15:27:36.144053+0000","last_became_peered":"2023-11-04T15:27:36.144053+0000","last_unstale":"2023-11-04T15:36:55.777444+0000","last_undegraded":"2023-11-04T15:36:55.777444+0000","last_fullsized":"2023-11-04T15:36:55.777444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3889,"log_dups_size":0,"ondisk_log_size":3889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:41:10.315016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061944979999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1328,"num_write_kb":706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.20","version":"40'3720","reported_seq":3102,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.774434+0000","last_change":"2023-11-04T15:36:55.775709+0000","last_active":"2023-11-04T15:36:55.774434+0000","last_peered":"2023-11-04T15:36:55.774434+0000","last_clean":"2023-11-04T15:36:55.774434+0000","last_became_active":"2023-11-04T15:27:36.148342+0000","last_became_peered":"2023-11-04T15:27:36.148342+0000","last_unstale":"2023-11-04T15:36:55.774434+0000","last_undegraded":"2023-11-04T15:36:55.774434+0000","last_fullsized":"2023-11-04T15:36:55.774434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3720,"log_dups_size":0,"ondisk_log_size":3720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:47:40.350777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056486557999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.14","version":"40'3424","reported_seq":2823,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.784869+0000","last_change":"2023-11-04T15:36:55.784869+0000","last_active":"2023-11-04T15:36:55.784869+0000","last_peered":"2023-11-04T15:36:55.784869+0000","last_clean":"2023-11-04T15:36:55.784869+0000","last_became_active":"2023-11-04T15:27:36.148951+0000","last_became_peered":"2023-11-04T15:27:36.148951+0000","last_unstale":"2023-11-04T15:36:55.784869+0000","last_undegraded":"2023-11-04T15:36:55.784869+0000","last_fullsized":"2023-11-04T15:36:55.784869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3424,"log_dups_size":0,"ondisk_log_size":3424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:58:32.190696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.066218149000000004,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1176,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.13","version":"40'2984","reported_seq":3023,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.184473+0000","last_change":"2023-11-04T15:27:35.775931+0000","last_active":"2023-11-04T15:36:55.184473+0000","last_peered":"2023-11-04T15:36:55.184473+0000","last_clean":"2023-11-04T15:36:55.184473+0000","last_became_active":"2023-11-04T15:27:35.775616+0000","last_became_peered":"2023-11-04T15:27:35.775616+0000","last_unstale":"2023-11-04T15:36:55.184473+0000","last_undegraded":"2023-11-04T15:36:55.184473+0000","last_fullsized":"2023-11-04T15:36:55.184473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2984,"log_dups_size":0,"ondisk_log_size":2984,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:14:34.175377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2984,"num_write_kb":24202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"40'3308","reported_seq":2723,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.821616+0000","last_change":"2023-11-04T15:36:55.822910+0000","last_active":"2023-11-04T15:36:55.821616+0000","last_peered":"2023-11-04T15:36:55.821616+0000","last_clean":"2023-11-04T15:36:55.821616+0000","last_became_active":"2023-11-04T15:27:36.150276+0000","last_became_peered":"2023-11-04T15:27:36.150276+0000","last_unstale":"2023-11-04T15:36:55.821616+0000","last_undegraded":"2023-11-04T15:36:55.821616+0000","last_fullsized":"2023-11-04T15:36:55.821616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3308,"log_dups_size":0,"ondisk_log_size":3308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T22:54:18.576814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101095329,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1177,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.12","version":"37'462","reported_seq":501,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.221673+0000","last_change":"2023-11-04T15:27:35.776610+0000","last_active":"2023-11-04T15:36:55.221673+0000","last_peered":"2023-11-04T15:36:55.221673+0000","last_clean":"2023-11-04T15:36:55.221673+0000","last_became_active":"2023-11-04T15:27:35.776297+0000","last_became_peered":"2023-11-04T15:27:35.776297+0000","last_unstale":"2023-11-04T15:36:55.221673+0000","last_undegraded":"2023-11-04T15:36:55.221673+0000","last_fullsized":"2023-11-04T15:36:55.221673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:11:01.495068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":462,"num_write_kb":12396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"40'3485","reported_seq":2904,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.799120+0000","last_change":"2023-11-04T15:36:55.800080+0000","last_active":"2023-11-04T15:36:55.799120+0000","last_peered":"2023-11-04T15:36:55.799120+0000","last_clean":"2023-11-04T15:36:55.799120+0000","last_became_active":"2023-11-04T15:27:36.139580+0000","last_became_peered":"2023-11-04T15:27:36.139580+0000","last_unstale":"2023-11-04T15:36:55.799120+0000","last_undegraded":"2023-11-04T15:36:55.799120+0000","last_fullsized":"2023-11-04T15:36:55.799120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3485,"log_dups_size":0,"ondisk_log_size":3485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:38:30.379384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.074768939000000006,"stat_sum":{"num_bytes":8192,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1207,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.11","version":"40'717","reported_seq":756,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.184426+0000","last_change":"2023-11-04T15:27:35.775977+0000","last_active":"2023-11-04T15:36:55.184426+0000","last_peered":"2023-11-04T15:36:55.184426+0000","last_clean":"2023-11-04T15:36:55.184426+0000","last_became_active":"2023-11-04T15:27:35.775486+0000","last_became_peered":"2023-11-04T15:27:35.775486+0000","last_unstale":"2023-11-04T15:36:55.184426+0000","last_undegraded":"2023-11-04T15:36:55.184426+0000","last_fullsized":"2023-11-04T15:36:55.184426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:44:09.266115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":707,"num_write_kb":16815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"40'3443","reported_seq":2872,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.798148+0000","last_change":"2023-11-04T15:36:55.799083+0000","last_active":"2023-11-04T15:36:55.798148+0000","last_peered":"2023-11-04T15:36:55.798148+0000","last_clean":"2023-11-04T15:36:55.798148+0000","last_became_active":"2023-11-04T15:27:36.139789+0000","last_became_peered":"2023-11-04T15:27:36.139789+0000","last_unstale":"2023-11-04T15:36:55.798148+0000","last_undegraded":"2023-11-04T15:36:55.798148+0000","last_fullsized":"2023-11-04T15:36:55.798148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3443,"log_dups_size":0,"ondisk_log_size":3443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:55:13.470788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.073936136,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.10","version":"37'1614","reported_seq":1653,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.184371+0000","last_change":"2023-11-04T15:27:35.776168+0000","last_active":"2023-11-04T15:36:55.184371+0000","last_peered":"2023-11-04T15:36:55.184371+0000","last_clean":"2023-11-04T15:36:55.184371+0000","last_became_active":"2023-11-04T15:27:35.775895+0000","last_became_peered":"2023-11-04T15:27:35.775895+0000","last_unstale":"2023-11-04T15:36:55.184371+0000","last_undegraded":"2023-11-04T15:36:55.184371+0000","last_fullsized":"2023-11-04T15:36:55.184371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1614,"log_dups_size":0,"ondisk_log_size":1614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:02:27.460776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":1625,"num_write_kb":22714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"43'1198","reported_seq":1237,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.717728+0000","last_change":"2023-11-04T15:27:35.767890+0000","last_active":"2023-11-04T15:36:55.717728+0000","last_peered":"2023-11-04T15:36:55.717728+0000","last_clean":"2023-11-04T15:36:55.717728+0000","last_became_active":"2023-11-04T15:27:35.767594+0000","last_became_peered":"2023-11-04T15:27:35.767594+0000","last_unstale":"2023-11-04T15:36:55.717728+0000","last_undegraded":"2023-11-04T15:36:55.717728+0000","last_fullsized":"2023-11-04T15:36:55.717728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1198,"log_dups_size":0,"ondisk_log_size":1198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:11:01.495068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1190,"num_write_kb":15478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"40'3688","reported_seq":3048,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.820227+0000","last_change":"2023-11-04T15:36:55.821576+0000","last_active":"2023-11-04T15:36:55.820227+0000","last_peered":"2023-11-04T15:36:55.820227+0000","last_clean":"2023-11-04T15:36:55.820227+0000","last_became_active":"2023-11-04T15:27:36.148282+0000","last_became_peered":"2023-11-04T15:27:36.148282+0000","last_unstale":"2023-11-04T15:36:55.820227+0000","last_undegraded":"2023-11-04T15:36:55.820227+0000","last_fullsized":"2023-11-04T15:36:55.820227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3688,"log_dups_size":0,"ondisk_log_size":3688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:28:21.024990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.102136719,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1244,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.e","version":"37'2392","reported_seq":2431,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.718563+0000","last_change":"2023-11-04T15:27:35.771839+0000","last_active":"2023-11-04T15:36:54.718563+0000","last_peered":"2023-11-04T15:36:54.718563+0000","last_clean":"2023-11-04T15:36:54.718563+0000","last_became_active":"2023-11-04T15:27:35.771554+0000","last_became_peered":"2023-11-04T15:27:35.771554+0000","last_unstale":"2023-11-04T15:36:54.718563+0000","last_undegraded":"2023-11-04T15:36:54.718563+0000","last_fullsized":"2023-11-04T15:36:54.718563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2392,"log_dups_size":0,"ondisk_log_size":2392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:02:11.972760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2386,"num_write_kb":21701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"40'3600","reported_seq":2983,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.777887+0000","last_change":"2023-11-04T15:36:55.779143+0000","last_active":"2023-11-04T15:36:55.777887+0000","last_peered":"2023-11-04T15:36:55.777887+0000","last_clean":"2023-11-04T15:36:55.777887+0000","last_became_active":"2023-11-04T15:27:36.149146+0000","last_became_peered":"2023-11-04T15:27:36.149146+0000","last_unstale":"2023-11-04T15:36:55.777887+0000","last_undegraded":"2023-11-04T15:36:55.777887+0000","last_fullsized":"2023-11-04T15:36:55.777887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3600,"log_dups_size":0,"ondisk_log_size":3600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:14:54.847413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055767874000000002,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.d","version":"40'3587","reported_seq":3626,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.719438+0000","last_change":"2023-11-04T15:27:35.773978+0000","last_active":"2023-11-04T15:36:54.719438+0000","last_peered":"2023-11-04T15:36:54.719438+0000","last_clean":"2023-11-04T15:36:54.719438+0000","last_became_active":"2023-11-04T15:27:35.773689+0000","last_became_peered":"2023-11-04T15:27:35.773689+0000","last_unstale":"2023-11-04T15:36:54.719438+0000","last_undegraded":"2023-11-04T15:36:54.719438+0000","last_fullsized":"2023-11-04T15:36:54.719438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3587,"log_dups_size":0,"ondisk_log_size":3587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:52:13.268866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582982,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3581,"num_write_kb":38716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"40'3511","reported_seq":2895,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.776611+0000","last_change":"2023-11-04T15:36:55.777637+0000","last_active":"2023-11-04T15:36:55.776611+0000","last_peered":"2023-11-04T15:36:55.776611+0000","last_clean":"2023-11-04T15:36:55.776611+0000","last_became_active":"2023-11-04T15:27:36.141695+0000","last_became_peered":"2023-11-04T15:27:36.141695+0000","last_unstale":"2023-11-04T15:36:55.776611+0000","last_undegraded":"2023-11-04T15:36:55.776611+0000","last_fullsized":"2023-11-04T15:36:55.776611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3511,"log_dups_size":0,"ondisk_log_size":3511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:45:22.367523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057953993000000002,"stat_sum":{"num_bytes":4107,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1230,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.c","version":"40'1577","reported_seq":1616,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.718956+0000","last_change":"2023-11-04T15:27:35.774108+0000","last_active":"2023-11-04T15:36:54.718956+0000","last_peered":"2023-11-04T15:36:54.718956+0000","last_clean":"2023-11-04T15:36:54.718956+0000","last_became_active":"2023-11-04T15:27:35.773818+0000","last_became_peered":"2023-11-04T15:27:35.773818+0000","last_unstale":"2023-11-04T15:36:54.718956+0000","last_undegraded":"2023-11-04T15:36:54.718956+0000","last_fullsized":"2023-11-04T15:36:54.718956+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1577,"log_dups_size":0,"ondisk_log_size":1577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:42:49.218866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1569,"num_write_kb":30603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"40'3300","reported_seq":2746,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.792637+0000","last_change":"2023-11-04T15:36:55.793529+0000","last_active":"2023-11-04T15:36:55.792637+0000","last_peered":"2023-11-04T15:36:55.792637+0000","last_clean":"2023-11-04T15:36:55.792637+0000","last_became_active":"2023-11-04T15:27:36.150653+0000","last_became_peered":"2023-11-04T15:27:36.150653+0000","last_unstale":"2023-11-04T15:36:55.792637+0000","last_undegraded":"2023-11-04T15:36:55.792637+0000","last_fullsized":"2023-11-04T15:36:55.792637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3300,"log_dups_size":0,"ondisk_log_size":3300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:36:21.960547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070970674999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1129,"num_write_kb":600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.b","version":"37'4021","reported_seq":4060,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.716556+0000","last_change":"2023-11-04T15:27:35.773128+0000","last_active":"2023-11-04T15:36:54.716556+0000","last_peered":"2023-11-04T15:36:54.716556+0000","last_clean":"2023-11-04T15:36:54.716556+0000","last_became_active":"2023-11-04T15:27:35.772815+0000","last_became_peered":"2023-11-04T15:27:35.772815+0000","last_unstale":"2023-11-04T15:36:54.716556+0000","last_undegraded":"2023-11-04T15:36:54.716556+0000","last_fullsized":"2023-11-04T15:36:54.716556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":4021,"log_dups_size":0,"ondisk_log_size":4021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:42:49.218866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4019,"num_write_kb":36923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"40'3784","reported_seq":3126,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.815424+0000","last_change":"2023-11-04T15:36:55.816749+0000","last_active":"2023-11-04T15:36:55.815424+0000","last_peered":"2023-11-04T15:36:55.815424+0000","last_clean":"2023-11-04T15:36:55.815424+0000","last_became_active":"2023-11-04T15:27:36.150667+0000","last_became_peered":"2023-11-04T15:27:36.150667+0000","last_unstale":"2023-11-04T15:36:55.815424+0000","last_undegraded":"2023-11-04T15:36:55.815424+0000","last_fullsized":"2023-11-04T15:36:55.815424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3784,"log_dups_size":0,"ondisk_log_size":3784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:55:13.470788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.098687114000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1287,"num_write_kb":684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.a","version":"37'2125","reported_seq":2164,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.718032+0000","last_change":"2023-11-04T15:27:35.775559+0000","last_active":"2023-11-04T15:36:54.718032+0000","last_peered":"2023-11-04T15:36:54.718032+0000","last_clean":"2023-11-04T15:36:54.718032+0000","last_became_active":"2023-11-04T15:27:35.775063+0000","last_became_peered":"2023-11-04T15:27:35.775063+0000","last_unstale":"2023-11-04T15:36:54.718032+0000","last_undegraded":"2023-11-04T15:36:54.718032+0000","last_fullsized":"2023-11-04T15:36:54.718032+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2125,"log_dups_size":0,"ondisk_log_size":2125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:30:45.293294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2118,"num_write_kb":30816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"40'3317","reported_seq":2785,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.824273+0000","last_change":"2023-11-04T15:36:55.826358+0000","last_active":"2023-11-04T15:36:55.824273+0000","last_peered":"2023-11-04T15:36:55.824273+0000","last_clean":"2023-11-04T15:36:55.824273+0000","last_became_active":"2023-11-04T15:27:36.139103+0000","last_became_peered":"2023-11-04T15:27:36.139103+0000","last_unstale":"2023-11-04T15:36:55.824273+0000","last_undegraded":"2023-11-04T15:36:55.824273+0000","last_fullsized":"2023-11-04T15:36:55.824273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3317,"log_dups_size":0,"ondisk_log_size":3317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:59:35.340281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10468400899999999,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1091,"num_write_kb":593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.9","version":"37'1934","reported_seq":1973,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.717552+0000","last_change":"2023-11-04T15:27:35.773686+0000","last_active":"2023-11-04T15:36:54.717552+0000","last_peered":"2023-11-04T15:36:54.717552+0000","last_clean":"2023-11-04T15:36:54.717552+0000","last_became_active":"2023-11-04T15:27:35.773449+0000","last_became_peered":"2023-11-04T15:27:35.773449+0000","last_unstale":"2023-11-04T15:36:54.717552+0000","last_undegraded":"2023-11-04T15:36:54.717552+0000","last_fullsized":"2023-11-04T15:36:54.717552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1934,"log_dups_size":0,"ondisk_log_size":1934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:17:14.527023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1929,"num_write_kb":17119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"40'3519","reported_seq":2939,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.780060+0000","last_change":"2023-11-04T15:36:55.781058+0000","last_active":"2023-11-04T15:36:55.780060+0000","last_peered":"2023-11-04T15:36:55.780060+0000","last_clean":"2023-11-04T15:36:55.780060+0000","last_became_active":"2023-11-04T15:27:36.141086+0000","last_became_peered":"2023-11-04T15:27:36.141086+0000","last_unstale":"2023-11-04T15:36:55.780060+0000","last_undegraded":"2023-11-04T15:36:55.780060+0000","last_fullsized":"2023-11-04T15:36:55.780060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3519,"log_dups_size":0,"ondisk_log_size":3519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:28:45.715407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059170119,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1142,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.8","version":"37'655","reported_seq":694,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.716231+0000","last_change":"2023-11-04T15:27:35.770858+0000","last_active":"2023-11-04T15:36:54.716231+0000","last_peered":"2023-11-04T15:36:54.716231+0000","last_clean":"2023-11-04T15:36:54.716231+0000","last_became_active":"2023-11-04T15:27:35.769001+0000","last_became_peered":"2023-11-04T15:27:35.769001+0000","last_unstale":"2023-11-04T15:36:54.716231+0000","last_undegraded":"2023-11-04T15:36:54.716231+0000","last_fullsized":"2023-11-04T15:36:54.716231+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:01:29.923726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":656,"num_write_kb":15166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"43'3665","reported_seq":3079,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:58.541361+0000","last_change":"2023-11-04T15:36:55.783360+0000","last_active":"2023-11-04T15:36:58.541361+0000","last_peered":"2023-11-04T15:36:58.541361+0000","last_clean":"2023-11-04T15:36:58.541361+0000","last_became_active":"2023-11-04T15:27:36.147034+0000","last_became_peered":"2023-11-04T15:27:36.147034+0000","last_unstale":"2023-11-04T15:36:58.541361+0000","last_undegraded":"2023-11-04T15:36:58.541361+0000","last_fullsized":"2023-11-04T15:36:58.541361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3665,"log_dups_size":0,"ondisk_log_size":3665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:14:54.847413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.064750725999999995,"stat_sum":{"num_bytes":4196,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1197,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"1.0","version":"12'117","reported_seq":195,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.718305+0000","last_change":"2023-11-04T15:27:26.267129+0000","last_active":"2023-11-04T15:36:54.718305+0000","last_peered":"2023-11-04T15:36:54.718305+0000","last_clean":"2023-11-04T15:36:54.718305+0000","last_became_active":"2023-11-04T15:27:26.266242+0000","last_became_peered":"2023-11-04T15:27:26.266242+0000","last_unstale":"2023-11-04T15:36:54.718305+0000","last_undegraded":"2023-11-04T15:36:54.718305+0000","last_fullsized":"2023-11-04T15:36:54.718305+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:25.163848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:25.163848+0000","last_clean_scrub_stamp":"2023-11-04T15:27:25.163848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:54:55.231471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":42,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.718437+0000","last_change":"2023-11-04T15:27:31.620178+0000","last_active":"2023-11-04T15:36:54.718437+0000","last_peered":"2023-11-04T15:36:54.718437+0000","last_clean":"2023-11-04T15:36:54.718437+0000","last_became_active":"2023-11-04T15:27:31.619798+0000","last_became_peered":"2023-11-04T15:27:31.619798+0000","last_unstale":"2023-11-04T15:36:54.718437+0000","last_undegraded":"2023-11-04T15:36:54.718437+0000","last_fullsized":"2023-11-04T15:36:54.718437+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:50:31.717109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"39'3629","reported_seq":3668,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.716613+0000","last_change":"2023-11-04T15:27:35.769689+0000","last_active":"2023-11-04T15:36:54.716613+0000","last_peered":"2023-11-04T15:36:54.716613+0000","last_clean":"2023-11-04T15:36:54.716613+0000","last_became_active":"2023-11-04T15:27:35.769150+0000","last_became_peered":"2023-11-04T15:27:35.769150+0000","last_unstale":"2023-11-04T15:36:54.716613+0000","last_undegraded":"2023-11-04T15:36:54.716613+0000","last_fullsized":"2023-11-04T15:36:54.716613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3629,"log_dups_size":0,"ondisk_log_size":3629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:15:19.151223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3620,"num_write_kb":52059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"40'3668","reported_seq":3072,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.826646+0000","last_change":"2023-11-04T15:36:55.827884+0000","last_active":"2023-11-04T15:36:55.826646+0000","last_peered":"2023-11-04T15:36:55.826646+0000","last_clean":"2023-11-04T15:36:55.826646+0000","last_became_active":"2023-11-04T15:27:36.140619+0000","last_became_peered":"2023-11-04T15:27:36.140619+0000","last_unstale":"2023-11-04T15:36:55.826646+0000","last_undegraded":"2023-11-04T15:36:55.826646+0000","last_fullsized":"2023-11-04T15:36:55.826646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3668,"log_dups_size":0,"ondisk_log_size":3668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:42:12.902707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10532783499999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.718479+0000","last_change":"2023-11-04T15:27:31.622106+0000","last_active":"2023-11-04T15:36:54.718479+0000","last_peered":"2023-11-04T15:36:54.718479+0000","last_clean":"2023-11-04T15:36:54.718479+0000","last_became_active":"2023-11-04T15:27:31.621889+0000","last_became_peered":"2023-11-04T15:27:31.621889+0000","last_unstale":"2023-11-04T15:36:54.718479+0000","last_undegraded":"2023-11-04T15:36:54.718479+0000","last_fullsized":"2023-11-04T15:36:54.718479+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:11:00.327441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"43'3684","reported_seq":3889,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:58.873189+0000","last_change":"2023-11-04T15:27:35.771207+0000","last_active":"2023-11-04T15:36:58.873189+0000","last_peered":"2023-11-04T15:36:58.873189+0000","last_clean":"2023-11-04T15:36:58.873189+0000","last_became_active":"2023-11-04T15:27:35.770364+0000","last_became_peered":"2023-11-04T15:27:35.770364+0000","last_unstale":"2023-11-04T15:36:58.873189+0000","last_undegraded":"2023-11-04T15:36:58.873189+0000","last_fullsized":"2023-11-04T15:36:58.873189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3684,"log_dups_size":0,"ondisk_log_size":3684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:23:45.371175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15883313,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":166,"num_read_kb":3338,"num_write":3668,"num_write_kb":29714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"40'3551","reported_seq":2981,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.795654+0000","last_change":"2023-11-04T15:36:55.796697+0000","last_active":"2023-11-04T15:36:55.795654+0000","last_peered":"2023-11-04T15:36:55.795654+0000","last_clean":"2023-11-04T15:36:55.795654+0000","last_became_active":"2023-11-04T15:27:36.144459+0000","last_became_peered":"2023-11-04T15:27:36.144459+0000","last_unstale":"2023-11-04T15:36:55.795654+0000","last_undegraded":"2023-11-04T15:36:55.795654+0000","last_fullsized":"2023-11-04T15:36:55.795654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3551,"log_dups_size":0,"ondisk_log_size":3551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:28:45.715407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072685394,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.716248+0000","last_change":"2023-11-04T15:27:31.622710+0000","last_active":"2023-11-04T15:36:54.716248+0000","last_peered":"2023-11-04T15:36:54.716248+0000","last_clean":"2023-11-04T15:36:54.716248+0000","last_became_active":"2023-11-04T15:27:31.622378+0000","last_became_peered":"2023-11-04T15:27:31.622378+0000","last_unstale":"2023-11-04T15:36:54.716248+0000","last_undegraded":"2023-11-04T15:36:54.716248+0000","last_fullsized":"2023-11-04T15:36:54.716248+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:49:04.803105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"40'6079","reported_seq":6118,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.716977+0000","last_change":"2023-11-04T15:27:35.774630+0000","last_active":"2023-11-04T15:36:54.716977+0000","last_peered":"2023-11-04T15:36:54.716977+0000","last_clean":"2023-11-04T15:36:54.716977+0000","last_became_active":"2023-11-04T15:27:35.774339+0000","last_became_peered":"2023-11-04T15:27:35.774339+0000","last_unstale":"2023-11-04T15:36:54.716977+0000","last_undegraded":"2023-11-04T15:36:54.716977+0000","last_fullsized":"2023-11-04T15:36:54.716977+0000","mapping_epoch":16,"log_start":"26'400","ondisk_log_start":"26'400","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":5679,"log_dups_size":0,"ondisk_log_size":5679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:44:38.690122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6078,"num_write_kb":43849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"40'3172","reported_seq":2635,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.785037+0000","last_change":"2023-11-04T15:36:55.786394+0000","last_active":"2023-11-04T15:36:55.785037+0000","last_peered":"2023-11-04T15:36:55.785037+0000","last_clean":"2023-11-04T15:36:55.785037+0000","last_became_active":"2023-11-04T15:27:36.146930+0000","last_became_peered":"2023-11-04T15:27:36.146930+0000","last_unstale":"2023-11-04T15:36:55.785037+0000","last_undegraded":"2023-11-04T15:36:55.785037+0000","last_fullsized":"2023-11-04T15:36:55.785037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3172,"log_dups_size":0,"ondisk_log_size":3172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:28:45.715407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067233409999999993,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1111,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.717699+0000","last_change":"2023-11-04T15:27:31.622105+0000","last_active":"2023-11-04T15:36:54.717699+0000","last_peered":"2023-11-04T15:36:54.717699+0000","last_clean":"2023-11-04T15:36:54.717699+0000","last_became_active":"2023-11-04T15:27:31.621849+0000","last_became_peered":"2023-11-04T15:27:31.621849+0000","last_unstale":"2023-11-04T15:36:54.717699+0000","last_undegraded":"2023-11-04T15:36:54.717699+0000","last_fullsized":"2023-11-04T15:36:54.717699+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:20:41.777316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"40'3275","reported_seq":3314,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.716912+0000","last_change":"2023-11-04T15:27:35.770188+0000","last_active":"2023-11-04T15:36:54.716912+0000","last_peered":"2023-11-04T15:36:54.716912+0000","last_clean":"2023-11-04T15:36:54.716912+0000","last_became_active":"2023-11-04T15:27:35.769730+0000","last_became_peered":"2023-11-04T15:27:35.769730+0000","last_unstale":"2023-11-04T15:36:54.716912+0000","last_undegraded":"2023-11-04T15:36:54.716912+0000","last_fullsized":"2023-11-04T15:36:54.716912+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3275,"log_dups_size":0,"ondisk_log_size":3275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:08:22.991334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3258,"num_write_kb":30072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"40'3431","reported_seq":2846,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.784956+0000","last_change":"2023-11-04T15:36:55.786213+0000","last_active":"2023-11-04T15:36:55.784956+0000","last_peered":"2023-11-04T15:36:55.784956+0000","last_clean":"2023-11-04T15:36:55.784956+0000","last_became_active":"2023-11-04T15:27:36.144417+0000","last_became_peered":"2023-11-04T15:27:36.144417+0000","last_unstale":"2023-11-04T15:36:55.784956+0000","last_undegraded":"2023-11-04T15:36:55.784956+0000","last_fullsized":"2023-11-04T15:36:55.784956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3431,"log_dups_size":0,"ondisk_log_size":3431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:41:32.995261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067418286999999993,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.5","version":"37'3105","reported_seq":3144,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.717735+0000","last_change":"2023-11-04T15:27:35.770033+0000","last_active":"2023-11-04T15:36:54.717735+0000","last_peered":"2023-11-04T15:36:54.717735+0000","last_clean":"2023-11-04T15:36:54.717735+0000","last_became_active":"2023-11-04T15:27:35.769772+0000","last_became_peered":"2023-11-04T15:27:35.769772+0000","last_unstale":"2023-11-04T15:36:54.717735+0000","last_undegraded":"2023-11-04T15:36:54.717735+0000","last_fullsized":"2023-11-04T15:36:54.717735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3105,"log_dups_size":0,"ondisk_log_size":3105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:00:20.246822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3101,"num_write_kb":32806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.716947+0000","last_change":"2023-11-04T15:27:31.622663+0000","last_active":"2023-11-04T15:36:54.716947+0000","last_peered":"2023-11-04T15:36:54.716947+0000","last_clean":"2023-11-04T15:36:54.716947+0000","last_became_active":"2023-11-04T15:27:31.622350+0000","last_became_peered":"2023-11-04T15:27:31.622350+0000","last_unstale":"2023-11-04T15:36:54.716947+0000","last_undegraded":"2023-11-04T15:36:54.716947+0000","last_fullsized":"2023-11-04T15:36:54.716947+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:31:02.273249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"43'3419","reported_seq":2891,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:57.990406+0000","last_change":"2023-11-04T15:36:55.780107+0000","last_active":"2023-11-04T15:36:57.990406+0000","last_peered":"2023-11-04T15:36:57.990406+0000","last_clean":"2023-11-04T15:36:57.990406+0000","last_became_active":"2023-11-04T15:27:36.143991+0000","last_became_peered":"2023-11-04T15:27:36.143991+0000","last_unstale":"2023-11-04T15:36:57.990406+0000","last_undegraded":"2023-11-04T15:36:57.990406+0000","last_fullsized":"2023-11-04T15:36:57.990406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3419,"log_dups_size":0,"ondisk_log_size":3419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:48:58.102459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062728023999999993,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":1116,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.4","version":"40'4464","reported_seq":4503,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.716896+0000","last_change":"2023-11-04T15:27:35.769416+0000","last_active":"2023-11-04T15:36:54.716896+0000","last_peered":"2023-11-04T15:36:54.716896+0000","last_clean":"2023-11-04T15:36:54.716896+0000","last_became_active":"2023-11-04T15:27:35.769095+0000","last_became_peered":"2023-11-04T15:27:35.769095+0000","last_unstale":"2023-11-04T15:36:54.716896+0000","last_undegraded":"2023-11-04T15:36:54.716896+0000","last_fullsized":"2023-11-04T15:36:54.716896+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":4464,"log_dups_size":0,"ondisk_log_size":4464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T22:02:04.025848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4451,"num_write_kb":27035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.719534+0000","last_change":"2023-11-04T15:27:31.619973+0000","last_active":"2023-11-04T15:36:54.719534+0000","last_peered":"2023-11-04T15:36:54.719534+0000","last_clean":"2023-11-04T15:36:54.719534+0000","last_became_active":"2023-11-04T15:27:31.619702+0000","last_became_peered":"2023-11-04T15:27:31.619702+0000","last_unstale":"2023-11-04T15:36:54.719534+0000","last_undegraded":"2023-11-04T15:36:54.719534+0000","last_fullsized":"2023-11-04T15:36:54.719534+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:24:34.782619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"40'3558","reported_seq":2941,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.797743+0000","last_change":"2023-11-04T15:36:55.798708+0000","last_active":"2023-11-04T15:36:55.797743+0000","last_peered":"2023-11-04T15:36:55.797743+0000","last_clean":"2023-11-04T15:36:55.797743+0000","last_became_active":"2023-11-04T15:27:36.139707+0000","last_became_peered":"2023-11-04T15:27:36.139707+0000","last_unstale":"2023-11-04T15:36:55.797743+0000","last_undegraded":"2023-11-04T15:36:55.797743+0000","last_fullsized":"2023-11-04T15:36:55.797743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3558,"log_dups_size":0,"ondisk_log_size":3558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:58:32.190696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.073815121999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.7","version":"37'1214","reported_seq":1253,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.717366+0000","last_change":"2023-11-04T15:27:35.768818+0000","last_active":"2023-11-04T15:36:54.717366+0000","last_peered":"2023-11-04T15:36:54.717366+0000","last_clean":"2023-11-04T15:36:54.717366+0000","last_became_active":"2023-11-04T15:27:35.768320+0000","last_became_peered":"2023-11-04T15:27:35.768320+0000","last_unstale":"2023-11-04T15:36:54.717366+0000","last_undegraded":"2023-11-04T15:36:54.717366+0000","last_fullsized":"2023-11-04T15:36:54.717366+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1214,"log_dups_size":0,"ondisk_log_size":1214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:14:58.601545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1211,"num_write_kb":18003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.716888+0000","last_change":"2023-11-04T15:27:31.624625+0000","last_active":"2023-11-04T15:36:54.716888+0000","last_peered":"2023-11-04T15:36:54.716888+0000","last_clean":"2023-11-04T15:36:54.716888+0000","last_became_active":"2023-11-04T15:27:31.624347+0000","last_became_peered":"2023-11-04T15:27:31.624347+0000","last_unstale":"2023-11-04T15:36:54.716888+0000","last_undegraded":"2023-11-04T15:36:54.716888+0000","last_fullsized":"2023-11-04T15:36:54.716888+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:53:45.131692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"40'3608","reported_seq":3010,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.791046+0000","last_change":"2023-11-04T15:36:55.791977+0000","last_active":"2023-11-04T15:36:55.791046+0000","last_peered":"2023-11-04T15:36:55.791046+0000","last_clean":"2023-11-04T15:36:55.791046+0000","last_became_active":"2023-11-04T15:27:36.137897+0000","last_became_peered":"2023-11-04T15:27:36.137897+0000","last_unstale":"2023-11-04T15:36:55.791046+0000","last_undegraded":"2023-11-04T15:36:55.791046+0000","last_fullsized":"2023-11-04T15:36:55.791046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3608,"log_dups_size":0,"ondisk_log_size":3608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:53:25.907251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.069534850999999995,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.6","version":"43'827","reported_seq":866,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.725882+0000","last_change":"2023-11-04T15:27:35.772416+0000","last_active":"2023-11-04T15:36:55.725882+0000","last_peered":"2023-11-04T15:36:55.725882+0000","last_clean":"2023-11-04T15:36:55.725882+0000","last_became_active":"2023-11-04T15:27:35.772121+0000","last_became_peered":"2023-11-04T15:27:35.772121+0000","last_unstale":"2023-11-04T15:36:55.725882+0000","last_undegraded":"2023-11-04T15:36:55.725882+0000","last_fullsized":"2023-11-04T15:36:55.725882+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:58:09.475936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":956,"num_write_kb":25975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.719152+0000","last_change":"2023-11-04T15:27:31.620235+0000","last_active":"2023-11-04T15:36:54.719152+0000","last_peered":"2023-11-04T15:36:54.719152+0000","last_clean":"2023-11-04T15:36:54.719152+0000","last_became_active":"2023-11-04T15:27:31.619831+0000","last_became_peered":"2023-11-04T15:27:31.619831+0000","last_unstale":"2023-11-04T15:36:54.719152+0000","last_undegraded":"2023-11-04T15:36:54.719152+0000","last_fullsized":"2023-11-04T15:36:54.719152+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:44:07.412379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"40'3480","reported_seq":2921,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.779195+0000","last_change":"2023-11-04T15:36:55.780069+0000","last_active":"2023-11-04T15:36:55.779195+0000","last_peered":"2023-11-04T15:36:55.779195+0000","last_clean":"2023-11-04T15:36:55.779195+0000","last_became_active":"2023-11-04T15:27:36.140871+0000","last_became_peered":"2023-11-04T15:27:36.140871+0000","last_unstale":"2023-11-04T15:36:55.779195+0000","last_undegraded":"2023-11-04T15:36:55.779195+0000","last_fullsized":"2023-11-04T15:36:55.779195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3480,"log_dups_size":0,"ondisk_log_size":3480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:28.095802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058381362999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.13","version":"40'3644","reported_seq":3045,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.777837+0000","last_change":"2023-11-04T15:36:55.777837+0000","last_active":"2023-11-04T15:36:55.777837+0000","last_peered":"2023-11-04T15:36:55.777837+0000","last_clean":"2023-11-04T15:36:55.777837+0000","last_became_active":"2023-11-04T15:27:36.139487+0000","last_became_peered":"2023-11-04T15:27:36.139487+0000","last_unstale":"2023-11-04T15:36:55.777837+0000","last_undegraded":"2023-11-04T15:36:55.777837+0000","last_fullsized":"2023-11-04T15:36:55.777837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3644,"log_dups_size":0,"ondisk_log_size":3644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:47:58.380308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056621590999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.14","version":"41'2770","reported_seq":2809,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.184520+0000","last_change":"2023-11-04T15:27:35.775665+0000","last_active":"2023-11-04T15:36:55.184520+0000","last_peered":"2023-11-04T15:36:55.184520+0000","last_clean":"2023-11-04T15:36:55.184520+0000","last_became_active":"2023-11-04T15:27:35.775356+0000","last_became_peered":"2023-11-04T15:27:35.775356+0000","last_unstale":"2023-11-04T15:36:55.184520+0000","last_undegraded":"2023-11-04T15:36:55.184520+0000","last_fullsized":"2023-11-04T15:36:55.184520+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2770,"log_dups_size":0,"ondisk_log_size":2770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:36:12.941030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2769,"num_write_kb":31341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"40'3525","reported_seq":2930,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.781878+0000","last_change":"2023-11-04T15:36:55.781878+0000","last_active":"2023-11-04T15:36:55.781878+0000","last_peered":"2023-11-04T15:36:55.781878+0000","last_clean":"2023-11-04T15:36:55.781878+0000","last_became_active":"2023-11-04T15:27:36.146464+0000","last_became_peered":"2023-11-04T15:27:36.146464+0000","last_unstale":"2023-11-04T15:36:55.781878+0000","last_undegraded":"2023-11-04T15:36:55.781878+0000","last_fullsized":"2023-11-04T15:36:55.781878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3525,"log_dups_size":0,"ondisk_log_size":3525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:47:40.350777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.064516859999999995,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.15","version":"43'3742","reported_seq":3780,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.718800+0000","last_change":"2023-11-04T15:27:35.770401+0000","last_active":"2023-11-04T15:36:55.718800+0000","last_peered":"2023-11-04T15:36:55.718800+0000","last_clean":"2023-11-04T15:36:55.718800+0000","last_became_active":"2023-11-04T15:27:35.769904+0000","last_became_peered":"2023-11-04T15:27:35.769904+0000","last_unstale":"2023-11-04T15:36:55.718800+0000","last_undegraded":"2023-11-04T15:36:55.718800+0000","last_fullsized":"2023-11-04T15:36:55.718800+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3742,"log_dups_size":0,"ondisk_log_size":3742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:58:09.475936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3740,"num_write_kb":21755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"40'3554","reported_seq":3592,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.718496+0000","last_change":"2023-11-04T15:27:35.768689+0000","last_active":"2023-11-04T15:36:54.718496+0000","last_peered":"2023-11-04T15:36:54.718496+0000","last_clean":"2023-11-04T15:36:54.718496+0000","last_became_active":"2023-11-04T15:27:35.768413+0000","last_became_peered":"2023-11-04T15:27:35.768413+0000","last_unstale":"2023-11-04T15:36:54.718496+0000","last_undegraded":"2023-11-04T15:36:54.718496+0000","last_fullsized":"2023-11-04T15:36:54.718496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3554,"log_dups_size":0,"ondisk_log_size":3554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:23:45.371175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3537,"num_write_kb":29647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"40'3937","reported_seq":3318,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.790992+0000","last_change":"2023-11-04T15:36:55.790992+0000","last_active":"2023-11-04T15:36:55.790992+0000","last_peered":"2023-11-04T15:36:55.790992+0000","last_clean":"2023-11-04T15:36:55.790992+0000","last_became_active":"2023-11-04T15:27:36.139524+0000","last_became_peered":"2023-11-04T15:27:36.139524+0000","last_unstale":"2023-11-04T15:36:55.790992+0000","last_undegraded":"2023-11-04T15:36:55.790992+0000","last_fullsized":"2023-11-04T15:36:55.790992+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3937,"log_dups_size":0,"ondisk_log_size":3937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:27:25.258046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.068494678000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1248,"num_write_kb":670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.17","version":"37'1637","reported_seq":1675,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.782076+0000","last_change":"2023-11-04T15:27:35.776242+0000","last_active":"2023-11-04T15:36:54.782076+0000","last_peered":"2023-11-04T15:36:54.782076+0000","last_clean":"2023-11-04T15:36:54.782076+0000","last_became_active":"2023-11-04T15:27:35.775917+0000","last_became_peered":"2023-11-04T15:27:35.775917+0000","last_unstale":"2023-11-04T15:36:54.782076+0000","last_undegraded":"2023-11-04T15:36:54.782076+0000","last_fullsized":"2023-11-04T15:36:54.782076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1637,"log_dups_size":0,"ondisk_log_size":1637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:14:58.601545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1634,"num_write_kb":25426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"40'3472","reported_seq":2891,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.779428+0000","last_change":"2023-11-04T15:36:55.779428+0000","last_active":"2023-11-04T15:36:55.779428+0000","last_peered":"2023-11-04T15:36:55.779428+0000","last_clean":"2023-11-04T15:36:55.779428+0000","last_became_active":"2023-11-04T15:27:36.150557+0000","last_became_peered":"2023-11-04T15:27:36.150557+0000","last_unstale":"2023-11-04T15:36:55.779428+0000","last_undegraded":"2023-11-04T15:36:55.779428+0000","last_fullsized":"2023-11-04T15:36:55.779428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3472,"log_dups_size":0,"ondisk_log_size":3472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:12:07.727740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062631718000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"4.1f","version":"40'3228","reported_seq":2708,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.824445+0000","last_change":"2023-11-04T15:36:55.826604+0000","last_active":"2023-11-04T15:36:55.824445+0000","last_peered":"2023-11-04T15:36:55.824445+0000","last_clean":"2023-11-04T15:36:55.824445+0000","last_became_active":"2023-11-04T15:27:36.149831+0000","last_became_peered":"2023-11-04T15:27:36.149831+0000","last_unstale":"2023-11-04T15:36:55.824445+0000","last_undegraded":"2023-11-04T15:36:55.824445+0000","last_fullsized":"2023-11-04T15:36:55.824445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3228,"log_dups_size":0,"ondisk_log_size":3228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:16:09.862958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.103639325,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1060,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.18","version":"43'4769","reported_seq":4807,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:58.591433+0000","last_change":"2023-11-04T15:27:35.770634+0000","last_active":"2023-11-04T15:36:58.591433+0000","last_peered":"2023-11-04T15:36:58.591433+0000","last_clean":"2023-11-04T15:36:58.591433+0000","last_became_active":"2023-11-04T15:27:35.770022+0000","last_became_peered":"2023-11-04T15:27:35.770022+0000","last_unstale":"2023-11-04T15:36:58.591433+0000","last_undegraded":"2023-11-04T15:36:58.591433+0000","last_fullsized":"2023-11-04T15:36:58.591433+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":4769,"log_dups_size":0,"ondisk_log_size":4769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:03:49.354013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28893509,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4768,"num_write_kb":50662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"43'3333","reported_seq":2774,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:58.141007+0000","last_change":"2023-11-04T15:36:55.797686+0000","last_active":"2023-11-04T15:36:58.141007+0000","last_peered":"2023-11-04T15:36:58.141007+0000","last_clean":"2023-11-04T15:36:58.141007+0000","last_became_active":"2023-11-04T15:27:36.138908+0000","last_became_peered":"2023-11-04T15:27:36.138908+0000","last_unstale":"2023-11-04T15:36:58.141007+0000","last_undegraded":"2023-11-04T15:36:58.141007+0000","last_fullsized":"2023-11-04T15:36:58.141007+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3333,"log_dups_size":0,"ondisk_log_size":3333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:32:27.370984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.073000567000000002,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":1157,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.19","version":"31'780","reported_seq":818,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.715533+0000","last_change":"2023-11-04T15:27:35.768190+0000","last_active":"2023-11-04T15:36:54.715533+0000","last_peered":"2023-11-04T15:36:54.715533+0000","last_clean":"2023-11-04T15:36:54.715533+0000","last_became_active":"2023-11-04T15:27:35.767858+0000","last_became_peered":"2023-11-04T15:27:35.767858+0000","last_unstale":"2023-11-04T15:36:54.715533+0000","last_undegraded":"2023-11-04T15:36:54.715533+0000","last_fullsized":"2023-11-04T15:36:54.715533+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:55:22.956180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":779,"num_write_kb":20966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"40'3359","reported_seq":2780,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.794676+0000","last_change":"2023-11-04T15:36:55.795596+0000","last_active":"2023-11-04T15:36:55.794676+0000","last_peered":"2023-11-04T15:36:55.794676+0000","last_clean":"2023-11-04T15:36:55.794676+0000","last_became_active":"2023-11-04T15:27:36.143442+0000","last_became_peered":"2023-11-04T15:27:36.143442+0000","last_unstale":"2023-11-04T15:36:55.794676+0000","last_undegraded":"2023-11-04T15:36:55.794676+0000","last_fullsized":"2023-11-04T15:36:55.794676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3359,"log_dups_size":0,"ondisk_log_size":3359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:45:22.367523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072078296,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1167,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1a","version":"37'3778","reported_seq":3816,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.717883+0000","last_change":"2023-11-04T15:27:35.771653+0000","last_active":"2023-11-04T15:36:54.717883+0000","last_peered":"2023-11-04T15:36:54.717883+0000","last_clean":"2023-11-04T15:36:54.717883+0000","last_became_active":"2023-11-04T15:27:35.770539+0000","last_became_peered":"2023-11-04T15:27:35.770539+0000","last_unstale":"2023-11-04T15:36:54.717883+0000","last_undegraded":"2023-11-04T15:36:54.717883+0000","last_fullsized":"2023-11-04T15:36:54.717883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3778,"log_dups_size":0,"ondisk_log_size":3778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:14:58.601545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3770,"num_write_kb":38321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"40'3791","reported_seq":3143,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.779484+0000","last_change":"2023-11-04T15:36:55.780664+0000","last_active":"2023-11-04T15:36:55.779484+0000","last_peered":"2023-11-04T15:36:55.779484+0000","last_clean":"2023-11-04T15:36:55.779484+0000","last_became_active":"2023-11-04T15:27:36.146477+0000","last_became_peered":"2023-11-04T15:27:36.146477+0000","last_unstale":"2023-11-04T15:36:55.779484+0000","last_undegraded":"2023-11-04T15:36:55.779484+0000","last_fullsized":"2023-11-04T15:36:55.779484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3791,"log_dups_size":0,"ondisk_log_size":3791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:53:25.907251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063144525000000007,"stat_sum":{"num_bytes":8192,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1270,"num_write_kb":694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1b","version":"40'2943","reported_seq":2981,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.781525+0000","last_change":"2023-11-04T15:27:35.772092+0000","last_active":"2023-11-04T15:36:54.781525+0000","last_peered":"2023-11-04T15:36:54.781525+0000","last_clean":"2023-11-04T15:36:54.781525+0000","last_became_active":"2023-11-04T15:27:35.771316+0000","last_became_peered":"2023-11-04T15:27:35.771316+0000","last_unstale":"2023-11-04T15:36:54.781525+0000","last_undegraded":"2023-11-04T15:36:54.781525+0000","last_fullsized":"2023-11-04T15:36:54.781525+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2943,"log_dups_size":0,"ondisk_log_size":2943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:00:20.246822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2943,"num_write_kb":28401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"40'3595","reported_seq":3002,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.777689+0000","last_change":"2023-11-04T15:36:55.778980+0000","last_active":"2023-11-04T15:36:55.777689+0000","last_peered":"2023-11-04T15:36:55.777689+0000","last_clean":"2023-11-04T15:36:55.777689+0000","last_became_active":"2023-11-04T15:27:36.144066+0000","last_became_peered":"2023-11-04T15:27:36.144066+0000","last_unstale":"2023-11-04T15:36:55.777689+0000","last_undegraded":"2023-11-04T15:36:55.777689+0000","last_fullsized":"2023-11-04T15:36:55.777689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3595,"log_dups_size":0,"ondisk_log_size":3595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:41:32.995261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057889772999999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1118,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1c","version":"41'926","reported_seq":964,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.717175+0000","last_change":"2023-11-04T15:27:35.768679+0000","last_active":"2023-11-04T15:36:54.717175+0000","last_peered":"2023-11-04T15:36:54.717175+0000","last_clean":"2023-11-04T15:36:54.717175+0000","last_became_active":"2023-11-04T15:27:35.767852+0000","last_became_peered":"2023-11-04T15:27:35.767852+0000","last_unstale":"2023-11-04T15:36:54.717175+0000","last_undegraded":"2023-11-04T15:36:54.717175+0000","last_fullsized":"2023-11-04T15:36:54.717175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":926,"log_dups_size":0,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:47:47.130490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":923,"num_write_kb":21087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"40'3552","reported_seq":2970,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.775568+0000","last_change":"2023-11-04T15:36:55.776553+0000","last_active":"2023-11-04T15:36:55.775568+0000","last_peered":"2023-11-04T15:36:55.775568+0000","last_clean":"2023-11-04T15:36:55.775568+0000","last_became_active":"2023-11-04T15:27:36.141167+0000","last_became_peered":"2023-11-04T15:27:36.141167+0000","last_unstale":"2023-11-04T15:36:55.775568+0000","last_undegraded":"2023-11-04T15:36:55.775568+0000","last_fullsized":"2023-11-04T15:36:55.775568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3552,"log_dups_size":0,"ondisk_log_size":3552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:22:21.262360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057363947999999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1127,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1d","version":"37'3225","reported_seq":3263,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.719175+0000","last_change":"2023-11-04T15:27:35.775629+0000","last_active":"2023-11-04T15:36:54.719175+0000","last_peered":"2023-11-04T15:36:54.719175+0000","last_clean":"2023-11-04T15:36:54.719175+0000","last_became_active":"2023-11-04T15:27:35.775171+0000","last_became_peered":"2023-11-04T15:27:35.775171+0000","last_unstale":"2023-11-04T15:36:54.719175+0000","last_undegraded":"2023-11-04T15:36:54.719175+0000","last_fullsized":"2023-11-04T15:36:54.719175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3225,"log_dups_size":0,"ondisk_log_size":3225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:13:42.865721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3214,"num_write_kb":42509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"43'3487","reported_seq":2929,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:58.220450+0000","last_change":"2023-11-04T15:36:55.792895+0000","last_active":"2023-11-04T15:36:58.220450+0000","last_peered":"2023-11-04T15:36:58.220450+0000","last_clean":"2023-11-04T15:36:58.220450+0000","last_became_active":"2023-11-04T15:27:36.145560+0000","last_became_peered":"2023-11-04T15:27:36.145560+0000","last_unstale":"2023-11-04T15:36:58.220450+0000","last_undegraded":"2023-11-04T15:36:58.220450+0000","last_fullsized":"2023-11-04T15:36:58.220450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3487,"log_dups_size":0,"ondisk_log_size":3487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:14:54.847413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.07011676,"stat_sum":{"num_bytes":4151,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":1159,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1e","version":"40'4214","reported_seq":4253,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.781727+0000","last_change":"2023-11-04T15:27:35.771225+0000","last_active":"2023-11-04T15:36:54.781727+0000","last_peered":"2023-11-04T15:36:54.781727+0000","last_clean":"2023-11-04T15:36:54.781727+0000","last_became_active":"2023-11-04T15:27:35.770873+0000","last_became_peered":"2023-11-04T15:27:35.770873+0000","last_unstale":"2023-11-04T15:36:54.781727+0000","last_undegraded":"2023-11-04T15:36:54.781727+0000","last_fullsized":"2023-11-04T15:36:54.781727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":4214,"log_dups_size":0,"ondisk_log_size":4214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:02:11.972760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4214,"num_write_kb":32525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"40'4090","reported_seq":3390,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.774510+0000","last_change":"2023-11-04T15:36:55.775512+0000","last_active":"2023-11-04T15:36:55.774510+0000","last_peered":"2023-11-04T15:36:55.774510+0000","last_clean":"2023-11-04T15:36:55.774510+0000","last_became_active":"2023-11-04T15:27:36.147535+0000","last_became_peered":"2023-11-04T15:27:36.147535+0000","last_unstale":"2023-11-04T15:36:55.774510+0000","last_undegraded":"2023-11-04T15:36:55.774510+0000","last_fullsized":"2023-11-04T15:36:55.774510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":4090,"log_dups_size":0,"ondisk_log_size":4090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:48:58.102459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055801837,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1294,"num_write_kb":719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1f","version":"40'1589","reported_seq":1628,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-11-04T15:36:54.781927+0000","last_change":"2023-11-04T15:27:35.776315+0000","last_active":"2023-11-04T15:36:54.781927+0000","last_peered":"2023-11-04T15:36:54.781927+0000","last_clean":"2023-11-04T15:36:54.781927+0000","last_became_active":"2023-11-04T15:27:35.775918+0000","last_became_peered":"2023-11-04T15:27:35.775918+0000","last_unstale":"2023-11-04T15:36:54.781927+0000","last_undegraded":"2023-11-04T15:36:54.781927+0000","last_fullsized":"2023-11-04T15:36:54.781927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1589,"log_dups_size":0,"ondisk_log_size":1589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:08:22.991334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1587,"num_write_kb":12658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":127433,"num_objects":92,"num_object_clones":25,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":8,"num_read":46,"num_read_kb":30,"num_write":74822,"num_write_kb":40603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":254672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224295,"ondisk_log_size":224295,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":430654260,"num_objects":126,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":126,"num_whiteouts":0,"num_read":190,"num_read_kb":3338,"num_write":83447,"num_write_kb":897460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":861372416,"data_stored":861308520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83070,"ondisk_log_size":83070,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705783,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":659540,"kb_used_data":173196,"kb_used_omap":0,"kb_used_meta":486336,"kb_avail":93712300,"statfs":{"total":96636764160,"available":95961395200,"internally_reserved":0,"allocated":177352704,"data_stored":176994799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":498008064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.435,"15min":0.40000000000000002},"min":{"1min":0.23000000000000001,"5min":0.17000000000000001,"15min":0.156},"max":{"1min":10.488,"5min":10.488,"15min":10.488},"last":0.442},{"interface":"front","average":{"1min":1.0509999999999999,"5min":0.58399999999999996,"15min":0.45500000000000002},"min":{"1min":0.21199999999999999,"5min":0.186,"15min":0.186},"max":{"1min":11.621,"5min":13.055,"15min":13.055},"last":0.53000000000000003}]},{"osd":1,"last update":"Sat Nov 4 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.496,"15min":0.433},"min":{"1min":0.219,"5min":0.188,"15min":0.188},"max":{"1min":12.347,"5min":12.347,"15min":12.347},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.48999999999999999,"15min":0.438},"min":{"1min":0.23699999999999999,"5min":0.21299999999999999,"15min":0.186},"max":{"1min":12.853999999999999,"5min":12.853999999999999,"15min":12.853999999999999},"last":0.51800000000000002}]},{"osd":2,"last update":"Sat Nov 4 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.41299999999999998,"15min":0.34499999999999997},"min":{"1min":0.16900000000000001,"5min":0.153,"15min":0.153},"max":{"1min":11.709,"5min":11.709,"15min":11.709},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.40300000000000002,"15min":0.35599999999999998},"min":{"1min":0.19500000000000001,"5min":0.14899999999999999,"15min":0.14899999999999999},"max":{"1min":9.2629999999999999,"5min":9.2629999999999999,"15min":9.2629999999999999},"last":0.32000000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705782,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":952412,"kb_used_data":245460,"kb_used_omap":0,"kb_used_meta":706944,"kb_avail":93419428,"statfs":{"total":96636764160,"available":95661494272,"internally_reserved":0,"allocated":251351040,"data_stored":250986928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":723910656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 15:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.41199999999999998,"15min":0.40100000000000002},"min":{"1min":0.20499999999999999,"5min":0.153,"15min":0.151},"max":{"1min":0.52900000000000003,"5min":14.584,"15min":14.584},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.35799999999999998,"15min":0.376},"min":{"1min":0.22,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.45600000000000002,"5min":7.2670000000000003,"15min":7.2670000000000003},"last":0.46800000000000003}]},{"osd":1,"last update":"Sat Nov 4 15:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32700000000000001,"15min":0.39000000000000001},"min":{"1min":0.23499999999999999,"5min":0.185,"15min":0.17100000000000001},"max":{"1min":0.48399999999999999,"5min":0.877,"15min":1.266},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.34699999999999998,"15min":0.40899999999999997},"min":{"1min":0.27500000000000002,"5min":0.20899999999999999,"15min":0.20399999999999999},"max":{"1min":0.54100000000000004,"5min":0.88600000000000001,"15min":1.2829999999999999},"last":0.55800000000000005}]},{"osd":3,"last update":"Sat Nov 4 15:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.28000000000000003,"15min":0.314},"min":{"1min":0.23699999999999999,"5min":0.14999999999999999,"15min":0.14699999999999999},"max":{"1min":0.41399999999999998,"5min":1.653,"15min":1.653},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.30599999999999999,"15min":0.34000000000000002},"min":{"1min":0.23000000000000001,"5min":0.159,"15min":0.14899999999999999},"max":{"1min":0.501,"5min":0.52400000000000002,"15min":1.304},"last":0.26700000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705781,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":715088,"kb_used_data":188552,"kb_used_omap":0,"kb_used_meta":526528,"kb_avail":93656752,"statfs":{"total":96636764160,"available":95904514048,"internally_reserved":0,"allocated":193077248,"data_stored":192721880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":539164672},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.40699999999999997,"15min":0.318},"min":{"1min":0.17100000000000001,"5min":0.14399999999999999,"15min":0.14399999999999999},"max":{"1min":1.012,"5min":12.768000000000001,"15min":12.768000000000001},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.248,"5min":0.30399999999999999,"15min":0.29499999999999998},"min":{"1min":0.19,"5min":0.14399999999999999,"15min":0.14399999999999999},"max":{"1min":0.377,"5min":8.609,"15min":8.609},"last":0.252}]},{"osd":2,"last update":"Sat Nov 4 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.40400000000000003,"15min":0.44},"min":{"1min":0.28499999999999998,"5min":0.19600000000000001,"15min":0.189},"max":{"1min":1.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.39000000000000001,"15min":0.42399999999999999},"min":{"1min":0.29599999999999999,"5min":0.19600000000000001,"15min":0.192},"max":{"1min":0.98199999999999998,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.41699999999999998}]},{"osd":3,"last update":"Sat Nov 4 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.42099999999999999,"15min":0.438},"min":{"1min":0.309,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.65200000000000002,"5min":6.7679999999999998,"15min":6.7679999999999998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.41999999999999998,"15min":0.45000000000000001},"min":{"1min":0.32100000000000001,"5min":0.249,"15min":0.24299999999999999},"max":{"1min":1.446,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.54300000000000004}]}]},{"osd":0,"up_from":9,"seq":38654705782,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":918120,"kb_used_data":237408,"kb_used_omap":0,"kb_used_meta":680704,"kb_avail":93453720,"statfs":{"total":96636764160,"available":95696609280,"internally_reserved":0,"allocated":243105792,"data_stored":242746625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":697040896},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 15:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.312,"15min":0.27900000000000003},"min":{"1min":0.14999999999999999,"5min":0.14399999999999999,"15min":0.13500000000000001},"max":{"1min":4.4059999999999997,"5min":6.4340000000000002,"15min":6.4340000000000002},"last":0.187},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.28000000000000003,"15min":0.27500000000000002},"min":{"1min":0.17299999999999999,"5min":0.155,"15min":0.155},"max":{"1min":1.1299999999999999,"5min":4.1200000000000001,"15min":4.1200000000000001},"last":0.20999999999999999}]},{"osd":2,"last update":"Sat Nov 4 15:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.40400000000000003,"15min":0.42599999999999999},"min":{"1min":0.251,"5min":0.17999999999999999,"15min":0.17599999999999999},"max":{"1min":2.5129999999999999,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.252},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.371,"15min":0.41899999999999998},"min":{"1min":0.28000000000000003,"5min":0.187,"15min":0.187},"max":{"1min":1.157,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.26600000000000001}]},{"osd":3,"last update":"Sat Nov 4 15:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.438,"15min":0.443},"min":{"1min":0.23899999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":2.6520000000000001,"5min":6.4660000000000002,"15min":6.4660000000000002},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.44600000000000001,"15min":0.44800000000000001},"min":{"1min":0.26800000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":2.621,"5min":6.3540000000000001,"15min":6.3540000000000001},"last":0.30599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":241926144,"data_stored":241909852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":192475136,"data_stored":192471365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":250785792,"data_stored":250765155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":176185344,"data_stored":176162148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":69829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":73939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":45197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":65707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T15:37:04.415 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T15:37:04.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.552+0000 7f3a22084640 1 Processor -- start 2023-11-04T15:37:04.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.552+0000 7f3a22084640 1 -- start start 2023-11-04T15:37:04.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.552+0000 7f3a22084640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3a1c136120 0x7f3a1c136500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:04.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.552+0000 7f3a22084640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3a1c0a6570 0x7f3a1c13a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:04.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.552+0000 7f3a22084640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a1c0a3df0 con 0x7f3a1c13a560 2023-11-04T15:37:04.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.552+0000 7f3a22084640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a1c0a5870 con 0x7f3a1c136120 2023-11-04T15:37:04.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.552+0000 7f3a22084640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a1c0a6350 con 0x7f3a1c0a6570 2023-11-04T15:37:04.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.552+0000 7f3a1b7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3a1c136120 0x7f3a1c136500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:04.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.552+0000 7f3a1b7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3a1c136120 0x7f3a1c136500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60488/0 (socket says 172.21.15.19:60488) 2023-11-04T15:37:04.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.552+0000 7f3a1bfff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3a1c13a560 0x7f3a1c141350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58014/0 (socket says 172.21.15.19:58014) 2023-11-04T15:37:04.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.552+0000 7f3a1b7fe640 1 -- 172.21.15.19:0/4126187525 learned_addr learned my addr 172.21.15.19:0/4126187525 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:37:04.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.552+0000 7f3a1affd640 1 --2- 172.21.15.19:0/4126187525 >> v2:172.21.15.96:3300/0 conn(0x7f3a1c0a6570 0x7f3a1c13a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:04.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.553+0000 7f3a1b7fe640 1 -- 172.21.15.19:0/4126187525 >> v2:172.21.15.96:3300/0 conn(0x7f3a1c0a6570 msgr2=0x7f3a1c13a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:04.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.553+0000 7f3a1b7fe640 1 --2- 172.21.15.19:0/4126187525 >> v2:172.21.15.96:3300/0 conn(0x7f3a1c0a6570 0x7f3a1c13a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:04.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.553+0000 7f3a1b7fe640 1 -- 172.21.15.19:0/4126187525 >> v1:172.21.15.19:6789/0 conn(0x7f3a1c13a560 legacy=0x7f3a1c141350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:04.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.553+0000 7f3a1b7fe640 1 -- 172.21.15.19:0/4126187525 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a1c0a51d0 con 0x7f3a1c136120 2023-11-04T15:37:04.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.553+0000 7f3a1a7fc640 1 -- 172.21.15.19:0/4126187525 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3494378145 0 0) 0x7f3a1c0a3df0 con 0x7f3a1c13a560 2023-11-04T15:37:04.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.553+0000 7f3a1affd640 1 --2- 172.21.15.19:0/4126187525 >> v2:172.21.15.96:3300/0 conn(0x7f3a1c0a6570 0x7f3a1c13a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T15:37:04.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.553+0000 7f3a1b7fe640 1 --2- 172.21.15.19:0/4126187525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a1c136120 0x7f3a1c136500 secure :-1 s=READY pgs=3748 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c0a2e90 tx=0x7f3a0c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dfe9c9715bb3b20 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:04.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.554+0000 7f3a1a7fc640 1 -- 172.21.15.19:0/4126187525 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c031870 con 0x7f3a1c136120 2023-11-04T15:37:04.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.554+0000 7f3a1a7fc640 1 -- 172.21.15.19:0/4126187525 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0c0319d0 con 0x7f3a1c136120 2023-11-04T15:37:04.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.554+0000 7f3a1a7fc640 1 -- 172.21.15.19:0/4126187525 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c031d60 con 0x7f3a1c136120 2023-11-04T15:37:04.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.554+0000 7f3a22084640 1 -- 172.21.15.19:0/4126187525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a1c136120 msgr2=0x7f3a1c136500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:04.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.554+0000 7f3a22084640 1 --2- 172.21.15.19:0/4126187525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a1c136120 0x7f3a1c136500 secure :-1 s=READY pgs=3748 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c0a2e90 tx=0x7f3a0c02b910 comp rx=0 tx=0).stop 2023-11-04T15:37:04.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.554+0000 7f3a22084640 1 -- 172.21.15.19:0/4126187525 shutdown_connections 2023-11-04T15:37:04.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.554+0000 7f3a22084640 1 --2- 172.21.15.19:0/4126187525 >> v2:172.21.15.96:3300/0 conn(0x7f3a1c0a6570 0x7f3a1c13a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:04.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.554+0000 7f3a22084640 1 --2- 172.21.15.19:0/4126187525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a1c136120 0x7f3a1c136500 unknown :-1 s=CLOSED pgs=3748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:04.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.554+0000 7f3a22084640 1 -- 172.21.15.19:0/4126187525 >> 172.21.15.19:0/4126187525 conn(0x7f3a1c0ac300 msgr2=0x7f3a1c0ac710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:04.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.554+0000 7f3a22084640 1 -- 172.21.15.19:0/4126187525 shutdown_connections 2023-11-04T15:37:04.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.554+0000 7f3a22084640 1 -- 172.21.15.19:0/4126187525 wait complete. 2023-11-04T15:37:04.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.555+0000 7f3a22084640 1 Processor -- start 2023-11-04T15:37:04.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.555+0000 7f3a22084640 1 -- start start 2023-11-04T15:37:04.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.556+0000 7f3a22084640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a1c0a6570 0x7f3a1c09c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:04.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.556+0000 7f3a22084640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a1c136120 0x7f3a1c09cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:04.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.556+0000 7f3a22084640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3a1c13a560 0x7f3a1c09d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:04.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.556+0000 7f3a22084640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c09fbb0 con 0x7f3a1c0a6570 2023-11-04T15:37:04.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.556+0000 7f3a22084640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c0a0be0 con 0x7f3a1c136120 2023-11-04T15:37:04.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.556+0000 7f3a22084640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c09f980 con 0x7f3a1c13a560 2023-11-04T15:37:04.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.556+0000 7f3a1b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a1c0a6570 0x7f3a1c09c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:04.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.556+0000 7f3a1b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a1c0a6570 0x7f3a1c09c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60496/0 (socket says 172.21.15.19:60496) 2023-11-04T15:37:04.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.556+0000 7f3a1b7fe640 1 -- 172.21.15.19:0/2523436240 learned_addr learned my addr 172.21.15.19:0/2523436240 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:37:04.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.556+0000 7f3a1affd640 1 --2- 172.21.15.19:0/2523436240 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a1c136120 0x7f3a1c09cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:04.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.556+0000 7f3a1bfff640 1 --2- 172.21.15.19:0/2523436240 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3a1c13a560 0x7f3a1c09d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:04.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.556+0000 7f3a1b7fe640 1 -- 172.21.15.19:0/2523436240 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3a1c13a560 msgr2=0x7f3a1c09d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:04.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.556+0000 7f3a1b7fe640 1 --2- 172.21.15.19:0/2523436240 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3a1c13a560 0x7f3a1c09d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:04.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.556+0000 7f3a1b7fe640 1 -- 172.21.15.19:0/2523436240 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a1c136120 msgr2=0x7f3a1c09cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:04.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.556+0000 7f3a1b7fe640 1 --2- 172.21.15.19:0/2523436240 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a1c136120 0x7f3a1c09cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:04.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.556+0000 7f3a1b7fe640 1 -- 172.21.15.19:0/2523436240 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0c0094d0 con 0x7f3a1c0a6570 2023-11-04T15:37:04.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.556+0000 7f3a1affd640 1 --2- 172.21.15.19:0/2523436240 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a1c136120 0x7f3a1c09cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:37:04.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.557+0000 7f3a1b7fe640 1 --2- 172.21.15.19:0/2523436240 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a1c0a6570 0x7f3a1c09c7d0 secure :-1 s=READY pgs=3749 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0090b0 tx=0x7f3a0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:04.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.557+0000 7f3a03fff640 1 -- 172.21.15.19:0/2523436240 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c03abe0 con 0x7f3a1c0a6570 2023-11-04T15:37:04.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.557+0000 7f3a03fff640 1 -- 172.21.15.19:0/2523436240 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0c03ad40 con 0x7f3a1c0a6570 2023-11-04T15:37:04.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.557+0000 7f3a22084640 1 -- 172.21.15.19:0/2523436240 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a1c09e810 con 0x7f3a1c0a6570 2023-11-04T15:37:04.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.557+0000 7f3a03fff640 1 -- 172.21.15.19:0/2523436240 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c004270 con 0x7f3a1c0a6570 2023-11-04T15:37:04.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.557+0000 7f3a22084640 1 -- 172.21.15.19:0/2523436240 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a1c0a0820 con 0x7f3a1c0a6570 2023-11-04T15:37:04.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.558+0000 7f3a22084640 1 -- 172.21.15.19:0/2523436240 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a1c067d60 con 0x7f3a1c0a6570 2023-11-04T15:37:04.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.558+0000 7f3a03fff640 1 -- 172.21.15.19:0/2523436240 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3a0c042070 con 0x7f3a1c0a6570 2023-11-04T15:37:04.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.559+0000 7f3a03fff640 1 --2- 172.21.15.19:0/2523436240 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f3a0806a430 0x7f3a0806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:04.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.559+0000 7f3a03fff640 1 -- 172.21.15.19:0/2523436240 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4462+0+0 (secure 0 0 0) 0x7f3a0c02d040 con 0x7f3a1c0a6570 2023-11-04T15:37:04.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.559+0000 7f3a1affd640 1 --2- 172.21.15.19:0/2523436240 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f3a0806a430 0x7f3a0806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:04.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.559+0000 7f3a1affd640 1 --2- 172.21.15.19:0/2523436240 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f3a0806a430 0x7f3a0806c8f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c0aaa90 tx=0x7f3a10008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:04.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.563+0000 7f3a03fff640 1 -- 172.21.15.19:0/2523436240 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3a0c0762e0 con 0x7f3a1c0a6570 2023-11-04T15:37:04.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.747+0000 7f3a22084640 1 -- 172.21.15.19:0/2523436240 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a1c09f1a0 con 0x7f3a1c0a6570 2023-11-04T15:37:04.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.748+0000 7f3a03fff640 1 -- 172.21.15.19:0/2523436240 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+13353 (secure 0 0 0) 0x7f3a1c09f1a0 con 0x7f3a1c0a6570 2023-11-04T15:37:04.751 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:37:04.751 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":44,"fsid":"e87311d5-496a-4b07-9654-358fe5bbf950","created":"2023-11-04T15:27:14.865121+0000","modified":"2023-11-04T15:37:04.713203+0000","last_up_change":"2023-11-04T15:27:24.162282+0000","last_in_change":"2023-11-04T15:27:15.971035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T15:27:24.987312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-04T15:27:30.500235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-04T15:27:34.476271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-04T15:27:35.096759+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":65,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"34818469-ebf2-4dd4-8119-af19a0121036","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":82879},{"type":"v1","addr":"172.21.15.19:6801","nonce":82879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":82879},{"type":"v1","addr":"172.21.15.19:6803","nonce":82879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":82879},{"type":"v1","addr":"172.21.15.19:6807","nonce":82879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":82879},{"type":"v1","addr":"172.21.15.19:6805","nonce":82879}]},"public_addr":"172.21.15.19:6801/82879","cluster_addr":"172.21.15.19:6803/82879","heartbeat_back_addr":"172.21.15.19:6807/82879","heartbeat_front_addr":"172.21.15.19:6805/82879","state":["exists","up"]},{"osd":1,"uuid":"92dab290-7912-4eea-b6f6-c754c2480721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":82880},{"type":"v1","addr":"172.21.15.19:6809","nonce":82880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":82880},{"type":"v1","addr":"172.21.15.19:6811","nonce":82880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":82880},{"type":"v1","addr":"172.21.15.19:6815","nonce":82880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":82880},{"type":"v1","addr":"172.21.15.19:6813","nonce":82880}]},"public_addr":"172.21.15.19:6809/82880","cluster_addr":"172.21.15.19:6811/82880","heartbeat_back_addr":"172.21.15.19:6815/82880","heartbeat_front_addr":"172.21.15.19:6813/82880","state":["exists","up"]},{"osd":2,"uuid":"1be47db4-6dd1-4ce5-832b-bc6ad30c78c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":83458},{"type":"v1","addr":"172.21.15.96:6808","nonce":83458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":83458},{"type":"v1","addr":"172.21.15.96:6811","nonce":83458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":83458},{"type":"v1","addr":"172.21.15.96:6815","nonce":83458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":83458},{"type":"v1","addr":"172.21.15.96:6813","nonce":83458}]},"public_addr":"172.21.15.96:6808/83458","cluster_addr":"172.21.15.96:6811/83458","heartbeat_back_addr":"172.21.15.96:6815/83458","heartbeat_front_addr":"172.21.15.96:6813/83458","state":["exists","up"]},{"osd":3,"uuid":"46505800-d64f-49ef-b811-5b5979f48252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":83459},{"type":"v1","addr":"172.21.15.96:6801","nonce":83459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":83459},{"type":"v1","addr":"172.21.15.96:6803","nonce":83459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6807","nonce":83459},{"type":"v1","addr":"172.21.15.96:6809","nonce":83459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":83459},{"type":"v1","addr":"172.21.15.96:6805","nonce":83459}]},"public_addr":"172.21.15.96:6801/83459","cluster_addr":"172.21.15.96:6803/83459","heartbeat_back_addr":"172.21.15.96:6809/83459","heartbeat_front_addr":"172.21.15.96:6805/83459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.081547+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.132075+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.094919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.074106+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.24","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.130:0/185843238":"2023-11-04T16:36:55.500269+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":4,"snaps":[{"begin":60,"length":6}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T15:37:04.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.750+0000 7f3a22084640 1 -- 172.21.15.19:0/2523436240 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f3a0806a430 msgr2=0x7f3a0806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:04.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.751+0000 7f3a22084640 1 --2- 172.21.15.19:0/2523436240 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f3a0806a430 0x7f3a0806c8f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c0aaa90 tx=0x7f3a10008040 comp rx=0 tx=0).stop 2023-11-04T15:37:04.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.751+0000 7f3a22084640 1 -- 172.21.15.19:0/2523436240 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a1c0a6570 msgr2=0x7f3a1c09c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:04.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.751+0000 7f3a22084640 1 --2- 172.21.15.19:0/2523436240 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a1c0a6570 0x7f3a1c09c7d0 secure :-1 s=READY pgs=3749 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0090b0 tx=0x7f3a0c0046c0 comp rx=0 tx=0).stop 2023-11-04T15:37:04.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.751+0000 7f3a22084640 1 -- 172.21.15.19:0/2523436240 shutdown_connections 2023-11-04T15:37:04.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.751+0000 7f3a22084640 1 --2- 172.21.15.19:0/2523436240 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f3a0806a430 0x7f3a0806c8f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:04.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.751+0000 7f3a22084640 1 --2- 172.21.15.19:0/2523436240 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3a1c13a560 0x7f3a1c09d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:04.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.751+0000 7f3a22084640 1 --2- 172.21.15.19:0/2523436240 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a1c136120 0x7f3a1c09cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:04.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.751+0000 7f3a22084640 1 --2- 172.21.15.19:0/2523436240 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a1c0a6570 0x7f3a1c09c7d0 unknown :-1 s=CLOSED pgs=3749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:04.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.751+0000 7f3a22084640 1 -- 172.21.15.19:0/2523436240 >> 172.21.15.19:0/2523436240 conn(0x7f3a1c0ac300 msgr2=0x7f3a1c097a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:04.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.751+0000 7f3a22084640 1 -- 172.21.15.19:0/2523436240 shutdown_connections 2023-11-04T15:37:04.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:04.751+0000 7f3a22084640 1 -- 172.21.15.19:0/2523436240 wait complete. 2023-11-04T15:37:05.766 INFO:tasks.ceph:Scrubbing osd.0 2023-11-04T15:37:05.767 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-04T15:37:05.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.889+0000 7f9509759640 1 Processor -- start 2023-11-04T15:37:05.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.889+0000 7f9509759640 1 -- start start 2023-11-04T15:37:05.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.890+0000 7f9509759640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9504135e30 0x7f95040a6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:05.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.890+0000 7f9509759640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9504136210 0x7f9504136670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:05.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.890+0000 7f9509759640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95040a4ea0 con 0x7f950413a040 2023-11-04T15:37:05.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.890+0000 7f9509759640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95040a53b0 con 0x7f9504135e30 2023-11-04T15:37:05.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.890+0000 7f9509759640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95040a4c20 con 0x7f9504136210 2023-11-04T15:37:05.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.890+0000 7f9502ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9504135e30 0x7f95040a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:05.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.890+0000 7f95037fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f950413a040 0x7f950413a490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58020/0 (socket says 172.21.15.19:58020) 2023-11-04T15:37:05.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.890+0000 7f95037fe640 1 -- 172.21.15.19:0/177329780 learned_addr learned my addr 172.21.15.19:0/177329780 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:37:05.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.890+0000 7f94fbfff640 1 --2- 172.21.15.19:0/177329780 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9504136210 0x7f9504136670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:05.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.890+0000 7f9502ffd640 1 -- 172.21.15.19:0/177329780 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9504136210 msgr2=0x7f9504136670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:05.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.890+0000 7f9502ffd640 1 --2- 172.21.15.19:0/177329780 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9504136210 0x7f9504136670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:05.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.890+0000 7f9502ffd640 1 -- 172.21.15.19:0/177329780 >> v1:172.21.15.19:6789/0 conn(0x7f950413a040 legacy=0x7f950413a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:05.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.890+0000 7f9502ffd640 1 -- 172.21.15.19:0/177329780 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95040a3fb0 con 0x7f9504135e30 2023-11-04T15:37:05.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.890+0000 7f95027fc640 1 -- 172.21.15.19:0/177329780 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2567395714 0 0) 0x7f95040a4ea0 con 0x7f950413a040 2023-11-04T15:37:05.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.891+0000 7f9502ffd640 1 --2- 172.21.15.19:0/177329780 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9504135e30 0x7f95040a6300 secure :-1 s=READY pgs=3751 cs=0 l=1 rev1=1 crypto rx=0x7f94f40097a0 tx=0x7f94f402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52b1666aaeb175b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:05.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.891+0000 7f95027fc640 1 -- 172.21.15.19:0/177329780 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f402e070 con 0x7f9504135e30 2023-11-04T15:37:05.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.891+0000 7f95027fc640 1 -- 172.21.15.19:0/177329780 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f40315a0 con 0x7f9504135e30 2023-11-04T15:37:05.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.891+0000 7f95027fc640 1 -- 172.21.15.19:0/177329780 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f4031930 con 0x7f9504135e30 2023-11-04T15:37:05.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.892+0000 7f9509759640 1 -- 172.21.15.19:0/177329780 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9504135e30 msgr2=0x7f95040a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:05.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.892+0000 7f9509759640 1 --2- 172.21.15.19:0/177329780 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9504135e30 0x7f95040a6300 secure :-1 s=READY pgs=3751 cs=0 l=1 rev1=1 crypto rx=0x7f94f40097a0 tx=0x7f94f402b840 comp rx=0 tx=0).stop 2023-11-04T15:37:05.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.892+0000 7f9509759640 1 -- 172.21.15.19:0/177329780 shutdown_connections 2023-11-04T15:37:05.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.892+0000 7f9509759640 1 --2- 172.21.15.19:0/177329780 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9504136210 0x7f9504136670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:05.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.892+0000 7f9509759640 1 --2- 172.21.15.19:0/177329780 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9504135e30 0x7f95040a6300 unknown :-1 s=CLOSED pgs=3751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:05.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.892+0000 7f9509759640 1 -- 172.21.15.19:0/177329780 >> 172.21.15.19:0/177329780 conn(0x7f95040a8d70 msgr2=0x7f95040a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:05.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.892+0000 7f9509759640 1 -- 172.21.15.19:0/177329780 shutdown_connections 2023-11-04T15:37:05.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.892+0000 7f9509759640 1 -- 172.21.15.19:0/177329780 wait complete. 2023-11-04T15:37:05.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.893+0000 7f9509759640 1 Processor -- start 2023-11-04T15:37:05.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.893+0000 7f9509759640 1 -- start start 2023-11-04T15:37:05.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.893+0000 7f9509759640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9504135e30 0x7f9504134d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:05.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.893+0000 7f9509759640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9504136210 0x7f95041352d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:05.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.893+0000 7f9509759640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f950413a040 0x7f95041ce6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:05.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.893+0000 7f9509759640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9504098d50 con 0x7f9504136210 2023-11-04T15:37:05.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.893+0000 7f9509759640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950409acd0 con 0x7f950413a040 2023-11-04T15:37:05.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.893+0000 7f9509759640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95040a2840 con 0x7f9504135e30 2023-11-04T15:37:05.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.893+0000 7f94fbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9504136210 0x7f95041352d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:05.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.893+0000 7f94fbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9504136210 0x7f95041352d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60520/0 (socket says 172.21.15.19:60520) 2023-11-04T15:37:05.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.893+0000 7f94fbfff640 1 -- 172.21.15.19:0/2309690941 learned_addr learned my addr 172.21.15.19:0/2309690941 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:37:05.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.893+0000 7f9502ffd640 1 --2- 172.21.15.19:0/2309690941 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9504135e30 0x7f9504134d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:05.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.893+0000 7f95037fe640 1 --2- 172.21.15.19:0/2309690941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f950413a040 0x7f95041ce6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:05.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.894+0000 7f94fbfff640 1 -- 172.21.15.19:0/2309690941 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9504135e30 msgr2=0x7f9504134d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:05.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.894+0000 7f94fbfff640 1 --2- 172.21.15.19:0/2309690941 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9504135e30 0x7f9504134d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:05.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.894+0000 7f94fbfff640 1 -- 172.21.15.19:0/2309690941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f950413a040 msgr2=0x7f95041ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:05.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.894+0000 7f94fbfff640 1 --2- 172.21.15.19:0/2309690941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f950413a040 0x7f95041ce6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:05.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.894+0000 7f94fbfff640 1 -- 172.21.15.19:0/2309690941 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f4009400 con 0x7f9504136210 2023-11-04T15:37:05.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.894+0000 7f94fbfff640 1 --2- 172.21.15.19:0/2309690941 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9504136210 0x7f95041352d0 secure :-1 s=READY pgs=3752 cs=0 l=1 rev1=1 crypto rx=0x7f94ec00e9b0 tx=0x7f94ec00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:05.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.894+0000 7f94fb7fe640 1 -- 172.21.15.19:0/2309690941 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec009670 con 0x7f9504136210 2023-11-04T15:37:05.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.894+0000 7f94fb7fe640 1 -- 172.21.15.19:0/2309690941 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ec00c9a0 con 0x7f9504136210 2023-11-04T15:37:05.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.894+0000 7f9509759640 1 -- 172.21.15.19:0/2309690941 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f950409ccc0 con 0x7f9504136210 2023-11-04T15:37:05.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.894+0000 7f94fb7fe640 1 -- 172.21.15.19:0/2309690941 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec00cd50 con 0x7f9504136210 2023-11-04T15:37:05.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.894+0000 7f9509759640 1 -- 172.21.15.19:0/2309690941 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95040a2530 con 0x7f9504136210 2023-11-04T15:37:05.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.895+0000 7f9509759640 1 -- 172.21.15.19:0/2309690941 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f95040a30a0 con 0x7f9504136210 2023-11-04T15:37:05.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.896+0000 7f94fb7fe640 1 -- 172.21.15.19:0/2309690941 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f94ec013470 con 0x7f9504136210 2023-11-04T15:37:05.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.896+0000 7f94fb7fe640 1 --2- 172.21.15.19:0/2309690941 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f94e406a430 0x7f94e406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:05.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.896+0000 7f94fb7fe640 1 -- 172.21.15.19:0/2309690941 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4434+0+0 (secure 0 0 0) 0x7f94ec0885b0 con 0x7f9504136210 2023-11-04T15:37:05.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.896+0000 7f94fb7fe640 1 --2- 172.21.15.19:0/2309690941 >> [v2:172.21.15.19:6800/82879,v1:172.21.15.19:6801/82879] conn(0x7f94e40721a0 0x7f94e4074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:05.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.896+0000 7f94fb7fe640 1 -- 172.21.15.19:0/2309690941 --> [v2:172.21.15.19:6800/82879,v1:172.21.15.19:6801/82879] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f94e4074cf0 con 0x7f94e40721a0 2023-11-04T15:37:05.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.896+0000 7f94fb7fe640 1 -- 172.21.15.19:0/2309690941 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94ec08ac70 con 0x7f9504136210 2023-11-04T15:37:05.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.896+0000 7f9502ffd640 1 --2- 172.21.15.19:0/2309690941 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f94e406a430 0x7f94e406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:05.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.896+0000 7f95037fe640 1 --2- 172.21.15.19:0/2309690941 >> [v2:172.21.15.19:6800/82879,v1:172.21.15.19:6801/82879] conn(0x7f94e40721a0 0x7f94e4074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:05.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.897+0000 7f95037fe640 1 --2- 172.21.15.19:0/2309690941 >> [v2:172.21.15.19:6800/82879,v1:172.21.15.19:6801/82879] conn(0x7f94e40721a0 0x7f94e4074620 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:05.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.897+0000 7f9502ffd640 1 --2- 172.21.15.19:0/2309690941 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f94e406a430 0x7f94e406c8f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f94f4036000 tx=0x7f94f403d040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:05.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.897+0000 7f94fb7fe640 1 -- 172.21.15.19:0/2309690941 <== osd.0 v2:172.21.15.19:6800/82879 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f94e4074cf0 con 0x7f94e40721a0 2023-11-04T15:37:05.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.911+0000 7f9509759640 1 -- 172.21.15.19:0/2309690941 --> [v2:172.21.15.19:6800/82879,v1:172.21.15.19:6801/82879] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f95040a50f0 con 0x7f94e40721a0 2023-11-04T15:37:05.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.911+0000 7f94fb7fe640 1 -- 172.21.15.19:0/2309690941 <== osd.0 v2:172.21.15.19:6800/82879 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f94fc004e00 con 0x7f94e40721a0 2023-11-04T15:37:05.913 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2023-11-04T15:37:05.913 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-04T15:37:05.914 INFO:teuthology.orchestra.run.smithi019.stdout:} 2023-11-04T15:37:05.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.911+0000 7f9509759640 1 -- 172.21.15.19:0/2309690941 >> [v2:172.21.15.19:6800/82879,v1:172.21.15.19:6801/82879] conn(0x7f94e40721a0 msgr2=0x7f94e4074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:05.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.911+0000 7f9509759640 1 --2- 172.21.15.19:0/2309690941 >> [v2:172.21.15.19:6800/82879,v1:172.21.15.19:6801/82879] conn(0x7f94e40721a0 0x7f94e4074620 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:05.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.911+0000 7f9509759640 1 -- 172.21.15.19:0/2309690941 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f94e406a430 msgr2=0x7f94e406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:05.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.911+0000 7f9509759640 1 --2- 172.21.15.19:0/2309690941 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f94e406a430 0x7f94e406c8f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f94f4036000 tx=0x7f94f403d040 comp rx=0 tx=0).stop 2023-11-04T15:37:05.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.911+0000 7f9509759640 1 -- 172.21.15.19:0/2309690941 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9504136210 msgr2=0x7f95041352d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:05.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.911+0000 7f9509759640 1 --2- 172.21.15.19:0/2309690941 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9504136210 0x7f95041352d0 secure :-1 s=READY pgs=3752 cs=0 l=1 rev1=1 crypto rx=0x7f94ec00e9b0 tx=0x7f94ec00ee70 comp rx=0 tx=0).stop 2023-11-04T15:37:05.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.911+0000 7f95037fe640 1 -- 172.21.15.19:0/2309690941 reap_dead start 2023-11-04T15:37:05.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.911+0000 7f9509759640 1 -- 172.21.15.19:0/2309690941 shutdown_connections 2023-11-04T15:37:05.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.911+0000 7f9509759640 1 -- 172.21.15.19:0/2309690941 >> 172.21.15.19:0/2309690941 conn(0x7f95040a8d70 msgr2=0x7f95041c2290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:05.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.911+0000 7f9509759640 1 -- 172.21.15.19:0/2309690941 shutdown_connections 2023-11-04T15:37:05.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:05.911+0000 7f9509759640 1 -- 172.21.15.19:0/2309690941 wait complete. 2023-11-04T15:37:05.927 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-04T15:37:06.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.034+0000 7f9881ebd640 1 Processor -- start 2023-11-04T15:37:06.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.034+0000 7f9881ebd640 1 -- start start 2023-11-04T15:37:06.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.035+0000 7f9881ebd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f987c0a3e90 0x7f987c0a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:06.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.035+0000 7f9881ebd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f987c137650 0x7f987c13a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:06.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.035+0000 7f9881ebd640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f987c0a4c20 con 0x7f987c137270 2023-11-04T15:37:06.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.035+0000 7f9881ebd640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f987c0a3060 con 0x7f987c137650 2023-11-04T15:37:06.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.035+0000 7f9881ebd640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f987c0a5080 con 0x7f987c0a3e90 2023-11-04T15:37:06.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.035+0000 7f987affd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f987c0a3e90 0x7f987c0a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:06.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.035+0000 7f987bfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f987c137650 0x7f987c13a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:06.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.035+0000 7f987affd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f987c0a3e90 0x7f987c0a6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.19:59492/0 (socket says 172.21.15.19:59492) 2023-11-04T15:37:06.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.035+0000 7f987affd640 1 -- 172.21.15.19:0/2148922410 learned_addr learned my addr 172.21.15.19:0/2148922410 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:37:06.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.035+0000 7f987affd640 1 -- 172.21.15.19:0/2148922410 >> v2:172.21.15.96:3300/0 conn(0x7f987c137650 msgr2=0x7f987c13a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:06.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.035+0000 7f987affd640 1 --2- 172.21.15.19:0/2148922410 >> v2:172.21.15.96:3300/0 conn(0x7f987c137650 0x7f987c13a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.035+0000 7f987a7fc640 1 -- 172.21.15.19:0/2148922410 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1421431629 0 0) 0x7f987c0a4c20 con 0x7f987c137270 2023-11-04T15:37:06.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.035+0000 7f987affd640 1 -- 172.21.15.19:0/2148922410 >> v1:172.21.15.96:6789/0 conn(0x7f987c137270 legacy=0x7f987c139f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:06.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.035+0000 7f987affd640 1 -- 172.21.15.19:0/2148922410 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f987c0a3440 con 0x7f987c0a3e90 2023-11-04T15:37:06.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.036+0000 7f987affd640 1 --2- 172.21.15.19:0/2148922410 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f987c0a3e90 0x7f987c0a6200 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f9870009870 tx=0x7f987002b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d96c66dad1fb3bd1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:06.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.036+0000 7f987a7fc640 1 -- 172.21.15.19:0/2148922410 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98700317c0 con 0x7f987c0a3e90 2023-11-04T15:37:06.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.036+0000 7f987a7fc640 1 -- 172.21.15.19:0/2148922410 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9870031920 con 0x7f987c0a3e90 2023-11-04T15:37:06.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.036+0000 7f987a7fc640 1 -- 172.21.15.19:0/2148922410 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9870031cb0 con 0x7f987c0a3e90 2023-11-04T15:37:06.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.037+0000 7f9881ebd640 1 -- 172.21.15.19:0/2148922410 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f987c0a3e90 msgr2=0x7f987c0a6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:06.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.037+0000 7f9881ebd640 1 --2- 172.21.15.19:0/2148922410 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f987c0a3e90 0x7f987c0a6200 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f9870009870 tx=0x7f987002b860 comp rx=0 tx=0).stop 2023-11-04T15:37:06.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.037+0000 7f9881ebd640 1 -- 172.21.15.19:0/2148922410 shutdown_connections 2023-11-04T15:37:06.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.037+0000 7f9881ebd640 1 --2- 172.21.15.19:0/2148922410 >> v2:172.21.15.96:3300/0 conn(0x7f987c137650 0x7f987c13a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.037+0000 7f9881ebd640 1 --2- 172.21.15.19:0/2148922410 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f987c0a3e90 0x7f987c0a6200 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.037+0000 7f9881ebd640 1 -- 172.21.15.19:0/2148922410 >> 172.21.15.19:0/2148922410 conn(0x7f987c0a8d70 msgr2=0x7f987c0a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:06.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.037+0000 7f9881ebd640 1 -- 172.21.15.19:0/2148922410 shutdown_connections 2023-11-04T15:37:06.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.037+0000 7f9881ebd640 1 -- 172.21.15.19:0/2148922410 wait complete. 2023-11-04T15:37:06.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.038+0000 7f9881ebd640 1 Processor -- start 2023-11-04T15:37:06.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.038+0000 7f9881ebd640 1 -- start start 2023-11-04T15:37:06.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.039+0000 7f9881ebd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f987c0a3e90 0x7f987c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:06.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.039+0000 7f9881ebd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f987c137270 0x7f987c133f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:06.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.039+0000 7f9881ebd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f987c137650 0x7f987c1344b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:06.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.039+0000 7f9881ebd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f987c09f060 con 0x7f987c0a3e90 2023-11-04T15:37:06.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.039+0000 7f9881ebd640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f987c09ea20 con 0x7f987c137270 2023-11-04T15:37:06.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.039+0000 7f9881ebd640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f987c09d810 con 0x7f987c137650 2023-11-04T15:37:06.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.039+0000 7f987b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f987c0a3e90 0x7f987c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:06.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.039+0000 7f987b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f987c0a3e90 0x7f987c133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60522/0 (socket says 172.21.15.19:60522) 2023-11-04T15:37:06.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.039+0000 7f987b7fe640 1 -- 172.21.15.19:0/708797433 learned_addr learned my addr 172.21.15.19:0/708797433 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:37:06.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.039+0000 7f987bfff640 1 --2- 172.21.15.19:0/708797433 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f987c137650 0x7f987c1344b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:06.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.039+0000 7f987affd640 1 --2- 172.21.15.19:0/708797433 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f987c137270 0x7f987c133f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:06.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.039+0000 7f987b7fe640 1 -- 172.21.15.19:0/708797433 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f987c137650 msgr2=0x7f987c1344b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:06.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.039+0000 7f987b7fe640 1 --2- 172.21.15.19:0/708797433 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f987c137650 0x7f987c1344b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.039+0000 7f987b7fe640 1 -- 172.21.15.19:0/708797433 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f987c137270 msgr2=0x7f987c133f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:06.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.039+0000 7f987b7fe640 1 --2- 172.21.15.19:0/708797433 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f987c137270 0x7f987c133f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.039+0000 7f987b7fe640 1 -- 172.21.15.19:0/708797433 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98700094d0 con 0x7f987c0a3e90 2023-11-04T15:37:06.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.039+0000 7f987b7fe640 1 --2- 172.21.15.19:0/708797433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f987c0a3e90 0x7f987c133a30 secure :-1 s=READY pgs=3753 cs=0 l=1 rev1=1 crypto rx=0x7f986c00c460 tx=0x7f986c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:06.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.039+0000 7f9863fff640 1 -- 172.21.15.19:0/708797433 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c005480 con 0x7f987c0a3e90 2023-11-04T15:37:06.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.039+0000 7f9863fff640 1 -- 172.21.15.19:0/708797433 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986c0035f0 con 0x7f987c0a3e90 2023-11-04T15:37:06.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.039+0000 7f9881ebd640 1 -- 172.21.15.19:0/708797433 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f987c09f560 con 0x7f987c0a3e90 2023-11-04T15:37:06.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.039+0000 7f9863fff640 1 -- 172.21.15.19:0/708797433 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c0039a0 con 0x7f987c0a3e90 2023-11-04T15:37:06.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.039+0000 7f9881ebd640 1 -- 172.21.15.19:0/708797433 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f987c09fb00 con 0x7f987c0a3e90 2023-11-04T15:37:06.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.040+0000 7f9881ebd640 1 -- 172.21.15.19:0/708797433 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f987c067d60 con 0x7f987c0a3e90 2023-11-04T15:37:06.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.041+0000 7f9863fff640 1 -- 172.21.15.19:0/708797433 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f986c003b00 con 0x7f987c0a3e90 2023-11-04T15:37:06.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.041+0000 7f9863fff640 1 --2- 172.21.15.19:0/708797433 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f986806a430 0x7f986806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:06.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.041+0000 7f9863fff640 1 -- 172.21.15.19:0/708797433 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4434+0+0 (secure 0 0 0) 0x7f986c087d60 con 0x7f987c0a3e90 2023-11-04T15:37:06.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.041+0000 7f987affd640 1 --2- 172.21.15.19:0/708797433 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f986806a430 0x7f986806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:06.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.042+0000 7f987affd640 1 --2- 172.21.15.19:0/708797433 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f986806a430 0x7f986806c8f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9870036000 tx=0x7f987003d040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:06.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.046+0000 7f9863fff640 1 -- 172.21.15.19:0/708797433 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f986c053980 con 0x7f987c0a3e90 2023-11-04T15:37:06.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.224+0000 7f9881ebd640 1 -- 172.21.15.19:0/708797433 --> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f987c0a5340 con 0x7f986806a430 2023-11-04T15:37:06.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.225+0000 7f9863fff640 1 -- 172.21.15.19:0/708797433 <== mgr.4114 v2:172.21.15.96:6816/83123 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9870031b10 con 0x7f986806a430 2023-11-04T15:37:06.227 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 0 to deep-scrub 2023-11-04T15:37:06.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.227+0000 7f9881ebd640 1 -- 172.21.15.19:0/708797433 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f986806a430 msgr2=0x7f986806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:06.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.227+0000 7f9881ebd640 1 --2- 172.21.15.19:0/708797433 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f986806a430 0x7f986806c8f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9870036000 tx=0x7f987003d040 comp rx=0 tx=0).stop 2023-11-04T15:37:06.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.227+0000 7f9881ebd640 1 -- 172.21.15.19:0/708797433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f987c0a3e90 msgr2=0x7f987c133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:06.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.227+0000 7f9881ebd640 1 --2- 172.21.15.19:0/708797433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f987c0a3e90 0x7f987c133a30 secure :-1 s=READY pgs=3753 cs=0 l=1 rev1=1 crypto rx=0x7f986c00c460 tx=0x7f986c00c920 comp rx=0 tx=0).stop 2023-11-04T15:37:06.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.227+0000 7f9881ebd640 1 -- 172.21.15.19:0/708797433 shutdown_connections 2023-11-04T15:37:06.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.227+0000 7f9881ebd640 1 --2- 172.21.15.19:0/708797433 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f986806a430 0x7f986806c8f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.227+0000 7f9881ebd640 1 --2- 172.21.15.19:0/708797433 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f987c137650 0x7f987c1344b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.227+0000 7f9881ebd640 1 --2- 172.21.15.19:0/708797433 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f987c137270 0x7f987c133f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.227+0000 7f9881ebd640 1 --2- 172.21.15.19:0/708797433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f987c0a3e90 0x7f987c133a30 unknown :-1 s=CLOSED pgs=3753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.227+0000 7f9881ebd640 1 -- 172.21.15.19:0/708797433 >> 172.21.15.19:0/708797433 conn(0x7f987c0a8d70 msgr2=0x7f987c0aa870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:06.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.227+0000 7f9881ebd640 1 -- 172.21.15.19:0/708797433 shutdown_connections 2023-11-04T15:37:06.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.227+0000 7f9881ebd640 1 -- 172.21.15.19:0/708797433 wait complete. 2023-11-04T15:37:06.242 INFO:tasks.ceph:Scrubbing osd.1 2023-11-04T15:37:06.243 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-04T15:37:06.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.352+0000 7f4a575d2640 1 Processor -- start 2023-11-04T15:37:06.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.353+0000 7f4a575d2640 1 -- start start 2023-11-04T15:37:06.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.353+0000 7f4a575d2640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4a50069c70 0x7f4a5013a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:06.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.353+0000 7f4a575d2640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a500a1110 con 0x7f4a500a1630 2023-11-04T15:37:06.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.353+0000 7f4a575d2640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a500a1dd0 con 0x7f4a501402b0 2023-11-04T15:37:06.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.353+0000 7f4a575d2640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5006a070 con 0x7f4a50069c70 2023-11-04T15:37:06.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.353+0000 7f4a5536e640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4a500a1630 0x7f4a50139f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58036/0 (socket says 172.21.15.19:58036) 2023-11-04T15:37:06.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.353+0000 7f4a5536e640 1 -- 172.21.15.19:0/1203505574 learned_addr learned my addr 172.21.15.19:0/1203505574 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:37:06.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.353+0000 7f4a47fff640 1 -- 172.21.15.19:0/1203505574 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 899773558 0 0) 0x7f4a500a1110 con 0x7f4a500a1630 2023-11-04T15:37:06.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.353+0000 7f4a54b6d640 1 --2- 172.21.15.19:0/1203505574 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4a50069c70 0x7f4a5013a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:06.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.353+0000 7f4a47fff640 1 -- 172.21.15.19:0/1203505574 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a3c003520 con 0x7f4a500a1630 2023-11-04T15:37:06.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.354+0000 7f4a47fff640 1 -- 172.21.15.19:0/1203505574 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1534738378 0 0) 0x7f4a3c003520 con 0x7f4a500a1630 2023-11-04T15:37:06.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.354+0000 7f4a47fff640 1 -- 172.21.15.19:0/1203505574 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4a50069c70 msgr2=0x7f4a5013a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:06.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.354+0000 7f4a47fff640 1 --2- 172.21.15.19:0/1203505574 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4a50069c70 0x7f4a5013a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.354+0000 7f4a47fff640 1 -- 172.21.15.19:0/1203505574 >> v1:172.21.15.96:6789/0 conn(0x7f4a501402b0 legacy=0x7f4a501426a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:06.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.354+0000 7f4a47fff640 1 -- 172.21.15.19:0/1203505574 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a500a0b70 con 0x7f4a500a1630 2023-11-04T15:37:06.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.354+0000 7f4a47fff640 1 -- 172.21.15.19:0/1203505574 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3646097784 0 0) 0x7f4a4c001670 con 0x7f4a500a1630 2023-11-04T15:37:06.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.354+0000 7f4a47fff640 1 -- 172.21.15.19:0/1203505574 >> v1:172.21.15.19:6789/0 conn(0x7f4a500a1630 legacy=0x7f4a50139f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:06.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.354+0000 7f4a47fff640 1 --2- 172.21.15.19:0/1203505574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a3c0039a0 0x7f4a3c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:06.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.354+0000 7f4a47fff640 1 --2- 172.21.15.19:0/1203505574 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a3c0047c0 0x7f4a3c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:06.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.354+0000 7f4a47fff640 1 --2- 172.21.15.19:0/1203505574 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4a50069c70 0x7f4a3c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:06.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.354+0000 7f4a47fff640 1 -- 172.21.15.19:0/1203505574 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5006a070 con 0x7f4a3c0039a0 2023-11-04T15:37:06.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.354+0000 7f4a47fff640 1 -- 172.21.15.19:0/1203505574 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3c00bab0 con 0x7f4a3c0047c0 2023-11-04T15:37:06.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.354+0000 7f4a47fff640 1 -- 172.21.15.19:0/1203505574 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3c00bc70 con 0x7f4a50069c70 2023-11-04T15:37:06.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.354+0000 7f4a5536e640 1 --2- 172.21.15.19:0/1203505574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a3c0039a0 0x7f4a3c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:06.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.354+0000 7f4a54b6d640 1 --2- 172.21.15.19:0/1203505574 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a3c0047c0 0x7f4a3c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:06.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.354+0000 7f4a55b6f640 1 --2- 172.21.15.19:0/1203505574 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4a50069c70 0x7f4a3c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:06.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.354+0000 7f4a5536e640 1 -- 172.21.15.19:0/1203505574 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4a50069c70 msgr2=0x7f4a3c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:06.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.354+0000 7f4a5536e640 1 --2- 172.21.15.19:0/1203505574 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4a50069c70 0x7f4a3c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.354+0000 7f4a5536e640 1 -- 172.21.15.19:0/1203505574 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a3c0047c0 msgr2=0x7f4a3c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:06.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.354+0000 7f4a5536e640 1 --2- 172.21.15.19:0/1203505574 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a3c0047c0 0x7f4a3c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.354+0000 7f4a5536e640 1 -- 172.21.15.19:0/1203505574 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a3c003520 con 0x7f4a3c0039a0 2023-11-04T15:37:06.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.355+0000 7f4a5536e640 1 --2- 172.21.15.19:0/1203505574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a3c0039a0 0x7f4a3c003dc0 secure :-1 s=READY pgs=3755 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c00c240 tx=0x7f4a3c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf77fbd0febb554 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:06.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.355+0000 7f4a47fff640 1 -- 172.21.15.19:0/1203505574 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c005ad0 con 0x7f4a3c0039a0 2023-11-04T15:37:06.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.355+0000 7f4a47fff640 1 -- 172.21.15.19:0/1203505574 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4c005c30 con 0x7f4a3c0039a0 2023-11-04T15:37:06.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.355+0000 7f4a47fff640 1 -- 172.21.15.19:0/1203505574 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c02c8b0 con 0x7f4a3c0039a0 2023-11-04T15:37:06.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.356+0000 7f4a575d2640 1 -- 172.21.15.19:0/1203505574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a3c0039a0 msgr2=0x7f4a3c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:06.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.356+0000 7f4a575d2640 1 --2- 172.21.15.19:0/1203505574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a3c0039a0 0x7f4a3c003dc0 secure :-1 s=READY pgs=3755 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c00c240 tx=0x7f4a3c0057f0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.356+0000 7f4a55b6f640 1 -- 172.21.15.19:0/1203505574 reap_dead start 2023-11-04T15:37:06.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.356+0000 7f4a575d2640 1 -- 172.21.15.19:0/1203505574 shutdown_connections 2023-11-04T15:37:06.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.356+0000 7f4a575d2640 1 -- 172.21.15.19:0/1203505574 >> 172.21.15.19:0/1203505574 conn(0x7f4a500a8f00 msgr2=0x7f4a500a9310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:06.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.356+0000 7f4a575d2640 1 -- 172.21.15.19:0/1203505574 shutdown_connections 2023-11-04T15:37:06.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.356+0000 7f4a575d2640 1 -- 172.21.15.19:0/1203505574 wait complete. 2023-11-04T15:37:06.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.357+0000 7f4a575d2640 1 Processor -- start 2023-11-04T15:37:06.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.357+0000 7f4a575d2640 1 -- start start 2023-11-04T15:37:06.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.357+0000 7f4a575d2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a3c0039a0 0x7f4a501cf390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:06.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.357+0000 7f4a575d2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a5013b510 0x7f4a501cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:06.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.357+0000 7f4a575d2640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4a501cb940 0x7f4a501cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:06.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.357+0000 7f4a575d2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5013bb10 con 0x7f4a3c0039a0 2023-11-04T15:37:06.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.357+0000 7f4a575d2640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a501cfe10 con 0x7f4a5013b510 2023-11-04T15:37:06.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.357+0000 7f4a575d2640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5009f470 con 0x7f4a501cb940 2023-11-04T15:37:06.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.357+0000 7f4a5536e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a3c0039a0 0x7f4a501cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:06.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.357+0000 7f4a5536e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a3c0039a0 0x7f4a501cf390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60540/0 (socket says 172.21.15.19:60540) 2023-11-04T15:37:06.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.357+0000 7f4a5536e640 1 -- 172.21.15.19:0/3209581305 learned_addr learned my addr 172.21.15.19:0/3209581305 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:37:06.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.357+0000 7f4a54b6d640 1 --2- 172.21.15.19:0/3209581305 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a5013b510 0x7f4a501cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:06.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.357+0000 7f4a55b6f640 1 --2- 172.21.15.19:0/3209581305 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4a501cb940 0x7f4a501cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:06.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.358+0000 7f4a5536e640 1 -- 172.21.15.19:0/3209581305 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4a501cb940 msgr2=0x7f4a501cbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:06.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.358+0000 7f4a5536e640 1 --2- 172.21.15.19:0/3209581305 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4a501cb940 0x7f4a501cbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.358+0000 7f4a5536e640 1 -- 172.21.15.19:0/3209581305 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a5013b510 msgr2=0x7f4a501cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:06.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.358+0000 7f4a5536e640 1 --2- 172.21.15.19:0/3209581305 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a5013b510 0x7f4a501cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.358+0000 7f4a5536e640 1 -- 172.21.15.19:0/3209581305 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5009db00 con 0x7f4a3c0039a0 2023-11-04T15:37:06.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.358+0000 7f4a5536e640 1 --2- 172.21.15.19:0/3209581305 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a3c0039a0 0x7f4a501cf390 secure :-1 s=READY pgs=3756 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c02c450 tx=0x7f4a4c001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:06.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.358+0000 7f4a45ffb640 1 -- 172.21.15.19:0/3209581305 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c039030 con 0x7f4a3c0039a0 2023-11-04T15:37:06.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.358+0000 7f4a45ffb640 1 -- 172.21.15.19:0/3209581305 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4c02ccc0 con 0x7f4a3c0039a0 2023-11-04T15:37:06.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.358+0000 7f4a575d2640 1 -- 172.21.15.19:0/3209581305 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a5009f850 con 0x7f4a3c0039a0 2023-11-04T15:37:06.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.358+0000 7f4a45ffb640 1 -- 172.21.15.19:0/3209581305 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c03c040 con 0x7f4a3c0039a0 2023-11-04T15:37:06.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.358+0000 7f4a575d2640 1 -- 172.21.15.19:0/3209581305 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a5009d840 con 0x7f4a3c0039a0 2023-11-04T15:37:06.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.359+0000 7f4a575d2640 1 -- 172.21.15.19:0/3209581305 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4a500a1a10 con 0x7f4a3c0039a0 2023-11-04T15:37:06.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.360+0000 7f4a45ffb640 1 -- 172.21.15.19:0/3209581305 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4a4c032070 con 0x7f4a3c0039a0 2023-11-04T15:37:06.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.360+0000 7f4a45ffb640 1 --2- 172.21.15.19:0/3209581305 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f4a3406a430 0x7f4a3406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:06.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.360+0000 7f4a45ffb640 1 -- 172.21.15.19:0/3209581305 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4434+0+0 (secure 0 0 0) 0x7f4a4c0a96b0 con 0x7f4a3c0039a0 2023-11-04T15:37:06.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.360+0000 7f4a54b6d640 1 --2- 172.21.15.19:0/3209581305 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f4a3406a430 0x7f4a3406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:06.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.360+0000 7f4a45ffb640 1 --2- 172.21.15.19:0/3209581305 >> [v2:172.21.15.19:6808/82880,v1:172.21.15.19:6809/82880] conn(0x7f4a340721a0 0x7f4a34074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:06.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.360+0000 7f4a45ffb640 1 -- 172.21.15.19:0/3209581305 --> [v2:172.21.15.19:6808/82880,v1:172.21.15.19:6809/82880] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4a34074cf0 con 0x7f4a340721a0 2023-11-04T15:37:06.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.360+0000 7f4a45ffb640 1 -- 172.21.15.19:0/3209581305 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a4c0abd70 con 0x7f4a3c0039a0 2023-11-04T15:37:06.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.360+0000 7f4a55b6f640 1 --2- 172.21.15.19:0/3209581305 >> [v2:172.21.15.19:6808/82880,v1:172.21.15.19:6809/82880] conn(0x7f4a340721a0 0x7f4a34074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:06.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.361+0000 7f4a54b6d640 1 --2- 172.21.15.19:0/3209581305 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f4a3406a430 0x7f4a3406c8f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4a5009d640 tx=0x7f4a40009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:06.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.361+0000 7f4a55b6f640 1 --2- 172.21.15.19:0/3209581305 >> [v2:172.21.15.19:6808/82880,v1:172.21.15.19:6809/82880] conn(0x7f4a340721a0 0x7f4a34074620 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:06.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.361+0000 7f4a45ffb640 1 -- 172.21.15.19:0/3209581305 <== osd.1 v2:172.21.15.19:6808/82880 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4a34074cf0 con 0x7f4a340721a0 2023-11-04T15:37:06.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.374+0000 7f4a575d2640 1 -- 172.21.15.19:0/3209581305 --> [v2:172.21.15.19:6808/82880,v1:172.21.15.19:6809/82880] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4a5009e5f0 con 0x7f4a340721a0 2023-11-04T15:37:06.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.374+0000 7f4a45ffb640 1 -- 172.21.15.19:0/3209581305 <== osd.1 v2:172.21.15.19:6808/82880 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4a5009e5f0 con 0x7f4a340721a0 2023-11-04T15:37:06.377 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2023-11-04T15:37:06.378 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-04T15:37:06.378 INFO:teuthology.orchestra.run.smithi019.stdout:} 2023-11-04T15:37:06.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.375+0000 7f4a575d2640 1 -- 172.21.15.19:0/3209581305 >> [v2:172.21.15.19:6808/82880,v1:172.21.15.19:6809/82880] conn(0x7f4a340721a0 msgr2=0x7f4a34074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:06.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.375+0000 7f4a575d2640 1 --2- 172.21.15.19:0/3209581305 >> [v2:172.21.15.19:6808/82880,v1:172.21.15.19:6809/82880] conn(0x7f4a340721a0 0x7f4a34074620 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.375+0000 7f4a575d2640 1 -- 172.21.15.19:0/3209581305 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f4a3406a430 msgr2=0x7f4a3406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:06.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.375+0000 7f4a575d2640 1 --2- 172.21.15.19:0/3209581305 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f4a3406a430 0x7f4a3406c8f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4a5009d640 tx=0x7f4a40009190 comp rx=0 tx=0).stop 2023-11-04T15:37:06.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.375+0000 7f4a575d2640 1 -- 172.21.15.19:0/3209581305 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a3c0039a0 msgr2=0x7f4a501cf390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:06.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.375+0000 7f4a575d2640 1 --2- 172.21.15.19:0/3209581305 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a3c0039a0 0x7f4a501cf390 secure :-1 s=READY pgs=3756 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c02c450 tx=0x7f4a4c001a00 comp rx=0 tx=0).stop 2023-11-04T15:37:06.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.375+0000 7f4a55b6f640 1 -- 172.21.15.19:0/3209581305 reap_dead start 2023-11-04T15:37:06.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.375+0000 7f4a575d2640 1 -- 172.21.15.19:0/3209581305 shutdown_connections 2023-11-04T15:37:06.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.375+0000 7f4a575d2640 1 -- 172.21.15.19:0/3209581305 >> 172.21.15.19:0/3209581305 conn(0x7f4a500a8f00 msgr2=0x7f4a500a6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:06.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.375+0000 7f4a575d2640 1 -- 172.21.15.19:0/3209581305 shutdown_connections 2023-11-04T15:37:06.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.375+0000 7f4a575d2640 1 -- 172.21.15.19:0/3209581305 wait complete. 2023-11-04T15:37:06.389 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-04T15:37:06.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.495+0000 7f6fd1041640 1 Processor -- start 2023-11-04T15:37:06.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.495+0000 7f6fd1041640 1 -- start start 2023-11-04T15:37:06.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.496+0000 7f6fd1041640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6fcc137270 0x7f6fcc0a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:06.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.496+0000 7f6fd1041640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fcc0a4c20 con 0x7f6fcc0a3e90 2023-11-04T15:37:06.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.496+0000 7f6fd1041640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fcc13ad80 con 0x7f6fcc137650 2023-11-04T15:37:06.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.496+0000 7f6fd1041640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc0a3060 con 0x7f6fcc137270 2023-11-04T15:37:06.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.496+0000 7f6fca59c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6fcc0a3e90 0x7f6fcc139f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58046/0 (socket says 172.21.15.19:58046) 2023-11-04T15:37:06.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.496+0000 7f6fca59c640 1 -- 172.21.15.19:0/1070287682 learned_addr learned my addr 172.21.15.19:0/1070287682 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:37:06.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.496+0000 7f6fcad9d640 1 --2- 172.21.15.19:0/1070287682 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6fcc137270 0x7f6fcc0a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:06.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.496+0000 7f6fc9d9b640 1 -- 172.21.15.19:0/1070287682 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3683179011 0 0) 0x7f6fcc0a4c20 con 0x7f6fcc0a3e90 2023-11-04T15:37:06.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.496+0000 7f6fc9d9b640 1 -- 172.21.15.19:0/1070287682 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fb8003520 con 0x7f6fcc0a3e90 2023-11-04T15:37:06.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.496+0000 7f6fc9d9b640 1 -- 172.21.15.19:0/1070287682 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1904399479 0 0) 0x7f6fcc13ad80 con 0x7f6fcc137650 2023-11-04T15:37:06.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.496+0000 7f6fc9d9b640 1 -- 172.21.15.19:0/1070287682 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fcc0a4c20 con 0x7f6fcc137650 2023-11-04T15:37:06.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.496+0000 7f6fcad9d640 1 -- 172.21.15.19:0/1070287682 >> v1:172.21.15.96:6789/0 conn(0x7f6fcc137650 legacy=0x7f6fcc13a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:06.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.496+0000 7f6fcad9d640 1 -- 172.21.15.19:0/1070287682 >> v1:172.21.15.19:6789/0 conn(0x7f6fcc0a3e90 legacy=0x7f6fcc139f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:06.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.496+0000 7f6fc9d9b640 1 -- 172.21.15.19:0/1070287682 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2471810291 0 0) 0x7f6fb8003520 con 0x7f6fcc0a3e90 2023-11-04T15:37:06.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.496+0000 7f6fcad9d640 1 -- 172.21.15.19:0/1070287682 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fcc0a5080 con 0x7f6fcc137270 2023-11-04T15:37:06.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.497+0000 7f6fcad9d640 1 --2- 172.21.15.19:0/1070287682 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6fcc137270 0x7f6fcc0a6200 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f6fc40097d0 tx=0x7f6fc402b6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f83cdfa4e80de576 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:06.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.497+0000 7f6fc9d9b640 1 -- 172.21.15.19:0/1070287682 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4001670 con 0x7f6fcc137270 2023-11-04T15:37:06.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.497+0000 7f6fc9d9b640 1 -- 172.21.15.19:0/1070287682 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc402e050 con 0x7f6fcc137270 2023-11-04T15:37:06.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.497+0000 7f6fc9d9b640 1 -- 172.21.15.19:0/1070287682 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc4030730 con 0x7f6fcc137270 2023-11-04T15:37:06.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.498+0000 7f6fd1041640 1 -- 172.21.15.19:0/1070287682 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6fcc137270 msgr2=0x7f6fcc0a6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:06.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.498+0000 7f6fd1041640 1 --2- 172.21.15.19:0/1070287682 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6fcc137270 0x7f6fcc0a6200 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f6fc40097d0 tx=0x7f6fc402b6e0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.498+0000 7f6fd1041640 1 -- 172.21.15.19:0/1070287682 shutdown_connections 2023-11-04T15:37:06.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.498+0000 7f6fd1041640 1 --2- 172.21.15.19:0/1070287682 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6fcc137270 0x7f6fcc0a6200 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.498+0000 7f6fd1041640 1 -- 172.21.15.19:0/1070287682 >> 172.21.15.19:0/1070287682 conn(0x7f6fcc0a8d70 msgr2=0x7f6fcc0a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:06.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.498+0000 7f6fd1041640 1 -- 172.21.15.19:0/1070287682 shutdown_connections 2023-11-04T15:37:06.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.498+0000 7f6fd1041640 1 -- 172.21.15.19:0/1070287682 wait complete. 2023-11-04T15:37:06.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.499+0000 7f6fd1041640 1 Processor -- start 2023-11-04T15:37:06.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.499+0000 7f6fd1041640 1 -- start start 2023-11-04T15:37:06.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.500+0000 7f6fd1041640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fcc0a3e90 0x7f6fcc133d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:06.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.500+0000 7f6fd1041640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6fcc137270 0x7f6fcc1342c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:06.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.500+0000 7f6fd1041640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fcc137650 0x7f6fcc1cef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:06.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.500+0000 7f6fd1041640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc09f750 con 0x7f6fcc137650 2023-11-04T15:37:06.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.500+0000 7f6fd1041640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc09ff20 con 0x7f6fcc0a3e90 2023-11-04T15:37:06.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.500+0000 7f6fd1041640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc09f4b0 con 0x7f6fcc137270 2023-11-04T15:37:06.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.500+0000 7f6fcb59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fcc137650 0x7f6fcc1cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:06.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.500+0000 7f6fcb59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fcc137650 0x7f6fcc1cef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60548/0 (socket says 172.21.15.19:60548) 2023-11-04T15:37:06.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.500+0000 7f6fcb59e640 1 -- 172.21.15.19:0/3259924173 learned_addr learned my addr 172.21.15.19:0/3259924173 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:37:06.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.500+0000 7f6fca59c640 1 --2- 172.21.15.19:0/3259924173 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6fcc137270 0x7f6fcc1342c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:06.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.500+0000 7f6fcad9d640 1 --2- 172.21.15.19:0/3259924173 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fcc0a3e90 0x7f6fcc133d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:06.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.500+0000 7f6fcb59e640 1 -- 172.21.15.19:0/3259924173 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6fcc137270 msgr2=0x7f6fcc1342c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:06.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.500+0000 7f6fcb59e640 1 --2- 172.21.15.19:0/3259924173 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6fcc137270 0x7f6fcc1342c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.500+0000 7f6fcb59e640 1 -- 172.21.15.19:0/3259924173 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fcc0a3e90 msgr2=0x7f6fcc133d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:06.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.500+0000 7f6fcb59e640 1 --2- 172.21.15.19:0/3259924173 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fcc0a3e90 0x7f6fcc133d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.500+0000 7f6fcb59e640 1 -- 172.21.15.19:0/3259924173 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc4009400 con 0x7f6fcc137650 2023-11-04T15:37:06.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.500+0000 7f6fca59c640 1 --2- 172.21.15.19:0/3259924173 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6fcc137270 0x7f6fcc1342c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T15:37:06.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.500+0000 7f6fcb59e640 1 --2- 172.21.15.19:0/3259924173 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fcc137650 0x7f6fcc1cef50 secure :-1 s=READY pgs=3758 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc00c790 tx=0x7f6fbc00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:06.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.501+0000 7f6fc37fe640 1 -- 172.21.15.19:0/3259924173 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc00cea0 con 0x7f6fcc137650 2023-11-04T15:37:06.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.501+0000 7f6fc37fe640 1 -- 172.21.15.19:0/3259924173 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fbc003b70 con 0x7f6fcc137650 2023-11-04T15:37:06.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.501+0000 7f6fd1041640 1 -- 172.21.15.19:0/3259924173 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fcc09dc30 con 0x7f6fcc137650 2023-11-04T15:37:06.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.501+0000 7f6fc37fe640 1 -- 172.21.15.19:0/3259924173 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc00a850 con 0x7f6fcc137650 2023-11-04T15:37:06.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.501+0000 7f6fd1041640 1 -- 172.21.15.19:0/3259924173 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fcc0a0b90 con 0x7f6fcc137650 2023-11-04T15:37:06.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.502+0000 7f6fd1041640 1 -- 172.21.15.19:0/3259924173 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fcc067d60 con 0x7f6fcc137650 2023-11-04T15:37:06.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.502+0000 7f6fc37fe640 1 -- 172.21.15.19:0/3259924173 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6fbc00a9b0 con 0x7f6fcc137650 2023-11-04T15:37:06.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.502+0000 7f6fc37fe640 1 --2- 172.21.15.19:0/3259924173 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f6fac06a430 0x7f6fac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:06.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.503+0000 7f6fc37fe640 1 -- 172.21.15.19:0/3259924173 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4434+0+0 (secure 0 0 0) 0x7f6fbc0881b0 con 0x7f6fcc137650 2023-11-04T15:37:06.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.503+0000 7f6fcad9d640 1 --2- 172.21.15.19:0/3259924173 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f6fac06a430 0x7f6fac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:06.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.503+0000 7f6fcad9d640 1 --2- 172.21.15.19:0/3259924173 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f6fac06a430 0x7f6fac06c8f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4034000 tx=0x7f6fc4008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:06.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.507+0000 7f6fc37fe640 1 -- 172.21.15.19:0/3259924173 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6fbc053cc0 con 0x7f6fcc137650 2023-11-04T15:37:06.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.685+0000 7f6fd1041640 1 -- 172.21.15.19:0/3259924173 --> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f6fcc0a5340 con 0x7f6fac06a430 2023-11-04T15:37:06.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.686+0000 7f6fc37fe640 1 -- 172.21.15.19:0/3259924173 <== mgr.4114 v2:172.21.15.96:6816/83123 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6fc4004230 con 0x7f6fac06a430 2023-11-04T15:37:06.689 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 1 to deep-scrub 2023-11-04T15:37:06.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.689+0000 7f6fd1041640 1 -- 172.21.15.19:0/3259924173 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f6fac06a430 msgr2=0x7f6fac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:06.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.689+0000 7f6fd1041640 1 --2- 172.21.15.19:0/3259924173 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f6fac06a430 0x7f6fac06c8f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4034000 tx=0x7f6fc4008030 comp rx=0 tx=0).stop 2023-11-04T15:37:06.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.689+0000 7f6fd1041640 1 -- 172.21.15.19:0/3259924173 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fcc137650 msgr2=0x7f6fcc1cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:06.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.689+0000 7f6fd1041640 1 --2- 172.21.15.19:0/3259924173 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fcc137650 0x7f6fcc1cef50 secure :-1 s=READY pgs=3758 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc00c790 tx=0x7f6fbc00cc50 comp rx=0 tx=0).stop 2023-11-04T15:37:06.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.689+0000 7f6fd1041640 1 -- 172.21.15.19:0/3259924173 shutdown_connections 2023-11-04T15:37:06.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.689+0000 7f6fd1041640 1 --2- 172.21.15.19:0/3259924173 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f6fac06a430 0x7f6fac06c8f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.689+0000 7f6fd1041640 1 --2- 172.21.15.19:0/3259924173 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fcc137650 0x7f6fcc1cef50 unknown :-1 s=CLOSED pgs=3758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.689+0000 7f6fd1041640 1 --2- 172.21.15.19:0/3259924173 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6fcc137270 0x7f6fcc1342c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.689+0000 7f6fd1041640 1 --2- 172.21.15.19:0/3259924173 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fcc0a3e90 0x7f6fcc133d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.689+0000 7f6fd1041640 1 -- 172.21.15.19:0/3259924173 >> 172.21.15.19:0/3259924173 conn(0x7f6fcc0a8d70 msgr2=0x7f6fcc139d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:06.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.689+0000 7f6fd1041640 1 -- 172.21.15.19:0/3259924173 shutdown_connections 2023-11-04T15:37:06.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.689+0000 7f6fd1041640 1 -- 172.21.15.19:0/3259924173 wait complete. 2023-11-04T15:37:06.703 INFO:tasks.ceph:Scrubbing osd.2 2023-11-04T15:37:06.704 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-04T15:37:06.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.814+0000 7fe860fbb640 1 Processor -- start 2023-11-04T15:37:06.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.814+0000 7fe860fbb640 1 -- start start 2023-11-04T15:37:06.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.815+0000 7fe860fbb640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe85c135e80 0x7fe85c136260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:06.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.815+0000 7fe860fbb640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe85c0a4670 0x7fe85c142260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:06.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.815+0000 7fe860fbb640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe85c0a0a20 con 0x7fe85c0a3b40 2023-11-04T15:37:06.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.815+0000 7fe860fbb640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe85c0a0c80 con 0x7fe85c135e80 2023-11-04T15:37:06.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.815+0000 7fe860fbb640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c06a980 con 0x7fe85c0a4670 2023-11-04T15:37:06.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.815+0000 7fe853fff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe85c0a3b40 0x7fe85c0a3f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58048/0 (socket says 172.21.15.19:58048) 2023-11-04T15:37:06.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.815+0000 7fe853fff640 1 -- 172.21.15.19:0/3797039746 learned_addr learned my addr 172.21.15.19:0/3797039746 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:37:06.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.815+0000 7fe859d9b640 1 -- 172.21.15.19:0/3797039746 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1558911099 0 0) 0x7fe85c0a0a20 con 0x7fe85c0a3b40 2023-11-04T15:37:06.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.815+0000 7fe859d9b640 1 -- 172.21.15.19:0/3797039746 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe848003520 con 0x7fe85c0a3b40 2023-11-04T15:37:06.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.815+0000 7fe85a59c640 1 --2- 172.21.15.19:0/3797039746 >> v2:172.21.15.96:3300/0 conn(0x7fe85c135e80 0x7fe85c136260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:06.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.815+0000 7fe85ad9d640 1 --2- 172.21.15.19:0/3797039746 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe85c0a4670 0x7fe85c142260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:06.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.816+0000 7fe859d9b640 1 -- 172.21.15.19:0/3797039746 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3826484099 0 0) 0x7fe848003520 con 0x7fe85c0a3b40 2023-11-04T15:37:06.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.816+0000 7fe859d9b640 1 -- 172.21.15.19:0/3797039746 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe85c0a4670 msgr2=0x7fe85c142260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:06.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.816+0000 7fe859d9b640 1 --2- 172.21.15.19:0/3797039746 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe85c0a4670 0x7fe85c142260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.816+0000 7fe859d9b640 1 -- 172.21.15.19:0/3797039746 >> v2:172.21.15.96:3300/0 conn(0x7fe85c135e80 msgr2=0x7fe85c136260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:06.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.816+0000 7fe859d9b640 1 --2- 172.21.15.19:0/3797039746 >> v2:172.21.15.96:3300/0 conn(0x7fe85c135e80 0x7fe85c136260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.816+0000 7fe859d9b640 1 -- 172.21.15.19:0/3797039746 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe85c0a0640 con 0x7fe85c0a3b40 2023-11-04T15:37:06.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.816+0000 7fe859d9b640 1 -- 172.21.15.19:0/3797039746 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3646097784 0 0) 0x7fe844001670 con 0x7fe85c0a3b40 2023-11-04T15:37:06.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.816+0000 7fe859d9b640 1 -- 172.21.15.19:0/3797039746 >> v1:172.21.15.19:6789/0 conn(0x7fe85c0a3b40 legacy=0x7fe85c0a3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:06.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.816+0000 7fe859d9b640 1 --2- 172.21.15.19:0/3797039746 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe848003970 0x7fe848003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:06.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.816+0000 7fe859d9b640 1 --2- 172.21.15.19:0/3797039746 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8480047c0 0x7fe848004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:06.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.816+0000 7fe859d9b640 1 --2- 172.21.15.19:0/3797039746 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe85c0a4670 0x7fe848005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:06.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.816+0000 7fe859d9b640 1 -- 172.21.15.19:0/3797039746 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c0a0c80 con 0x7fe848003970 2023-11-04T15:37:06.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.816+0000 7fe859d9b640 1 -- 172.21.15.19:0/3797039746 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c06a980 con 0x7fe8480047c0 2023-11-04T15:37:06.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.816+0000 7fe859d9b640 1 -- 172.21.15.19:0/3797039746 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe84800ba30 con 0x7fe85c0a4670 2023-11-04T15:37:06.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.816+0000 7fe85a59c640 1 --2- 172.21.15.19:0/3797039746 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe848003970 0x7fe848003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:06.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.816+0000 7fe853fff640 1 --2- 172.21.15.19:0/3797039746 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8480047c0 0x7fe848004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:06.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.816+0000 7fe85ad9d640 1 --2- 172.21.15.19:0/3797039746 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe85c0a4670 0x7fe848005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:06.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.816+0000 7fe85a59c640 1 -- 172.21.15.19:0/3797039746 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe85c0a4670 msgr2=0x7fe848005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:06.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.816+0000 7fe85a59c640 1 --2- 172.21.15.19:0/3797039746 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe85c0a4670 0x7fe848005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.816+0000 7fe85a59c640 1 -- 172.21.15.19:0/3797039746 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8480047c0 msgr2=0x7fe848004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:06.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.816+0000 7fe85a59c640 1 --2- 172.21.15.19:0/3797039746 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8480047c0 0x7fe848004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.816+0000 7fe85a59c640 1 -- 172.21.15.19:0/3797039746 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe848003520 con 0x7fe848003970 2023-11-04T15:37:06.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.816+0000 7fe85ad9d640 1 --2- 172.21.15.19:0/3797039746 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe85c0a4670 0x7fe848005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:37:06.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.817+0000 7fe85a59c640 1 --2- 172.21.15.19:0/3797039746 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe848003970 0x7fe848003d90 secure :-1 s=READY pgs=3760 cs=0 l=1 rev1=1 crypto rx=0x7fe84c009ac0 tx=0x7fe8480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c1fa70cf3a9cf8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:06.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.817+0000 7fe859d9b640 1 -- 172.21.15.19:0/3797039746 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84c02c710 con 0x7fe848003970 2023-11-04T15:37:06.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.817+0000 7fe859d9b640 1 -- 172.21.15.19:0/3797039746 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe84c02c870 con 0x7fe848003970 2023-11-04T15:37:06.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.817+0000 7fe859d9b640 1 -- 172.21.15.19:0/3797039746 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84c02cc00 con 0x7fe848003970 2023-11-04T15:37:06.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.818+0000 7fe860fbb640 1 -- 172.21.15.19:0/3797039746 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe848003970 msgr2=0x7fe848003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:06.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.818+0000 7fe860fbb640 1 --2- 172.21.15.19:0/3797039746 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe848003970 0x7fe848003d90 secure :-1 s=READY pgs=3760 cs=0 l=1 rev1=1 crypto rx=0x7fe84c009ac0 tx=0x7fe8480057f0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.818+0000 7fe85ad9d640 1 -- 172.21.15.19:0/3797039746 reap_dead start 2023-11-04T15:37:06.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.818+0000 7fe860fbb640 1 -- 172.21.15.19:0/3797039746 shutdown_connections 2023-11-04T15:37:06.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.818+0000 7fe860fbb640 1 -- 172.21.15.19:0/3797039746 >> 172.21.15.19:0/3797039746 conn(0x7fe85c0a9140 msgr2=0x7fe85c0a9550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:06.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.818+0000 7fe860fbb640 1 -- 172.21.15.19:0/3797039746 shutdown_connections 2023-11-04T15:37:06.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.818+0000 7fe860fbb640 1 -- 172.21.15.19:0/3797039746 wait complete. 2023-11-04T15:37:06.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.819+0000 7fe860fbb640 1 Processor -- start 2023-11-04T15:37:06.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.819+0000 7fe860fbb640 1 -- start start 2023-11-04T15:37:06.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.819+0000 7fe860fbb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe848003970 0x7fe85c1cef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:06.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.819+0000 7fe860fbb640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe85c1cf450 0x7fe85c11f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:06.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.819+0000 7fe860fbb640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe85c1cf830 0x7fe85c11fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:06.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.819+0000 7fe860fbb640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c121810 con 0x7fe848003970 2023-11-04T15:37:06.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.819+0000 7fe860fbb640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c122a20 con 0x7fe85c1cf450 2023-11-04T15:37:06.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.819+0000 7fe860fbb640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c123060 con 0x7fe85c1cf830 2023-11-04T15:37:06.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.819+0000 7fe85a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe848003970 0x7fe85c1cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:06.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.819+0000 7fe85a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe848003970 0x7fe85c1cef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60566/0 (socket says 172.21.15.19:60566) 2023-11-04T15:37:06.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.819+0000 7fe85a59c640 1 -- 172.21.15.19:0/3065356531 learned_addr learned my addr 172.21.15.19:0/3065356531 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:37:06.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.819+0000 7fe853fff640 1 --2- 172.21.15.19:0/3065356531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe85c1cf450 0x7fe85c11f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:06.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.819+0000 7fe85ad9d640 1 --2- 172.21.15.19:0/3065356531 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe85c1cf830 0x7fe85c11fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:06.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.820+0000 7fe85a59c640 1 -- 172.21.15.19:0/3065356531 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe85c1cf830 msgr2=0x7fe85c11fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:06.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.820+0000 7fe85a59c640 1 --2- 172.21.15.19:0/3065356531 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe85c1cf830 0x7fe85c11fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.820+0000 7fe85a59c640 1 -- 172.21.15.19:0/3065356531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe85c1cf450 msgr2=0x7fe85c11f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:06.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.820+0000 7fe85a59c640 1 --2- 172.21.15.19:0/3065356531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe85c1cf450 0x7fe85c11f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.820+0000 7fe85a59c640 1 -- 172.21.15.19:0/3065356531 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe85c1235d0 con 0x7fe848003970 2023-11-04T15:37:06.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.820+0000 7fe853fff640 1 --2- 172.21.15.19:0/3065356531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe85c1cf450 0x7fe85c11f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:37:06.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.820+0000 7fe85ad9d640 1 --2- 172.21.15.19:0/3065356531 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe85c1cf830 0x7fe85c11fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:37:06.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.820+0000 7fe85a59c640 1 --2- 172.21.15.19:0/3065356531 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe848003970 0x7fe85c1cef10 secure :-1 s=READY pgs=3761 cs=0 l=1 rev1=1 crypto rx=0x7fe84c02c2b0 tx=0x7fe84c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:06.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.820+0000 7fe852ffd640 1 -- 172.21.15.19:0/3065356531 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84c003810 con 0x7fe848003970 2023-11-04T15:37:06.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.820+0000 7fe852ffd640 1 -- 172.21.15.19:0/3065356531 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe84c02de90 con 0x7fe848003970 2023-11-04T15:37:06.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.820+0000 7fe860fbb640 1 -- 172.21.15.19:0/3065356531 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe85c123890 con 0x7fe848003970 2023-11-04T15:37:06.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.820+0000 7fe852ffd640 1 -- 172.21.15.19:0/3065356531 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84c003b70 con 0x7fe848003970 2023-11-04T15:37:06.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.820+0000 7fe860fbb640 1 -- 172.21.15.19:0/3065356531 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe85c124750 con 0x7fe848003970 2023-11-04T15:37:06.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.821+0000 7fe860fbb640 1 -- 172.21.15.19:0/3065356531 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe85c0a15d0 con 0x7fe848003970 2023-11-04T15:37:06.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.821+0000 7fe852ffd640 1 -- 172.21.15.19:0/3065356531 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe84c003cd0 con 0x7fe848003970 2023-11-04T15:37:06.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.822+0000 7fe852ffd640 1 --2- 172.21.15.19:0/3065356531 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fe83c06a430 0x7fe83c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:06.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.822+0000 7fe852ffd640 1 -- 172.21.15.19:0/3065356531 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4434+0+0 (secure 0 0 0) 0x7fe84c0aa250 con 0x7fe848003970 2023-11-04T15:37:06.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.822+0000 7fe852ffd640 1 --2- 172.21.15.19:0/3065356531 >> [v2:172.21.15.96:6806/83458,v1:172.21.15.96:6808/83458] conn(0x7fe83c0721a0 0x7fe83c074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:06.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.822+0000 7fe852ffd640 1 -- 172.21.15.19:0/3065356531 --> [v2:172.21.15.96:6806/83458,v1:172.21.15.96:6808/83458] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe83c074cf0 con 0x7fe83c0721a0 2023-11-04T15:37:06.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.822+0000 7fe852ffd640 1 -- 172.21.15.19:0/3065356531 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe84c0ac910 con 0x7fe848003970 2023-11-04T15:37:06.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.822+0000 7fe853fff640 1 --2- 172.21.15.19:0/3065356531 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fe83c06a430 0x7fe83c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:06.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.822+0000 7fe85ad9d640 1 --2- 172.21.15.19:0/3065356531 >> [v2:172.21.15.96:6806/83458,v1:172.21.15.96:6808/83458] conn(0x7fe83c0721a0 0x7fe83c074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:06.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.823+0000 7fe853fff640 1 --2- 172.21.15.19:0/3065356531 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fe83c06a430 0x7fe83c06c8f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe844007fd0 tx=0x7fe844009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:06.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.823+0000 7fe85ad9d640 1 --2- 172.21.15.19:0/3065356531 >> [v2:172.21.15.96:6806/83458,v1:172.21.15.96:6808/83458] conn(0x7fe83c0721a0 0x7fe83c074620 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:06.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.823+0000 7fe852ffd640 1 -- 172.21.15.19:0/3065356531 <== osd.2 v2:172.21.15.96:6806/83458 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe83c074cf0 con 0x7fe83c0721a0 2023-11-04T15:37:06.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.836+0000 7fe860fbb640 1 -- 172.21.15.19:0/3065356531 --> [v2:172.21.15.96:6806/83458,v1:172.21.15.96:6808/83458] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe85c0a12f0 con 0x7fe83c0721a0 2023-11-04T15:37:06.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.837+0000 7fe852ffd640 1 -- 172.21.15.19:0/3065356531 <== osd.2 v2:172.21.15.96:6806/83458 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe85400f040 con 0x7fe83c0721a0 2023-11-04T15:37:06.842 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2023-11-04T15:37:06.842 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-04T15:37:06.842 INFO:teuthology.orchestra.run.smithi019.stdout:} 2023-11-04T15:37:06.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.837+0000 7fe860fbb640 1 -- 172.21.15.19:0/3065356531 >> [v2:172.21.15.96:6806/83458,v1:172.21.15.96:6808/83458] conn(0x7fe83c0721a0 msgr2=0x7fe83c074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:06.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.837+0000 7fe860fbb640 1 --2- 172.21.15.19:0/3065356531 >> [v2:172.21.15.96:6806/83458,v1:172.21.15.96:6808/83458] conn(0x7fe83c0721a0 0x7fe83c074620 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.838+0000 7fe860fbb640 1 -- 172.21.15.19:0/3065356531 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fe83c06a430 msgr2=0x7fe83c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:06.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.838+0000 7fe860fbb640 1 --2- 172.21.15.19:0/3065356531 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fe83c06a430 0x7fe83c06c8f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe844007fd0 tx=0x7fe844009040 comp rx=0 tx=0).stop 2023-11-04T15:37:06.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.838+0000 7fe860fbb640 1 -- 172.21.15.19:0/3065356531 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe848003970 msgr2=0x7fe85c1cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:06.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.838+0000 7fe860fbb640 1 --2- 172.21.15.19:0/3065356531 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe848003970 0x7fe85c1cef10 secure :-1 s=READY pgs=3761 cs=0 l=1 rev1=1 crypto rx=0x7fe84c02c2b0 tx=0x7fe84c004730 comp rx=0 tx=0).stop 2023-11-04T15:37:06.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.838+0000 7fe85ad9d640 1 -- 172.21.15.19:0/3065356531 reap_dead start 2023-11-04T15:37:06.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.838+0000 7fe860fbb640 1 -- 172.21.15.19:0/3065356531 shutdown_connections 2023-11-04T15:37:06.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.838+0000 7fe860fbb640 1 -- 172.21.15.19:0/3065356531 >> 172.21.15.19:0/3065356531 conn(0x7fe85c0a9140 msgr2=0x7fe85c0708e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:06.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.838+0000 7fe860fbb640 1 -- 172.21.15.19:0/3065356531 shutdown_connections 2023-11-04T15:37:06.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.838+0000 7fe860fbb640 1 -- 172.21.15.19:0/3065356531 wait complete. 2023-11-04T15:37:06.852 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-04T15:37:06.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.958+0000 7fee26c41640 1 Processor -- start 2023-11-04T15:37:06.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.958+0000 7fee26c41640 1 -- start start 2023-11-04T15:37:06.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.959+0000 7fee26c41640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fee20137270 0x7fee200a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:06.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.959+0000 7fee26c41640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fee200a3e90 0x7fee20139f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:06.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.959+0000 7fee26c41640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee200a4c20 con 0x7fee20137650 2023-11-04T15:37:06.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.959+0000 7fee26c41640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee200a3060 con 0x7fee20137270 2023-11-04T15:37:06.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.959+0000 7fee26c41640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee200a5080 con 0x7fee200a3e90 2023-11-04T15:37:06.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.959+0000 7fee249dd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fee20137270 0x7fee200a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:06.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.959+0000 7fee249dd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fee20137270 0x7fee200a6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60574/0 (socket says 172.21.15.19:60574) 2023-11-04T15:37:06.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.959+0000 7fee249dd640 1 -- 172.21.15.19:0/1334082863 learned_addr learned my addr 172.21.15.19:0/1334082863 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:37:06.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.959+0000 7fee1ffff640 1 --2- 172.21.15.19:0/1334082863 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fee200a3e90 0x7fee20139f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:06.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.959+0000 7fee249dd640 1 -- 172.21.15.19:0/1334082863 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fee200a3e90 msgr2=0x7fee20139f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:06.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.959+0000 7fee249dd640 1 --2- 172.21.15.19:0/1334082863 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fee200a3e90 0x7fee20139f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.959+0000 7fee249dd640 1 -- 172.21.15.19:0/1334082863 >> v1:172.21.15.96:6789/0 conn(0x7fee20137650 legacy=0x7fee2013a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:06.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.959+0000 7fee249dd640 1 -- 172.21.15.19:0/1334082863 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee200a3440 con 0x7fee20137270 2023-11-04T15:37:06.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.960+0000 7fee249dd640 1 --2- 172.21.15.19:0/1334082863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee20137270 0x7fee200a6200 secure :-1 s=READY pgs=3762 cs=0 l=1 rev1=1 crypto rx=0x7fee18009e50 tx=0x7fee1802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c765bf7eb4b076 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:06.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.960+0000 7fee1f7fe640 1 -- 172.21.15.19:0/1334082863 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1802c9e0 con 0x7fee20137270 2023-11-04T15:37:06.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.960+0000 7fee1f7fe640 1 -- 172.21.15.19:0/1334082863 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1802cb40 con 0x7fee20137270 2023-11-04T15:37:06.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.960+0000 7fee1f7fe640 1 -- 172.21.15.19:0/1334082863 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee180343f0 con 0x7fee20137270 2023-11-04T15:37:06.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.961+0000 7fee26c41640 1 -- 172.21.15.19:0/1334082863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee20137270 msgr2=0x7fee200a6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:06.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.961+0000 7fee26c41640 1 --2- 172.21.15.19:0/1334082863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee20137270 0x7fee200a6200 secure :-1 s=READY pgs=3762 cs=0 l=1 rev1=1 crypto rx=0x7fee18009e50 tx=0x7fee1802be40 comp rx=0 tx=0).stop 2023-11-04T15:37:06.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.961+0000 7fee26c41640 1 -- 172.21.15.19:0/1334082863 shutdown_connections 2023-11-04T15:37:06.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.961+0000 7fee26c41640 1 --2- 172.21.15.19:0/1334082863 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fee200a3e90 0x7fee20139f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.961+0000 7fee26c41640 1 --2- 172.21.15.19:0/1334082863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee20137270 0x7fee200a6200 unknown :-1 s=CLOSED pgs=3762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.961+0000 7fee26c41640 1 -- 172.21.15.19:0/1334082863 >> 172.21.15.19:0/1334082863 conn(0x7fee200a8d70 msgr2=0x7fee200a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:06.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.961+0000 7fee26c41640 1 -- 172.21.15.19:0/1334082863 shutdown_connections 2023-11-04T15:37:06.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.961+0000 7fee26c41640 1 -- 172.21.15.19:0/1334082863 wait complete. 2023-11-04T15:37:06.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.962+0000 7fee26c41640 1 Processor -- start 2023-11-04T15:37:06.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.962+0000 7fee26c41640 1 -- start start 2023-11-04T15:37:06.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.963+0000 7fee26c41640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee200a3e90 0x7fee20133d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:06.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.963+0000 7fee26c41640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee20137270 0x7fee201342c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:06.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.963+0000 7fee26c41640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fee20137650 0x7fee201cef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:06.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.963+0000 7fee26c41640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee200a0bb0 con 0x7fee200a3e90 2023-11-04T15:37:06.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.963+0000 7fee26c41640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee200a1ef0 con 0x7fee20137270 2023-11-04T15:37:06.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.963+0000 7fee26c41640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee2009f3c0 con 0x7fee20137650 2023-11-04T15:37:06.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.963+0000 7fee249dd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee200a3e90 0x7fee20133d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:06.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.963+0000 7fee249dd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee200a3e90 0x7fee20133d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60578/0 (socket says 172.21.15.19:60578) 2023-11-04T15:37:06.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.963+0000 7fee249dd640 1 -- 172.21.15.19:0/4291435629 learned_addr learned my addr 172.21.15.19:0/4291435629 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:37:06.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.963+0000 7fee1ffff640 1 --2- 172.21.15.19:0/4291435629 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee20137270 0x7fee201342c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:06.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.963+0000 7fee251de640 1 --2- 172.21.15.19:0/4291435629 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fee20137650 0x7fee201cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:06.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.963+0000 7fee249dd640 1 -- 172.21.15.19:0/4291435629 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fee20137650 msgr2=0x7fee201cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:06.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.963+0000 7fee249dd640 1 --2- 172.21.15.19:0/4291435629 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fee20137650 0x7fee201cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.963+0000 7fee249dd640 1 -- 172.21.15.19:0/4291435629 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee20137270 msgr2=0x7fee201342c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:06.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.963+0000 7fee249dd640 1 --2- 172.21.15.19:0/4291435629 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee20137270 0x7fee201342c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:06.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.963+0000 7fee249dd640 1 -- 172.21.15.19:0/4291435629 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee18009b30 con 0x7fee200a3e90 2023-11-04T15:37:06.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.963+0000 7fee1ffff640 1 --2- 172.21.15.19:0/4291435629 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee20137270 0x7fee201342c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:37:06.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.963+0000 7fee249dd640 1 --2- 172.21.15.19:0/4291435629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee200a3e90 0x7fee20133d80 secure :-1 s=READY pgs=3763 cs=0 l=1 rev1=1 crypto rx=0x7fee18000f80 tx=0x7fee18004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:06.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.963+0000 7fee1d7fa640 1 -- 172.21.15.19:0/4291435629 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1803e450 con 0x7fee200a3e90 2023-11-04T15:37:06.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.963+0000 7fee1d7fa640 1 -- 172.21.15.19:0/4291435629 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1803e5b0 con 0x7fee200a3e90 2023-11-04T15:37:06.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.963+0000 7fee1d7fa640 1 -- 172.21.15.19:0/4291435629 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1803e960 con 0x7fee200a3e90 2023-11-04T15:37:06.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.963+0000 7fee26c41640 1 -- 172.21.15.19:0/4291435629 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee2009dac0 con 0x7fee200a3e90 2023-11-04T15:37:06.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.963+0000 7fee26c41640 1 -- 172.21.15.19:0/4291435629 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee2009fdb0 con 0x7fee200a3e90 2023-11-04T15:37:06.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.964+0000 7fee26c41640 1 -- 172.21.15.19:0/4291435629 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee2009f920 con 0x7fee200a3e90 2023-11-04T15:37:06.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.965+0000 7fee1d7fa640 1 -- 172.21.15.19:0/4291435629 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fee1803eac0 con 0x7fee200a3e90 2023-11-04T15:37:06.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.965+0000 7fee1d7fa640 1 --2- 172.21.15.19:0/4291435629 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fee0c06a430 0x7fee0c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:06.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.965+0000 7fee1d7fa640 1 -- 172.21.15.19:0/4291435629 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4434+0+0 (secure 0 0 0) 0x7fee180ab200 con 0x7fee200a3e90 2023-11-04T15:37:06.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.965+0000 7fee1ffff640 1 --2- 172.21.15.19:0/4291435629 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fee0c06a430 0x7fee0c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:06.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.966+0000 7fee1ffff640 1 --2- 172.21.15.19:0/4291435629 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fee0c06a430 0x7fee0c06c8f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fee2009d300 tx=0x7fee14008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:06.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:06.970+0000 7fee1d7fa640 1 -- 172.21.15.19:0/4291435629 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fee18076d70 con 0x7fee200a3e90 2023-11-04T15:37:07.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.148+0000 7fee26c41640 1 -- 172.21.15.19:0/4291435629 --> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fee200a5340 con 0x7fee0c06a430 2023-11-04T15:37:07.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.149+0000 7fee1d7fa640 1 -- 172.21.15.19:0/4291435629 <== mgr.4114 v2:172.21.15.96:6816/83123 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fee14007730 con 0x7fee0c06a430 2023-11-04T15:37:07.151 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 2 to deep-scrub 2023-11-04T15:37:07.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.150+0000 7fee26c41640 1 -- 172.21.15.19:0/4291435629 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fee0c06a430 msgr2=0x7fee0c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:07.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.150+0000 7fee26c41640 1 --2- 172.21.15.19:0/4291435629 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fee0c06a430 0x7fee0c06c8f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fee2009d300 tx=0x7fee14008040 comp rx=0 tx=0).stop 2023-11-04T15:37:07.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.150+0000 7fee26c41640 1 -- 172.21.15.19:0/4291435629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee200a3e90 msgr2=0x7fee20133d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:07.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.150+0000 7fee26c41640 1 --2- 172.21.15.19:0/4291435629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee200a3e90 0x7fee20133d80 secure :-1 s=READY pgs=3763 cs=0 l=1 rev1=1 crypto rx=0x7fee18000f80 tx=0x7fee18004a40 comp rx=0 tx=0).stop 2023-11-04T15:37:07.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.151+0000 7fee26c41640 1 -- 172.21.15.19:0/4291435629 shutdown_connections 2023-11-04T15:37:07.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.151+0000 7fee26c41640 1 --2- 172.21.15.19:0/4291435629 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fee0c06a430 0x7fee0c06c8f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:07.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.151+0000 7fee26c41640 1 --2- 172.21.15.19:0/4291435629 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fee20137650 0x7fee201cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:07.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.151+0000 7fee26c41640 1 --2- 172.21.15.19:0/4291435629 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee20137270 0x7fee201342c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:07.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.151+0000 7fee26c41640 1 --2- 172.21.15.19:0/4291435629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee200a3e90 0x7fee20133d80 unknown :-1 s=CLOSED pgs=3763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:07.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.151+0000 7fee26c41640 1 -- 172.21.15.19:0/4291435629 >> 172.21.15.19:0/4291435629 conn(0x7fee200a8d70 msgr2=0x7fee20139d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:07.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.151+0000 7fee26c41640 1 -- 172.21.15.19:0/4291435629 shutdown_connections 2023-11-04T15:37:07.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.151+0000 7fee26c41640 1 -- 172.21.15.19:0/4291435629 wait complete. 2023-11-04T15:37:07.165 INFO:tasks.ceph:Scrubbing osd.3 2023-11-04T15:37:07.165 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-04T15:37:07.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.274+0000 7f2b5c76e640 1 Processor -- start 2023-11-04T15:37:07.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.274+0000 7f2b5c76e640 1 -- start start 2023-11-04T15:37:07.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.274+0000 7f2b5c76e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2b54135e30 0x7f2b540a6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:07.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.274+0000 7f2b5c76e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2b54136210 0x7f2b54136670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:07.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.274+0000 7f2b5c76e640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b540a4ea0 con 0x7f2b5413a040 2023-11-04T15:37:07.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.274+0000 7f2b5c76e640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b540a53b0 con 0x7f2b54136210 2023-11-04T15:37:07.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.274+0000 7f2b5c76e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b540a4c20 con 0x7f2b54135e30 2023-11-04T15:37:07.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.275+0000 7f2b59d09640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2b54136210 0x7f2b54136670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:07.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.275+0000 7f2b5a50a640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2b54135e30 0x7f2b540a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:07.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.275+0000 7f2b5a50a640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2b54135e30 0x7f2b540a6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.19:59624/0 (socket says 172.21.15.19:59624) 2023-11-04T15:37:07.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.275+0000 7f2b59d09640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2b54136210 0x7f2b54136670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.19:50102/0 (socket says 172.21.15.19:50102) 2023-11-04T15:37:07.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.275+0000 7f2b5a50a640 1 -- 172.21.15.19:0/286726109 learned_addr learned my addr 172.21.15.19:0/286726109 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:37:07.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.275+0000 7f2b5ad0b640 1 --1- 172.21.15.19:0/286726109 >> v1:172.21.15.96:6789/0 conn(0x7f2b5413a040 0x7f2b5413a490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.19:37262/0 (socket says 172.21.15.19:37262) 2023-11-04T15:37:07.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.275+0000 7f2b5a50a640 1 -- 172.21.15.19:0/286726109 >> v2:172.21.15.96:3300/0 conn(0x7f2b54136210 msgr2=0x7f2b54136670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:07.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.275+0000 7f2b5a50a640 1 --2- 172.21.15.19:0/286726109 >> v2:172.21.15.96:3300/0 conn(0x7f2b54136210 0x7f2b54136670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:07.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.275+0000 7f2b5a50a640 1 -- 172.21.15.19:0/286726109 >> v1:172.21.15.96:6789/0 conn(0x7f2b5413a040 legacy=0x7f2b5413a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:07.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.275+0000 7f2b5a50a640 1 -- 172.21.15.19:0/286726109 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b540a3fb0 con 0x7f2b54135e30 2023-11-04T15:37:07.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.275+0000 7f2b59d09640 1 --2- 172.21.15.19:0/286726109 >> v2:172.21.15.96:3300/0 conn(0x7f2b54136210 0x7f2b54136670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T15:37:07.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.276+0000 7f2b5a50a640 1 --2- 172.21.15.19:0/286726109 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2b54135e30 0x7f2b540a6300 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f2b50009870 tx=0x7f2b5002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bb435e9d9b1945 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:07.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.276+0000 7f2b59508640 1 -- 172.21.15.19:0/286726109 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b50031640 con 0x7f2b54135e30 2023-11-04T15:37:07.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.276+0000 7f2b59508640 1 -- 172.21.15.19:0/286726109 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b500317a0 con 0x7f2b54135e30 2023-11-04T15:37:07.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.276+0000 7f2b59508640 1 -- 172.21.15.19:0/286726109 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b50031b30 con 0x7f2b54135e30 2023-11-04T15:37:07.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.277+0000 7f2b5c76e640 1 -- 172.21.15.19:0/286726109 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2b54135e30 msgr2=0x7f2b540a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:07.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.277+0000 7f2b5c76e640 1 --2- 172.21.15.19:0/286726109 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2b54135e30 0x7f2b540a6300 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f2b50009870 tx=0x7f2b5002b8f0 comp rx=0 tx=0).stop 2023-11-04T15:37:07.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.277+0000 7f2b5c76e640 1 -- 172.21.15.19:0/286726109 shutdown_connections 2023-11-04T15:37:07.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.277+0000 7f2b5c76e640 1 --2- 172.21.15.19:0/286726109 >> v2:172.21.15.96:3300/0 conn(0x7f2b54136210 0x7f2b54136670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:07.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.277+0000 7f2b5c76e640 1 --2- 172.21.15.19:0/286726109 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2b54135e30 0x7f2b540a6300 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:07.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.277+0000 7f2b5c76e640 1 -- 172.21.15.19:0/286726109 >> 172.21.15.19:0/286726109 conn(0x7f2b540a8d70 msgr2=0x7f2b540a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:07.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.277+0000 7f2b5c76e640 1 -- 172.21.15.19:0/286726109 shutdown_connections 2023-11-04T15:37:07.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.277+0000 7f2b5c76e640 1 -- 172.21.15.19:0/286726109 wait complete. 2023-11-04T15:37:07.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.278+0000 7f2b5c76e640 1 Processor -- start 2023-11-04T15:37:07.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.278+0000 7f2b5c76e640 1 -- start start 2023-11-04T15:37:07.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.278+0000 7f2b5c76e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b54135e30 0x7f2b541cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:07.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.278+0000 7f2b5c76e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2b54136210 0x7f2b541cf100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:07.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.278+0000 7f2b5c76e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b5413a040 0x7f2b541cf640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:07.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.278+0000 7f2b5c76e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b541cb650 con 0x7f2b5413a040 2023-11-04T15:37:07.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.278+0000 7f2b5c76e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5409c040 con 0x7f2b54135e30 2023-11-04T15:37:07.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.278+0000 7f2b5c76e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5409bbb0 con 0x7f2b54136210 2023-11-04T15:37:07.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.278+0000 7f2b5ad0b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b5413a040 0x7f2b541cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:07.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.278+0000 7f2b5ad0b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b5413a040 0x7f2b541cf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60584/0 (socket says 172.21.15.19:60584) 2023-11-04T15:37:07.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.278+0000 7f2b5ad0b640 1 -- 172.21.15.19:0/846535284 learned_addr learned my addr 172.21.15.19:0/846535284 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:37:07.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.278+0000 7f2b5a50a640 1 --2- 172.21.15.19:0/846535284 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b54135e30 0x7f2b541cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:07.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.278+0000 7f2b59d09640 1 --2- 172.21.15.19:0/846535284 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2b54136210 0x7f2b541cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:07.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.279+0000 7f2b5ad0b640 1 -- 172.21.15.19:0/846535284 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2b54136210 msgr2=0x7f2b541cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:07.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.279+0000 7f2b5ad0b640 1 --2- 172.21.15.19:0/846535284 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2b54136210 0x7f2b541cf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:07.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.279+0000 7f2b5ad0b640 1 -- 172.21.15.19:0/846535284 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b54135e30 msgr2=0x7f2b541cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:07.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.279+0000 7f2b5ad0b640 1 --2- 172.21.15.19:0/846535284 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b54135e30 0x7f2b541cebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:07.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.279+0000 7f2b5ad0b640 1 -- 172.21.15.19:0/846535284 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b44009400 con 0x7f2b5413a040 2023-11-04T15:37:07.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.279+0000 7f2b5ad0b640 1 --2- 172.21.15.19:0/846535284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b5413a040 0x7f2b541cf640 secure :-1 s=READY pgs=3764 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c00c780 tx=0x7f2b4c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:07.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.279+0000 7f2b4affd640 1 -- 172.21.15.19:0/846535284 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c00ce90 con 0x7f2b5413a040 2023-11-04T15:37:07.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.279+0000 7f2b4affd640 1 -- 172.21.15.19:0/846535284 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4c00a640 con 0x7f2b5413a040 2023-11-04T15:37:07.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.279+0000 7f2b4affd640 1 -- 172.21.15.19:0/846535284 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c00a9f0 con 0x7f2b5413a040 2023-11-04T15:37:07.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.279+0000 7f2b5c76e640 1 -- 172.21.15.19:0/846535284 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b500094d0 con 0x7f2b5413a040 2023-11-04T15:37:07.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.279+0000 7f2b5c76e640 1 -- 172.21.15.19:0/846535284 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b5409c300 con 0x7f2b5413a040 2023-11-04T15:37:07.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.280+0000 7f2b5c76e640 1 -- 172.21.15.19:0/846535284 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2b540a30a0 con 0x7f2b5413a040 2023-11-04T15:37:07.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.280+0000 7f2b4affd640 1 -- 172.21.15.19:0/846535284 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2b4c00ab50 con 0x7f2b5413a040 2023-11-04T15:37:07.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.281+0000 7f2b4affd640 1 --2- 172.21.15.19:0/846535284 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f2b3806a430 0x7f2b3806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:07.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.281+0000 7f2b4affd640 1 -- 172.21.15.19:0/846535284 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4434+0+0 (secure 0 0 0) 0x7f2b4c087ad0 con 0x7f2b5413a040 2023-11-04T15:37:07.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.281+0000 7f2b5a50a640 1 --2- 172.21.15.19:0/846535284 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f2b3806a430 0x7f2b3806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:07.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.281+0000 7f2b4affd640 1 --2- 172.21.15.19:0/846535284 >> [v2:172.21.15.96:6800/83459,v1:172.21.15.96:6801/83459] conn(0x7f2b38072030 0x7f2b380744b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:07.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.281+0000 7f2b4affd640 1 -- 172.21.15.19:0/846535284 --> [v2:172.21.15.96:6800/83459,v1:172.21.15.96:6801/83459] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b38074b80 con 0x7f2b38072030 2023-11-04T15:37:07.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.281+0000 7f2b4affd640 1 -- 172.21.15.19:0/846535284 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b4c08c2c0 con 0x7f2b5413a040 2023-11-04T15:37:07.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.281+0000 7f2b59d09640 1 --2- 172.21.15.19:0/846535284 >> [v2:172.21.15.96:6800/83459,v1:172.21.15.96:6801/83459] conn(0x7f2b38072030 0x7f2b380744b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:07.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.281+0000 7f2b5a50a640 1 --2- 172.21.15.19:0/846535284 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f2b3806a430 0x7f2b3806c8f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2b50036000 tx=0x7f2b5003c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:07.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.282+0000 7f2b59d09640 1 --2- 172.21.15.19:0/846535284 >> [v2:172.21.15.96:6800/83459,v1:172.21.15.96:6801/83459] conn(0x7f2b38072030 0x7f2b380744b0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:07.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.282+0000 7f2b4affd640 1 -- 172.21.15.19:0/846535284 <== osd.3 v2:172.21.15.96:6800/83459 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2b38074b80 con 0x7f2b38072030 2023-11-04T15:37:07.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.295+0000 7f2b5c76e640 1 -- 172.21.15.19:0/846535284 --> [v2:172.21.15.96:6800/83459,v1:172.21.15.96:6801/83459] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2b540a5130 con 0x7f2b38072030 2023-11-04T15:37:07.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.296+0000 7f2b4affd640 1 -- 172.21.15.19:0/846535284 <== osd.3 v2:172.21.15.96:6800/83459 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f2b44009280 con 0x7f2b38072030 2023-11-04T15:37:07.300 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2023-11-04T15:37:07.301 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-04T15:37:07.301 INFO:teuthology.orchestra.run.smithi019.stdout:} 2023-11-04T15:37:07.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.296+0000 7f2b5c76e640 1 -- 172.21.15.19:0/846535284 >> [v2:172.21.15.96:6800/83459,v1:172.21.15.96:6801/83459] conn(0x7f2b38072030 msgr2=0x7f2b380744b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:07.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.296+0000 7f2b5c76e640 1 --2- 172.21.15.19:0/846535284 >> [v2:172.21.15.96:6800/83459,v1:172.21.15.96:6801/83459] conn(0x7f2b38072030 0x7f2b380744b0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:07.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.296+0000 7f2b5c76e640 1 -- 172.21.15.19:0/846535284 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f2b3806a430 msgr2=0x7f2b3806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:07.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.296+0000 7f2b5c76e640 1 --2- 172.21.15.19:0/846535284 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f2b3806a430 0x7f2b3806c8f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2b50036000 tx=0x7f2b5003c040 comp rx=0 tx=0).stop 2023-11-04T15:37:07.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.296+0000 7f2b5c76e640 1 -- 172.21.15.19:0/846535284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b5413a040 msgr2=0x7f2b541cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:07.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.296+0000 7f2b5c76e640 1 --2- 172.21.15.19:0/846535284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b5413a040 0x7f2b541cf640 secure :-1 s=READY pgs=3764 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c00c780 tx=0x7f2b4c00cc40 comp rx=0 tx=0).stop 2023-11-04T15:37:07.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.296+0000 7f2b5ad0b640 1 -- 172.21.15.19:0/846535284 reap_dead start 2023-11-04T15:37:07.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.296+0000 7f2b5c76e640 1 -- 172.21.15.19:0/846535284 shutdown_connections 2023-11-04T15:37:07.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.296+0000 7f2b5c76e640 1 -- 172.21.15.19:0/846535284 >> 172.21.15.19:0/846535284 conn(0x7f2b540a8d70 msgr2=0x7f2b54135130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:07.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.297+0000 7f2b5c76e640 1 -- 172.21.15.19:0/846535284 shutdown_connections 2023-11-04T15:37:07.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.297+0000 7f2b5c76e640 1 -- 172.21.15.19:0/846535284 wait complete. 2023-11-04T15:37:07.310 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-04T15:37:07.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.416+0000 7f02d4d6e640 1 Processor -- start 2023-11-04T15:37:07.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.416+0000 7f02d4d6e640 1 -- start start 2023-11-04T15:37:07.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.417+0000 7f02d4d6e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f02d0137270 0x7f02d00a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:07.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.417+0000 7f02d4d6e640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f02d00a3e90 0x7f02d0139f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:07.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.417+0000 7f02d4d6e640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02d00a4c20 con 0x7f02d0137650 2023-11-04T15:37:07.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.417+0000 7f02d4d6e640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02d00a3060 con 0x7f02d00a3e90 2023-11-04T15:37:07.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.417+0000 7f02d4d6e640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02d00a5080 con 0x7f02d0137270 2023-11-04T15:37:07.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.417+0000 7f02ced9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f02d0137650 0x7f02d013a4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58058/0 (socket says 172.21.15.19:58058) 2023-11-04T15:37:07.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.417+0000 7f02ced9d640 1 -- 172.21.15.19:0/2133345031 learned_addr learned my addr 172.21.15.19:0/2133345031 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:37:07.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.417+0000 7f02cdd9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f02d00a3e90 0x7f02d0139f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:07.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.417+0000 7f02cdd9b640 1 -- 172.21.15.19:0/2133345031 >> v2:172.21.15.96:3300/0 conn(0x7f02d0137270 msgr2=0x7f02d00a6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:07.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.417+0000 7f02ce59c640 1 --2- 172.21.15.19:0/2133345031 >> v2:172.21.15.96:3300/0 conn(0x7f02d0137270 0x7f02d00a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:07.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.417+0000 7f02cdd9b640 1 --2- 172.21.15.19:0/2133345031 >> v2:172.21.15.96:3300/0 conn(0x7f02d0137270 0x7f02d00a6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:07.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.417+0000 7f02cd59a640 1 -- 172.21.15.19:0/2133345031 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 706453074 0 0) 0x7f02d00a4c20 con 0x7f02d0137650 2023-11-04T15:37:07.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.417+0000 7f02cdd9b640 1 -- 172.21.15.19:0/2133345031 >> v1:172.21.15.19:6789/0 conn(0x7f02d0137650 legacy=0x7f02d013a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:07.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.417+0000 7f02cdd9b640 1 -- 172.21.15.19:0/2133345031 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d00a3440 con 0x7f02d00a3e90 2023-11-04T15:37:07.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.417+0000 7f02ce59c640 1 --2- 172.21.15.19:0/2133345031 >> v2:172.21.15.96:3300/0 conn(0x7f02d0137270 0x7f02d00a6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T15:37:07.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.418+0000 7f02cdd9b640 1 --2- 172.21.15.19:0/2133345031 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02d00a3e90 0x7f02d0139f60 secure :-1 s=READY pgs=3766 cs=0 l=1 rev1=1 crypto rx=0x7f02d00ad2d0 tx=0x7f02c402b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5e9f0a34bc70825 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:07.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.418+0000 7f02cd59a640 1 -- 172.21.15.19:0/2133345031 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c4031710 con 0x7f02d00a3e90 2023-11-04T15:37:07.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.418+0000 7f02cd59a640 1 -- 172.21.15.19:0/2133345031 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c402f050 con 0x7f02d00a3e90 2023-11-04T15:37:07.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.418+0000 7f02cd59a640 1 -- 172.21.15.19:0/2133345031 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c4031a90 con 0x7f02d00a3e90 2023-11-04T15:37:07.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.419+0000 7f02d4d6e640 1 -- 172.21.15.19:0/2133345031 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02d00a3e90 msgr2=0x7f02d0139f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:07.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.419+0000 7f02d4d6e640 1 --2- 172.21.15.19:0/2133345031 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02d00a3e90 0x7f02d0139f60 secure :-1 s=READY pgs=3766 cs=0 l=1 rev1=1 crypto rx=0x7f02d00ad2d0 tx=0x7f02c402b7b0 comp rx=0 tx=0).stop 2023-11-04T15:37:07.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.419+0000 7f02d4d6e640 1 -- 172.21.15.19:0/2133345031 shutdown_connections 2023-11-04T15:37:07.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.419+0000 7f02d4d6e640 1 --2- 172.21.15.19:0/2133345031 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02d00a3e90 0x7f02d0139f60 unknown :-1 s=CLOSED pgs=3766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:07.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.419+0000 7f02d4d6e640 1 --2- 172.21.15.19:0/2133345031 >> v2:172.21.15.96:3300/0 conn(0x7f02d0137270 0x7f02d00a6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:07.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.419+0000 7f02d4d6e640 1 -- 172.21.15.19:0/2133345031 >> 172.21.15.19:0/2133345031 conn(0x7f02d00a8d70 msgr2=0x7f02d00a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:07.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.419+0000 7f02d4d6e640 1 -- 172.21.15.19:0/2133345031 shutdown_connections 2023-11-04T15:37:07.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.419+0000 7f02d4d6e640 1 -- 172.21.15.19:0/2133345031 wait complete. 2023-11-04T15:37:07.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.420+0000 7f02d4d6e640 1 Processor -- start 2023-11-04T15:37:07.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.420+0000 7f02d4d6e640 1 -- start start 2023-11-04T15:37:07.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.421+0000 7f02d4d6e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02d00a3e90 0x7f02d0131ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:07.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.421+0000 7f02d4d6e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02d0137270 0x7f02d0132410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:07.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.421+0000 7f02d4d6e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f02d0137650 0x7f02d0097a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:07.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.421+0000 7f02d4d6e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d00a25e0 con 0x7f02d0137270 2023-11-04T15:37:07.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.421+0000 7f02d4d6e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d0098e00 con 0x7f02d00a3e90 2023-11-04T15:37:07.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.421+0000 7f02d4d6e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d00a27c0 con 0x7f02d0137650 2023-11-04T15:37:07.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.421+0000 7f02cdd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02d0137270 0x7f02d0132410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:07.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.421+0000 7f02cdd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02d0137270 0x7f02d0132410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60604/0 (socket says 172.21.15.19:60604) 2023-11-04T15:37:07.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.421+0000 7f02cdd9b640 1 -- 172.21.15.19:0/2652383220 learned_addr learned my addr 172.21.15.19:0/2652383220 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:37:07.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.421+0000 7f02ce59c640 1 --2- 172.21.15.19:0/2652383220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02d00a3e90 0x7f02d0131ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:07.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.421+0000 7f02cdd9b640 1 -- 172.21.15.19:0/2652383220 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f02d0137650 msgr2=0x7f02d0097a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:07.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.421+0000 7f02cdd9b640 1 --2- 172.21.15.19:0/2652383220 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f02d0137650 0x7f02d0097a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:07.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.421+0000 7f02cdd9b640 1 -- 172.21.15.19:0/2652383220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02d00a3e90 msgr2=0x7f02d0131ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:07.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.421+0000 7f02cdd9b640 1 --2- 172.21.15.19:0/2652383220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02d00a3e90 0x7f02d0131ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:07.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.421+0000 7f02cdd9b640 1 -- 172.21.15.19:0/2652383220 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c4009400 con 0x7f02d0137270 2023-11-04T15:37:07.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.421+0000 7f02cdd9b640 1 --2- 172.21.15.19:0/2652383220 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02d0137270 0x7f02d0132410 secure :-1 s=READY pgs=3767 cs=0 l=1 rev1=1 crypto rx=0x7f02c4009890 tx=0x7f02c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:07.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.421+0000 7f02beffd640 1 -- 172.21.15.19:0/2652383220 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c40339d0 con 0x7f02d0137270 2023-11-04T15:37:07.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.421+0000 7f02beffd640 1 -- 172.21.15.19:0/2652383220 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c4033b30 con 0x7f02d0137270 2023-11-04T15:37:07.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.421+0000 7f02d4d6e640 1 -- 172.21.15.19:0/2652383220 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02d0137bc0 con 0x7f02d0137270 2023-11-04T15:37:07.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.421+0000 7f02beffd640 1 -- 172.21.15.19:0/2652383220 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c403c400 con 0x7f02d0137270 2023-11-04T15:37:07.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.421+0000 7f02d4d6e640 1 -- 172.21.15.19:0/2652383220 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02d009af10 con 0x7f02d0137270 2023-11-04T15:37:07.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.422+0000 7f02d4d6e640 1 -- 172.21.15.19:0/2652383220 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02d0067d60 con 0x7f02d0137270 2023-11-04T15:37:07.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.423+0000 7f02beffd640 1 -- 172.21.15.19:0/2652383220 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f02c403a040 con 0x7f02d0137270 2023-11-04T15:37:07.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.423+0000 7f02beffd640 1 --2- 172.21.15.19:0/2652383220 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f02b006a460 0x7f02b006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:07.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.423+0000 7f02beffd640 1 -- 172.21.15.19:0/2652383220 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4434+0+0 (secure 0 0 0) 0x7f02c40a9480 con 0x7f02d0137270 2023-11-04T15:37:07.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.423+0000 7f02ce59c640 1 --2- 172.21.15.19:0/2652383220 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f02b006a460 0x7f02b006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:07.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.424+0000 7f02ce59c640 1 --2- 172.21.15.19:0/2652383220 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f02b006a460 0x7f02b006c920 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f02d0133c90 tx=0x7f02c0008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:07.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.428+0000 7f02beffd640 1 -- 172.21.15.19:0/2652383220 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f02c4074ff0 con 0x7f02d0137270 2023-11-04T15:37:07.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.609+0000 7f02d4d6e640 1 -- 172.21.15.19:0/2652383220 --> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f02d00a5340 con 0x7f02b006a460 2023-11-04T15:37:07.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.609+0000 7f02beffd640 1 -- 172.21.15.19:0/2652383220 <== mgr.4114 v2:172.21.15.96:6816/83123 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f02c000c040 con 0x7f02b006a460 2023-11-04T15:37:07.612 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 3 to deep-scrub 2023-11-04T15:37:07.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.611+0000 7f02d4d6e640 1 -- 172.21.15.19:0/2652383220 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f02b006a460 msgr2=0x7f02b006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:07.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.611+0000 7f02d4d6e640 1 --2- 172.21.15.19:0/2652383220 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f02b006a460 0x7f02b006c920 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f02d0133c90 tx=0x7f02c0008040 comp rx=0 tx=0).stop 2023-11-04T15:37:07.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.612+0000 7f02d4d6e640 1 -- 172.21.15.19:0/2652383220 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02d0137270 msgr2=0x7f02d0132410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:07.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.612+0000 7f02d4d6e640 1 --2- 172.21.15.19:0/2652383220 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02d0137270 0x7f02d0132410 secure :-1 s=READY pgs=3767 cs=0 l=1 rev1=1 crypto rx=0x7f02c4009890 tx=0x7f02c40046c0 comp rx=0 tx=0).stop 2023-11-04T15:37:07.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.612+0000 7f02d4d6e640 1 -- 172.21.15.19:0/2652383220 shutdown_connections 2023-11-04T15:37:07.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.612+0000 7f02d4d6e640 1 --2- 172.21.15.19:0/2652383220 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f02b006a460 0x7f02b006c920 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:07.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.612+0000 7f02d4d6e640 1 --2- 172.21.15.19:0/2652383220 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f02d0137650 0x7f02d0097a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:07.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.612+0000 7f02d4d6e640 1 --2- 172.21.15.19:0/2652383220 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02d0137270 0x7f02d0132410 unknown :-1 s=CLOSED pgs=3767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:07.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.612+0000 7f02d4d6e640 1 --2- 172.21.15.19:0/2652383220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02d00a3e90 0x7f02d0131ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:07.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.612+0000 7f02d4d6e640 1 -- 172.21.15.19:0/2652383220 >> 172.21.15.19:0/2652383220 conn(0x7f02d00a8d70 msgr2=0x7f02d0134090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:07.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.612+0000 7f02d4d6e640 1 -- 172.21.15.19:0/2652383220 shutdown_connections 2023-11-04T15:37:07.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.612+0000 7f02d4d6e640 1 -- 172.21.15.19:0/2652383220 wait complete. 2023-11-04T15:37:07.626 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T15:37:07.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.731+0000 7fd7bed39640 1 Processor -- start 2023-11-04T15:37:07.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.731+0000 7fd7bed39640 1 -- start start 2023-11-04T15:37:07.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.732+0000 7fd7bed39640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd7b8137270 0x7fd7b80a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:07.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.732+0000 7fd7bed39640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd7b80a3e90 0x7fd7b8139f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:07.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.732+0000 7fd7bed39640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd7b8137650 0x7fd7b813a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:07.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.732+0000 7fd7bed39640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7b80a3060 con 0x7fd7b80a3e90 2023-11-04T15:37:07.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.732+0000 7fd7bed39640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7b80a4c20 con 0x7fd7b8137650 2023-11-04T15:37:07.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.732+0000 7fd7bed39640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b80a5080 con 0x7fd7b8137270 2023-11-04T15:37:07.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.732+0000 7fd7b7fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd7b80a3e90 0x7fd7b8139f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:07.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.732+0000 7fd7b7fff640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd7b80a3e90 0x7fd7b8139f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60616/0 (socket says 172.21.15.19:60616) 2023-11-04T15:37:07.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.732+0000 7fd7b7fff640 1 -- 172.21.15.19:0/1471539429 learned_addr learned my addr 172.21.15.19:0/1471539429 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:37:07.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.732+0000 7fd7bd2d6640 1 --2- 172.21.15.19:0/1471539429 >> v2:172.21.15.96:3300/0 conn(0x7fd7b8137650 0x7fd7b813a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:07.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.732+0000 7fd7bcad5640 1 --2- 172.21.15.19:0/1471539429 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd7b8137270 0x7fd7b80a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:07.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.732+0000 7fd7b7fff640 1 -- 172.21.15.19:0/1471539429 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd7b8137270 msgr2=0x7fd7b80a6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:07.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.732+0000 7fd7b7fff640 1 --2- 172.21.15.19:0/1471539429 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd7b8137270 0x7fd7b80a6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:07.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.732+0000 7fd7b7fff640 1 -- 172.21.15.19:0/1471539429 >> v2:172.21.15.96:3300/0 conn(0x7fd7b8137650 msgr2=0x7fd7b813a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:07.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.732+0000 7fd7b7fff640 1 --2- 172.21.15.19:0/1471539429 >> v2:172.21.15.96:3300/0 conn(0x7fd7b8137650 0x7fd7b813a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:07.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.732+0000 7fd7b7fff640 1 -- 172.21.15.19:0/1471539429 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b80a3440 con 0x7fd7b80a3e90 2023-11-04T15:37:07.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.732+0000 7fd7bd2d6640 1 --2- 172.21.15.19:0/1471539429 >> v2:172.21.15.96:3300/0 conn(0x7fd7b8137650 0x7fd7b813a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T15:37:07.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.733+0000 7fd7b7fff640 1 --2- 172.21.15.19:0/1471539429 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7b80a3e90 0x7fd7b8139f60 secure :-1 s=READY pgs=3768 cs=0 l=1 rev1=1 crypto rx=0x7fd7b813b000 tx=0x7fd7ac02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46328064224d9782 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:07.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.733+0000 7fd7b77fe640 1 -- 172.21.15.19:0/1471539429 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac031750 con 0x7fd7b80a3e90 2023-11-04T15:37:07.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.733+0000 7fd7b77fe640 1 -- 172.21.15.19:0/1471539429 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7ac0318b0 con 0x7fd7b80a3e90 2023-11-04T15:37:07.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.733+0000 7fd7b77fe640 1 -- 172.21.15.19:0/1471539429 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac031c40 con 0x7fd7b80a3e90 2023-11-04T15:37:07.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.734+0000 7fd7bed39640 1 -- 172.21.15.19:0/1471539429 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7b80a3e90 msgr2=0x7fd7b8139f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:07.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.734+0000 7fd7bed39640 1 --2- 172.21.15.19:0/1471539429 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7b80a3e90 0x7fd7b8139f60 secure :-1 s=READY pgs=3768 cs=0 l=1 rev1=1 crypto rx=0x7fd7b813b000 tx=0x7fd7ac02b7f0 comp rx=0 tx=0).stop 2023-11-04T15:37:07.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.734+0000 7fd7bed39640 1 -- 172.21.15.19:0/1471539429 shutdown_connections 2023-11-04T15:37:07.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.734+0000 7fd7bed39640 1 --2- 172.21.15.19:0/1471539429 >> v2:172.21.15.96:3300/0 conn(0x7fd7b8137650 0x7fd7b813a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:07.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.734+0000 7fd7bed39640 1 --2- 172.21.15.19:0/1471539429 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7b80a3e90 0x7fd7b8139f60 unknown :-1 s=CLOSED pgs=3768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:07.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.734+0000 7fd7bed39640 1 --2- 172.21.15.19:0/1471539429 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd7b8137270 0x7fd7b80a6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:07.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.734+0000 7fd7bed39640 1 -- 172.21.15.19:0/1471539429 >> 172.21.15.19:0/1471539429 conn(0x7fd7b80a8d70 msgr2=0x7fd7b80a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:07.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.734+0000 7fd7bed39640 1 -- 172.21.15.19:0/1471539429 shutdown_connections 2023-11-04T15:37:07.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.734+0000 7fd7bed39640 1 -- 172.21.15.19:0/1471539429 wait complete. 2023-11-04T15:37:07.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.735+0000 7fd7bed39640 1 Processor -- start 2023-11-04T15:37:07.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.735+0000 7fd7bed39640 1 -- start start 2023-11-04T15:37:07.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.735+0000 7fd7bed39640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7b80a3e90 0x7fd7b809fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:07.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.735+0000 7fd7bed39640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7b8137270 0x7fd7b81cf080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:07.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.735+0000 7fd7bed39640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd7b8137650 0x7fd7b81cf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:07.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.735+0000 7fd7bed39640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b809cc60 con 0x7fd7b8137270 2023-11-04T15:37:07.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.735+0000 7fd7bed39640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b809e470 con 0x7fd7b80a3e90 2023-11-04T15:37:07.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.735+0000 7fd7bed39640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b80a03a0 con 0x7fd7b8137650 2023-11-04T15:37:07.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.736+0000 7fd7b7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7b8137270 0x7fd7b81cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:07.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.736+0000 7fd7b7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7b8137270 0x7fd7b81cf080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60622/0 (socket says 172.21.15.19:60622) 2023-11-04T15:37:07.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.736+0000 7fd7bcad5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7b80a3e90 0x7fd7b809fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:07.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.736+0000 7fd7b7fff640 1 -- 172.21.15.19:0/1704598898 learned_addr learned my addr 172.21.15.19:0/1704598898 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:37:07.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.736+0000 7fd7bd2d6640 1 --2- 172.21.15.19:0/1704598898 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd7b8137650 0x7fd7b81cf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:07.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.736+0000 7fd7b7fff640 1 -- 172.21.15.19:0/1704598898 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd7b8137650 msgr2=0x7fd7b81cf5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:07.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.736+0000 7fd7b7fff640 1 --2- 172.21.15.19:0/1704598898 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd7b8137650 0x7fd7b81cf5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:07.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.736+0000 7fd7b7fff640 1 -- 172.21.15.19:0/1704598898 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7b80a3e90 msgr2=0x7fd7b809fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:07.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.736+0000 7fd7b7fff640 1 --2- 172.21.15.19:0/1704598898 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7b80a3e90 0x7fd7b809fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:07.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.736+0000 7fd7b7fff640 1 -- 172.21.15.19:0/1704598898 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ac0094d0 con 0x7fd7b8137270 2023-11-04T15:37:07.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.736+0000 7fd7bcad5640 1 --2- 172.21.15.19:0/1704598898 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7b80a3e90 0x7fd7b809fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T15:37:07.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.736+0000 7fd7b7fff640 1 --2- 172.21.15.19:0/1704598898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7b8137270 0x7fd7b81cf080 secure :-1 s=READY pgs=3769 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac02b830 tx=0x7fd7ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:07.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.736+0000 7fd7b57fa640 1 -- 172.21.15.19:0/1704598898 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac033c80 con 0x7fd7b8137270 2023-11-04T15:37:07.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.736+0000 7fd7b57fa640 1 -- 172.21.15.19:0/1704598898 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7ac033e00 con 0x7fd7b8137270 2023-11-04T15:37:07.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.736+0000 7fd7bed39640 1 -- 172.21.15.19:0/1704598898 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7b809ef30 con 0x7fd7b8137270 2023-11-04T15:37:07.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.736+0000 7fd7b57fa640 1 -- 172.21.15.19:0/1704598898 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac03c640 con 0x7fd7b8137270 2023-11-04T15:37:07.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.736+0000 7fd7bed39640 1 -- 172.21.15.19:0/1704598898 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7b809d6e0 con 0x7fd7b8137270 2023-11-04T15:37:07.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.737+0000 7fd7bed39640 1 -- 172.21.15.19:0/1704598898 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7b809d2e0 con 0x7fd7b8137270 2023-11-04T15:37:07.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.738+0000 7fd7b57fa640 1 -- 172.21.15.19:0/1704598898 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd7ac03a040 con 0x7fd7b8137270 2023-11-04T15:37:07.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.738+0000 7fd7b57fa640 1 --2- 172.21.15.19:0/1704598898 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fd7a406a430 0x7fd7a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:07.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.738+0000 7fd7b57fa640 1 -- 172.21.15.19:0/1704598898 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4434+0+0 (secure 0 0 0) 0x7fd7ac0aa180 con 0x7fd7b8137270 2023-11-04T15:37:07.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.738+0000 7fd7bcad5640 1 --2- 172.21.15.19:0/1704598898 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fd7a406a430 0x7fd7a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:07.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.739+0000 7fd7bcad5640 1 --2- 172.21.15.19:0/1704598898 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fd7a406a430 0x7fd7a406c8f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd7b809cfb0 tx=0x7fd7a8008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:07.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.742+0000 7fd7b57fa640 1 -- 172.21.15.19:0/1704598898 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd7ac075e30 con 0x7fd7b8137270 2023-11-04T15:37:07.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.919+0000 7fd7bed39640 1 -- 172.21.15.19:0/1704598898 --> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd7b80a5340 con 0x7fd7a406a430 2023-11-04T15:37:07.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.926+0000 7fd7b57fa640 1 -- 172.21.15.19:0/1704598898 <== mgr.4114 v2:172.21.15.96:6816/83123 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279428 (secure 0 0 0) 0x7fd7a800c040 con 0x7fd7a406a430 2023-11-04T15:37:07.931 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:37:07.933 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-11-04T15:37:07.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.929+0000 7fd7bed39640 1 -- 172.21.15.19:0/1704598898 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fd7a406a430 msgr2=0x7fd7a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:07.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.929+0000 7fd7bed39640 1 --2- 172.21.15.19:0/1704598898 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fd7a406a430 0x7fd7a406c8f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd7b809cfb0 tx=0x7fd7a8008040 comp rx=0 tx=0).stop 2023-11-04T15:37:07.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.929+0000 7fd7bed39640 1 -- 172.21.15.19:0/1704598898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7b8137270 msgr2=0x7fd7b81cf080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:07.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.929+0000 7fd7bed39640 1 --2- 172.21.15.19:0/1704598898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7b8137270 0x7fd7b81cf080 secure :-1 s=READY pgs=3769 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac02b830 tx=0x7fd7ac0046c0 comp rx=0 tx=0).stop 2023-11-04T15:37:07.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.929+0000 7fd7bed39640 1 -- 172.21.15.19:0/1704598898 shutdown_connections 2023-11-04T15:37:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.929+0000 7fd7bed39640 1 --2- 172.21.15.19:0/1704598898 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fd7a406a430 0x7fd7a406c8f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.929+0000 7fd7bed39640 1 --2- 172.21.15.19:0/1704598898 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd7b8137650 0x7fd7b81cf5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.929+0000 7fd7bed39640 1 --2- 172.21.15.19:0/1704598898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7b8137270 0x7fd7b81cf080 unknown :-1 s=CLOSED pgs=3769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.929+0000 7fd7bed39640 1 --2- 172.21.15.19:0/1704598898 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7b80a3e90 0x7fd7b809fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.929+0000 7fd7bed39640 1 -- 172.21.15.19:0/1704598898 >> 172.21.15.19:0/1704598898 conn(0x7fd7b80a8d70 msgr2=0x7fd7b8139d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:07.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.929+0000 7fd7bed39640 1 -- 172.21.15.19:0/1704598898 shutdown_connections 2023-11-04T15:37:07.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:07.929+0000 7fd7bed39640 1 -- 172.21.15.19:0/1704598898 wait complete. 2023-11-04T15:37:07.944 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":332,"stamp":"2023-11-04T15:37:07.055636+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":431440415,"num_objects":220,"num_object_clones":25,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":8,"num_read":352,"num_read_kb":3468,"num_write":158433,"num_write_kb":940549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":307486,"ondisk_log_size":307486,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":3245288,"kb_used_data":844744,"kb_used_omap":0,"kb_used_meta":2400512,"kb_avail":374242072,"statfs":{"total":386547056640,"available":383223881728,"internally_reserved":0,"allocated":865017856,"data_stored":863586940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2458124288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2980013,"num_objects":12,"num_object_clones":6,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":149,"num_write_kb":3001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002245"},"pg_stats":[{"pgid":"4.3f","version":"40'3514","reported_seq":2950,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.796140+0000","last_change":"2023-11-04T15:36:55.800606+0000","last_active":"2023-11-04T15:37:04.796140+0000","last_peered":"2023-11-04T15:37:04.796140+0000","last_clean":"2023-11-04T15:37:04.796140+0000","last_became_active":"2023-11-04T15:27:36.150296+0000","last_became_peered":"2023-11-04T15:27:36.150296+0000","last_unstale":"2023-11-04T15:37:04.796140+0000","last_undegraded":"2023-11-04T15:37:04.796140+0000","last_fullsized":"2023-11-04T15:37:04.796140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3514,"log_dups_size":0,"ondisk_log_size":3514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:41:32.995261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.074678280999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1112,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"43'3332","reported_seq":2783,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720186+0000","last_change":"2023-11-04T15:36:55.781000+0000","last_active":"2023-11-04T15:37:04.720186+0000","last_peered":"2023-11-04T15:37:04.720186+0000","last_clean":"2023-11-04T15:37:04.720186+0000","last_became_active":"2023-11-04T15:27:36.148939+0000","last_became_peered":"2023-11-04T15:27:36.148939+0000","last_unstale":"2023-11-04T15:37:04.720186+0000","last_undegraded":"2023-11-04T15:37:04.720186+0000","last_fullsized":"2023-11-04T15:37:04.720186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3332,"log_dups_size":0,"ondisk_log_size":3332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:52:55.975636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059113046000000002,"stat_sum":{"num_bytes":35,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1118,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"40'3527","reported_seq":2999,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719044+0000","last_change":"2023-11-04T15:36:55.822917+0000","last_active":"2023-11-04T15:37:04.719044+0000","last_peered":"2023-11-04T15:37:04.719044+0000","last_clean":"2023-11-04T15:37:04.719044+0000","last_became_active":"2023-11-04T15:27:36.149748+0000","last_became_peered":"2023-11-04T15:27:36.149748+0000","last_unstale":"2023-11-04T15:37:04.719044+0000","last_undegraded":"2023-11-04T15:37:04.719044+0000","last_fullsized":"2023-11-04T15:37:04.719044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3527,"log_dups_size":0,"ondisk_log_size":3527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:49:04.091063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101592565,"stat_sum":{"num_bytes":8206,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":1149,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"40'3602","reported_seq":2983,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718273+0000","last_change":"2023-11-04T15:36:55.770578+0000","last_active":"2023-11-04T15:37:04.718273+0000","last_peered":"2023-11-04T15:37:04.718273+0000","last_clean":"2023-11-04T15:37:04.718273+0000","last_became_active":"2023-11-04T15:27:36.139761+0000","last_became_peered":"2023-11-04T15:27:36.139761+0000","last_unstale":"2023-11-04T15:37:04.718273+0000","last_undegraded":"2023-11-04T15:37:04.718273+0000","last_fullsized":"2023-11-04T15:37:04.718273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3602,"log_dups_size":0,"ondisk_log_size":3602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:38:30.379384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052924038,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1171,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"40'3725","reported_seq":3117,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795913+0000","last_change":"2023-11-04T15:36:55.798093+0000","last_active":"2023-11-04T15:37:04.795913+0000","last_peered":"2023-11-04T15:37:04.795913+0000","last_clean":"2023-11-04T15:37:04.795913+0000","last_became_active":"2023-11-04T15:27:36.150017+0000","last_became_peered":"2023-11-04T15:27:36.150017+0000","last_unstale":"2023-11-04T15:37:04.795913+0000","last_undegraded":"2023-11-04T15:37:04.795913+0000","last_fullsized":"2023-11-04T15:37:04.795913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3725,"log_dups_size":0,"ondisk_log_size":3725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:47:40.350777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.073241305000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1192,"num_write_kb":641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"40'3327","reported_seq":2769,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720295+0000","last_change":"2023-11-04T15:36:55.824394+0000","last_active":"2023-11-04T15:37:04.720295+0000","last_peered":"2023-11-04T15:37:04.720295+0000","last_clean":"2023-11-04T15:37:04.720295+0000","last_became_active":"2023-11-04T15:27:36.139036+0000","last_became_peered":"2023-11-04T15:27:36.139036+0000","last_unstale":"2023-11-04T15:37:04.720295+0000","last_undegraded":"2023-11-04T15:37:04.720295+0000","last_fullsized":"2023-11-04T15:37:04.720295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3327,"log_dups_size":0,"ondisk_log_size":3327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:05:44.093984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.102154117,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1074,"num_write_kb":603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"43'3353","reported_seq":2803,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.717514+0000","last_change":"2023-11-04T15:36:55.820147+0000","last_active":"2023-11-04T15:37:04.717514+0000","last_peered":"2023-11-04T15:37:04.717514+0000","last_clean":"2023-11-04T15:37:04.717514+0000","last_became_active":"2023-11-04T15:27:36.139121+0000","last_became_peered":"2023-11-04T15:27:36.139121+0000","last_unstale":"2023-11-04T15:37:04.717514+0000","last_undegraded":"2023-11-04T15:37:04.717514+0000","last_fullsized":"2023-11-04T15:37:04.717514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3353,"log_dups_size":0,"ondisk_log_size":3353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:57:05.896392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.099827518000000004,"stat_sum":{"num_bytes":4117,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":2,"num_read_kb":1,"num_write":1086,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"40'3425","reported_seq":2842,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.717428+0000","last_change":"2023-11-04T15:36:55.816551+0000","last_active":"2023-11-04T15:37:04.717428+0000","last_peered":"2023-11-04T15:37:04.717428+0000","last_clean":"2023-11-04T15:37:04.717428+0000","last_became_active":"2023-11-04T15:27:36.147050+0000","last_became_peered":"2023-11-04T15:27:36.147050+0000","last_unstale":"2023-11-04T15:37:04.717428+0000","last_undegraded":"2023-11-04T15:37:04.717428+0000","last_fullsized":"2023-11-04T15:37:04.717428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3425,"log_dups_size":0,"ondisk_log_size":3425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:40:36.811342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.098810337999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"40'3561","reported_seq":2963,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795613+0000","last_change":"2023-11-04T15:36:55.796038+0000","last_active":"2023-11-04T15:37:04.795613+0000","last_peered":"2023-11-04T15:37:04.795613+0000","last_clean":"2023-11-04T15:37:04.795613+0000","last_became_active":"2023-11-04T15:27:36.145825+0000","last_became_peered":"2023-11-04T15:27:36.145825+0000","last_unstale":"2023-11-04T15:37:04.795613+0000","last_undegraded":"2023-11-04T15:37:04.795613+0000","last_fullsized":"2023-11-04T15:37:04.795613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3561,"log_dups_size":0,"ondisk_log_size":3561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:52:55.975636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072094483000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"40'3327","reported_seq":2842,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719182+0000","last_change":"2023-11-04T15:36:55.817992+0000","last_active":"2023-11-04T15:37:04.719182+0000","last_peered":"2023-11-04T15:37:04.719182+0000","last_clean":"2023-11-04T15:37:04.719182+0000","last_became_active":"2023-11-04T15:27:36.150307+0000","last_became_peered":"2023-11-04T15:27:36.150307+0000","last_unstale":"2023-11-04T15:37:04.719182+0000","last_undegraded":"2023-11-04T15:37:04.719182+0000","last_fullsized":"2023-11-04T15:37:04.719182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3327,"log_dups_size":0,"ondisk_log_size":3327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:38:23.440792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10012518099999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1064,"num_write_kb":572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"40'3202","reported_seq":2719,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719282+0000","last_change":"2023-11-04T15:36:55.770571+0000","last_active":"2023-11-04T15:37:04.719282+0000","last_peered":"2023-11-04T15:37:04.719282+0000","last_clean":"2023-11-04T15:37:04.719282+0000","last_became_active":"2023-11-04T15:27:36.144988+0000","last_became_peered":"2023-11-04T15:27:36.144988+0000","last_unstale":"2023-11-04T15:37:04.719282+0000","last_undegraded":"2023-11-04T15:37:04.719282+0000","last_fullsized":"2023-11-04T15:37:04.719282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3202,"log_dups_size":0,"ondisk_log_size":3202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:41.544754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052379294999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1028,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"40'3394","reported_seq":2821,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720280+0000","last_change":"2023-11-04T15:36:55.782106+0000","last_active":"2023-11-04T15:37:04.720280+0000","last_peered":"2023-11-04T15:37:04.720280+0000","last_clean":"2023-11-04T15:37:04.720280+0000","last_became_active":"2023-11-04T15:27:36.149156+0000","last_became_peered":"2023-11-04T15:27:36.149156+0000","last_unstale":"2023-11-04T15:37:04.720280+0000","last_undegraded":"2023-11-04T15:37:04.720280+0000","last_fullsized":"2023-11-04T15:37:04.720280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3394,"log_dups_size":0,"ondisk_log_size":3394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:22:17.580120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.064372897999999998,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1159,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"40'3255","reported_seq":2742,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795152+0000","last_change":"2023-11-04T15:36:55.792591+0000","last_active":"2023-11-04T15:37:04.795152+0000","last_peered":"2023-11-04T15:37:04.795152+0000","last_clean":"2023-11-04T15:37:04.795152+0000","last_became_active":"2023-11-04T15:27:36.139824+0000","last_became_peered":"2023-11-04T15:27:36.139824+0000","last_unstale":"2023-11-04T15:37:04.795152+0000","last_undegraded":"2023-11-04T15:37:04.795152+0000","last_fullsized":"2023-11-04T15:37:04.795152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3255,"log_dups_size":0,"ondisk_log_size":3255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:28.095802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070068697999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1062,"num_write_kb":575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"40'3538","reported_seq":2917,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718745+0000","last_change":"2023-11-04T15:36:55.774374+0000","last_active":"2023-11-04T15:37:04.718745+0000","last_peered":"2023-11-04T15:37:04.718745+0000","last_clean":"2023-11-04T15:37:04.718745+0000","last_became_active":"2023-11-04T15:27:36.147273+0000","last_became_peered":"2023-11-04T15:27:36.147273+0000","last_unstale":"2023-11-04T15:37:04.718745+0000","last_undegraded":"2023-11-04T15:37:04.718745+0000","last_fullsized":"2023-11-04T15:37:04.718745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3538,"log_dups_size":0,"ondisk_log_size":3538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:22:17.580120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055716603000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"40'3766","reported_seq":3158,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718333+0000","last_change":"2023-11-04T15:36:55.780005+0000","last_active":"2023-11-04T15:37:04.718333+0000","last_peered":"2023-11-04T15:37:04.718333+0000","last_clean":"2023-11-04T15:37:04.718333+0000","last_became_active":"2023-11-04T15:27:36.148932+0000","last_became_peered":"2023-11-04T15:27:36.148932+0000","last_unstale":"2023-11-04T15:37:04.718333+0000","last_undegraded":"2023-11-04T15:37:04.718333+0000","last_fullsized":"2023-11-04T15:37:04.718333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3766,"log_dups_size":0,"ondisk_log_size":3766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:12:07.727740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062648212999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1209,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"40'3538","reported_seq":2945,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718451+0000","last_change":"2023-11-04T15:36:55.818096+0000","last_active":"2023-11-04T15:37:04.718451+0000","last_peered":"2023-11-04T15:37:04.718451+0000","last_clean":"2023-11-04T15:37:04.718451+0000","last_became_active":"2023-11-04T15:27:36.150856+0000","last_became_peered":"2023-11-04T15:27:36.150856+0000","last_unstale":"2023-11-04T15:37:04.718451+0000","last_undegraded":"2023-11-04T15:37:04.718451+0000","last_fullsized":"2023-11-04T15:37:04.718451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3538,"log_dups_size":0,"ondisk_log_size":3538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:51:31.442634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.099772735000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"40'3671","reported_seq":2999,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795666+0000","last_change":"2023-11-04T15:36:55.797112+0000","last_active":"2023-11-04T15:37:04.795666+0000","last_peered":"2023-11-04T15:37:04.795666+0000","last_clean":"2023-11-04T15:37:04.795666+0000","last_became_active":"2023-11-04T15:27:36.144997+0000","last_became_peered":"2023-11-04T15:27:36.144997+0000","last_unstale":"2023-11-04T15:37:04.795666+0000","last_undegraded":"2023-11-04T15:37:04.795666+0000","last_fullsized":"2023-11-04T15:37:04.795666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3671,"log_dups_size":0,"ondisk_log_size":3671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:22:17.580120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072563297999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1270,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"40'3137","reported_seq":2642,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718925+0000","last_change":"2023-11-04T15:36:55.820139+0000","last_active":"2023-11-04T15:37:04.718925+0000","last_peered":"2023-11-04T15:37:04.718925+0000","last_clean":"2023-11-04T15:37:04.718925+0000","last_became_active":"2023-11-04T15:27:36.150555+0000","last_became_peered":"2023-11-04T15:27:36.150555+0000","last_unstale":"2023-11-04T15:37:04.718925+0000","last_undegraded":"2023-11-04T15:37:04.718925+0000","last_fullsized":"2023-11-04T15:37:04.718925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3137,"log_dups_size":0,"ondisk_log_size":3137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:32:27.370984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101696772,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1042,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"40'3390","reported_seq":2812,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795870+0000","last_change":"2023-11-04T15:36:55.795034+0000","last_active":"2023-11-04T15:37:04.795870+0000","last_peered":"2023-11-04T15:37:04.795870+0000","last_clean":"2023-11-04T15:37:04.795870+0000","last_became_active":"2023-11-04T15:27:36.147745+0000","last_became_peered":"2023-11-04T15:27:36.147745+0000","last_unstale":"2023-11-04T15:37:04.795870+0000","last_undegraded":"2023-11-04T15:37:04.795870+0000","last_fullsized":"2023-11-04T15:37:04.795870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3390,"log_dups_size":0,"ondisk_log_size":3390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:41:10.315016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071588252000000005,"stat_sum":{"num_bytes":4128,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1173,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"40'3505","reported_seq":2915,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719147+0000","last_change":"2023-11-04T15:36:55.815381+0000","last_active":"2023-11-04T15:37:04.719147+0000","last_peered":"2023-11-04T15:37:04.719147+0000","last_clean":"2023-11-04T15:37:04.719147+0000","last_became_active":"2023-11-04T15:27:36.150687+0000","last_became_peered":"2023-11-04T15:27:36.150687+0000","last_unstale":"2023-11-04T15:37:04.719147+0000","last_undegraded":"2023-11-04T15:37:04.719147+0000","last_fullsized":"2023-11-04T15:37:04.719147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3505,"log_dups_size":0,"ondisk_log_size":3505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:56:24.790444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.097896176000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1154,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"43'3544","reported_seq":2981,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.717916+0000","last_change":"2023-11-04T15:36:55.776770+0000","last_active":"2023-11-04T15:37:04.717916+0000","last_peered":"2023-11-04T15:37:04.717916+0000","last_clean":"2023-11-04T15:37:04.717916+0000","last_became_active":"2023-11-04T15:27:36.143551+0000","last_became_peered":"2023-11-04T15:27:36.143551+0000","last_unstale":"2023-11-04T15:37:04.717916+0000","last_undegraded":"2023-11-04T15:37:04.717916+0000","last_fullsized":"2023-11-04T15:37:04.717916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3544,"log_dups_size":0,"ondisk_log_size":3544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:36:21.960547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056037475000000003,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1178,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"40'3728","reported_seq":3085,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795117+0000","last_change":"2023-11-04T15:36:55.794625+0000","last_active":"2023-11-04T15:37:04.795117+0000","last_peered":"2023-11-04T15:37:04.795117+0000","last_clean":"2023-11-04T15:37:04.795117+0000","last_became_active":"2023-11-04T15:27:36.145943+0000","last_became_peered":"2023-11-04T15:27:36.145943+0000","last_unstale":"2023-11-04T15:37:04.795117+0000","last_undegraded":"2023-11-04T15:37:04.795117+0000","last_fullsized":"2023-11-04T15:37:04.795117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3728,"log_dups_size":0,"ondisk_log_size":3728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:48:58.102459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071549077000000003,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1242,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"40'3454","reported_seq":2889,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719388+0000","last_change":"2023-11-04T15:36:55.777772+0000","last_active":"2023-11-04T15:37:04.719388+0000","last_peered":"2023-11-04T15:37:04.719388+0000","last_clean":"2023-11-04T15:37:04.719388+0000","last_became_active":"2023-11-04T15:27:36.144083+0000","last_became_peered":"2023-11-04T15:27:36.144083+0000","last_unstale":"2023-11-04T15:37:04.719388+0000","last_undegraded":"2023-11-04T15:37:04.719388+0000","last_fullsized":"2023-11-04T15:37:04.719388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3454,"log_dups_size":0,"ondisk_log_size":3454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:32:27.370984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.060959410999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1127,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"40'3632","reported_seq":2991,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.717655+0000","last_change":"2023-11-04T15:36:55.821483+0000","last_active":"2023-11-04T15:37:04.717655+0000","last_peered":"2023-11-04T15:37:04.717655+0000","last_clean":"2023-11-04T15:37:04.717655+0000","last_became_active":"2023-11-04T15:27:36.146546+0000","last_became_peered":"2023-11-04T15:27:36.146546+0000","last_unstale":"2023-11-04T15:37:04.717655+0000","last_undegraded":"2023-11-04T15:37:04.717655+0000","last_fullsized":"2023-11-04T15:37:04.717655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3632,"log_dups_size":0,"ondisk_log_size":3632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:41:10.315016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.102597439,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1222,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"40'3166","reported_seq":2628,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720944+0000","last_change":"2023-11-04T15:36:55.783207+0000","last_active":"2023-11-04T15:37:04.720944+0000","last_peered":"2023-11-04T15:37:04.720944+0000","last_clean":"2023-11-04T15:37:04.720944+0000","last_became_active":"2023-11-04T15:27:36.144047+0000","last_became_peered":"2023-11-04T15:27:36.144047+0000","last_unstale":"2023-11-04T15:37:04.720944+0000","last_undegraded":"2023-11-04T15:37:04.720944+0000","last_fullsized":"2023-11-04T15:37:04.720944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3166,"log_dups_size":0,"ondisk_log_size":3166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:36:21.960547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.064725415999999994,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1115,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"40'3493","reported_seq":2893,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720357+0000","last_change":"2023-11-04T15:36:55.784865+0000","last_active":"2023-11-04T15:37:04.720357+0000","last_peered":"2023-11-04T15:37:04.720357+0000","last_clean":"2023-11-04T15:37:04.720357+0000","last_became_active":"2023-11-04T15:27:36.144458+0000","last_became_peered":"2023-11-04T15:27:36.144458+0000","last_unstale":"2023-11-04T15:37:04.720357+0000","last_undegraded":"2023-11-04T15:37:04.720357+0000","last_fullsized":"2023-11-04T15:37:04.720357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3493,"log_dups_size":0,"ondisk_log_size":3493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:52:55.975636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.066118209999999997,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"40'3386","reported_seq":2825,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720121+0000","last_change":"2023-11-04T15:36:55.827764+0000","last_active":"2023-11-04T15:37:04.720121+0000","last_peered":"2023-11-04T15:37:04.720121+0000","last_clean":"2023-11-04T15:37:04.720121+0000","last_became_active":"2023-11-04T15:27:36.150270+0000","last_became_peered":"2023-11-04T15:27:36.150270+0000","last_unstale":"2023-11-04T15:37:04.720121+0000","last_undegraded":"2023-11-04T15:37:04.720121+0000","last_fullsized":"2023-11-04T15:37:04.720121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3386,"log_dups_size":0,"ondisk_log_size":3386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:18:00.808576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.104674168,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"40'3286","reported_seq":2717,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795488+0000","last_change":"2023-11-04T15:36:55.799791+0000","last_active":"2023-11-04T15:37:04.795488+0000","last_peered":"2023-11-04T15:37:04.795488+0000","last_clean":"2023-11-04T15:37:04.795488+0000","last_became_active":"2023-11-04T15:28:20.871378+0000","last_became_peered":"2023-11-04T15:28:20.871378+0000","last_unstale":"2023-11-04T15:37:04.795488+0000","last_undegraded":"2023-11-04T15:37:04.795488+0000","last_fullsized":"2023-11-04T15:37:04.795488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3286,"log_dups_size":0,"ondisk_log_size":3286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:50:26.736014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.074381663000000001,"stat_sum":{"num_bytes":9,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1152,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"40'3578","reported_seq":3006,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795600+0000","last_change":"2023-11-04T15:36:55.793946+0000","last_active":"2023-11-04T15:37:04.795600+0000","last_peered":"2023-11-04T15:37:04.795600+0000","last_clean":"2023-11-04T15:37:04.795600+0000","last_became_active":"2023-11-04T15:27:36.145392+0000","last_became_peered":"2023-11-04T15:27:36.145392+0000","last_unstale":"2023-11-04T15:37:04.795600+0000","last_undegraded":"2023-11-04T15:37:04.795600+0000","last_fullsized":"2023-11-04T15:37:04.795600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3578,"log_dups_size":0,"ondisk_log_size":3578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:12:07.727740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070714202000000004,"stat_sum":{"num_bytes":12288,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1167,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"40'3386","reported_seq":2861,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720441+0000","last_change":"2023-11-04T15:36:55.824211+0000","last_active":"2023-11-04T15:37:04.720441+0000","last_peered":"2023-11-04T15:37:04.720441+0000","last_clean":"2023-11-04T15:37:04.720441+0000","last_became_active":"2023-11-04T15:27:36.145273+0000","last_became_peered":"2023-11-04T15:27:36.145273+0000","last_unstale":"2023-11-04T15:37:04.720441+0000","last_undegraded":"2023-11-04T15:37:04.720441+0000","last_fullsized":"2023-11-04T15:37:04.720441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3386,"log_dups_size":0,"ondisk_log_size":3386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:27:25.258046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101784969,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1155,"num_write_kb":603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"40'3889","reported_seq":3213,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719394+0000","last_change":"2023-11-04T15:36:55.778888+0000","last_active":"2023-11-04T15:37:04.719394+0000","last_peered":"2023-11-04T15:37:04.719394+0000","last_clean":"2023-11-04T15:37:04.719394+0000","last_became_active":"2023-11-04T15:27:36.144053+0000","last_became_peered":"2023-11-04T15:27:36.144053+0000","last_unstale":"2023-11-04T15:37:04.719394+0000","last_undegraded":"2023-11-04T15:37:04.719394+0000","last_fullsized":"2023-11-04T15:37:04.719394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3889,"log_dups_size":0,"ondisk_log_size":3889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:41:10.315016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061944979999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1328,"num_write_kb":706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"40'3720","reported_seq":3104,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.717847+0000","last_change":"2023-11-04T15:36:55.775709+0000","last_active":"2023-11-04T15:37:04.717847+0000","last_peered":"2023-11-04T15:37:04.717847+0000","last_clean":"2023-11-04T15:37:04.717847+0000","last_became_active":"2023-11-04T15:27:36.148342+0000","last_became_peered":"2023-11-04T15:27:36.148342+0000","last_unstale":"2023-11-04T15:37:04.717847+0000","last_undegraded":"2023-11-04T15:37:04.717847+0000","last_fullsized":"2023-11-04T15:37:04.717847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3720,"log_dups_size":0,"ondisk_log_size":3720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:47:40.350777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056486557999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"40'3424","reported_seq":2825,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720639+0000","last_change":"2023-11-04T15:36:55.784869+0000","last_active":"2023-11-04T15:37:04.720639+0000","last_peered":"2023-11-04T15:37:04.720639+0000","last_clean":"2023-11-04T15:37:04.720639+0000","last_became_active":"2023-11-04T15:27:36.148951+0000","last_became_peered":"2023-11-04T15:27:36.148951+0000","last_unstale":"2023-11-04T15:37:04.720639+0000","last_undegraded":"2023-11-04T15:37:04.720639+0000","last_fullsized":"2023-11-04T15:37:04.720639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3424,"log_dups_size":0,"ondisk_log_size":3424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:58:32.190696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.066218149000000004,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1176,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"40'2984","reported_seq":3024,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.722574+0000","last_change":"2023-11-04T15:27:35.775931+0000","last_active":"2023-11-04T15:36:55.722574+0000","last_peered":"2023-11-04T15:36:55.722574+0000","last_clean":"2023-11-04T15:36:55.722574+0000","last_became_active":"2023-11-04T15:27:35.775616+0000","last_became_peered":"2023-11-04T15:27:35.775616+0000","last_unstale":"2023-11-04T15:36:55.722574+0000","last_undegraded":"2023-11-04T15:36:55.722574+0000","last_fullsized":"2023-11-04T15:36:55.722574+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2984,"log_dups_size":0,"ondisk_log_size":2984,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:14:34.175377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2984,"num_write_kb":24202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"40'3308","reported_seq":2725,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719654+0000","last_change":"2023-11-04T15:36:55.822910+0000","last_active":"2023-11-04T15:37:04.719654+0000","last_peered":"2023-11-04T15:37:04.719654+0000","last_clean":"2023-11-04T15:37:04.719654+0000","last_became_active":"2023-11-04T15:27:36.150276+0000","last_became_peered":"2023-11-04T15:27:36.150276+0000","last_unstale":"2023-11-04T15:37:04.719654+0000","last_undegraded":"2023-11-04T15:37:04.719654+0000","last_fullsized":"2023-11-04T15:37:04.719654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3308,"log_dups_size":0,"ondisk_log_size":3308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T22:54:18.576814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101095329,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1177,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"37'462","reported_seq":502,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.723127+0000","last_change":"2023-11-04T15:27:35.776610+0000","last_active":"2023-11-04T15:36:55.723127+0000","last_peered":"2023-11-04T15:36:55.723127+0000","last_clean":"2023-11-04T15:36:55.723127+0000","last_became_active":"2023-11-04T15:27:35.776297+0000","last_became_peered":"2023-11-04T15:27:35.776297+0000","last_unstale":"2023-11-04T15:36:55.723127+0000","last_undegraded":"2023-11-04T15:36:55.723127+0000","last_fullsized":"2023-11-04T15:36:55.723127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:11:01.495068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":462,"num_write_kb":12396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"40'3485","reported_seq":2906,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.796204+0000","last_change":"2023-11-04T15:36:55.800080+0000","last_active":"2023-11-04T15:37:04.796204+0000","last_peered":"2023-11-04T15:37:04.796204+0000","last_clean":"2023-11-04T15:37:04.796204+0000","last_became_active":"2023-11-04T15:27:36.139580+0000","last_became_peered":"2023-11-04T15:27:36.139580+0000","last_unstale":"2023-11-04T15:37:04.796204+0000","last_undegraded":"2023-11-04T15:37:04.796204+0000","last_fullsized":"2023-11-04T15:37:04.796204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3485,"log_dups_size":0,"ondisk_log_size":3485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:38:30.379384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.074768939000000006,"stat_sum":{"num_bytes":8192,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1207,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"40'717","reported_seq":757,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.720453+0000","last_change":"2023-11-04T15:27:35.775977+0000","last_active":"2023-11-04T15:36:55.720453+0000","last_peered":"2023-11-04T15:36:55.720453+0000","last_clean":"2023-11-04T15:36:55.720453+0000","last_became_active":"2023-11-04T15:27:35.775486+0000","last_became_peered":"2023-11-04T15:27:35.775486+0000","last_unstale":"2023-11-04T15:36:55.720453+0000","last_undegraded":"2023-11-04T15:36:55.720453+0000","last_fullsized":"2023-11-04T15:36:55.720453+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:44:09.266115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":707,"num_write_kb":16815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"40'3443","reported_seq":2874,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795852+0000","last_change":"2023-11-04T15:36:55.799083+0000","last_active":"2023-11-04T15:37:04.795852+0000","last_peered":"2023-11-04T15:37:04.795852+0000","last_clean":"2023-11-04T15:37:04.795852+0000","last_became_active":"2023-11-04T15:27:36.139789+0000","last_became_peered":"2023-11-04T15:27:36.139789+0000","last_unstale":"2023-11-04T15:37:04.795852+0000","last_undegraded":"2023-11-04T15:37:04.795852+0000","last_fullsized":"2023-11-04T15:37:04.795852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3443,"log_dups_size":0,"ondisk_log_size":3443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:55:13.470788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.073936136,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"37'1614","reported_seq":1654,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.719925+0000","last_change":"2023-11-04T15:27:35.776168+0000","last_active":"2023-11-04T15:36:55.719925+0000","last_peered":"2023-11-04T15:36:55.719925+0000","last_clean":"2023-11-04T15:36:55.719925+0000","last_became_active":"2023-11-04T15:27:35.775895+0000","last_became_peered":"2023-11-04T15:27:35.775895+0000","last_unstale":"2023-11-04T15:36:55.719925+0000","last_undegraded":"2023-11-04T15:36:55.719925+0000","last_fullsized":"2023-11-04T15:36:55.719925+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1614,"log_dups_size":0,"ondisk_log_size":1614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:02:27.460776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":1625,"num_write_kb":22714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"43'1198","reported_seq":1238,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:58.876028+0000","last_change":"2023-11-04T15:27:35.767890+0000","last_active":"2023-11-04T15:36:58.876028+0000","last_peered":"2023-11-04T15:36:58.876028+0000","last_clean":"2023-11-04T15:36:58.876028+0000","last_became_active":"2023-11-04T15:27:35.767594+0000","last_became_peered":"2023-11-04T15:27:35.767594+0000","last_unstale":"2023-11-04T15:36:58.876028+0000","last_undegraded":"2023-11-04T15:36:58.876028+0000","last_fullsized":"2023-11-04T15:36:58.876028+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1198,"log_dups_size":0,"ondisk_log_size":1198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:11:01.495068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1190,"num_write_kb":15478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"40'3688","reported_seq":3050,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.717843+0000","last_change":"2023-11-04T15:36:55.821576+0000","last_active":"2023-11-04T15:37:04.717843+0000","last_peered":"2023-11-04T15:37:04.717843+0000","last_clean":"2023-11-04T15:37:04.717843+0000","last_became_active":"2023-11-04T15:27:36.148282+0000","last_became_peered":"2023-11-04T15:27:36.148282+0000","last_unstale":"2023-11-04T15:37:04.717843+0000","last_undegraded":"2023-11-04T15:37:04.717843+0000","last_fullsized":"2023-11-04T15:37:04.717843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3688,"log_dups_size":0,"ondisk_log_size":3688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:28:21.024990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.102136719,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1244,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"37'2392","reported_seq":2432,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.724183+0000","last_change":"2023-11-04T15:27:35.771839+0000","last_active":"2023-11-04T15:36:55.724183+0000","last_peered":"2023-11-04T15:36:55.724183+0000","last_clean":"2023-11-04T15:36:55.724183+0000","last_became_active":"2023-11-04T15:27:35.771554+0000","last_became_peered":"2023-11-04T15:27:35.771554+0000","last_unstale":"2023-11-04T15:36:55.724183+0000","last_undegraded":"2023-11-04T15:36:55.724183+0000","last_fullsized":"2023-11-04T15:36:55.724183+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2392,"log_dups_size":0,"ondisk_log_size":2392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:02:11.972760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2386,"num_write_kb":21701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"40'3600","reported_seq":2985,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719406+0000","last_change":"2023-11-04T15:36:55.779143+0000","last_active":"2023-11-04T15:37:04.719406+0000","last_peered":"2023-11-04T15:37:04.719406+0000","last_clean":"2023-11-04T15:37:04.719406+0000","last_became_active":"2023-11-04T15:27:36.149146+0000","last_became_peered":"2023-11-04T15:27:36.149146+0000","last_unstale":"2023-11-04T15:37:04.719406+0000","last_undegraded":"2023-11-04T15:37:04.719406+0000","last_fullsized":"2023-11-04T15:37:04.719406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3600,"log_dups_size":0,"ondisk_log_size":3600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:14:54.847413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055767874000000002,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"40'3587","reported_seq":3627,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.722842+0000","last_change":"2023-11-04T15:27:35.773978+0000","last_active":"2023-11-04T15:36:55.722842+0000","last_peered":"2023-11-04T15:36:55.722842+0000","last_clean":"2023-11-04T15:36:55.722842+0000","last_became_active":"2023-11-04T15:27:35.773689+0000","last_became_peered":"2023-11-04T15:27:35.773689+0000","last_unstale":"2023-11-04T15:36:55.722842+0000","last_undegraded":"2023-11-04T15:36:55.722842+0000","last_fullsized":"2023-11-04T15:36:55.722842+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3587,"log_dups_size":0,"ondisk_log_size":3587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:52:13.268866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582982,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3581,"num_write_kb":38716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"40'3511","reported_seq":2897,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718824+0000","last_change":"2023-11-04T15:36:55.777637+0000","last_active":"2023-11-04T15:37:04.718824+0000","last_peered":"2023-11-04T15:37:04.718824+0000","last_clean":"2023-11-04T15:37:04.718824+0000","last_became_active":"2023-11-04T15:27:36.141695+0000","last_became_peered":"2023-11-04T15:27:36.141695+0000","last_unstale":"2023-11-04T15:37:04.718824+0000","last_undegraded":"2023-11-04T15:37:04.718824+0000","last_fullsized":"2023-11-04T15:37:04.718824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3511,"log_dups_size":0,"ondisk_log_size":3511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:45:22.367523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057953993000000002,"stat_sum":{"num_bytes":4107,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1230,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"40'1577","reported_seq":1617,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.718761+0000","last_change":"2023-11-04T15:27:35.774108+0000","last_active":"2023-11-04T15:36:55.718761+0000","last_peered":"2023-11-04T15:36:55.718761+0000","last_clean":"2023-11-04T15:36:55.718761+0000","last_became_active":"2023-11-04T15:27:35.773818+0000","last_became_peered":"2023-11-04T15:27:35.773818+0000","last_unstale":"2023-11-04T15:36:55.718761+0000","last_undegraded":"2023-11-04T15:36:55.718761+0000","last_fullsized":"2023-11-04T15:36:55.718761+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1577,"log_dups_size":0,"ondisk_log_size":1577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:42:49.218866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1569,"num_write_kb":30603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"40'3300","reported_seq":2748,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795278+0000","last_change":"2023-11-04T15:36:55.793529+0000","last_active":"2023-11-04T15:37:04.795278+0000","last_peered":"2023-11-04T15:37:04.795278+0000","last_clean":"2023-11-04T15:37:04.795278+0000","last_became_active":"2023-11-04T15:27:36.150653+0000","last_became_peered":"2023-11-04T15:27:36.150653+0000","last_unstale":"2023-11-04T15:37:04.795278+0000","last_undegraded":"2023-11-04T15:37:04.795278+0000","last_fullsized":"2023-11-04T15:37:04.795278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3300,"log_dups_size":0,"ondisk_log_size":3300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:36:21.960547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070970674999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1129,"num_write_kb":600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"37'4021","reported_seq":4061,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.717379+0000","last_change":"2023-11-04T15:27:35.773128+0000","last_active":"2023-11-04T15:36:55.717379+0000","last_peered":"2023-11-04T15:36:55.717379+0000","last_clean":"2023-11-04T15:36:55.717379+0000","last_became_active":"2023-11-04T15:27:35.772815+0000","last_became_peered":"2023-11-04T15:27:35.772815+0000","last_unstale":"2023-11-04T15:36:55.717379+0000","last_undegraded":"2023-11-04T15:36:55.717379+0000","last_fullsized":"2023-11-04T15:36:55.717379+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":4021,"log_dups_size":0,"ondisk_log_size":4021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:42:49.218866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4019,"num_write_kb":36923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"40'3784","reported_seq":3128,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719363+0000","last_change":"2023-11-04T15:36:55.816749+0000","last_active":"2023-11-04T15:37:04.719363+0000","last_peered":"2023-11-04T15:37:04.719363+0000","last_clean":"2023-11-04T15:37:04.719363+0000","last_became_active":"2023-11-04T15:27:36.150667+0000","last_became_peered":"2023-11-04T15:27:36.150667+0000","last_unstale":"2023-11-04T15:37:04.719363+0000","last_undegraded":"2023-11-04T15:37:04.719363+0000","last_fullsized":"2023-11-04T15:37:04.719363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3784,"log_dups_size":0,"ondisk_log_size":3784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:55:13.470788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.098687114000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1287,"num_write_kb":684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"37'2125","reported_seq":2165,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.722748+0000","last_change":"2023-11-04T15:27:35.775559+0000","last_active":"2023-11-04T15:36:55.722748+0000","last_peered":"2023-11-04T15:36:55.722748+0000","last_clean":"2023-11-04T15:36:55.722748+0000","last_became_active":"2023-11-04T15:27:35.775063+0000","last_became_peered":"2023-11-04T15:27:35.775063+0000","last_unstale":"2023-11-04T15:36:55.722748+0000","last_undegraded":"2023-11-04T15:36:55.722748+0000","last_fullsized":"2023-11-04T15:36:55.722748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2125,"log_dups_size":0,"ondisk_log_size":2125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:30:45.293294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2118,"num_write_kb":30816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"40'3317","reported_seq":2787,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719292+0000","last_change":"2023-11-04T15:36:55.826358+0000","last_active":"2023-11-04T15:37:04.719292+0000","last_peered":"2023-11-04T15:37:04.719292+0000","last_clean":"2023-11-04T15:37:04.719292+0000","last_became_active":"2023-11-04T15:27:36.139103+0000","last_became_peered":"2023-11-04T15:27:36.139103+0000","last_unstale":"2023-11-04T15:37:04.719292+0000","last_undegraded":"2023-11-04T15:37:04.719292+0000","last_fullsized":"2023-11-04T15:37:04.719292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3317,"log_dups_size":0,"ondisk_log_size":3317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:59:35.340281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10468400899999999,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1091,"num_write_kb":593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"37'1934","reported_seq":1974,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.720601+0000","last_change":"2023-11-04T15:27:35.773686+0000","last_active":"2023-11-04T15:36:55.720601+0000","last_peered":"2023-11-04T15:36:55.720601+0000","last_clean":"2023-11-04T15:36:55.720601+0000","last_became_active":"2023-11-04T15:27:35.773449+0000","last_became_peered":"2023-11-04T15:27:35.773449+0000","last_unstale":"2023-11-04T15:36:55.720601+0000","last_undegraded":"2023-11-04T15:36:55.720601+0000","last_fullsized":"2023-11-04T15:36:55.720601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1934,"log_dups_size":0,"ondisk_log_size":1934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:17:14.527023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1929,"num_write_kb":17119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"40'3519","reported_seq":2941,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720266+0000","last_change":"2023-11-04T15:36:55.781058+0000","last_active":"2023-11-04T15:37:04.720266+0000","last_peered":"2023-11-04T15:37:04.720266+0000","last_clean":"2023-11-04T15:37:04.720266+0000","last_became_active":"2023-11-04T15:27:36.141086+0000","last_became_peered":"2023-11-04T15:27:36.141086+0000","last_unstale":"2023-11-04T15:37:04.720266+0000","last_undegraded":"2023-11-04T15:37:04.720266+0000","last_fullsized":"2023-11-04T15:37:04.720266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3519,"log_dups_size":0,"ondisk_log_size":3519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:28:45.715407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059170119,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1142,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"37'655","reported_seq":695,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.718925+0000","last_change":"2023-11-04T15:27:35.770858+0000","last_active":"2023-11-04T15:36:55.718925+0000","last_peered":"2023-11-04T15:36:55.718925+0000","last_clean":"2023-11-04T15:36:55.718925+0000","last_became_active":"2023-11-04T15:27:35.769001+0000","last_became_peered":"2023-11-04T15:27:35.769001+0000","last_unstale":"2023-11-04T15:36:55.718925+0000","last_undegraded":"2023-11-04T15:36:55.718925+0000","last_fullsized":"2023-11-04T15:36:55.718925+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:01:29.923726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":656,"num_write_kb":15166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"43'3665","reported_seq":3081,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720992+0000","last_change":"2023-11-04T15:36:55.783360+0000","last_active":"2023-11-04T15:37:04.720992+0000","last_peered":"2023-11-04T15:37:04.720992+0000","last_clean":"2023-11-04T15:37:04.720992+0000","last_became_active":"2023-11-04T15:27:36.147034+0000","last_became_peered":"2023-11-04T15:27:36.147034+0000","last_unstale":"2023-11-04T15:37:04.720992+0000","last_undegraded":"2023-11-04T15:37:04.720992+0000","last_fullsized":"2023-11-04T15:37:04.720992+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3665,"log_dups_size":0,"ondisk_log_size":3665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:14:54.847413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.064750725999999995,"stat_sum":{"num_bytes":4196,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1197,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":196,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.720203+0000","last_change":"2023-11-04T15:27:26.267129+0000","last_active":"2023-11-04T15:36:55.720203+0000","last_peered":"2023-11-04T15:36:55.720203+0000","last_clean":"2023-11-04T15:36:55.720203+0000","last_became_active":"2023-11-04T15:27:26.266242+0000","last_became_peered":"2023-11-04T15:27:26.266242+0000","last_unstale":"2023-11-04T15:36:55.720203+0000","last_undegraded":"2023-11-04T15:36:55.720203+0000","last_fullsized":"2023-11-04T15:36:55.720203+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:25.163848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:25.163848+0000","last_clean_scrub_stamp":"2023-11-04T15:27:25.163848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:54:55.231471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.722465+0000","last_change":"2023-11-04T15:27:31.620178+0000","last_active":"2023-11-04T15:36:55.722465+0000","last_peered":"2023-11-04T15:36:55.722465+0000","last_clean":"2023-11-04T15:36:55.722465+0000","last_became_active":"2023-11-04T15:27:31.619798+0000","last_became_peered":"2023-11-04T15:27:31.619798+0000","last_unstale":"2023-11-04T15:36:55.722465+0000","last_undegraded":"2023-11-04T15:36:55.722465+0000","last_fullsized":"2023-11-04T15:36:55.722465+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:50:31.717109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"39'3629","reported_seq":3669,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.718481+0000","last_change":"2023-11-04T15:27:35.769689+0000","last_active":"2023-11-04T15:36:55.718481+0000","last_peered":"2023-11-04T15:36:55.718481+0000","last_clean":"2023-11-04T15:36:55.718481+0000","last_became_active":"2023-11-04T15:27:35.769150+0000","last_became_peered":"2023-11-04T15:27:35.769150+0000","last_unstale":"2023-11-04T15:36:55.718481+0000","last_undegraded":"2023-11-04T15:36:55.718481+0000","last_fullsized":"2023-11-04T15:36:55.718481+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3629,"log_dups_size":0,"ondisk_log_size":3629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:15:19.151223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3620,"num_write_kb":52059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"40'3668","reported_seq":3074,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719948+0000","last_change":"2023-11-04T15:36:55.827884+0000","last_active":"2023-11-04T15:37:04.719948+0000","last_peered":"2023-11-04T15:37:04.719948+0000","last_clean":"2023-11-04T15:37:04.719948+0000","last_became_active":"2023-11-04T15:27:36.140619+0000","last_became_peered":"2023-11-04T15:27:36.140619+0000","last_unstale":"2023-11-04T15:37:04.719948+0000","last_undegraded":"2023-11-04T15:37:04.719948+0000","last_fullsized":"2023-11-04T15:37:04.719948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3668,"log_dups_size":0,"ondisk_log_size":3668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:42:12.902707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10532783499999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.720119+0000","last_change":"2023-11-04T15:27:31.622106+0000","last_active":"2023-11-04T15:36:55.720119+0000","last_peered":"2023-11-04T15:36:55.720119+0000","last_clean":"2023-11-04T15:36:55.720119+0000","last_became_active":"2023-11-04T15:27:31.621889+0000","last_became_peered":"2023-11-04T15:27:31.621889+0000","last_unstale":"2023-11-04T15:36:55.720119+0000","last_undegraded":"2023-11-04T15:36:55.720119+0000","last_fullsized":"2023-11-04T15:36:55.720119+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:11:00.327441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"43'3684","reported_seq":3890,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:58.873511+0000","last_change":"2023-11-04T15:27:35.771207+0000","last_active":"2023-11-04T15:36:58.873511+0000","last_peered":"2023-11-04T15:36:58.873511+0000","last_clean":"2023-11-04T15:36:58.873511+0000","last_became_active":"2023-11-04T15:27:35.770364+0000","last_became_peered":"2023-11-04T15:27:35.770364+0000","last_unstale":"2023-11-04T15:36:58.873511+0000","last_undegraded":"2023-11-04T15:36:58.873511+0000","last_fullsized":"2023-11-04T15:36:58.873511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3684,"log_dups_size":0,"ondisk_log_size":3684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:23:45.371175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15883313,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":166,"num_read_kb":3338,"num_write":3668,"num_write_kb":29714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"40'3551","reported_seq":2983,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.796003+0000","last_change":"2023-11-04T15:36:55.796697+0000","last_active":"2023-11-04T15:37:04.796003+0000","last_peered":"2023-11-04T15:37:04.796003+0000","last_clean":"2023-11-04T15:37:04.796003+0000","last_became_active":"2023-11-04T15:27:36.144459+0000","last_became_peered":"2023-11-04T15:27:36.144459+0000","last_unstale":"2023-11-04T15:37:04.796003+0000","last_undegraded":"2023-11-04T15:37:04.796003+0000","last_fullsized":"2023-11-04T15:37:04.796003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3551,"log_dups_size":0,"ondisk_log_size":3551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:28:45.715407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072685394,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.718661+0000","last_change":"2023-11-04T15:27:31.622710+0000","last_active":"2023-11-04T15:36:55.718661+0000","last_peered":"2023-11-04T15:36:55.718661+0000","last_clean":"2023-11-04T15:36:55.718661+0000","last_became_active":"2023-11-04T15:27:31.622378+0000","last_became_peered":"2023-11-04T15:27:31.622378+0000","last_unstale":"2023-11-04T15:36:55.718661+0000","last_undegraded":"2023-11-04T15:36:55.718661+0000","last_fullsized":"2023-11-04T15:36:55.718661+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:49:04.803105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"40'6079","reported_seq":6119,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.718885+0000","last_change":"2023-11-04T15:27:35.774630+0000","last_active":"2023-11-04T15:36:55.718885+0000","last_peered":"2023-11-04T15:36:55.718885+0000","last_clean":"2023-11-04T15:36:55.718885+0000","last_became_active":"2023-11-04T15:27:35.774339+0000","last_became_peered":"2023-11-04T15:27:35.774339+0000","last_unstale":"2023-11-04T15:36:55.718885+0000","last_undegraded":"2023-11-04T15:36:55.718885+0000","last_fullsized":"2023-11-04T15:36:55.718885+0000","mapping_epoch":16,"log_start":"26'400","ondisk_log_start":"26'400","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":5679,"log_dups_size":0,"ondisk_log_size":5679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:44:38.690122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6078,"num_write_kb":43849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"40'3172","reported_seq":2637,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.721139+0000","last_change":"2023-11-04T15:36:55.786394+0000","last_active":"2023-11-04T15:37:04.721139+0000","last_peered":"2023-11-04T15:37:04.721139+0000","last_clean":"2023-11-04T15:37:04.721139+0000","last_became_active":"2023-11-04T15:27:36.146930+0000","last_became_peered":"2023-11-04T15:27:36.146930+0000","last_unstale":"2023-11-04T15:37:04.721139+0000","last_undegraded":"2023-11-04T15:37:04.721139+0000","last_fullsized":"2023-11-04T15:37:04.721139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3172,"log_dups_size":0,"ondisk_log_size":3172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:28:45.715407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067233409999999993,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1111,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.722875+0000","last_change":"2023-11-04T15:27:31.622105+0000","last_active":"2023-11-04T15:36:55.722875+0000","last_peered":"2023-11-04T15:36:55.722875+0000","last_clean":"2023-11-04T15:36:55.722875+0000","last_became_active":"2023-11-04T15:27:31.621849+0000","last_became_peered":"2023-11-04T15:27:31.621849+0000","last_unstale":"2023-11-04T15:36:55.722875+0000","last_undegraded":"2023-11-04T15:36:55.722875+0000","last_fullsized":"2023-11-04T15:36:55.722875+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:20:41.777316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"40'3275","reported_seq":3315,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.721518+0000","last_change":"2023-11-04T15:27:35.770188+0000","last_active":"2023-11-04T15:36:55.721518+0000","last_peered":"2023-11-04T15:36:55.721518+0000","last_clean":"2023-11-04T15:36:55.721518+0000","last_became_active":"2023-11-04T15:27:35.769730+0000","last_became_peered":"2023-11-04T15:27:35.769730+0000","last_unstale":"2023-11-04T15:36:55.721518+0000","last_undegraded":"2023-11-04T15:36:55.721518+0000","last_fullsized":"2023-11-04T15:36:55.721518+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3275,"log_dups_size":0,"ondisk_log_size":3275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:08:22.991334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3258,"num_write_kb":30072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"40'3431","reported_seq":2848,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720655+0000","last_change":"2023-11-04T15:36:55.786213+0000","last_active":"2023-11-04T15:37:04.720655+0000","last_peered":"2023-11-04T15:37:04.720655+0000","last_clean":"2023-11-04T15:37:04.720655+0000","last_became_active":"2023-11-04T15:27:36.144417+0000","last_became_peered":"2023-11-04T15:27:36.144417+0000","last_unstale":"2023-11-04T15:37:04.720655+0000","last_undegraded":"2023-11-04T15:37:04.720655+0000","last_fullsized":"2023-11-04T15:37:04.720655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3431,"log_dups_size":0,"ondisk_log_size":3431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:41:32.995261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067418286999999993,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"37'3105","reported_seq":3145,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.718998+0000","last_change":"2023-11-04T15:27:35.770033+0000","last_active":"2023-11-04T15:36:55.718998+0000","last_peered":"2023-11-04T15:36:55.718998+0000","last_clean":"2023-11-04T15:36:55.718998+0000","last_became_active":"2023-11-04T15:27:35.769772+0000","last_became_peered":"2023-11-04T15:27:35.769772+0000","last_unstale":"2023-11-04T15:36:55.718998+0000","last_undegraded":"2023-11-04T15:36:55.718998+0000","last_fullsized":"2023-11-04T15:36:55.718998+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3105,"log_dups_size":0,"ondisk_log_size":3105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:00:20.246822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3101,"num_write_kb":32806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.720097+0000","last_change":"2023-11-04T15:27:31.622663+0000","last_active":"2023-11-04T15:36:55.720097+0000","last_peered":"2023-11-04T15:36:55.720097+0000","last_clean":"2023-11-04T15:36:55.720097+0000","last_became_active":"2023-11-04T15:27:31.622350+0000","last_became_peered":"2023-11-04T15:27:31.622350+0000","last_unstale":"2023-11-04T15:36:55.720097+0000","last_undegraded":"2023-11-04T15:36:55.720097+0000","last_fullsized":"2023-11-04T15:36:55.720097+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:31:02.273249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"43'3419","reported_seq":2893,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720064+0000","last_change":"2023-11-04T15:36:55.780107+0000","last_active":"2023-11-04T15:37:04.720064+0000","last_peered":"2023-11-04T15:37:04.720064+0000","last_clean":"2023-11-04T15:37:04.720064+0000","last_became_active":"2023-11-04T15:27:36.143991+0000","last_became_peered":"2023-11-04T15:27:36.143991+0000","last_unstale":"2023-11-04T15:37:04.720064+0000","last_undegraded":"2023-11-04T15:37:04.720064+0000","last_fullsized":"2023-11-04T15:37:04.720064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3419,"log_dups_size":0,"ondisk_log_size":3419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:48:58.102459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062728023999999993,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":1116,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"40'4464","reported_seq":4504,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.719298+0000","last_change":"2023-11-04T15:27:35.769416+0000","last_active":"2023-11-04T15:36:55.719298+0000","last_peered":"2023-11-04T15:36:55.719298+0000","last_clean":"2023-11-04T15:36:55.719298+0000","last_became_active":"2023-11-04T15:27:35.769095+0000","last_became_peered":"2023-11-04T15:27:35.769095+0000","last_unstale":"2023-11-04T15:36:55.719298+0000","last_undegraded":"2023-11-04T15:36:55.719298+0000","last_fullsized":"2023-11-04T15:36:55.719298+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":4464,"log_dups_size":0,"ondisk_log_size":4464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T22:02:04.025848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4451,"num_write_kb":27035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.723148+0000","last_change":"2023-11-04T15:27:31.619973+0000","last_active":"2023-11-04T15:36:55.723148+0000","last_peered":"2023-11-04T15:36:55.723148+0000","last_clean":"2023-11-04T15:36:55.723148+0000","last_became_active":"2023-11-04T15:27:31.619702+0000","last_became_peered":"2023-11-04T15:27:31.619702+0000","last_unstale":"2023-11-04T15:36:55.723148+0000","last_undegraded":"2023-11-04T15:36:55.723148+0000","last_fullsized":"2023-11-04T15:36:55.723148+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:24:34.782619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"40'3558","reported_seq":2943,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795390+0000","last_change":"2023-11-04T15:36:55.798708+0000","last_active":"2023-11-04T15:37:04.795390+0000","last_peered":"2023-11-04T15:37:04.795390+0000","last_clean":"2023-11-04T15:37:04.795390+0000","last_became_active":"2023-11-04T15:27:36.139707+0000","last_became_peered":"2023-11-04T15:27:36.139707+0000","last_unstale":"2023-11-04T15:37:04.795390+0000","last_undegraded":"2023-11-04T15:37:04.795390+0000","last_fullsized":"2023-11-04T15:37:04.795390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3558,"log_dups_size":0,"ondisk_log_size":3558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:58:32.190696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.073815121999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"37'1214","reported_seq":1254,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.720216+0000","last_change":"2023-11-04T15:27:35.768818+0000","last_active":"2023-11-04T15:36:55.720216+0000","last_peered":"2023-11-04T15:36:55.720216+0000","last_clean":"2023-11-04T15:36:55.720216+0000","last_became_active":"2023-11-04T15:27:35.768320+0000","last_became_peered":"2023-11-04T15:27:35.768320+0000","last_unstale":"2023-11-04T15:36:55.720216+0000","last_undegraded":"2023-11-04T15:36:55.720216+0000","last_fullsized":"2023-11-04T15:36:55.720216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1214,"log_dups_size":0,"ondisk_log_size":1214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:14:58.601545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1211,"num_write_kb":18003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.718817+0000","last_change":"2023-11-04T15:27:31.624625+0000","last_active":"2023-11-04T15:36:55.718817+0000","last_peered":"2023-11-04T15:36:55.718817+0000","last_clean":"2023-11-04T15:36:55.718817+0000","last_became_active":"2023-11-04T15:27:31.624347+0000","last_became_peered":"2023-11-04T15:27:31.624347+0000","last_unstale":"2023-11-04T15:36:55.718817+0000","last_undegraded":"2023-11-04T15:36:55.718817+0000","last_fullsized":"2023-11-04T15:36:55.718817+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:53:45.131692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"40'3608","reported_seq":3012,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.794964+0000","last_change":"2023-11-04T15:36:55.791977+0000","last_active":"2023-11-04T15:37:04.794964+0000","last_peered":"2023-11-04T15:37:04.794964+0000","last_clean":"2023-11-04T15:37:04.794964+0000","last_became_active":"2023-11-04T15:27:36.137897+0000","last_became_peered":"2023-11-04T15:27:36.137897+0000","last_unstale":"2023-11-04T15:37:04.794964+0000","last_undegraded":"2023-11-04T15:37:04.794964+0000","last_fullsized":"2023-11-04T15:37:04.794964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3608,"log_dups_size":0,"ondisk_log_size":3608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:53:25.907251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.069534850999999995,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"43'828","reported_seq":868,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:37:01.773105+0000","last_change":"2023-11-04T15:27:35.772416+0000","last_active":"2023-11-04T15:37:01.773105+0000","last_peered":"2023-11-04T15:37:01.773105+0000","last_clean":"2023-11-04T15:37:01.773105+0000","last_became_active":"2023-11-04T15:27:35.772121+0000","last_became_peered":"2023-11-04T15:27:35.772121+0000","last_unstale":"2023-11-04T15:37:01.773105+0000","last_undegraded":"2023-11-04T15:37:01.773105+0000","last_fullsized":"2023-11-04T15:37:01.773105+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":828,"log_dups_size":0,"ondisk_log_size":828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:58:09.475936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":958,"num_write_kb":25976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.723053+0000","last_change":"2023-11-04T15:27:31.620235+0000","last_active":"2023-11-04T15:36:55.723053+0000","last_peered":"2023-11-04T15:36:55.723053+0000","last_clean":"2023-11-04T15:36:55.723053+0000","last_became_active":"2023-11-04T15:27:31.619831+0000","last_became_peered":"2023-11-04T15:27:31.619831+0000","last_unstale":"2023-11-04T15:36:55.723053+0000","last_undegraded":"2023-11-04T15:36:55.723053+0000","last_fullsized":"2023-11-04T15:36:55.723053+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:44:07.412379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"40'3480","reported_seq":2923,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719212+0000","last_change":"2023-11-04T15:36:55.780069+0000","last_active":"2023-11-04T15:37:04.719212+0000","last_peered":"2023-11-04T15:37:04.719212+0000","last_clean":"2023-11-04T15:37:04.719212+0000","last_became_active":"2023-11-04T15:27:36.140871+0000","last_became_peered":"2023-11-04T15:27:36.140871+0000","last_unstale":"2023-11-04T15:37:04.719212+0000","last_undegraded":"2023-11-04T15:37:04.719212+0000","last_fullsized":"2023-11-04T15:37:04.719212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3480,"log_dups_size":0,"ondisk_log_size":3480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:28.095802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058381362999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"40'3644","reported_seq":3047,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718338+0000","last_change":"2023-11-04T15:36:55.777837+0000","last_active":"2023-11-04T15:37:04.718338+0000","last_peered":"2023-11-04T15:37:04.718338+0000","last_clean":"2023-11-04T15:37:04.718338+0000","last_became_active":"2023-11-04T15:27:36.139487+0000","last_became_peered":"2023-11-04T15:27:36.139487+0000","last_unstale":"2023-11-04T15:37:04.718338+0000","last_undegraded":"2023-11-04T15:37:04.718338+0000","last_fullsized":"2023-11-04T15:37:04.718338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3644,"log_dups_size":0,"ondisk_log_size":3644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:47:58.380308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056621590999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"41'2770","reported_seq":2810,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.718557+0000","last_change":"2023-11-04T15:27:35.775665+0000","last_active":"2023-11-04T15:36:55.718557+0000","last_peered":"2023-11-04T15:36:55.718557+0000","last_clean":"2023-11-04T15:36:55.718557+0000","last_became_active":"2023-11-04T15:27:35.775356+0000","last_became_peered":"2023-11-04T15:27:35.775356+0000","last_unstale":"2023-11-04T15:36:55.718557+0000","last_undegraded":"2023-11-04T15:36:55.718557+0000","last_fullsized":"2023-11-04T15:36:55.718557+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2770,"log_dups_size":0,"ondisk_log_size":2770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T15:36:12.941030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2769,"num_write_kb":31341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"40'3525","reported_seq":2932,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719926+0000","last_change":"2023-11-04T15:36:55.781878+0000","last_active":"2023-11-04T15:37:04.719926+0000","last_peered":"2023-11-04T15:37:04.719926+0000","last_clean":"2023-11-04T15:37:04.719926+0000","last_became_active":"2023-11-04T15:27:36.146464+0000","last_became_peered":"2023-11-04T15:27:36.146464+0000","last_unstale":"2023-11-04T15:37:04.719926+0000","last_undegraded":"2023-11-04T15:37:04.719926+0000","last_fullsized":"2023-11-04T15:37:04.719926+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3525,"log_dups_size":0,"ondisk_log_size":3525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:47:40.350777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.064516859999999995,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"43'3742","reported_seq":3781,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:58.878831+0000","last_change":"2023-11-04T15:27:35.770401+0000","last_active":"2023-11-04T15:36:58.878831+0000","last_peered":"2023-11-04T15:36:58.878831+0000","last_clean":"2023-11-04T15:36:58.878831+0000","last_became_active":"2023-11-04T15:27:35.769904+0000","last_became_peered":"2023-11-04T15:27:35.769904+0000","last_unstale":"2023-11-04T15:36:58.878831+0000","last_undegraded":"2023-11-04T15:36:58.878831+0000","last_fullsized":"2023-11-04T15:36:58.878831+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3742,"log_dups_size":0,"ondisk_log_size":3742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:58:09.475936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3740,"num_write_kb":21755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"40'3554","reported_seq":3593,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.724006+0000","last_change":"2023-11-04T15:27:35.768689+0000","last_active":"2023-11-04T15:36:55.724006+0000","last_peered":"2023-11-04T15:36:55.724006+0000","last_clean":"2023-11-04T15:36:55.724006+0000","last_became_active":"2023-11-04T15:27:35.768413+0000","last_became_peered":"2023-11-04T15:27:35.768413+0000","last_unstale":"2023-11-04T15:36:55.724006+0000","last_undegraded":"2023-11-04T15:36:55.724006+0000","last_fullsized":"2023-11-04T15:36:55.724006+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3554,"log_dups_size":0,"ondisk_log_size":3554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:23:45.371175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3537,"num_write_kb":29647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"40'3937","reported_seq":3320,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795020+0000","last_change":"2023-11-04T15:36:55.790992+0000","last_active":"2023-11-04T15:37:04.795020+0000","last_peered":"2023-11-04T15:37:04.795020+0000","last_clean":"2023-11-04T15:37:04.795020+0000","last_became_active":"2023-11-04T15:27:36.139524+0000","last_became_peered":"2023-11-04T15:27:36.139524+0000","last_unstale":"2023-11-04T15:37:04.795020+0000","last_undegraded":"2023-11-04T15:37:04.795020+0000","last_fullsized":"2023-11-04T15:37:04.795020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3937,"log_dups_size":0,"ondisk_log_size":3937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:27:25.258046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.068494678000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1248,"num_write_kb":670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"37'1637","reported_seq":1676,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.725924+0000","last_change":"2023-11-04T15:27:35.776242+0000","last_active":"2023-11-04T15:36:55.725924+0000","last_peered":"2023-11-04T15:36:55.725924+0000","last_clean":"2023-11-04T15:36:55.725924+0000","last_became_active":"2023-11-04T15:27:35.775917+0000","last_became_peered":"2023-11-04T15:27:35.775917+0000","last_unstale":"2023-11-04T15:36:55.725924+0000","last_undegraded":"2023-11-04T15:36:55.725924+0000","last_fullsized":"2023-11-04T15:36:55.725924+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1637,"log_dups_size":0,"ondisk_log_size":1637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:14:58.601545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1634,"num_write_kb":25426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"40'3472","reported_seq":2893,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719642+0000","last_change":"2023-11-04T15:36:55.779428+0000","last_active":"2023-11-04T15:37:04.719642+0000","last_peered":"2023-11-04T15:37:04.719642+0000","last_clean":"2023-11-04T15:37:04.719642+0000","last_became_active":"2023-11-04T15:27:36.150557+0000","last_became_peered":"2023-11-04T15:27:36.150557+0000","last_unstale":"2023-11-04T15:37:04.719642+0000","last_undegraded":"2023-11-04T15:37:04.719642+0000","last_fullsized":"2023-11-04T15:37:04.719642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3472,"log_dups_size":0,"ondisk_log_size":3472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:12:07.727740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062631718000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"40'3228","reported_seq":2710,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719540+0000","last_change":"2023-11-04T15:36:55.826604+0000","last_active":"2023-11-04T15:37:04.719540+0000","last_peered":"2023-11-04T15:37:04.719540+0000","last_clean":"2023-11-04T15:37:04.719540+0000","last_became_active":"2023-11-04T15:27:36.149831+0000","last_became_peered":"2023-11-04T15:27:36.149831+0000","last_unstale":"2023-11-04T15:37:04.719540+0000","last_undegraded":"2023-11-04T15:37:04.719540+0000","last_fullsized":"2023-11-04T15:37:04.719540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3228,"log_dups_size":0,"ondisk_log_size":3228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:16:09.862958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.103639325,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1060,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"43'4772","reported_seq":4811,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:37:02.982996+0000","last_change":"2023-11-04T15:27:35.770634+0000","last_active":"2023-11-04T15:37:02.982996+0000","last_peered":"2023-11-04T15:37:02.982996+0000","last_clean":"2023-11-04T15:37:02.982996+0000","last_became_active":"2023-11-04T15:27:35.770022+0000","last_became_peered":"2023-11-04T15:27:35.770022+0000","last_unstale":"2023-11-04T15:37:02.982996+0000","last_undegraded":"2023-11-04T15:37:02.982996+0000","last_fullsized":"2023-11-04T15:37:02.982996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":4772,"log_dups_size":0,"ondisk_log_size":4772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:03:49.354013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28961863,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4771,"num_write_kb":50731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"43'3333","reported_seq":2776,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795878+0000","last_change":"2023-11-04T15:36:55.797686+0000","last_active":"2023-11-04T15:37:04.795878+0000","last_peered":"2023-11-04T15:37:04.795878+0000","last_clean":"2023-11-04T15:37:04.795878+0000","last_became_active":"2023-11-04T15:27:36.138908+0000","last_became_peered":"2023-11-04T15:27:36.138908+0000","last_unstale":"2023-11-04T15:37:04.795878+0000","last_undegraded":"2023-11-04T15:37:04.795878+0000","last_fullsized":"2023-11-04T15:37:04.795878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3333,"log_dups_size":0,"ondisk_log_size":3333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:32:27.370984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.073000567000000002,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":1157,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'780","reported_seq":819,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.718200+0000","last_change":"2023-11-04T15:27:35.768190+0000","last_active":"2023-11-04T15:36:55.718200+0000","last_peered":"2023-11-04T15:36:55.718200+0000","last_clean":"2023-11-04T15:36:55.718200+0000","last_became_active":"2023-11-04T15:27:35.767858+0000","last_became_peered":"2023-11-04T15:27:35.767858+0000","last_unstale":"2023-11-04T15:36:55.718200+0000","last_undegraded":"2023-11-04T15:36:55.718200+0000","last_fullsized":"2023-11-04T15:36:55.718200+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:55:22.956180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":779,"num_write_kb":20966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"40'3359","reported_seq":2782,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795843+0000","last_change":"2023-11-04T15:36:55.795596+0000","last_active":"2023-11-04T15:37:04.795843+0000","last_peered":"2023-11-04T15:37:04.795843+0000","last_clean":"2023-11-04T15:37:04.795843+0000","last_became_active":"2023-11-04T15:27:36.143442+0000","last_became_peered":"2023-11-04T15:27:36.143442+0000","last_unstale":"2023-11-04T15:37:04.795843+0000","last_undegraded":"2023-11-04T15:37:04.795843+0000","last_fullsized":"2023-11-04T15:37:04.795843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3359,"log_dups_size":0,"ondisk_log_size":3359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:45:22.367523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072078296,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1167,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"37'3778","reported_seq":3817,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.720186+0000","last_change":"2023-11-04T15:27:35.771653+0000","last_active":"2023-11-04T15:36:55.720186+0000","last_peered":"2023-11-04T15:36:55.720186+0000","last_clean":"2023-11-04T15:36:55.720186+0000","last_became_active":"2023-11-04T15:27:35.770539+0000","last_became_peered":"2023-11-04T15:27:35.770539+0000","last_unstale":"2023-11-04T15:36:55.720186+0000","last_undegraded":"2023-11-04T15:36:55.720186+0000","last_fullsized":"2023-11-04T15:36:55.720186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3778,"log_dups_size":0,"ondisk_log_size":3778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T19:14:58.601545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3770,"num_write_kb":38321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"40'3791","reported_seq":3145,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720471+0000","last_change":"2023-11-04T15:36:55.780664+0000","last_active":"2023-11-04T15:37:04.720471+0000","last_peered":"2023-11-04T15:37:04.720471+0000","last_clean":"2023-11-04T15:37:04.720471+0000","last_became_active":"2023-11-04T15:27:36.146477+0000","last_became_peered":"2023-11-04T15:27:36.146477+0000","last_unstale":"2023-11-04T15:37:04.720471+0000","last_undegraded":"2023-11-04T15:37:04.720471+0000","last_fullsized":"2023-11-04T15:37:04.720471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3791,"log_dups_size":0,"ondisk_log_size":3791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:53:25.907251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063144525000000007,"stat_sum":{"num_bytes":8192,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1270,"num_write_kb":694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"40'2943","reported_seq":2982,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.726230+0000","last_change":"2023-11-04T15:27:35.772092+0000","last_active":"2023-11-04T15:36:55.726230+0000","last_peered":"2023-11-04T15:36:55.726230+0000","last_clean":"2023-11-04T15:36:55.726230+0000","last_became_active":"2023-11-04T15:27:35.771316+0000","last_became_peered":"2023-11-04T15:27:35.771316+0000","last_unstale":"2023-11-04T15:36:55.726230+0000","last_undegraded":"2023-11-04T15:36:55.726230+0000","last_fullsized":"2023-11-04T15:36:55.726230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2943,"log_dups_size":0,"ondisk_log_size":2943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:00:20.246822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2943,"num_write_kb":28401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"40'3595","reported_seq":3004,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718128+0000","last_change":"2023-11-04T15:36:55.778980+0000","last_active":"2023-11-04T15:37:04.718128+0000","last_peered":"2023-11-04T15:37:04.718128+0000","last_clean":"2023-11-04T15:37:04.718128+0000","last_became_active":"2023-11-04T15:27:36.144066+0000","last_became_peered":"2023-11-04T15:27:36.144066+0000","last_unstale":"2023-11-04T15:37:04.718128+0000","last_undegraded":"2023-11-04T15:37:04.718128+0000","last_fullsized":"2023-11-04T15:37:04.718128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3595,"log_dups_size":0,"ondisk_log_size":3595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:41:32.995261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057889772999999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1118,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"41'926","reported_seq":965,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.718261+0000","last_change":"2023-11-04T15:27:35.768679+0000","last_active":"2023-11-04T15:36:55.718261+0000","last_peered":"2023-11-04T15:36:55.718261+0000","last_clean":"2023-11-04T15:36:55.718261+0000","last_became_active":"2023-11-04T15:27:35.767852+0000","last_became_peered":"2023-11-04T15:27:35.767852+0000","last_unstale":"2023-11-04T15:36:55.718261+0000","last_undegraded":"2023-11-04T15:36:55.718261+0000","last_fullsized":"2023-11-04T15:36:55.718261+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":926,"log_dups_size":0,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:47:47.130490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":923,"num_write_kb":21087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"40'3552","reported_seq":2972,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718612+0000","last_change":"2023-11-04T15:36:55.776553+0000","last_active":"2023-11-04T15:37:04.718612+0000","last_peered":"2023-11-04T15:37:04.718612+0000","last_clean":"2023-11-04T15:37:04.718612+0000","last_became_active":"2023-11-04T15:27:36.141167+0000","last_became_peered":"2023-11-04T15:27:36.141167+0000","last_unstale":"2023-11-04T15:37:04.718612+0000","last_undegraded":"2023-11-04T15:37:04.718612+0000","last_fullsized":"2023-11-04T15:37:04.718612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3552,"log_dups_size":0,"ondisk_log_size":3552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:22:21.262360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057363947999999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1127,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"37'3225","reported_seq":3264,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.722318+0000","last_change":"2023-11-04T15:27:35.775629+0000","last_active":"2023-11-04T15:36:55.722318+0000","last_peered":"2023-11-04T15:36:55.722318+0000","last_clean":"2023-11-04T15:36:55.722318+0000","last_became_active":"2023-11-04T15:27:35.775171+0000","last_became_peered":"2023-11-04T15:27:35.775171+0000","last_unstale":"2023-11-04T15:36:55.722318+0000","last_undegraded":"2023-11-04T15:36:55.722318+0000","last_fullsized":"2023-11-04T15:36:55.722318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3225,"log_dups_size":0,"ondisk_log_size":3225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:13:42.865721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3214,"num_write_kb":42509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"43'3487","reported_seq":2931,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795245+0000","last_change":"2023-11-04T15:36:55.792895+0000","last_active":"2023-11-04T15:37:04.795245+0000","last_peered":"2023-11-04T15:37:04.795245+0000","last_clean":"2023-11-04T15:37:04.795245+0000","last_became_active":"2023-11-04T15:27:36.145560+0000","last_became_peered":"2023-11-04T15:27:36.145560+0000","last_unstale":"2023-11-04T15:37:04.795245+0000","last_undegraded":"2023-11-04T15:37:04.795245+0000","last_fullsized":"2023-11-04T15:37:04.795245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3487,"log_dups_size":0,"ondisk_log_size":3487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:14:54.847413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.07011676,"stat_sum":{"num_bytes":4151,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":1159,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"40'4214","reported_seq":4254,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.725219+0000","last_change":"2023-11-04T15:27:35.771225+0000","last_active":"2023-11-04T15:36:55.725219+0000","last_peered":"2023-11-04T15:36:55.725219+0000","last_clean":"2023-11-04T15:36:55.725219+0000","last_became_active":"2023-11-04T15:27:35.770873+0000","last_became_peered":"2023-11-04T15:27:35.770873+0000","last_unstale":"2023-11-04T15:36:55.725219+0000","last_undegraded":"2023-11-04T15:36:55.725219+0000","last_fullsized":"2023-11-04T15:36:55.725219+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":4214,"log_dups_size":0,"ondisk_log_size":4214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:02:11.972760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4214,"num_write_kb":32525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"40'4090","reported_seq":3392,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718092+0000","last_change":"2023-11-04T15:36:55.775512+0000","last_active":"2023-11-04T15:37:04.718092+0000","last_peered":"2023-11-04T15:37:04.718092+0000","last_clean":"2023-11-04T15:37:04.718092+0000","last_became_active":"2023-11-04T15:27:36.147535+0000","last_became_peered":"2023-11-04T15:27:36.147535+0000","last_unstale":"2023-11-04T15:37:04.718092+0000","last_undegraded":"2023-11-04T15:37:04.718092+0000","last_fullsized":"2023-11-04T15:37:04.718092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":4090,"log_dups_size":0,"ondisk_log_size":4090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:48:58.102459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055801837,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1294,"num_write_kb":719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"40'1589","reported_seq":1629,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-04T15:36:55.725708+0000","last_change":"2023-11-04T15:27:35.776315+0000","last_active":"2023-11-04T15:36:55.725708+0000","last_peered":"2023-11-04T15:36:55.725708+0000","last_clean":"2023-11-04T15:36:55.725708+0000","last_became_active":"2023-11-04T15:27:35.775918+0000","last_became_peered":"2023-11-04T15:27:35.775918+0000","last_unstale":"2023-11-04T15:36:55.725708+0000","last_undegraded":"2023-11-04T15:36:55.725708+0000","last_fullsized":"2023-11-04T15:36:55.725708+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1589,"log_dups_size":0,"ondisk_log_size":1589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:08:22.991334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1587,"num_write_kb":12658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":127433,"num_objects":92,"num_object_clones":25,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":8,"num_read":46,"num_read_kb":30,"num_write":74822,"num_write_kb":40603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":254672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224295,"ondisk_log_size":224295,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":430722614,"num_objects":126,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":126,"num_whiteouts":0,"num_read":190,"num_read_kb":3338,"num_write":83452,"num_write_kb":897530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":861503488,"data_stored":861445228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83074,"ondisk_log_size":83074,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705784,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":659540,"kb_used_data":173196,"kb_used_omap":0,"kb_used_meta":486336,"kb_avail":93712300,"statfs":{"total":96636764160,"available":95961395200,"internally_reserved":0,"allocated":177352704,"data_stored":176994799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":498008064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.435,"15min":0.40000000000000002},"min":{"1min":0.23000000000000001,"5min":0.17000000000000001,"15min":0.156},"max":{"1min":10.488,"5min":10.488,"15min":10.488},"last":0.34100000000000003},{"interface":"front","average":{"1min":1.0509999999999999,"5min":0.58399999999999996,"15min":0.45500000000000002},"min":{"1min":0.21199999999999999,"5min":0.186,"15min":0.186},"max":{"1min":11.621,"5min":13.055,"15min":13.055},"last":0.309}]},{"osd":1,"last update":"Sat Nov 4 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.496,"15min":0.433},"min":{"1min":0.219,"5min":0.188,"15min":0.188},"max":{"1min":12.347,"5min":12.347,"15min":12.347},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.48999999999999999,"15min":0.438},"min":{"1min":0.23699999999999999,"5min":0.21299999999999999,"15min":0.186},"max":{"1min":12.853999999999999,"5min":12.853999999999999,"15min":12.853999999999999},"last":0.28899999999999998}]},{"osd":2,"last update":"Sat Nov 4 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.41299999999999998,"15min":0.34499999999999997},"min":{"1min":0.16900000000000001,"5min":0.153,"15min":0.153},"max":{"1min":11.709,"5min":11.709,"15min":11.709},"last":0.246},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.40300000000000002,"15min":0.35599999999999998},"min":{"1min":0.19500000000000001,"5min":0.14899999999999999,"15min":0.14899999999999999},"max":{"1min":9.2629999999999999,"5min":9.2629999999999999,"15min":9.2629999999999999},"last":0.22600000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705783,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":952412,"kb_used_data":245460,"kb_used_omap":0,"kb_used_meta":706944,"kb_avail":93419428,"statfs":{"total":96636764160,"available":95661494272,"internally_reserved":0,"allocated":251351040,"data_stored":250986928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":723910656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 15:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.41199999999999998,"15min":0.40100000000000002},"min":{"1min":0.20499999999999999,"5min":0.153,"15min":0.151},"max":{"1min":0.52900000000000003,"5min":14.584,"15min":14.584},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.35799999999999998,"15min":0.376},"min":{"1min":0.22,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.45600000000000002,"5min":7.2670000000000003,"15min":7.2670000000000003},"last":0.53800000000000003}]},{"osd":1,"last update":"Sat Nov 4 15:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32700000000000001,"15min":0.39000000000000001},"min":{"1min":0.23499999999999999,"5min":0.185,"15min":0.17100000000000001},"max":{"1min":0.48399999999999999,"5min":0.877,"15min":1.266},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.34699999999999998,"15min":0.40899999999999997},"min":{"1min":0.27500000000000002,"5min":0.20899999999999999,"15min":0.20399999999999999},"max":{"1min":0.54100000000000004,"5min":0.88600000000000001,"15min":1.2829999999999999},"last":0.63100000000000001}]},{"osd":3,"last update":"Sat Nov 4 15:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.28000000000000003,"15min":0.314},"min":{"1min":0.23699999999999999,"5min":0.14999999999999999,"15min":0.14699999999999999},"max":{"1min":0.41399999999999998,"5min":1.653,"15min":1.653},"last":0.436},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.30599999999999999,"15min":0.34000000000000002},"min":{"1min":0.23000000000000001,"5min":0.159,"15min":0.14899999999999999},"max":{"1min":0.501,"5min":0.52400000000000002,"15min":1.304},"last":0.52200000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705782,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":715152,"kb_used_data":188616,"kb_used_omap":0,"kb_used_meta":526528,"kb_avail":93656688,"statfs":{"total":96636764160,"available":95904448512,"internally_reserved":0,"allocated":193142784,"data_stored":192790234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":539164672},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.40699999999999997,"15min":0.318},"min":{"1min":0.17100000000000001,"5min":0.14399999999999999,"15min":0.14399999999999999},"max":{"1min":1.012,"5min":12.768000000000001,"15min":12.768000000000001},"last":0.20699999999999999},{"interface":"front","average":{"1min":0.248,"5min":0.30399999999999999,"15min":0.29499999999999998},"min":{"1min":0.19,"5min":0.14399999999999999,"15min":0.14399999999999999},"max":{"1min":0.377,"5min":8.609,"15min":8.609},"last":0.22500000000000001}]},{"osd":2,"last update":"Sat Nov 4 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.40400000000000003,"15min":0.44},"min":{"1min":0.28499999999999998,"5min":0.19600000000000001,"15min":0.189},"max":{"1min":1.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.307},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.39000000000000001,"15min":0.42399999999999999},"min":{"1min":0.29599999999999999,"5min":0.19600000000000001,"15min":0.192},"max":{"1min":0.98199999999999998,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.34399999999999997}]},{"osd":3,"last update":"Sat Nov 4 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.42099999999999999,"15min":0.438},"min":{"1min":0.309,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.65200000000000002,"5min":6.7679999999999998,"15min":6.7679999999999998},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.41999999999999998,"15min":0.45000000000000001},"min":{"1min":0.32100000000000001,"5min":0.249,"15min":0.24299999999999999},"max":{"1min":1.446,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.36399999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705783,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":918184,"kb_used_data":237472,"kb_used_omap":0,"kb_used_meta":680704,"kb_avail":93453656,"statfs":{"total":96636764160,"available":95696543744,"internally_reserved":0,"allocated":243171328,"data_stored":242814979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":697040896},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 15:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.312,"15min":0.27900000000000003},"min":{"1min":0.14999999999999999,"5min":0.14399999999999999,"15min":0.13500000000000001},"max":{"1min":4.4059999999999997,"5min":6.4340000000000002,"15min":6.4340000000000002},"last":0.217},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.28000000000000003,"15min":0.27500000000000002},"min":{"1min":0.17299999999999999,"5min":0.155,"15min":0.155},"max":{"1min":1.1299999999999999,"5min":4.1200000000000001,"15min":4.1200000000000001},"last":0.20499999999999999}]},{"osd":2,"last update":"Sat Nov 4 15:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.40400000000000003,"15min":0.42599999999999999},"min":{"1min":0.251,"5min":0.17999999999999999,"15min":0.17599999999999999},"max":{"1min":2.5129999999999999,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.371,"15min":0.41899999999999998},"min":{"1min":0.28000000000000003,"5min":0.187,"15min":0.187},"max":{"1min":1.157,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.48799999999999999}]},{"osd":3,"last update":"Sat Nov 4 15:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.438,"15min":0.443},"min":{"1min":0.23899999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":2.6520000000000001,"5min":6.4660000000000002,"15min":6.4660000000000002},"last":0.498},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.44600000000000001,"15min":0.44800000000000001},"min":{"1min":0.26800000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":2.621,"5min":6.3540000000000001,"15min":6.3540000000000001},"last":0.41499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":241991680,"data_stored":241978206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":192540672,"data_stored":192539719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":250785792,"data_stored":250765155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":176185344,"data_stored":176162148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":69829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":73939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":45197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":65707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T15:37:07.951 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.952 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.952 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.952 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.953 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.953 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.953 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.954 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.954 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.954 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.954 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.955 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.955 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.955 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.956 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.956 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.956 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.957 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.957 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.957 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.957 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.958 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.958 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.958 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.959 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.959 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.959 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.959 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.960 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.960 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.960 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.961 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.961 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.961 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.961 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.962 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.962 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.962 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.963 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.963 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.963 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.964 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.964 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.964 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.964 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.965 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.965 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.965 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.966 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.966 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.966 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.966 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.967 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.967 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.967 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.968 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.968 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-04T15:27:25.163848+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=25, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.968 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-04T15:27:30.611946+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.968 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.969 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.969 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-04T15:27:30.611946+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.969 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.970 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.970 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-04T15:27:30.611946+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.970 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.971 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.971 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-04T15:27:30.611946+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.971 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.971 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.972 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.972 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-04T15:27:30.611946+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.972 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.973 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.973 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-04T15:27:30.611946+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.973 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.973 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.974 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-04T15:27:30.611946+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.974 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.974 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.975 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-04T15:27:30.611946+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.975 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.975 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.975 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.976 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.976 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.976 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.977 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.977 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.977 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.977 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.978 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.978 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.978 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.979 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.979 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.979 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.980 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.980 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.980 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.980 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.981 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.981 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.981 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.982 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.982 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:07.982 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-04T15:37:27.983 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T15:37:28.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.102+0000 7fb278d4c640 1 Processor -- start 2023-11-04T15:37:28.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.102+0000 7fb278d4c640 1 -- start start 2023-11-04T15:37:28.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.102+0000 7fb278d4c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb274137270 0x7fb2740a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:28.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.102+0000 7fb278d4c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb274137650 0x7fb27413a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:28.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.102+0000 7fb278d4c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2740a4c20 con 0x7fb2740a3e90 2023-11-04T15:37:28.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.102+0000 7fb278d4c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2740a3060 con 0x7fb274137270 2023-11-04T15:37:28.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.102+0000 7fb278d4c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2740a5080 con 0x7fb274137650 2023-11-04T15:37:28.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.103+0000 7fb26bfff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb2740a3e90 0x7fb274139f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37096/0 (socket says 172.21.15.19:37096) 2023-11-04T15:37:28.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.103+0000 7fb27259c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb274137270 0x7fb2740a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:28.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.103+0000 7fb26bfff640 1 -- 172.21.15.19:0/3614657511 learned_addr learned my addr 172.21.15.19:0/3614657511 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:37:28.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.103+0000 7fb272d9d640 1 --2- 172.21.15.19:0/3614657511 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb274137650 0x7fb27413a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:28.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.103+0000 7fb27259c640 1 -- 172.21.15.19:0/3614657511 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb274137650 msgr2=0x7fb27413a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:28.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.103+0000 7fb27259c640 1 --2- 172.21.15.19:0/3614657511 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb274137650 0x7fb27413a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:28.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.103+0000 7fb27259c640 1 -- 172.21.15.19:0/3614657511 >> v1:172.21.15.19:6789/0 conn(0x7fb2740a3e90 legacy=0x7fb274139f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:28.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.103+0000 7fb271d9b640 1 -- 172.21.15.19:0/3614657511 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2584422219 0 0) 0x7fb2740a4c20 con 0x7fb2740a3e90 2023-11-04T15:37:28.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.103+0000 7fb27259c640 1 -- 172.21.15.19:0/3614657511 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2740a3440 con 0x7fb274137270 2023-11-04T15:37:28.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.103+0000 7fb272d9d640 1 --2- 172.21.15.19:0/3614657511 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb274137650 0x7fb27413a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T15:37:28.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.104+0000 7fb27259c640 1 --2- 172.21.15.19:0/3614657511 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb274137270 0x7fb2740a6200 secure :-1 s=READY pgs=3771 cs=0 l=1 rev1=1 crypto rx=0x7fb2640097a0 tx=0x7fb26402b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b810f486620a4c60 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:28.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.104+0000 7fb271d9b640 1 -- 172.21.15.19:0/3614657511 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb264031710 con 0x7fb274137270 2023-11-04T15:37:28.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.104+0000 7fb271d9b640 1 -- 172.21.15.19:0/3614657511 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26402f050 con 0x7fb274137270 2023-11-04T15:37:28.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.104+0000 7fb271d9b640 1 -- 172.21.15.19:0/3614657511 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb264031a90 con 0x7fb274137270 2023-11-04T15:37:28.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.104+0000 7fb278d4c640 1 -- 172.21.15.19:0/3614657511 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb274137270 msgr2=0x7fb2740a6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:28.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.104+0000 7fb278d4c640 1 --2- 172.21.15.19:0/3614657511 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb274137270 0x7fb2740a6200 secure :-1 s=READY pgs=3771 cs=0 l=1 rev1=1 crypto rx=0x7fb2640097a0 tx=0x7fb26402b7b0 comp rx=0 tx=0).stop 2023-11-04T15:37:28.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.104+0000 7fb278d4c640 1 -- 172.21.15.19:0/3614657511 shutdown_connections 2023-11-04T15:37:28.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.104+0000 7fb278d4c640 1 --2- 172.21.15.19:0/3614657511 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb274137650 0x7fb27413a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:28.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.104+0000 7fb278d4c640 1 --2- 172.21.15.19:0/3614657511 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb274137270 0x7fb2740a6200 unknown :-1 s=CLOSED pgs=3771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:28.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.104+0000 7fb278d4c640 1 -- 172.21.15.19:0/3614657511 >> 172.21.15.19:0/3614657511 conn(0x7fb2740a8d70 msgr2=0x7fb2740a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:28.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.105+0000 7fb278d4c640 1 -- 172.21.15.19:0/3614657511 shutdown_connections 2023-11-04T15:37:28.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.105+0000 7fb278d4c640 1 -- 172.21.15.19:0/3614657511 wait complete. 2023-11-04T15:37:28.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.106+0000 7fb278d4c640 1 Processor -- start 2023-11-04T15:37:28.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.106+0000 7fb278d4c640 1 -- start start 2023-11-04T15:37:28.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.106+0000 7fb278d4c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2740a3e90 0x7fb274130a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:28.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.106+0000 7fb278d4c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb274137270 0x7fb274130f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:28.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.106+0000 7fb278d4c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb274137650 0x7fb274131480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:28.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.106+0000 7fb278d4c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27409ae30 con 0x7fb274137270 2023-11-04T15:37:28.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.106+0000 7fb278d4c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27409b060 con 0x7fb2740a3e90 2023-11-04T15:37:28.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.106+0000 7fb278d4c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb27409ba80 con 0x7fb274137650 2023-11-04T15:37:28.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.106+0000 7fb26bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb274137270 0x7fb274130f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:28.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.106+0000 7fb26bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb274137270 0x7fb274130f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55386/0 (socket says 172.21.15.19:55386) 2023-11-04T15:37:28.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.106+0000 7fb26bfff640 1 -- 172.21.15.19:0/3870499715 learned_addr learned my addr 172.21.15.19:0/3870499715 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:37:28.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.106+0000 7fb272d9d640 1 --2- 172.21.15.19:0/3870499715 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb274137650 0x7fb274131480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:28.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.106+0000 7fb27259c640 1 --2- 172.21.15.19:0/3870499715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2740a3e90 0x7fb274130a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:28.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.107+0000 7fb26bfff640 1 -- 172.21.15.19:0/3870499715 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb274137650 msgr2=0x7fb274131480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:28.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.107+0000 7fb26bfff640 1 --2- 172.21.15.19:0/3870499715 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb274137650 0x7fb274131480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:28.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.107+0000 7fb26bfff640 1 -- 172.21.15.19:0/3870499715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2740a3e90 msgr2=0x7fb274130a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:28.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.107+0000 7fb26bfff640 1 --2- 172.21.15.19:0/3870499715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2740a3e90 0x7fb274130a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:28.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.107+0000 7fb26bfff640 1 -- 172.21.15.19:0/3870499715 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb264009400 con 0x7fb274137270 2023-11-04T15:37:28.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.107+0000 7fb272d9d640 1 --2- 172.21.15.19:0/3870499715 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb274137650 0x7fb274131480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:37:28.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.107+0000 7fb27259c640 1 --2- 172.21.15.19:0/3870499715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2740a3e90 0x7fb274130a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:37:28.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.107+0000 7fb26bfff640 1 --2- 172.21.15.19:0/3870499715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb274137270 0x7fb274130f40 secure :-1 s=READY pgs=3772 cs=0 l=1 rev1=1 crypto rx=0x7fb25c005880 tx=0x7fb25c00c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:28.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.107+0000 7fb26affd640 1 -- 172.21.15.19:0/3870499715 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25c005ce0 con 0x7fb274137270 2023-11-04T15:37:28.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.107+0000 7fb26affd640 1 -- 172.21.15.19:0/3870499715 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25c005e40 con 0x7fb274137270 2023-11-04T15:37:28.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.107+0000 7fb278d4c640 1 -- 172.21.15.19:0/3870499715 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb27409c310 con 0x7fb274137270 2023-11-04T15:37:28.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.107+0000 7fb26affd640 1 -- 172.21.15.19:0/3870499715 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25c007310 con 0x7fb274137270 2023-11-04T15:37:28.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.107+0000 7fb278d4c640 1 -- 172.21.15.19:0/3870499715 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb27409d500 con 0x7fb274137270 2023-11-04T15:37:28.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.108+0000 7fb278d4c640 1 -- 172.21.15.19:0/3870499715 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb274067d60 con 0x7fb274137270 2023-11-04T15:37:28.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.108+0000 7fb26affd640 1 -- 172.21.15.19:0/3870499715 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb25c007470 con 0x7fb274137270 2023-11-04T15:37:28.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.109+0000 7fb26affd640 1 --2- 172.21.15.19:0/3870499715 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fb25406a430 0x7fb25406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:28.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.109+0000 7fb26affd640 1 -- 172.21.15.19:0/3870499715 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4434+0+0 (secure 0 0 0) 0x7fb25c087910 con 0x7fb274137270 2023-11-04T15:37:28.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.109+0000 7fb27259c640 1 --2- 172.21.15.19:0/3870499715 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fb25406a430 0x7fb25406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:28.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.110+0000 7fb27259c640 1 --2- 172.21.15.19:0/3870499715 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fb25406a430 0x7fb25406c8f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb264035000 tx=0x7fb264008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:28.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.113+0000 7fb26affd640 1 -- 172.21.15.19:0/3870499715 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb25c053480 con 0x7fb274137270 2023-11-04T15:37:28.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.291+0000 7fb278d4c640 1 -- 172.21.15.19:0/3870499715 --> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb27409bf00 con 0x7fb25406a430 2023-11-04T15:37:28.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.298+0000 7fb26affd640 1 -- 172.21.15.19:0/3870499715 <== mgr.4114 v2:172.21.15.96:6816/83123 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276826 (secure 0 0 0) 0x7fb27409bf00 con 0x7fb25406a430 2023-11-04T15:37:28.303 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:37:28.305 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-11-04T15:37:28.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.301+0000 7fb278d4c640 1 -- 172.21.15.19:0/3870499715 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fb25406a430 msgr2=0x7fb25406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:28.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.301+0000 7fb278d4c640 1 --2- 172.21.15.19:0/3870499715 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fb25406a430 0x7fb25406c8f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb264035000 tx=0x7fb264008030 comp rx=0 tx=0).stop 2023-11-04T15:37:28.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.301+0000 7fb278d4c640 1 -- 172.21.15.19:0/3870499715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb274137270 msgr2=0x7fb274130f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:28.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.301+0000 7fb278d4c640 1 --2- 172.21.15.19:0/3870499715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb274137270 0x7fb274130f40 secure :-1 s=READY pgs=3772 cs=0 l=1 rev1=1 crypto rx=0x7fb25c005880 tx=0x7fb25c00c870 comp rx=0 tx=0).stop 2023-11-04T15:37:28.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.301+0000 7fb278d4c640 1 -- 172.21.15.19:0/3870499715 shutdown_connections 2023-11-04T15:37:28.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.301+0000 7fb278d4c640 1 --2- 172.21.15.19:0/3870499715 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fb25406a430 0x7fb25406c8f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:28.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.301+0000 7fb278d4c640 1 --2- 172.21.15.19:0/3870499715 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb274137650 0x7fb274131480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:28.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.301+0000 7fb278d4c640 1 --2- 172.21.15.19:0/3870499715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb274137270 0x7fb274130f40 unknown :-1 s=CLOSED pgs=3772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:28.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.301+0000 7fb278d4c640 1 --2- 172.21.15.19:0/3870499715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2740a3e90 0x7fb274130a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:28.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.301+0000 7fb278d4c640 1 -- 172.21.15.19:0/3870499715 >> 172.21.15.19:0/3870499715 conn(0x7fb2740a8d70 msgr2=0x7fb2740aa170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:28.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.301+0000 7fb278d4c640 1 -- 172.21.15.19:0/3870499715 shutdown_connections 2023-11-04T15:37:28.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:28.301+0000 7fb278d4c640 1 -- 172.21.15.19:0/3870499715 wait complete. 2023-11-04T15:37:28.315 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":342,"stamp":"2023-11-04T15:37:27.060663+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":431453382,"num_objects":220,"num_object_clones":25,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":8,"num_read":352,"num_read_kb":3468,"num_write":158437,"num_write_kb":940563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":307522,"ondisk_log_size":307522,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":3245360,"kb_used_data":844816,"kb_used_omap":0,"kb_used_meta":2400512,"kb_avail":374242000,"statfs":{"total":386547056640,"available":383223808000,"internally_reserved":0,"allocated":865091584,"data_stored":863631522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2458124288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002880"},"pg_stats":[{"pgid":"4.3f","version":"40'3514","reported_seq":2962,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:08.783037+0000","last_change":"2023-11-04T15:37:08.783192+0000","last_active":"2023-11-04T15:37:08.783037+0000","last_peered":"2023-11-04T15:37:08.783037+0000","last_clean":"2023-11-04T15:37:08.783037+0000","last_became_active":"2023-11-04T15:27:36.150296+0000","last_became_peered":"2023-11-04T15:27:36.150296+0000","last_unstale":"2023-11-04T15:37:08.783037+0000","last_undegraded":"2023-11-04T15:37:08.783037+0000","last_fullsized":"2023-11-04T15:37:08.783037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3514","last_scrub_stamp":"2023-11-04T15:37:08.783013+0000","last_deep_scrub":"40'3514","last_deep_scrub_stamp":"2023-11-04T15:37:08.783013+0000","last_clean_scrub_stamp":"2023-11-04T15:37:08.783013+0000","objects_scrubbed":0,"log_size":3514,"log_dups_size":0,"ondisk_log_size":3514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:20:34.659393+0000","scrub_duration":0.0030156520000000002,"objects_trimmed":0,"snaptrim_duration":0.074678280999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1112,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"43'3332","reported_seq":2784,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720237+0000","last_change":"2023-11-04T15:36:55.781000+0000","last_active":"2023-11-04T15:37:04.720237+0000","last_peered":"2023-11-04T15:37:04.720237+0000","last_clean":"2023-11-04T15:37:04.720237+0000","last_became_active":"2023-11-04T15:27:36.148939+0000","last_became_peered":"2023-11-04T15:27:36.148939+0000","last_unstale":"2023-11-04T15:37:04.720237+0000","last_undegraded":"2023-11-04T15:37:04.720237+0000","last_fullsized":"2023-11-04T15:37:04.720237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3332,"log_dups_size":0,"ondisk_log_size":3332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059113046000000002,"stat_sum":{"num_bytes":35,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1118,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"40'3527","reported_seq":3000,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719132+0000","last_change":"2023-11-04T15:36:55.822917+0000","last_active":"2023-11-04T15:37:04.719132+0000","last_peered":"2023-11-04T15:37:04.719132+0000","last_clean":"2023-11-04T15:37:04.719132+0000","last_became_active":"2023-11-04T15:27:36.149748+0000","last_became_peered":"2023-11-04T15:27:36.149748+0000","last_unstale":"2023-11-04T15:37:04.719132+0000","last_undegraded":"2023-11-04T15:37:04.719132+0000","last_fullsized":"2023-11-04T15:37:04.719132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3527,"log_dups_size":0,"ondisk_log_size":3527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101592565,"stat_sum":{"num_bytes":8206,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":1149,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"40'3602","reported_seq":2984,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718326+0000","last_change":"2023-11-04T15:36:55.770578+0000","last_active":"2023-11-04T15:37:04.718326+0000","last_peered":"2023-11-04T15:37:04.718326+0000","last_clean":"2023-11-04T15:37:04.718326+0000","last_became_active":"2023-11-04T15:27:36.139761+0000","last_became_peered":"2023-11-04T15:27:36.139761+0000","last_unstale":"2023-11-04T15:37:04.718326+0000","last_undegraded":"2023-11-04T15:37:04.718326+0000","last_fullsized":"2023-11-04T15:37:04.718326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3602,"log_dups_size":0,"ondisk_log_size":3602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052924038,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1171,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"40'3725","reported_seq":3118,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795978+0000","last_change":"2023-11-04T15:36:55.798093+0000","last_active":"2023-11-04T15:37:04.795978+0000","last_peered":"2023-11-04T15:37:04.795978+0000","last_clean":"2023-11-04T15:37:04.795978+0000","last_became_active":"2023-11-04T15:27:36.150017+0000","last_became_peered":"2023-11-04T15:27:36.150017+0000","last_unstale":"2023-11-04T15:37:04.795978+0000","last_undegraded":"2023-11-04T15:37:04.795978+0000","last_fullsized":"2023-11-04T15:37:04.795978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3725,"log_dups_size":0,"ondisk_log_size":3725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.073241305000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1192,"num_write_kb":641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"40'3327","reported_seq":2770,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720336+0000","last_change":"2023-11-04T15:36:55.824394+0000","last_active":"2023-11-04T15:37:04.720336+0000","last_peered":"2023-11-04T15:37:04.720336+0000","last_clean":"2023-11-04T15:37:04.720336+0000","last_became_active":"2023-11-04T15:27:36.139036+0000","last_became_peered":"2023-11-04T15:27:36.139036+0000","last_unstale":"2023-11-04T15:37:04.720336+0000","last_undegraded":"2023-11-04T15:37:04.720336+0000","last_fullsized":"2023-11-04T15:37:04.720336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3327,"log_dups_size":0,"ondisk_log_size":3327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.102154117,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1074,"num_write_kb":603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"43'3353","reported_seq":2804,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.717564+0000","last_change":"2023-11-04T15:36:55.820147+0000","last_active":"2023-11-04T15:37:04.717564+0000","last_peered":"2023-11-04T15:37:04.717564+0000","last_clean":"2023-11-04T15:37:04.717564+0000","last_became_active":"2023-11-04T15:27:36.139121+0000","last_became_peered":"2023-11-04T15:27:36.139121+0000","last_unstale":"2023-11-04T15:37:04.717564+0000","last_undegraded":"2023-11-04T15:37:04.717564+0000","last_fullsized":"2023-11-04T15:37:04.717564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3353,"log_dups_size":0,"ondisk_log_size":3353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.099827518000000004,"stat_sum":{"num_bytes":4117,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":2,"num_read_kb":1,"num_write":1086,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"40'3425","reported_seq":2843,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.717487+0000","last_change":"2023-11-04T15:36:55.816551+0000","last_active":"2023-11-04T15:37:04.717487+0000","last_peered":"2023-11-04T15:37:04.717487+0000","last_clean":"2023-11-04T15:37:04.717487+0000","last_became_active":"2023-11-04T15:27:36.147050+0000","last_became_peered":"2023-11-04T15:27:36.147050+0000","last_unstale":"2023-11-04T15:37:04.717487+0000","last_undegraded":"2023-11-04T15:37:04.717487+0000","last_fullsized":"2023-11-04T15:37:04.717487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3425,"log_dups_size":0,"ondisk_log_size":3425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.098810337999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"40'3561","reported_seq":2965,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:06.226649+0000","last_change":"2023-11-04T15:36:55.796038+0000","last_active":"2023-11-04T15:37:06.226649+0000","last_peered":"2023-11-04T15:37:06.226649+0000","last_clean":"2023-11-04T15:37:06.226649+0000","last_became_active":"2023-11-04T15:27:36.145825+0000","last_became_peered":"2023-11-04T15:27:36.145825+0000","last_unstale":"2023-11-04T15:37:06.226649+0000","last_undegraded":"2023-11-04T15:37:06.226649+0000","last_fullsized":"2023-11-04T15:37:06.226649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3561,"log_dups_size":0,"ondisk_log_size":3561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072094483000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"40'3327","reported_seq":2844,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.611585+0000","last_change":"2023-11-04T15:36:55.817992+0000","last_active":"2023-11-04T15:37:07.611585+0000","last_peered":"2023-11-04T15:37:07.611585+0000","last_clean":"2023-11-04T15:37:07.611585+0000","last_became_active":"2023-11-04T15:27:36.150307+0000","last_became_peered":"2023-11-04T15:27:36.150307+0000","last_unstale":"2023-11-04T15:37:07.611585+0000","last_undegraded":"2023-11-04T15:37:07.611585+0000","last_fullsized":"2023-11-04T15:37:07.611585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3327,"log_dups_size":0,"ondisk_log_size":3327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10012518099999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1064,"num_write_kb":572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"40'3202","reported_seq":2721,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.150819+0000","last_change":"2023-11-04T15:36:55.770571+0000","last_active":"2023-11-04T15:37:07.150819+0000","last_peered":"2023-11-04T15:37:07.150819+0000","last_clean":"2023-11-04T15:37:07.150819+0000","last_became_active":"2023-11-04T15:27:36.144988+0000","last_became_peered":"2023-11-04T15:27:36.144988+0000","last_unstale":"2023-11-04T15:37:07.150819+0000","last_undegraded":"2023-11-04T15:37:07.150819+0000","last_fullsized":"2023-11-04T15:37:07.150819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3202,"log_dups_size":0,"ondisk_log_size":3202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052379294999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1028,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"40'3394","reported_seq":2823,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:06.688553+0000","last_change":"2023-11-04T15:36:55.782106+0000","last_active":"2023-11-04T15:37:06.688553+0000","last_peered":"2023-11-04T15:37:06.688553+0000","last_clean":"2023-11-04T15:37:06.688553+0000","last_became_active":"2023-11-04T15:27:36.149156+0000","last_became_peered":"2023-11-04T15:27:36.149156+0000","last_unstale":"2023-11-04T15:37:06.688553+0000","last_undegraded":"2023-11-04T15:37:06.688553+0000","last_fullsized":"2023-11-04T15:37:06.688553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3394,"log_dups_size":0,"ondisk_log_size":3394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.064372897999999998,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1159,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"40'3255","reported_seq":2744,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:06.226588+0000","last_change":"2023-11-04T15:36:55.792591+0000","last_active":"2023-11-04T15:37:06.226588+0000","last_peered":"2023-11-04T15:37:06.226588+0000","last_clean":"2023-11-04T15:37:06.226588+0000","last_became_active":"2023-11-04T15:27:36.139824+0000","last_became_peered":"2023-11-04T15:27:36.139824+0000","last_unstale":"2023-11-04T15:37:06.226588+0000","last_undegraded":"2023-11-04T15:37:06.226588+0000","last_fullsized":"2023-11-04T15:37:06.226588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3255,"log_dups_size":0,"ondisk_log_size":3255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070068697999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1062,"num_write_kb":575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"40'3538","reported_seq":2918,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718794+0000","last_change":"2023-11-04T15:36:55.774374+0000","last_active":"2023-11-04T15:37:04.718794+0000","last_peered":"2023-11-04T15:37:04.718794+0000","last_clean":"2023-11-04T15:37:04.718794+0000","last_became_active":"2023-11-04T15:27:36.147273+0000","last_became_peered":"2023-11-04T15:27:36.147273+0000","last_unstale":"2023-11-04T15:37:04.718794+0000","last_undegraded":"2023-11-04T15:37:04.718794+0000","last_fullsized":"2023-11-04T15:37:04.718794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3538,"log_dups_size":0,"ondisk_log_size":3538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055716603000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"40'3766","reported_seq":3159,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718379+0000","last_change":"2023-11-04T15:36:55.780005+0000","last_active":"2023-11-04T15:37:04.718379+0000","last_peered":"2023-11-04T15:37:04.718379+0000","last_clean":"2023-11-04T15:37:04.718379+0000","last_became_active":"2023-11-04T15:27:36.148932+0000","last_became_peered":"2023-11-04T15:27:36.148932+0000","last_unstale":"2023-11-04T15:37:04.718379+0000","last_undegraded":"2023-11-04T15:37:04.718379+0000","last_fullsized":"2023-11-04T15:37:04.718379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3766,"log_dups_size":0,"ondisk_log_size":3766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062648212999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1209,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"40'3538","reported_seq":2946,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718524+0000","last_change":"2023-11-04T15:36:55.818096+0000","last_active":"2023-11-04T15:37:04.718524+0000","last_peered":"2023-11-04T15:37:04.718524+0000","last_clean":"2023-11-04T15:37:04.718524+0000","last_became_active":"2023-11-04T15:27:36.150856+0000","last_became_peered":"2023-11-04T15:27:36.150856+0000","last_unstale":"2023-11-04T15:37:04.718524+0000","last_undegraded":"2023-11-04T15:37:04.718524+0000","last_fullsized":"2023-11-04T15:37:04.718524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3538,"log_dups_size":0,"ondisk_log_size":3538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.099772735000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"40'3671","reported_seq":3000,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795770+0000","last_change":"2023-11-04T15:36:55.797112+0000","last_active":"2023-11-04T15:37:04.795770+0000","last_peered":"2023-11-04T15:37:04.795770+0000","last_clean":"2023-11-04T15:37:04.795770+0000","last_became_active":"2023-11-04T15:27:36.144997+0000","last_became_peered":"2023-11-04T15:27:36.144997+0000","last_unstale":"2023-11-04T15:37:04.795770+0000","last_undegraded":"2023-11-04T15:37:04.795770+0000","last_fullsized":"2023-11-04T15:37:04.795770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3671,"log_dups_size":0,"ondisk_log_size":3671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072563297999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1270,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"40'3137","reported_seq":2643,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718976+0000","last_change":"2023-11-04T15:36:55.820139+0000","last_active":"2023-11-04T15:37:04.718976+0000","last_peered":"2023-11-04T15:37:04.718976+0000","last_clean":"2023-11-04T15:37:04.718976+0000","last_became_active":"2023-11-04T15:27:36.150555+0000","last_became_peered":"2023-11-04T15:27:36.150555+0000","last_unstale":"2023-11-04T15:37:04.718976+0000","last_undegraded":"2023-11-04T15:37:04.718976+0000","last_fullsized":"2023-11-04T15:37:04.718976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3137,"log_dups_size":0,"ondisk_log_size":3137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101696772,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1042,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"40'3390","reported_seq":2813,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795930+0000","last_change":"2023-11-04T15:36:55.795034+0000","last_active":"2023-11-04T15:37:04.795930+0000","last_peered":"2023-11-04T15:37:04.795930+0000","last_clean":"2023-11-04T15:37:04.795930+0000","last_became_active":"2023-11-04T15:27:36.147745+0000","last_became_peered":"2023-11-04T15:27:36.147745+0000","last_unstale":"2023-11-04T15:37:04.795930+0000","last_undegraded":"2023-11-04T15:37:04.795930+0000","last_fullsized":"2023-11-04T15:37:04.795930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3390,"log_dups_size":0,"ondisk_log_size":3390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071588252000000005,"stat_sum":{"num_bytes":4128,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1173,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"40'3505","reported_seq":2916,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719201+0000","last_change":"2023-11-04T15:36:55.815381+0000","last_active":"2023-11-04T15:37:04.719201+0000","last_peered":"2023-11-04T15:37:04.719201+0000","last_clean":"2023-11-04T15:37:04.719201+0000","last_became_active":"2023-11-04T15:27:36.150687+0000","last_became_peered":"2023-11-04T15:27:36.150687+0000","last_unstale":"2023-11-04T15:37:04.719201+0000","last_undegraded":"2023-11-04T15:37:04.719201+0000","last_fullsized":"2023-11-04T15:37:04.719201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3505,"log_dups_size":0,"ondisk_log_size":3505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.097896176000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1154,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"43'3544","reported_seq":2982,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.717966+0000","last_change":"2023-11-04T15:36:55.776770+0000","last_active":"2023-11-04T15:37:04.717966+0000","last_peered":"2023-11-04T15:37:04.717966+0000","last_clean":"2023-11-04T15:37:04.717966+0000","last_became_active":"2023-11-04T15:27:36.143551+0000","last_became_peered":"2023-11-04T15:27:36.143551+0000","last_unstale":"2023-11-04T15:37:04.717966+0000","last_undegraded":"2023-11-04T15:37:04.717966+0000","last_fullsized":"2023-11-04T15:37:04.717966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3544,"log_dups_size":0,"ondisk_log_size":3544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056037475000000003,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1178,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"40'3728","reported_seq":3086,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795181+0000","last_change":"2023-11-04T15:36:55.794625+0000","last_active":"2023-11-04T15:37:04.795181+0000","last_peered":"2023-11-04T15:37:04.795181+0000","last_clean":"2023-11-04T15:37:04.795181+0000","last_became_active":"2023-11-04T15:27:36.145943+0000","last_became_peered":"2023-11-04T15:27:36.145943+0000","last_unstale":"2023-11-04T15:37:04.795181+0000","last_undegraded":"2023-11-04T15:37:04.795181+0000","last_fullsized":"2023-11-04T15:37:04.795181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3728,"log_dups_size":0,"ondisk_log_size":3728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071549077000000003,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1242,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"40'3454","reported_seq":2890,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719444+0000","last_change":"2023-11-04T15:36:55.777772+0000","last_active":"2023-11-04T15:37:04.719444+0000","last_peered":"2023-11-04T15:37:04.719444+0000","last_clean":"2023-11-04T15:37:04.719444+0000","last_became_active":"2023-11-04T15:27:36.144083+0000","last_became_peered":"2023-11-04T15:27:36.144083+0000","last_unstale":"2023-11-04T15:37:04.719444+0000","last_undegraded":"2023-11-04T15:37:04.719444+0000","last_fullsized":"2023-11-04T15:37:04.719444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3454,"log_dups_size":0,"ondisk_log_size":3454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.060959410999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1127,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"40'3632","reported_seq":2992,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.717704+0000","last_change":"2023-11-04T15:36:55.821483+0000","last_active":"2023-11-04T15:37:04.717704+0000","last_peered":"2023-11-04T15:37:04.717704+0000","last_clean":"2023-11-04T15:37:04.717704+0000","last_became_active":"2023-11-04T15:27:36.146546+0000","last_became_peered":"2023-11-04T15:27:36.146546+0000","last_unstale":"2023-11-04T15:37:04.717704+0000","last_undegraded":"2023-11-04T15:37:04.717704+0000","last_fullsized":"2023-11-04T15:37:04.717704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3632,"log_dups_size":0,"ondisk_log_size":3632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.102597439,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1222,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"40'3166","reported_seq":2629,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720999+0000","last_change":"2023-11-04T15:36:55.783207+0000","last_active":"2023-11-04T15:37:04.720999+0000","last_peered":"2023-11-04T15:37:04.720999+0000","last_clean":"2023-11-04T15:37:04.720999+0000","last_became_active":"2023-11-04T15:27:36.144047+0000","last_became_peered":"2023-11-04T15:27:36.144047+0000","last_unstale":"2023-11-04T15:37:04.720999+0000","last_undegraded":"2023-11-04T15:37:04.720999+0000","last_fullsized":"2023-11-04T15:37:04.720999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3166,"log_dups_size":0,"ondisk_log_size":3166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.064725415999999994,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1115,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"40'3493","reported_seq":2894,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720410+0000","last_change":"2023-11-04T15:36:55.784865+0000","last_active":"2023-11-04T15:37:04.720410+0000","last_peered":"2023-11-04T15:37:04.720410+0000","last_clean":"2023-11-04T15:37:04.720410+0000","last_became_active":"2023-11-04T15:27:36.144458+0000","last_became_peered":"2023-11-04T15:27:36.144458+0000","last_unstale":"2023-11-04T15:37:04.720410+0000","last_undegraded":"2023-11-04T15:37:04.720410+0000","last_fullsized":"2023-11-04T15:37:04.720410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3493,"log_dups_size":0,"ondisk_log_size":3493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.066118209999999997,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"40'3386","reported_seq":2826,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720176+0000","last_change":"2023-11-04T15:36:55.827764+0000","last_active":"2023-11-04T15:37:04.720176+0000","last_peered":"2023-11-04T15:37:04.720176+0000","last_clean":"2023-11-04T15:37:04.720176+0000","last_became_active":"2023-11-04T15:27:36.150270+0000","last_became_peered":"2023-11-04T15:27:36.150270+0000","last_unstale":"2023-11-04T15:37:04.720176+0000","last_undegraded":"2023-11-04T15:37:04.720176+0000","last_fullsized":"2023-11-04T15:37:04.720176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3386,"log_dups_size":0,"ondisk_log_size":3386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.104674168,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"40'3286","reported_seq":2718,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795538+0000","last_change":"2023-11-04T15:36:55.799791+0000","last_active":"2023-11-04T15:37:04.795538+0000","last_peered":"2023-11-04T15:37:04.795538+0000","last_clean":"2023-11-04T15:37:04.795538+0000","last_became_active":"2023-11-04T15:28:20.871378+0000","last_became_peered":"2023-11-04T15:28:20.871378+0000","last_unstale":"2023-11-04T15:37:04.795538+0000","last_undegraded":"2023-11-04T15:37:04.795538+0000","last_fullsized":"2023-11-04T15:37:04.795538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3286,"log_dups_size":0,"ondisk_log_size":3286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.074381663000000001,"stat_sum":{"num_bytes":9,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1152,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"40'3578","reported_seq":3007,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795648+0000","last_change":"2023-11-04T15:36:55.793946+0000","last_active":"2023-11-04T15:37:04.795648+0000","last_peered":"2023-11-04T15:37:04.795648+0000","last_clean":"2023-11-04T15:37:04.795648+0000","last_became_active":"2023-11-04T15:27:36.145392+0000","last_became_peered":"2023-11-04T15:27:36.145392+0000","last_unstale":"2023-11-04T15:37:04.795648+0000","last_undegraded":"2023-11-04T15:37:04.795648+0000","last_fullsized":"2023-11-04T15:37:04.795648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3578,"log_dups_size":0,"ondisk_log_size":3578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070714202000000004,"stat_sum":{"num_bytes":12288,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1167,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"40'3386","reported_seq":2873,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:10.551465+0000","last_change":"2023-11-04T15:37:10.551561+0000","last_active":"2023-11-04T15:37:10.551465+0000","last_peered":"2023-11-04T15:37:10.551465+0000","last_clean":"2023-11-04T15:37:10.551465+0000","last_became_active":"2023-11-04T15:27:36.145273+0000","last_became_peered":"2023-11-04T15:27:36.145273+0000","last_unstale":"2023-11-04T15:37:10.551465+0000","last_undegraded":"2023-11-04T15:37:10.551465+0000","last_fullsized":"2023-11-04T15:37:10.551465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3386","last_scrub_stamp":"2023-11-04T15:37:10.551443+0000","last_deep_scrub":"40'3386","last_deep_scrub_stamp":"2023-11-04T15:37:10.551443+0000","last_clean_scrub_stamp":"2023-11-04T15:37:10.551443+0000","objects_scrubbed":0,"log_size":3386,"log_dups_size":0,"ondisk_log_size":3386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:21:56.476755+0000","scrub_duration":0.005704687,"objects_trimmed":0,"snaptrim_duration":0.101784969,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1155,"num_write_kb":603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"40'3889","reported_seq":3214,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719444+0000","last_change":"2023-11-04T15:36:55.778888+0000","last_active":"2023-11-04T15:37:04.719444+0000","last_peered":"2023-11-04T15:37:04.719444+0000","last_clean":"2023-11-04T15:37:04.719444+0000","last_became_active":"2023-11-04T15:27:36.144053+0000","last_became_peered":"2023-11-04T15:27:36.144053+0000","last_unstale":"2023-11-04T15:37:04.719444+0000","last_undegraded":"2023-11-04T15:37:04.719444+0000","last_fullsized":"2023-11-04T15:37:04.719444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3889,"log_dups_size":0,"ondisk_log_size":3889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061944979999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1328,"num_write_kb":706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"40'3720","reported_seq":3105,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.717917+0000","last_change":"2023-11-04T15:36:55.775709+0000","last_active":"2023-11-04T15:37:04.717917+0000","last_peered":"2023-11-04T15:37:04.717917+0000","last_clean":"2023-11-04T15:37:04.717917+0000","last_became_active":"2023-11-04T15:27:36.148342+0000","last_became_peered":"2023-11-04T15:27:36.148342+0000","last_unstale":"2023-11-04T15:37:04.717917+0000","last_undegraded":"2023-11-04T15:37:04.717917+0000","last_fullsized":"2023-11-04T15:37:04.717917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3720,"log_dups_size":0,"ondisk_log_size":3720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056486557999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"40'3424","reported_seq":2826,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720693+0000","last_change":"2023-11-04T15:36:55.784869+0000","last_active":"2023-11-04T15:37:04.720693+0000","last_peered":"2023-11-04T15:37:04.720693+0000","last_clean":"2023-11-04T15:37:04.720693+0000","last_became_active":"2023-11-04T15:27:36.148951+0000","last_became_peered":"2023-11-04T15:27:36.148951+0000","last_unstale":"2023-11-04T15:37:04.720693+0000","last_undegraded":"2023-11-04T15:37:04.720693+0000","last_fullsized":"2023-11-04T15:37:04.720693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3424,"log_dups_size":0,"ondisk_log_size":3424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.066218149000000004,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1176,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"40'2984","reported_seq":3025,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718897+0000","last_change":"2023-11-04T15:27:35.775931+0000","last_active":"2023-11-04T15:37:04.718897+0000","last_peered":"2023-11-04T15:37:04.718897+0000","last_clean":"2023-11-04T15:37:04.718897+0000","last_became_active":"2023-11-04T15:27:35.775616+0000","last_became_peered":"2023-11-04T15:27:35.775616+0000","last_unstale":"2023-11-04T15:37:04.718897+0000","last_undegraded":"2023-11-04T15:37:04.718897+0000","last_fullsized":"2023-11-04T15:37:04.718897+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2984,"log_dups_size":0,"ondisk_log_size":2984,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2984,"num_write_kb":24202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"40'3308","reported_seq":2727,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.611520+0000","last_change":"2023-11-04T15:36:55.822910+0000","last_active":"2023-11-04T15:37:07.611520+0000","last_peered":"2023-11-04T15:37:07.611520+0000","last_clean":"2023-11-04T15:37:07.611520+0000","last_became_active":"2023-11-04T15:27:36.150276+0000","last_became_peered":"2023-11-04T15:27:36.150276+0000","last_unstale":"2023-11-04T15:37:07.611520+0000","last_undegraded":"2023-11-04T15:37:07.611520+0000","last_fullsized":"2023-11-04T15:37:07.611520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3308,"log_dups_size":0,"ondisk_log_size":3308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101095329,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1177,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"37'462","reported_seq":503,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795171+0000","last_change":"2023-11-04T15:27:35.776610+0000","last_active":"2023-11-04T15:37:04.795171+0000","last_peered":"2023-11-04T15:37:04.795171+0000","last_clean":"2023-11-04T15:37:04.795171+0000","last_became_active":"2023-11-04T15:27:35.776297+0000","last_became_peered":"2023-11-04T15:27:35.776297+0000","last_unstale":"2023-11-04T15:37:04.795171+0000","last_undegraded":"2023-11-04T15:37:04.795171+0000","last_fullsized":"2023-11-04T15:37:04.795171+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":462,"num_write_kb":12396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"44'3489","reported_seq":2923,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:22.680227+0000","last_change":"2023-11-04T15:37:22.680321+0000","last_active":"2023-11-04T15:37:22.680227+0000","last_peered":"2023-11-04T15:37:22.680227+0000","last_clean":"2023-11-04T15:37:22.680227+0000","last_became_active":"2023-11-04T15:27:36.139580+0000","last_became_peered":"2023-11-04T15:27:36.139580+0000","last_unstale":"2023-11-04T15:37:22.680227+0000","last_undegraded":"2023-11-04T15:37:22.680227+0000","last_fullsized":"2023-11-04T15:37:22.680227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3489","last_scrub_stamp":"2023-11-04T15:37:22.680205+0000","last_deep_scrub":"44'3489","last_deep_scrub_stamp":"2023-11-04T15:37:22.680205+0000","last_clean_scrub_stamp":"2023-11-04T15:37:22.680205+0000","objects_scrubbed":4,"log_size":3489,"log_dups_size":0,"ondisk_log_size":3489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:18:28.360934+0000","scrub_duration":0.013912934,"objects_trimmed":0,"snaptrim_duration":0.074768939000000006,"stat_sum":{"num_bytes":8192,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1207,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"40'717","reported_seq":758,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718608+0000","last_change":"2023-11-04T15:27:35.775977+0000","last_active":"2023-11-04T15:37:04.718608+0000","last_peered":"2023-11-04T15:37:04.718608+0000","last_clean":"2023-11-04T15:37:04.718608+0000","last_became_active":"2023-11-04T15:27:35.775486+0000","last_became_peered":"2023-11-04T15:27:35.775486+0000","last_unstale":"2023-11-04T15:37:04.718608+0000","last_undegraded":"2023-11-04T15:37:04.718608+0000","last_fullsized":"2023-11-04T15:37:04.718608+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":707,"num_write_kb":16815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"40'3443","reported_seq":2876,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:06.226433+0000","last_change":"2023-11-04T15:36:55.799083+0000","last_active":"2023-11-04T15:37:06.226433+0000","last_peered":"2023-11-04T15:37:06.226433+0000","last_clean":"2023-11-04T15:37:06.226433+0000","last_became_active":"2023-11-04T15:27:36.139789+0000","last_became_peered":"2023-11-04T15:27:36.139789+0000","last_unstale":"2023-11-04T15:37:06.226433+0000","last_undegraded":"2023-11-04T15:37:06.226433+0000","last_fullsized":"2023-11-04T15:37:06.226433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3443,"log_dups_size":0,"ondisk_log_size":3443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.073936136,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"37'1614","reported_seq":1655,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718065+0000","last_change":"2023-11-04T15:27:35.776168+0000","last_active":"2023-11-04T15:37:04.718065+0000","last_peered":"2023-11-04T15:37:04.718065+0000","last_clean":"2023-11-04T15:37:04.718065+0000","last_became_active":"2023-11-04T15:27:35.775895+0000","last_became_peered":"2023-11-04T15:27:35.775895+0000","last_unstale":"2023-11-04T15:37:04.718065+0000","last_undegraded":"2023-11-04T15:37:04.718065+0000","last_fullsized":"2023-11-04T15:37:04.718065+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1614,"log_dups_size":0,"ondisk_log_size":1614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":1625,"num_write_kb":22714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"43'1198","reported_seq":1239,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718987+0000","last_change":"2023-11-04T15:27:35.767890+0000","last_active":"2023-11-04T15:37:04.718987+0000","last_peered":"2023-11-04T15:37:04.718987+0000","last_clean":"2023-11-04T15:37:04.718987+0000","last_became_active":"2023-11-04T15:27:35.767594+0000","last_became_peered":"2023-11-04T15:27:35.767594+0000","last_unstale":"2023-11-04T15:37:04.718987+0000","last_undegraded":"2023-11-04T15:37:04.718987+0000","last_fullsized":"2023-11-04T15:37:04.718987+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1198,"log_dups_size":0,"ondisk_log_size":1198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1190,"num_write_kb":15478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"40'3688","reported_seq":3062,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:14.480922+0000","last_change":"2023-11-04T15:37:14.481041+0000","last_active":"2023-11-04T15:37:14.480922+0000","last_peered":"2023-11-04T15:37:14.480922+0000","last_clean":"2023-11-04T15:37:14.480922+0000","last_became_active":"2023-11-04T15:27:36.148282+0000","last_became_peered":"2023-11-04T15:27:36.148282+0000","last_unstale":"2023-11-04T15:37:14.480922+0000","last_undegraded":"2023-11-04T15:37:14.480922+0000","last_fullsized":"2023-11-04T15:37:14.480922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3688","last_scrub_stamp":"2023-11-04T15:37:14.480897+0000","last_deep_scrub":"40'3688","last_deep_scrub_stamp":"2023-11-04T15:37:14.480897+0000","last_clean_scrub_stamp":"2023-11-04T15:37:14.480897+0000","objects_scrubbed":0,"log_size":3688,"log_dups_size":0,"ondisk_log_size":3688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:24:49.251475+0000","scrub_duration":0.0044870750000000001,"objects_trimmed":0,"snaptrim_duration":0.102136719,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1244,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"37'2392","reported_seq":2433,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720477+0000","last_change":"2023-11-04T15:27:35.771839+0000","last_active":"2023-11-04T15:37:04.720477+0000","last_peered":"2023-11-04T15:37:04.720477+0000","last_clean":"2023-11-04T15:37:04.720477+0000","last_became_active":"2023-11-04T15:27:35.771554+0000","last_became_peered":"2023-11-04T15:27:35.771554+0000","last_unstale":"2023-11-04T15:37:04.720477+0000","last_undegraded":"2023-11-04T15:37:04.720477+0000","last_fullsized":"2023-11-04T15:37:04.720477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2392,"log_dups_size":0,"ondisk_log_size":2392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2386,"num_write_kb":21701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"40'3600","reported_seq":2986,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719460+0000","last_change":"2023-11-04T15:36:55.779143+0000","last_active":"2023-11-04T15:37:04.719460+0000","last_peered":"2023-11-04T15:37:04.719460+0000","last_clean":"2023-11-04T15:37:04.719460+0000","last_became_active":"2023-11-04T15:27:36.149146+0000","last_became_peered":"2023-11-04T15:27:36.149146+0000","last_unstale":"2023-11-04T15:37:04.719460+0000","last_undegraded":"2023-11-04T15:37:04.719460+0000","last_fullsized":"2023-11-04T15:37:04.719460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3600,"log_dups_size":0,"ondisk_log_size":3600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055767874000000002,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"40'3587","reported_seq":3628,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720018+0000","last_change":"2023-11-04T15:27:35.773978+0000","last_active":"2023-11-04T15:37:04.720018+0000","last_peered":"2023-11-04T15:37:04.720018+0000","last_clean":"2023-11-04T15:37:04.720018+0000","last_became_active":"2023-11-04T15:27:35.773689+0000","last_became_peered":"2023-11-04T15:27:35.773689+0000","last_unstale":"2023-11-04T15:37:04.720018+0000","last_undegraded":"2023-11-04T15:37:04.720018+0000","last_fullsized":"2023-11-04T15:37:04.720018+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3587,"log_dups_size":0,"ondisk_log_size":3587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582982,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3581,"num_write_kb":38716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"44'3514","reported_seq":2912,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:14.746158+0000","last_change":"2023-11-04T15:37:14.746264+0000","last_active":"2023-11-04T15:37:14.746158+0000","last_peered":"2023-11-04T15:37:14.746158+0000","last_clean":"2023-11-04T15:37:14.746158+0000","last_became_active":"2023-11-04T15:27:36.141695+0000","last_became_peered":"2023-11-04T15:27:36.141695+0000","last_unstale":"2023-11-04T15:37:14.746158+0000","last_undegraded":"2023-11-04T15:37:14.746158+0000","last_fullsized":"2023-11-04T15:37:14.746158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3514","last_scrub_stamp":"2023-11-04T15:37:14.746134+0000","last_deep_scrub":"44'3514","last_deep_scrub_stamp":"2023-11-04T15:37:14.746134+0000","last_clean_scrub_stamp":"2023-11-04T15:37:14.746134+0000","objects_scrubbed":3,"log_size":3514,"log_dups_size":0,"ondisk_log_size":3514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:36.355741+0000","scrub_duration":0.013556656,"objects_trimmed":0,"snaptrim_duration":0.057953993000000002,"stat_sum":{"num_bytes":4107,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1230,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"40'1577","reported_seq":1618,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719659+0000","last_change":"2023-11-04T15:27:35.774108+0000","last_active":"2023-11-04T15:37:04.719659+0000","last_peered":"2023-11-04T15:37:04.719659+0000","last_clean":"2023-11-04T15:37:04.719659+0000","last_became_active":"2023-11-04T15:27:35.773818+0000","last_became_peered":"2023-11-04T15:27:35.773818+0000","last_unstale":"2023-11-04T15:37:04.719659+0000","last_undegraded":"2023-11-04T15:37:04.719659+0000","last_fullsized":"2023-11-04T15:37:04.719659+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1577,"log_dups_size":0,"ondisk_log_size":1577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1569,"num_write_kb":30603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"40'3300","reported_seq":2749,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795330+0000","last_change":"2023-11-04T15:36:55.793529+0000","last_active":"2023-11-04T15:37:04.795330+0000","last_peered":"2023-11-04T15:37:04.795330+0000","last_clean":"2023-11-04T15:37:04.795330+0000","last_became_active":"2023-11-04T15:27:36.150653+0000","last_became_peered":"2023-11-04T15:27:36.150653+0000","last_unstale":"2023-11-04T15:37:04.795330+0000","last_undegraded":"2023-11-04T15:37:04.795330+0000","last_fullsized":"2023-11-04T15:37:04.795330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3300,"log_dups_size":0,"ondisk_log_size":3300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070970674999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1129,"num_write_kb":600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"37'4021","reported_seq":4062,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719815+0000","last_change":"2023-11-04T15:27:35.773128+0000","last_active":"2023-11-04T15:37:04.719815+0000","last_peered":"2023-11-04T15:37:04.719815+0000","last_clean":"2023-11-04T15:37:04.719815+0000","last_became_active":"2023-11-04T15:27:35.772815+0000","last_became_peered":"2023-11-04T15:27:35.772815+0000","last_unstale":"2023-11-04T15:37:04.719815+0000","last_undegraded":"2023-11-04T15:37:04.719815+0000","last_fullsized":"2023-11-04T15:37:04.719815+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":4021,"log_dups_size":0,"ondisk_log_size":4021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4019,"num_write_kb":36923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"40'3784","reported_seq":3140,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:21.440173+0000","last_change":"2023-11-04T15:37:21.440272+0000","last_active":"2023-11-04T15:37:21.440173+0000","last_peered":"2023-11-04T15:37:21.440173+0000","last_clean":"2023-11-04T15:37:21.440173+0000","last_became_active":"2023-11-04T15:27:36.150667+0000","last_became_peered":"2023-11-04T15:27:36.150667+0000","last_unstale":"2023-11-04T15:37:21.440173+0000","last_undegraded":"2023-11-04T15:37:21.440173+0000","last_fullsized":"2023-11-04T15:37:21.440173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3784","last_scrub_stamp":"2023-11-04T15:37:21.440149+0000","last_deep_scrub":"40'3784","last_deep_scrub_stamp":"2023-11-04T15:37:21.440149+0000","last_clean_scrub_stamp":"2023-11-04T15:37:21.440149+0000","objects_scrubbed":0,"log_size":3784,"log_dups_size":0,"ondisk_log_size":3784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:35.107882+0000","scrub_duration":0.0057867910000000003,"objects_trimmed":0,"snaptrim_duration":0.098687114000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1287,"num_write_kb":684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"37'2125","reported_seq":2166,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720555+0000","last_change":"2023-11-04T15:27:35.775559+0000","last_active":"2023-11-04T15:37:04.720555+0000","last_peered":"2023-11-04T15:37:04.720555+0000","last_clean":"2023-11-04T15:37:04.720555+0000","last_became_active":"2023-11-04T15:27:35.775063+0000","last_became_peered":"2023-11-04T15:27:35.775063+0000","last_unstale":"2023-11-04T15:37:04.720555+0000","last_undegraded":"2023-11-04T15:37:04.720555+0000","last_fullsized":"2023-11-04T15:37:04.720555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2125,"log_dups_size":0,"ondisk_log_size":2125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2118,"num_write_kb":30816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"40'3317","reported_seq":2788,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719341+0000","last_change":"2023-11-04T15:36:55.826358+0000","last_active":"2023-11-04T15:37:04.719341+0000","last_peered":"2023-11-04T15:37:04.719341+0000","last_clean":"2023-11-04T15:37:04.719341+0000","last_became_active":"2023-11-04T15:27:36.139103+0000","last_became_peered":"2023-11-04T15:27:36.139103+0000","last_unstale":"2023-11-04T15:37:04.719341+0000","last_undegraded":"2023-11-04T15:37:04.719341+0000","last_fullsized":"2023-11-04T15:37:04.719341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3317,"log_dups_size":0,"ondisk_log_size":3317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10468400899999999,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1091,"num_write_kb":593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"37'1934","reported_seq":1975,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718699+0000","last_change":"2023-11-04T15:27:35.773686+0000","last_active":"2023-11-04T15:37:04.718699+0000","last_peered":"2023-11-04T15:37:04.718699+0000","last_clean":"2023-11-04T15:37:04.718699+0000","last_became_active":"2023-11-04T15:27:35.773449+0000","last_became_peered":"2023-11-04T15:27:35.773449+0000","last_unstale":"2023-11-04T15:37:04.718699+0000","last_undegraded":"2023-11-04T15:37:04.718699+0000","last_fullsized":"2023-11-04T15:37:04.718699+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1934,"log_dups_size":0,"ondisk_log_size":1934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1929,"num_write_kb":17119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"40'3519","reported_seq":2953,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:23.652533+0000","last_change":"2023-11-04T15:37:23.652627+0000","last_active":"2023-11-04T15:37:23.652533+0000","last_peered":"2023-11-04T15:37:23.652533+0000","last_clean":"2023-11-04T15:37:23.652533+0000","last_became_active":"2023-11-04T15:27:36.141086+0000","last_became_peered":"2023-11-04T15:27:36.141086+0000","last_unstale":"2023-11-04T15:37:23.652533+0000","last_undegraded":"2023-11-04T15:37:23.652533+0000","last_fullsized":"2023-11-04T15:37:23.652533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3519","last_scrub_stamp":"2023-11-04T15:37:23.652509+0000","last_deep_scrub":"40'3519","last_deep_scrub_stamp":"2023-11-04T15:37:23.652509+0000","last_clean_scrub_stamp":"2023-11-04T15:37:23.652509+0000","objects_scrubbed":0,"log_size":3519,"log_dups_size":0,"ondisk_log_size":3519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:28.689310+0000","scrub_duration":0.0061970940000000002,"objects_trimmed":0,"snaptrim_duration":0.059170119,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1142,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"37'655","reported_seq":696,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719906+0000","last_change":"2023-11-04T15:27:35.770858+0000","last_active":"2023-11-04T15:37:04.719906+0000","last_peered":"2023-11-04T15:37:04.719906+0000","last_clean":"2023-11-04T15:37:04.719906+0000","last_became_active":"2023-11-04T15:27:35.769001+0000","last_became_peered":"2023-11-04T15:27:35.769001+0000","last_unstale":"2023-11-04T15:37:04.719906+0000","last_undegraded":"2023-11-04T15:37:04.719906+0000","last_fullsized":"2023-11-04T15:37:04.719906+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":656,"num_write_kb":15166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"44'3666","reported_seq":3094,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:24.311230+0000","last_change":"2023-11-04T15:37:24.311349+0000","last_active":"2023-11-04T15:37:24.311230+0000","last_peered":"2023-11-04T15:37:24.311230+0000","last_clean":"2023-11-04T15:37:24.311230+0000","last_became_active":"2023-11-04T15:27:36.147034+0000","last_became_peered":"2023-11-04T15:27:36.147034+0000","last_unstale":"2023-11-04T15:37:24.311230+0000","last_undegraded":"2023-11-04T15:37:24.311230+0000","last_fullsized":"2023-11-04T15:37:24.311230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3666","last_scrub_stamp":"2023-11-04T15:37:24.311202+0000","last_deep_scrub":"44'3666","last_deep_scrub_stamp":"2023-11-04T15:37:24.311202+0000","last_clean_scrub_stamp":"2023-11-04T15:37:24.311202+0000","objects_scrubbed":3,"log_size":3666,"log_dups_size":0,"ondisk_log_size":3666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:56:38.113824+0000","scrub_duration":0.0088871530000000001,"objects_trimmed":0,"snaptrim_duration":0.064750725999999995,"stat_sum":{"num_bytes":4196,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1197,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":197,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718225+0000","last_change":"2023-11-04T15:27:26.267129+0000","last_active":"2023-11-04T15:37:04.718225+0000","last_peered":"2023-11-04T15:37:04.718225+0000","last_clean":"2023-11-04T15:37:04.718225+0000","last_became_active":"2023-11-04T15:27:26.266242+0000","last_became_peered":"2023-11-04T15:27:26.266242+0000","last_unstale":"2023-11-04T15:37:04.718225+0000","last_undegraded":"2023-11-04T15:37:04.718225+0000","last_fullsized":"2023-11-04T15:37:04.718225+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:25.163848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:25.163848+0000","last_clean_scrub_stamp":"2023-11-04T15:27:25.163848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718937+0000","last_change":"2023-11-04T15:27:31.620178+0000","last_active":"2023-11-04T15:37:04.718937+0000","last_peered":"2023-11-04T15:37:04.718937+0000","last_clean":"2023-11-04T15:37:04.718937+0000","last_became_active":"2023-11-04T15:27:31.619798+0000","last_became_peered":"2023-11-04T15:27:31.619798+0000","last_unstale":"2023-11-04T15:37:04.718937+0000","last_undegraded":"2023-11-04T15:37:04.718937+0000","last_fullsized":"2023-11-04T15:37:04.718937+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"39'3629","reported_seq":3670,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720110+0000","last_change":"2023-11-04T15:27:35.769689+0000","last_active":"2023-11-04T15:37:04.720110+0000","last_peered":"2023-11-04T15:37:04.720110+0000","last_clean":"2023-11-04T15:37:04.720110+0000","last_became_active":"2023-11-04T15:27:35.769150+0000","last_became_peered":"2023-11-04T15:27:35.769150+0000","last_unstale":"2023-11-04T15:37:04.720110+0000","last_undegraded":"2023-11-04T15:37:04.720110+0000","last_fullsized":"2023-11-04T15:37:04.720110+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3629,"log_dups_size":0,"ondisk_log_size":3629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3620,"num_write_kb":52059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"40'3668","reported_seq":3075,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720004+0000","last_change":"2023-11-04T15:36:55.827884+0000","last_active":"2023-11-04T15:37:04.720004+0000","last_peered":"2023-11-04T15:37:04.720004+0000","last_clean":"2023-11-04T15:37:04.720004+0000","last_became_active":"2023-11-04T15:27:36.140619+0000","last_became_peered":"2023-11-04T15:27:36.140619+0000","last_unstale":"2023-11-04T15:37:04.720004+0000","last_undegraded":"2023-11-04T15:37:04.720004+0000","last_fullsized":"2023-11-04T15:37:04.720004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3668,"log_dups_size":0,"ondisk_log_size":3668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10532783499999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":44,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718142+0000","last_change":"2023-11-04T15:27:31.622106+0000","last_active":"2023-11-04T15:37:04.718142+0000","last_peered":"2023-11-04T15:37:04.718142+0000","last_clean":"2023-11-04T15:37:04.718142+0000","last_became_active":"2023-11-04T15:27:31.621889+0000","last_became_peered":"2023-11-04T15:27:31.621889+0000","last_unstale":"2023-11-04T15:37:04.718142+0000","last_undegraded":"2023-11-04T15:37:04.718142+0000","last_fullsized":"2023-11-04T15:37:04.718142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"43'3684","reported_seq":3891,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795087+0000","last_change":"2023-11-04T15:27:35.771207+0000","last_active":"2023-11-04T15:37:04.795087+0000","last_peered":"2023-11-04T15:37:04.795087+0000","last_clean":"2023-11-04T15:37:04.795087+0000","last_became_active":"2023-11-04T15:27:35.770364+0000","last_became_peered":"2023-11-04T15:27:35.770364+0000","last_unstale":"2023-11-04T15:37:04.795087+0000","last_undegraded":"2023-11-04T15:37:04.795087+0000","last_fullsized":"2023-11-04T15:37:04.795087+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3684,"log_dups_size":0,"ondisk_log_size":3684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15883313,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":166,"num_read_kb":3338,"num_write":3668,"num_write_kb":29714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"44'3553","reported_seq":2997,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:24.639590+0000","last_change":"2023-11-04T15:37:24.639702+0000","last_active":"2023-11-04T15:37:24.639590+0000","last_peered":"2023-11-04T15:37:24.639590+0000","last_clean":"2023-11-04T15:37:24.639590+0000","last_became_active":"2023-11-04T15:27:36.144459+0000","last_became_peered":"2023-11-04T15:27:36.144459+0000","last_unstale":"2023-11-04T15:37:24.639590+0000","last_undegraded":"2023-11-04T15:37:24.639590+0000","last_fullsized":"2023-11-04T15:37:24.639590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3553","last_scrub_stamp":"2023-11-04T15:37:24.639567+0000","last_deep_scrub":"44'3553","last_deep_scrub_stamp":"2023-11-04T15:37:24.639567+0000","last_clean_scrub_stamp":"2023-11-04T15:37:24.639567+0000","objects_scrubbed":2,"log_size":3553,"log_dups_size":0,"ondisk_log_size":3553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:38.307301+0000","scrub_duration":0.010629794999999999,"objects_trimmed":0,"snaptrim_duration":0.072685394,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719755+0000","last_change":"2023-11-04T15:27:31.622710+0000","last_active":"2023-11-04T15:37:04.719755+0000","last_peered":"2023-11-04T15:37:04.719755+0000","last_clean":"2023-11-04T15:37:04.719755+0000","last_became_active":"2023-11-04T15:27:31.622378+0000","last_became_peered":"2023-11-04T15:27:31.622378+0000","last_unstale":"2023-11-04T15:37:04.719755+0000","last_undegraded":"2023-11-04T15:37:04.719755+0000","last_fullsized":"2023-11-04T15:37:04.719755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"40'6079","reported_seq":6120,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720017+0000","last_change":"2023-11-04T15:27:35.774630+0000","last_active":"2023-11-04T15:37:04.720017+0000","last_peered":"2023-11-04T15:37:04.720017+0000","last_clean":"2023-11-04T15:37:04.720017+0000","last_became_active":"2023-11-04T15:27:35.774339+0000","last_became_peered":"2023-11-04T15:27:35.774339+0000","last_unstale":"2023-11-04T15:37:04.720017+0000","last_undegraded":"2023-11-04T15:37:04.720017+0000","last_fullsized":"2023-11-04T15:37:04.720017+0000","mapping_epoch":16,"log_start":"26'400","ondisk_log_start":"26'400","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":5679,"log_dups_size":0,"ondisk_log_size":5679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6078,"num_write_kb":43849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"44'3173","reported_seq":2650,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:10.304885+0000","last_change":"2023-11-04T15:37:10.305048+0000","last_active":"2023-11-04T15:37:10.304885+0000","last_peered":"2023-11-04T15:37:10.304885+0000","last_clean":"2023-11-04T15:37:10.304885+0000","last_became_active":"2023-11-04T15:27:36.146930+0000","last_became_peered":"2023-11-04T15:27:36.146930+0000","last_unstale":"2023-11-04T15:37:10.304885+0000","last_undegraded":"2023-11-04T15:37:10.304885+0000","last_fullsized":"2023-11-04T15:37:10.304885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3173","last_scrub_stamp":"2023-11-04T15:37:10.304861+0000","last_deep_scrub":"44'3173","last_deep_scrub_stamp":"2023-11-04T15:37:10.304861+0000","last_clean_scrub_stamp":"2023-11-04T15:37:10.304861+0000","objects_scrubbed":1,"log_size":3173,"log_dups_size":0,"ondisk_log_size":3173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:31.914468+0000","scrub_duration":0.0078700769999999996,"objects_trimmed":0,"snaptrim_duration":0.067233409999999993,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1111,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":44,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720647+0000","last_change":"2023-11-04T15:27:31.622105+0000","last_active":"2023-11-04T15:37:04.720647+0000","last_peered":"2023-11-04T15:37:04.720647+0000","last_clean":"2023-11-04T15:37:04.720647+0000","last_became_active":"2023-11-04T15:27:31.621849+0000","last_became_peered":"2023-11-04T15:27:31.621849+0000","last_unstale":"2023-11-04T15:37:04.720647+0000","last_undegraded":"2023-11-04T15:37:04.720647+0000","last_fullsized":"2023-11-04T15:37:04.720647+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"40'3275","reported_seq":3316,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718598+0000","last_change":"2023-11-04T15:27:35.770188+0000","last_active":"2023-11-04T15:37:04.718598+0000","last_peered":"2023-11-04T15:37:04.718598+0000","last_clean":"2023-11-04T15:37:04.718598+0000","last_became_active":"2023-11-04T15:27:35.769730+0000","last_became_peered":"2023-11-04T15:27:35.769730+0000","last_unstale":"2023-11-04T15:37:04.718598+0000","last_undegraded":"2023-11-04T15:37:04.718598+0000","last_fullsized":"2023-11-04T15:37:04.718598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3275,"log_dups_size":0,"ondisk_log_size":3275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3258,"num_write_kb":30072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"44'3434","reported_seq":2863,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:18.421603+0000","last_change":"2023-11-04T15:37:18.421706+0000","last_active":"2023-11-04T15:37:18.421603+0000","last_peered":"2023-11-04T15:37:18.421603+0000","last_clean":"2023-11-04T15:37:18.421603+0000","last_became_active":"2023-11-04T15:27:36.144417+0000","last_became_peered":"2023-11-04T15:27:36.144417+0000","last_unstale":"2023-11-04T15:37:18.421603+0000","last_undegraded":"2023-11-04T15:37:18.421603+0000","last_fullsized":"2023-11-04T15:37:18.421603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3434","last_scrub_stamp":"2023-11-04T15:37:18.421580+0000","last_deep_scrub":"44'3434","last_deep_scrub_stamp":"2023-11-04T15:37:18.421580+0000","last_clean_scrub_stamp":"2023-11-04T15:37:18.421580+0000","objects_scrubbed":3,"log_size":3434,"log_dups_size":0,"ondisk_log_size":3434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:37:14.873581+0000","scrub_duration":0.011594345000000001,"objects_trimmed":0,"snaptrim_duration":0.067418286999999993,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"37'3105","reported_seq":3146,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719658+0000","last_change":"2023-11-04T15:27:35.770033+0000","last_active":"2023-11-04T15:37:04.719658+0000","last_peered":"2023-11-04T15:37:04.719658+0000","last_clean":"2023-11-04T15:37:04.719658+0000","last_became_active":"2023-11-04T15:27:35.769772+0000","last_became_peered":"2023-11-04T15:27:35.769772+0000","last_unstale":"2023-11-04T15:37:04.719658+0000","last_undegraded":"2023-11-04T15:37:04.719658+0000","last_fullsized":"2023-11-04T15:37:04.719658+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3105,"log_dups_size":0,"ondisk_log_size":3105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3101,"num_write_kb":32806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":44,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720931+0000","last_change":"2023-11-04T15:27:31.622663+0000","last_active":"2023-11-04T15:37:04.720931+0000","last_peered":"2023-11-04T15:37:04.720931+0000","last_clean":"2023-11-04T15:37:04.720931+0000","last_became_active":"2023-11-04T15:27:31.622350+0000","last_became_peered":"2023-11-04T15:27:31.622350+0000","last_unstale":"2023-11-04T15:37:04.720931+0000","last_undegraded":"2023-11-04T15:37:04.720931+0000","last_fullsized":"2023-11-04T15:37:04.720931+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"43'3419","reported_seq":2905,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:09.350809+0000","last_change":"2023-11-04T15:37:09.350908+0000","last_active":"2023-11-04T15:37:09.350809+0000","last_peered":"2023-11-04T15:37:09.350809+0000","last_clean":"2023-11-04T15:37:09.350809+0000","last_became_active":"2023-11-04T15:27:36.143991+0000","last_became_peered":"2023-11-04T15:27:36.143991+0000","last_unstale":"2023-11-04T15:37:09.350809+0000","last_undegraded":"2023-11-04T15:37:09.350809+0000","last_fullsized":"2023-11-04T15:37:09.350809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3419","last_scrub_stamp":"2023-11-04T15:37:09.350786+0000","last_deep_scrub":"43'3419","last_deep_scrub_stamp":"2023-11-04T15:37:09.350786+0000","last_clean_scrub_stamp":"2023-11-04T15:37:09.350786+0000","objects_scrubbed":2,"log_size":3419,"log_dups_size":0,"ondisk_log_size":3419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:20:35.227166+0000","scrub_duration":0.0074817540000000002,"objects_trimmed":0,"snaptrim_duration":0.062728023999999993,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":1116,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"40'4464","reported_seq":4505,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720851+0000","last_change":"2023-11-04T15:27:35.769416+0000","last_active":"2023-11-04T15:37:04.720851+0000","last_peered":"2023-11-04T15:37:04.720851+0000","last_clean":"2023-11-04T15:37:04.720851+0000","last_became_active":"2023-11-04T15:27:35.769095+0000","last_became_peered":"2023-11-04T15:27:35.769095+0000","last_unstale":"2023-11-04T15:37:04.720851+0000","last_undegraded":"2023-11-04T15:37:04.720851+0000","last_fullsized":"2023-11-04T15:37:04.720851+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":4464,"log_dups_size":0,"ondisk_log_size":4464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4451,"num_write_kb":27035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720156+0000","last_change":"2023-11-04T15:27:31.619973+0000","last_active":"2023-11-04T15:37:04.720156+0000","last_peered":"2023-11-04T15:37:04.720156+0000","last_clean":"2023-11-04T15:37:04.720156+0000","last_became_active":"2023-11-04T15:27:31.619702+0000","last_became_peered":"2023-11-04T15:27:31.619702+0000","last_unstale":"2023-11-04T15:37:04.720156+0000","last_undegraded":"2023-11-04T15:37:04.720156+0000","last_fullsized":"2023-11-04T15:37:04.720156+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"40'3558","reported_seq":2955,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:19.665748+0000","last_change":"2023-11-04T15:37:19.665851+0000","last_active":"2023-11-04T15:37:19.665748+0000","last_peered":"2023-11-04T15:37:19.665748+0000","last_clean":"2023-11-04T15:37:19.665748+0000","last_became_active":"2023-11-04T15:27:36.139707+0000","last_became_peered":"2023-11-04T15:27:36.139707+0000","last_unstale":"2023-11-04T15:37:19.665748+0000","last_undegraded":"2023-11-04T15:37:19.665748+0000","last_fullsized":"2023-11-04T15:37:19.665748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3558","last_scrub_stamp":"2023-11-04T15:37:19.665726+0000","last_deep_scrub":"40'3558","last_deep_scrub_stamp":"2023-11-04T15:37:19.665726+0000","last_clean_scrub_stamp":"2023-11-04T15:37:19.665726+0000","objects_scrubbed":0,"log_size":3558,"log_dups_size":0,"ondisk_log_size":3558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:24:54.436304+0000","scrub_duration":0.0061987099999999996,"objects_trimmed":0,"snaptrim_duration":0.073815121999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"37'1214","reported_seq":1255,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.721285+0000","last_change":"2023-11-04T15:27:35.768818+0000","last_active":"2023-11-04T15:37:04.721285+0000","last_peered":"2023-11-04T15:37:04.721285+0000","last_clean":"2023-11-04T15:37:04.721285+0000","last_became_active":"2023-11-04T15:27:35.768320+0000","last_became_peered":"2023-11-04T15:27:35.768320+0000","last_unstale":"2023-11-04T15:37:04.721285+0000","last_undegraded":"2023-11-04T15:37:04.721285+0000","last_fullsized":"2023-11-04T15:37:04.721285+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1214,"log_dups_size":0,"ondisk_log_size":1214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1211,"num_write_kb":18003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":44,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720403+0000","last_change":"2023-11-04T15:27:31.624625+0000","last_active":"2023-11-04T15:37:04.720403+0000","last_peered":"2023-11-04T15:37:04.720403+0000","last_clean":"2023-11-04T15:37:04.720403+0000","last_became_active":"2023-11-04T15:27:31.624347+0000","last_became_peered":"2023-11-04T15:27:31.624347+0000","last_unstale":"2023-11-04T15:37:04.720403+0000","last_undegraded":"2023-11-04T15:37:04.720403+0000","last_fullsized":"2023-11-04T15:37:04.720403+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"40'3608","reported_seq":3013,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795024+0000","last_change":"2023-11-04T15:36:55.791977+0000","last_active":"2023-11-04T15:37:04.795024+0000","last_peered":"2023-11-04T15:37:04.795024+0000","last_clean":"2023-11-04T15:37:04.795024+0000","last_became_active":"2023-11-04T15:27:36.137897+0000","last_became_peered":"2023-11-04T15:27:36.137897+0000","last_unstale":"2023-11-04T15:37:04.795024+0000","last_undegraded":"2023-11-04T15:37:04.795024+0000","last_fullsized":"2023-11-04T15:37:04.795024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3608,"log_dups_size":0,"ondisk_log_size":3608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.069534850999999995,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"44'829","reported_seq":870,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:06.226281+0000","last_change":"2023-11-04T15:27:35.772416+0000","last_active":"2023-11-04T15:37:06.226281+0000","last_peered":"2023-11-04T15:37:06.226281+0000","last_clean":"2023-11-04T15:37:06.226281+0000","last_became_active":"2023-11-04T15:27:35.772121+0000","last_became_peered":"2023-11-04T15:27:35.772121+0000","last_unstale":"2023-11-04T15:37:06.226281+0000","last_undegraded":"2023-11-04T15:37:06.226281+0000","last_fullsized":"2023-11-04T15:37:06.226281+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":960,"num_write_kb":25976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719859+0000","last_change":"2023-11-04T15:27:31.620235+0000","last_active":"2023-11-04T15:37:04.719859+0000","last_peered":"2023-11-04T15:37:04.719859+0000","last_clean":"2023-11-04T15:37:04.719859+0000","last_became_active":"2023-11-04T15:27:31.619831+0000","last_became_peered":"2023-11-04T15:27:31.619831+0000","last_unstale":"2023-11-04T15:37:04.719859+0000","last_undegraded":"2023-11-04T15:37:04.719859+0000","last_fullsized":"2023-11-04T15:37:04.719859+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"44'3481","reported_seq":2936,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:10.702812+0000","last_change":"2023-11-04T15:37:10.702911+0000","last_active":"2023-11-04T15:37:10.702812+0000","last_peered":"2023-11-04T15:37:10.702812+0000","last_clean":"2023-11-04T15:37:10.702812+0000","last_became_active":"2023-11-04T15:27:36.140871+0000","last_became_peered":"2023-11-04T15:27:36.140871+0000","last_unstale":"2023-11-04T15:37:10.702812+0000","last_undegraded":"2023-11-04T15:37:10.702812+0000","last_fullsized":"2023-11-04T15:37:10.702812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3481","last_scrub_stamp":"2023-11-04T15:37:10.702789+0000","last_deep_scrub":"44'3481","last_deep_scrub_stamp":"2023-11-04T15:37:10.702789+0000","last_clean_scrub_stamp":"2023-11-04T15:37:10.702789+0000","objects_scrubbed":1,"log_size":3481,"log_dups_size":0,"ondisk_log_size":3481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:23:02.723895+0000","scrub_duration":0.008399541,"objects_trimmed":0,"snaptrim_duration":0.058381362999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"40'3644","reported_seq":3059,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:22.638939+0000","last_change":"2023-11-04T15:37:22.639061+0000","last_active":"2023-11-04T15:37:22.638939+0000","last_peered":"2023-11-04T15:37:22.638939+0000","last_clean":"2023-11-04T15:37:22.638939+0000","last_became_active":"2023-11-04T15:27:36.139487+0000","last_became_peered":"2023-11-04T15:27:36.139487+0000","last_unstale":"2023-11-04T15:37:22.638939+0000","last_undegraded":"2023-11-04T15:37:22.638939+0000","last_fullsized":"2023-11-04T15:37:22.638939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3644","last_scrub_stamp":"2023-11-04T15:37:22.638916+0000","last_deep_scrub":"40'3644","last_deep_scrub_stamp":"2023-11-04T15:37:22.638916+0000","last_clean_scrub_stamp":"2023-11-04T15:37:22.638916+0000","objects_scrubbed":0,"log_size":3644,"log_dups_size":0,"ondisk_log_size":3644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:37:19.090917+0000","scrub_duration":0.0049130600000000003,"objects_trimmed":0,"snaptrim_duration":0.056621590999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"44'2771","reported_seq":2812,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:06.774921+0000","last_change":"2023-11-04T15:27:35.775665+0000","last_active":"2023-11-04T15:37:06.774921+0000","last_peered":"2023-11-04T15:37:06.774921+0000","last_clean":"2023-11-04T15:37:06.774921+0000","last_became_active":"2023-11-04T15:27:35.775356+0000","last_became_peered":"2023-11-04T15:27:35.775356+0000","last_unstale":"2023-11-04T15:37:06.774921+0000","last_undegraded":"2023-11-04T15:37:06.774921+0000","last_fullsized":"2023-11-04T15:37:06.774921+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2771,"log_dups_size":0,"ondisk_log_size":2771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2770,"num_write_kb":31342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"40'3525","reported_seq":2933,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719969+0000","last_change":"2023-11-04T15:36:55.781878+0000","last_active":"2023-11-04T15:37:04.719969+0000","last_peered":"2023-11-04T15:37:04.719969+0000","last_clean":"2023-11-04T15:37:04.719969+0000","last_became_active":"2023-11-04T15:27:36.146464+0000","last_became_peered":"2023-11-04T15:27:36.146464+0000","last_unstale":"2023-11-04T15:37:04.719969+0000","last_undegraded":"2023-11-04T15:37:04.719969+0000","last_fullsized":"2023-11-04T15:37:04.719969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3525,"log_dups_size":0,"ondisk_log_size":3525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.064516859999999995,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"43'3742","reported_seq":3783,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.150547+0000","last_change":"2023-11-04T15:27:35.770401+0000","last_active":"2023-11-04T15:37:07.150547+0000","last_peered":"2023-11-04T15:37:07.150547+0000","last_clean":"2023-11-04T15:37:07.150547+0000","last_became_active":"2023-11-04T15:27:35.769904+0000","last_became_peered":"2023-11-04T15:27:35.769904+0000","last_unstale":"2023-11-04T15:37:07.150547+0000","last_undegraded":"2023-11-04T15:37:07.150547+0000","last_fullsized":"2023-11-04T15:37:07.150547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3742,"log_dups_size":0,"ondisk_log_size":3742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3740,"num_write_kb":21755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"40'3554","reported_seq":3595,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.150549+0000","last_change":"2023-11-04T15:27:35.768689+0000","last_active":"2023-11-04T15:37:07.150549+0000","last_peered":"2023-11-04T15:37:07.150549+0000","last_clean":"2023-11-04T15:37:07.150549+0000","last_became_active":"2023-11-04T15:27:35.768413+0000","last_became_peered":"2023-11-04T15:27:35.768413+0000","last_unstale":"2023-11-04T15:37:07.150549+0000","last_undegraded":"2023-11-04T15:37:07.150549+0000","last_fullsized":"2023-11-04T15:37:07.150549+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3554,"log_dups_size":0,"ondisk_log_size":3554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3537,"num_write_kb":29647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"40'3937","reported_seq":3321,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795082+0000","last_change":"2023-11-04T15:36:55.790992+0000","last_active":"2023-11-04T15:37:04.795082+0000","last_peered":"2023-11-04T15:37:04.795082+0000","last_clean":"2023-11-04T15:37:04.795082+0000","last_became_active":"2023-11-04T15:27:36.139524+0000","last_became_peered":"2023-11-04T15:27:36.139524+0000","last_unstale":"2023-11-04T15:37:04.795082+0000","last_undegraded":"2023-11-04T15:37:04.795082+0000","last_fullsized":"2023-11-04T15:37:04.795082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3937,"log_dups_size":0,"ondisk_log_size":3937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.068494678000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1248,"num_write_kb":670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"37'1637","reported_seq":1678,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:06.226344+0000","last_change":"2023-11-04T15:27:35.776242+0000","last_active":"2023-11-04T15:37:06.226344+0000","last_peered":"2023-11-04T15:37:06.226344+0000","last_clean":"2023-11-04T15:37:06.226344+0000","last_became_active":"2023-11-04T15:27:35.775917+0000","last_became_peered":"2023-11-04T15:27:35.775917+0000","last_unstale":"2023-11-04T15:37:06.226344+0000","last_undegraded":"2023-11-04T15:37:06.226344+0000","last_fullsized":"2023-11-04T15:37:06.226344+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1637,"log_dups_size":0,"ondisk_log_size":1637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1634,"num_write_kb":25426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"44'3473","reported_seq":2906,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:21.407271+0000","last_change":"2023-11-04T15:37:21.407382+0000","last_active":"2023-11-04T15:37:21.407271+0000","last_peered":"2023-11-04T15:37:21.407271+0000","last_clean":"2023-11-04T15:37:21.407271+0000","last_became_active":"2023-11-04T15:27:36.150557+0000","last_became_peered":"2023-11-04T15:27:36.150557+0000","last_unstale":"2023-11-04T15:37:21.407271+0000","last_undegraded":"2023-11-04T15:37:21.407271+0000","last_fullsized":"2023-11-04T15:37:21.407271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3473","last_scrub_stamp":"2023-11-04T15:37:21.407243+0000","last_deep_scrub":"44'3473","last_deep_scrub_stamp":"2023-11-04T15:37:21.407243+0000","last_clean_scrub_stamp":"2023-11-04T15:37:21.407243+0000","objects_scrubbed":1,"log_size":3473,"log_dups_size":0,"ondisk_log_size":3473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:18:27.087972+0000","scrub_duration":0.0082048629999999997,"objects_trimmed":0,"snaptrim_duration":0.062631718000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"40'3228","reported_seq":2711,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719603+0000","last_change":"2023-11-04T15:36:55.826604+0000","last_active":"2023-11-04T15:37:04.719603+0000","last_peered":"2023-11-04T15:37:04.719603+0000","last_clean":"2023-11-04T15:37:04.719603+0000","last_became_active":"2023-11-04T15:27:36.149831+0000","last_became_peered":"2023-11-04T15:27:36.149831+0000","last_unstale":"2023-11-04T15:37:04.719603+0000","last_undegraded":"2023-11-04T15:37:04.719603+0000","last_fullsized":"2023-11-04T15:37:04.719603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3228,"log_dups_size":0,"ondisk_log_size":3228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.103639325,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1060,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"44'4779","reported_seq":4831,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:19.478819+0000","last_change":"2023-11-04T15:37:19.478909+0000","last_active":"2023-11-04T15:37:19.478819+0000","last_peered":"2023-11-04T15:37:19.478819+0000","last_clean":"2023-11-04T15:37:19.478819+0000","last_became_active":"2023-11-04T15:27:35.770022+0000","last_became_peered":"2023-11-04T15:27:35.770022+0000","last_unstale":"2023-11-04T15:37:19.478819+0000","last_undegraded":"2023-11-04T15:37:19.478819+0000","last_fullsized":"2023-11-04T15:37:19.478819+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4779","last_scrub_stamp":"2023-11-04T15:37:19.478796+0000","last_deep_scrub":"44'4779","last_deep_scrub_stamp":"2023-11-04T15:37:19.478796+0000","last_clean_scrub_stamp":"2023-11-04T15:37:19.478796+0000","objects_scrubbed":7,"log_size":4779,"log_dups_size":0,"ondisk_log_size":4779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:24.515597+0000","scrub_duration":0.083030119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28974830,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4772,"num_write_kb":50744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"43'3333","reported_seq":2777,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795929+0000","last_change":"2023-11-04T15:36:55.797686+0000","last_active":"2023-11-04T15:37:04.795929+0000","last_peered":"2023-11-04T15:37:04.795929+0000","last_clean":"2023-11-04T15:37:04.795929+0000","last_became_active":"2023-11-04T15:27:36.138908+0000","last_became_peered":"2023-11-04T15:27:36.138908+0000","last_unstale":"2023-11-04T15:37:04.795929+0000","last_undegraded":"2023-11-04T15:37:04.795929+0000","last_fullsized":"2023-11-04T15:37:04.795929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3333,"log_dups_size":0,"ondisk_log_size":3333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.073000567000000002,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":1157,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"44'784","reported_seq":836,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:23.362195+0000","last_change":"2023-11-04T15:37:23.362327+0000","last_active":"2023-11-04T15:37:23.362195+0000","last_peered":"2023-11-04T15:37:23.362195+0000","last_clean":"2023-11-04T15:37:23.362195+0000","last_became_active":"2023-11-04T15:27:35.767858+0000","last_became_peered":"2023-11-04T15:27:35.767858+0000","last_unstale":"2023-11-04T15:37:23.362195+0000","last_undegraded":"2023-11-04T15:37:23.362195+0000","last_fullsized":"2023-11-04T15:37:23.362195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'784","last_scrub_stamp":"2023-11-04T15:37:23.362171+0000","last_deep_scrub":"44'784","last_deep_scrub_stamp":"2023-11-04T15:37:23.362171+0000","last_clean_scrub_stamp":"2023-11-04T15:37:23.362171+0000","objects_scrubbed":4,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:37.029904+0000","scrub_duration":0.042357839000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":779,"num_write_kb":20966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"40'3359","reported_seq":2783,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795890+0000","last_change":"2023-11-04T15:36:55.795596+0000","last_active":"2023-11-04T15:37:04.795890+0000","last_peered":"2023-11-04T15:37:04.795890+0000","last_clean":"2023-11-04T15:37:04.795890+0000","last_became_active":"2023-11-04T15:27:36.143442+0000","last_became_peered":"2023-11-04T15:27:36.143442+0000","last_unstale":"2023-11-04T15:37:04.795890+0000","last_undegraded":"2023-11-04T15:37:04.795890+0000","last_fullsized":"2023-11-04T15:37:04.795890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3359,"log_dups_size":0,"ondisk_log_size":3359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072078296,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1167,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"37'3778","reported_seq":3818,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719025+0000","last_change":"2023-11-04T15:27:35.771653+0000","last_active":"2023-11-04T15:37:04.719025+0000","last_peered":"2023-11-04T15:37:04.719025+0000","last_clean":"2023-11-04T15:37:04.719025+0000","last_became_active":"2023-11-04T15:27:35.770539+0000","last_became_peered":"2023-11-04T15:27:35.770539+0000","last_unstale":"2023-11-04T15:37:04.719025+0000","last_undegraded":"2023-11-04T15:37:04.719025+0000","last_fullsized":"2023-11-04T15:37:04.719025+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3778,"log_dups_size":0,"ondisk_log_size":3778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3770,"num_write_kb":38321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"40'3791","reported_seq":3146,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720519+0000","last_change":"2023-11-04T15:36:55.780664+0000","last_active":"2023-11-04T15:37:04.720519+0000","last_peered":"2023-11-04T15:37:04.720519+0000","last_clean":"2023-11-04T15:37:04.720519+0000","last_became_active":"2023-11-04T15:27:36.146477+0000","last_became_peered":"2023-11-04T15:27:36.146477+0000","last_unstale":"2023-11-04T15:37:04.720519+0000","last_undegraded":"2023-11-04T15:37:04.720519+0000","last_fullsized":"2023-11-04T15:37:04.720519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3791,"log_dups_size":0,"ondisk_log_size":3791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063144525000000007,"stat_sum":{"num_bytes":8192,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1270,"num_write_kb":694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"40'2943","reported_seq":2983,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795928+0000","last_change":"2023-11-04T15:27:35.772092+0000","last_active":"2023-11-04T15:37:04.795928+0000","last_peered":"2023-11-04T15:37:04.795928+0000","last_clean":"2023-11-04T15:37:04.795928+0000","last_became_active":"2023-11-04T15:27:35.771316+0000","last_became_peered":"2023-11-04T15:27:35.771316+0000","last_unstale":"2023-11-04T15:37:04.795928+0000","last_undegraded":"2023-11-04T15:37:04.795928+0000","last_fullsized":"2023-11-04T15:37:04.795928+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2943,"log_dups_size":0,"ondisk_log_size":2943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2943,"num_write_kb":28401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"44'3597","reported_seq":3018,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:09.670925+0000","last_change":"2023-11-04T15:37:09.671026+0000","last_active":"2023-11-04T15:37:09.670925+0000","last_peered":"2023-11-04T15:37:09.670925+0000","last_clean":"2023-11-04T15:37:09.670925+0000","last_became_active":"2023-11-04T15:27:36.144066+0000","last_became_peered":"2023-11-04T15:27:36.144066+0000","last_unstale":"2023-11-04T15:37:09.670925+0000","last_undegraded":"2023-11-04T15:37:09.670925+0000","last_fullsized":"2023-11-04T15:37:09.670925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3597","last_scrub_stamp":"2023-11-04T15:37:09.670901+0000","last_deep_scrub":"44'3597","last_deep_scrub_stamp":"2023-11-04T15:37:09.670901+0000","last_clean_scrub_stamp":"2023-11-04T15:37:09.670901+0000","objects_scrubbed":2,"log_size":3597,"log_dups_size":0,"ondisk_log_size":3597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T22:52:59.961460+0000","scrub_duration":0.010082327,"objects_trimmed":0,"snaptrim_duration":0.057889772999999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1118,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"41'926","reported_seq":966,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718593+0000","last_change":"2023-11-04T15:27:35.768679+0000","last_active":"2023-11-04T15:37:04.718593+0000","last_peered":"2023-11-04T15:37:04.718593+0000","last_clean":"2023-11-04T15:37:04.718593+0000","last_became_active":"2023-11-04T15:27:35.767852+0000","last_became_peered":"2023-11-04T15:27:35.767852+0000","last_unstale":"2023-11-04T15:37:04.718593+0000","last_undegraded":"2023-11-04T15:37:04.718593+0000","last_fullsized":"2023-11-04T15:37:04.718593+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":926,"log_dups_size":0,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":923,"num_write_kb":21087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"40'3552","reported_seq":2973,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718664+0000","last_change":"2023-11-04T15:36:55.776553+0000","last_active":"2023-11-04T15:37:04.718664+0000","last_peered":"2023-11-04T15:37:04.718664+0000","last_clean":"2023-11-04T15:37:04.718664+0000","last_became_active":"2023-11-04T15:27:36.141167+0000","last_became_peered":"2023-11-04T15:27:36.141167+0000","last_unstale":"2023-11-04T15:37:04.718664+0000","last_undegraded":"2023-11-04T15:37:04.718664+0000","last_fullsized":"2023-11-04T15:37:04.718664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3552,"log_dups_size":0,"ondisk_log_size":3552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057363947999999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1127,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"37'3225","reported_seq":3265,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719857+0000","last_change":"2023-11-04T15:27:35.775629+0000","last_active":"2023-11-04T15:37:04.719857+0000","last_peered":"2023-11-04T15:37:04.719857+0000","last_clean":"2023-11-04T15:37:04.719857+0000","last_became_active":"2023-11-04T15:27:35.775171+0000","last_became_peered":"2023-11-04T15:27:35.775171+0000","last_unstale":"2023-11-04T15:37:04.719857+0000","last_undegraded":"2023-11-04T15:37:04.719857+0000","last_fullsized":"2023-11-04T15:37:04.719857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3225,"log_dups_size":0,"ondisk_log_size":3225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3214,"num_write_kb":42509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"44'3490","reported_seq":2947,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:09.749095+0000","last_change":"2023-11-04T15:37:09.749095+0000","last_active":"2023-11-04T15:37:09.749095+0000","last_peered":"2023-11-04T15:37:09.749095+0000","last_clean":"2023-11-04T15:37:09.749095+0000","last_became_active":"2023-11-04T15:27:36.145560+0000","last_became_peered":"2023-11-04T15:27:36.145560+0000","last_unstale":"2023-11-04T15:37:09.749095+0000","last_undegraded":"2023-11-04T15:37:09.749095+0000","last_fullsized":"2023-11-04T15:37:09.749095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3490","last_scrub_stamp":"2023-11-04T15:37:09.748973+0000","last_deep_scrub":"44'3490","last_deep_scrub_stamp":"2023-11-04T15:37:09.748973+0000","last_clean_scrub_stamp":"2023-11-04T15:37:09.748973+0000","objects_scrubbed":5,"log_size":3490,"log_dups_size":0,"ondisk_log_size":3490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:31.358580+0000","scrub_duration":0.011863093,"objects_trimmed":0,"snaptrim_duration":0.07011676,"stat_sum":{"num_bytes":4151,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":1159,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"40'4214","reported_seq":4255,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.796095+0000","last_change":"2023-11-04T15:27:35.771225+0000","last_active":"2023-11-04T15:37:04.796095+0000","last_peered":"2023-11-04T15:37:04.796095+0000","last_clean":"2023-11-04T15:37:04.796095+0000","last_became_active":"2023-11-04T15:27:35.770873+0000","last_became_peered":"2023-11-04T15:27:35.770873+0000","last_unstale":"2023-11-04T15:37:04.796095+0000","last_undegraded":"2023-11-04T15:37:04.796095+0000","last_fullsized":"2023-11-04T15:37:04.796095+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":4214,"log_dups_size":0,"ondisk_log_size":4214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4214,"num_write_kb":32525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"44'4092","reported_seq":3407,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:13.735284+0000","last_change":"2023-11-04T15:37:13.735284+0000","last_active":"2023-11-04T15:37:13.735284+0000","last_peered":"2023-11-04T15:37:13.735284+0000","last_clean":"2023-11-04T15:37:13.735284+0000","last_became_active":"2023-11-04T15:27:36.147535+0000","last_became_peered":"2023-11-04T15:27:36.147535+0000","last_unstale":"2023-11-04T15:37:13.735284+0000","last_undegraded":"2023-11-04T15:37:13.735284+0000","last_fullsized":"2023-11-04T15:37:13.735284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4092","last_scrub_stamp":"2023-11-04T15:37:13.735159+0000","last_deep_scrub":"44'4092","last_deep_scrub_stamp":"2023-11-04T15:37:13.735159+0000","last_clean_scrub_stamp":"2023-11-04T15:37:13.735159+0000","objects_scrubbed":2,"log_size":4092,"log_dups_size":0,"ondisk_log_size":4092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:20:39.611539+0000","scrub_duration":0.012119325,"objects_trimmed":0,"snaptrim_duration":0.055801837,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1294,"num_write_kb":719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"40'1589","reported_seq":1630,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795958+0000","last_change":"2023-11-04T15:27:35.776315+0000","last_active":"2023-11-04T15:37:04.795958+0000","last_peered":"2023-11-04T15:37:04.795958+0000","last_clean":"2023-11-04T15:37:04.795958+0000","last_became_active":"2023-11-04T15:27:35.775918+0000","last_became_peered":"2023-11-04T15:27:35.775918+0000","last_unstale":"2023-11-04T15:37:04.795958+0000","last_undegraded":"2023-11-04T15:37:04.795958+0000","last_fullsized":"2023-11-04T15:37:04.795958+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1589,"log_dups_size":0,"ondisk_log_size":1589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1587,"num_write_kb":12658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":127433,"num_objects":92,"num_object_clones":25,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":8,"num_read":46,"num_read_kb":30,"num_write":74822,"num_write_kb":40603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":254672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224318,"ondisk_log_size":224318,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":430735581,"num_objects":126,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":126,"num_whiteouts":0,"num_read":190,"num_read_kb":3338,"num_write":83456,"num_write_kb":897544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":861528064,"data_stored":861471162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83087,"ondisk_log_size":83087,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705788,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":659552,"kb_used_data":173208,"kb_used_omap":0,"kb_used_meta":486336,"kb_avail":93712288,"statfs":{"total":96636764160,"available":95961382912,"internally_reserved":0,"allocated":177364992,"data_stored":176999461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":498008064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.435,"15min":0.40000000000000002},"min":{"1min":0.23000000000000001,"5min":0.17000000000000001,"15min":0.156},"max":{"1min":10.488,"5min":10.488,"15min":10.488},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.0509999999999999,"5min":0.58399999999999996,"15min":0.45500000000000002},"min":{"1min":0.21199999999999999,"5min":0.186,"15min":0.186},"max":{"1min":11.621,"5min":13.055,"15min":13.055},"last":0.54100000000000004}]},{"osd":1,"last update":"Sat Nov 4 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.496,"15min":0.433},"min":{"1min":0.219,"5min":0.188,"15min":0.188},"max":{"1min":12.347,"5min":12.347,"15min":12.347},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.48999999999999999,"15min":0.438},"min":{"1min":0.23699999999999999,"5min":0.21299999999999999,"15min":0.186},"max":{"1min":12.853999999999999,"5min":12.853999999999999,"15min":12.853999999999999},"last":0.65100000000000002}]},{"osd":2,"last update":"Sat Nov 4 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.41299999999999998,"15min":0.34499999999999997},"min":{"1min":0.16900000000000001,"5min":0.153,"15min":0.153},"max":{"1min":11.709,"5min":11.709,"15min":11.709},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.40300000000000002,"15min":0.35599999999999998},"min":{"1min":0.19500000000000001,"5min":0.14899999999999999,"15min":0.14899999999999999},"max":{"1min":9.2629999999999999,"5min":9.2629999999999999,"15min":9.2629999999999999},"last":0.46700000000000003}]}]},{"osd":2,"up_from":9,"seq":38654705787,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":952424,"kb_used_data":245472,"kb_used_omap":0,"kb_used_meta":706944,"kb_avail":93419416,"statfs":{"total":96636764160,"available":95661481984,"internally_reserved":0,"allocated":251363328,"data_stored":250991590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":723910656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 15:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.41199999999999998,"15min":0.40100000000000002},"min":{"1min":0.20499999999999999,"5min":0.153,"15min":0.151},"max":{"1min":0.52900000000000003,"5min":14.584,"15min":14.584},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.35799999999999998,"15min":0.376},"min":{"1min":0.22,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.45600000000000002,"5min":7.2670000000000003,"15min":7.2670000000000003},"last":0.56399999999999995}]},{"osd":1,"last update":"Sat Nov 4 15:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32700000000000001,"15min":0.39000000000000001},"min":{"1min":0.23499999999999999,"5min":0.185,"15min":0.17100000000000001},"max":{"1min":0.48399999999999999,"5min":0.877,"15min":1.266},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.34699999999999998,"15min":0.40899999999999997},"min":{"1min":0.27500000000000002,"5min":0.20899999999999999,"15min":0.20399999999999999},"max":{"1min":0.54100000000000004,"5min":0.88600000000000001,"15min":1.2829999999999999},"last":0.59799999999999998}]},{"osd":3,"last update":"Sat Nov 4 15:36:44 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.28000000000000003,"15min":0.314},"min":{"1min":0.23699999999999999,"5min":0.14999999999999999,"15min":0.14699999999999999},"max":{"1min":0.41399999999999998,"5min":1.653,"15min":1.653},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.30599999999999999,"15min":0.34000000000000002},"min":{"1min":0.23000000000000001,"5min":0.159,"15min":0.14899999999999999},"max":{"1min":0.501,"5min":0.52400000000000002,"15min":1.304},"last":0.42699999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705786,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":715176,"kb_used_data":188640,"kb_used_omap":0,"kb_used_meta":526528,"kb_avail":93656664,"statfs":{"total":96636764160,"available":95904423936,"internally_reserved":0,"allocated":193167360,"data_stored":192807863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":539164672},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.40699999999999997,"15min":0.318},"min":{"1min":0.17100000000000001,"5min":0.14399999999999999,"15min":0.14399999999999999},"max":{"1min":1.012,"5min":12.768000000000001,"15min":12.768000000000001},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.248,"5min":0.30399999999999999,"15min":0.29499999999999998},"min":{"1min":0.19,"5min":0.14399999999999999,"15min":0.14399999999999999},"max":{"1min":0.377,"5min":8.609,"15min":8.609},"last":0.35999999999999999}]},{"osd":2,"last update":"Sat Nov 4 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.40400000000000003,"15min":0.44},"min":{"1min":0.28499999999999998,"5min":0.19600000000000001,"15min":0.189},"max":{"1min":1.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.39000000000000001,"15min":0.42399999999999999},"min":{"1min":0.29599999999999999,"5min":0.19600000000000001,"15min":0.192},"max":{"1min":0.98199999999999998,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.52800000000000002}]},{"osd":3,"last update":"Sat Nov 4 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.42099999999999999,"15min":0.438},"min":{"1min":0.309,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.65200000000000002,"5min":6.7679999999999998,"15min":6.7679999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.41999999999999998,"15min":0.45000000000000001},"min":{"1min":0.32100000000000001,"5min":0.249,"15min":0.24299999999999999},"max":{"1min":1.446,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.56699999999999995}]}]},{"osd":0,"up_from":9,"seq":38654705787,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":918208,"kb_used_data":237496,"kb_used_omap":0,"kb_used_meta":680704,"kb_avail":93453632,"statfs":{"total":96636764160,"available":95696519168,"internally_reserved":0,"allocated":243195904,"data_stored":242832608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":697040896},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 15:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.312,"15min":0.27900000000000003},"min":{"1min":0.14999999999999999,"5min":0.14399999999999999,"15min":0.13500000000000001},"max":{"1min":4.4059999999999997,"5min":6.4340000000000002,"15min":6.4340000000000002},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.28000000000000003,"15min":0.27500000000000002},"min":{"1min":0.17299999999999999,"5min":0.155,"15min":0.155},"max":{"1min":1.1299999999999999,"5min":4.1200000000000001,"15min":4.1200000000000001},"last":0.30299999999999999}]},{"osd":2,"last update":"Sat Nov 4 15:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.40400000000000003,"15min":0.42599999999999999},"min":{"1min":0.251,"5min":0.17999999999999999,"15min":0.17599999999999999},"max":{"1min":2.5129999999999999,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.371,"15min":0.41899999999999998},"min":{"1min":0.28000000000000003,"5min":0.187,"15min":0.187},"max":{"1min":1.157,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.48099999999999998}]},{"osd":3,"last update":"Sat Nov 4 15:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.438,"15min":0.443},"min":{"1min":0.23899999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":2.6520000000000001,"5min":6.4660000000000002,"15min":6.4660000000000002},"last":0.505},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.44600000000000001,"15min":0.44800000000000001},"min":{"1min":0.26800000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":2.621,"5min":6.3540000000000001,"15min":6.3540000000000001},"last":0.44800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":242003968,"data_stored":241991173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":192552960,"data_stored":192552686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":250785792,"data_stored":250765155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":176185344,"data_stored":176162148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":69829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":73939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":45197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":65707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T15:37:28.321 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.321 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.322 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.322 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.322 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.323 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.323 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.323 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.323 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.324 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.324 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.324 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.325 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.325 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.325 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.325 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.326 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.326 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.326 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.327 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.327 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.327 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.328 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.328 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.328 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.328 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.329 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.329 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.329 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.330 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.330 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.330 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.330 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.331 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.331 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.331 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.332 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.332 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.332 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.333 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.333 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.333 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.334 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.334 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.334 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.334 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.335 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.335 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.335 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-04T15:27:25.163848+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=25, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.336 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-04T15:27:30.611946+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.336 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.336 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.337 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-04T15:27:30.611946+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.337 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.337 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-04T15:27:30.611946+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.337 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.338 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-04T15:27:30.611946+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.338 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.338 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.339 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-04T15:27:30.611946+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.339 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.339 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-04T15:27:30.611946+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.339 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.340 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-04T15:27:30.611946+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.340 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.340 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.341 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-04T15:27:30.611946+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.341 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.341 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.342 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.342 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.342 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.342 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.343 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.343 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.343 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.344 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.344 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.344 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.345 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.345 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.345 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.345 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.346 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:28.346 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-04T15:37:33.829 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:37:33.832 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:37:33.835 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:37:48.347 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T15:37:48.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.464+0000 7fa9c284b640 1 Processor -- start 2023-11-04T15:37:48.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.464+0000 7fa9c284b640 1 -- start start 2023-11-04T15:37:48.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.465+0000 7fa9c284b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa9bc137270 0x7fa9bc0a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:48.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.465+0000 7fa9c284b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9bc0a4c20 con 0x7fa9bc137650 2023-11-04T15:37:48.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.465+0000 7fa9c284b640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9bc13ad80 con 0x7fa9bc0a3e90 2023-11-04T15:37:48.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.465+0000 7fa9c284b640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9bc0a3060 con 0x7fa9bc137270 2023-11-04T15:37:48.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.465+0000 7fa9c0de8640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa9bc137650 0x7fa9bc13a670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:51484/0 (socket says 172.21.15.19:51484) 2023-11-04T15:37:48.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.465+0000 7fa9c0de8640 1 -- 172.21.15.19:0/3768778867 learned_addr learned my addr 172.21.15.19:0/3768778867 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:37:48.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.466+0000 7fa9baffd640 1 -- 172.21.15.19:0/3768778867 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3726004247 0 0) 0x7fa9bc0a4c20 con 0x7fa9bc137650 2023-11-04T15:37:48.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.466+0000 7fa9bbfff640 1 --2- 172.21.15.19:0/3768778867 >> v2:172.21.15.96:3300/0 conn(0x7fa9bc137270 0x7fa9bc0a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:48.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.466+0000 7fa9baffd640 1 -- 172.21.15.19:0/3768778867 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9a4003520 con 0x7fa9bc137650 2023-11-04T15:37:48.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.466+0000 7fa9baffd640 1 -- 172.21.15.19:0/3768778867 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1922064781 0 0) 0x7fa9a4003520 con 0x7fa9bc137650 2023-11-04T15:37:48.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.466+0000 7fa9baffd640 1 -- 172.21.15.19:0/3768778867 >> v2:172.21.15.96:3300/0 conn(0x7fa9bc137270 msgr2=0x7fa9bc0a6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:48.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.466+0000 7fa9baffd640 1 --2- 172.21.15.19:0/3768778867 >> v2:172.21.15.96:3300/0 conn(0x7fa9bc137270 0x7fa9bc0a6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:48.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.466+0000 7fa9baffd640 1 -- 172.21.15.19:0/3768778867 >> v1:172.21.15.96:6789/0 conn(0x7fa9bc0a3e90 legacy=0x7fa9bc139f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:48.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.466+0000 7fa9baffd640 1 -- 172.21.15.19:0/3768778867 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9bc0a5080 con 0x7fa9bc137650 2023-11-04T15:37:48.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.466+0000 7fa9baffd640 1 -- 172.21.15.19:0/3768778867 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3646097784 0 0) 0x7fa9b40019f0 con 0x7fa9bc137650 2023-11-04T15:37:48.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.466+0000 7fa9baffd640 1 -- 172.21.15.19:0/3768778867 >> v1:172.21.15.19:6789/0 conn(0x7fa9bc137650 legacy=0x7fa9bc13a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:48.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.466+0000 7fa9baffd640 1 --2- 172.21.15.19:0/3768778867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a4003970 0x7fa9a4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:48.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.466+0000 7fa9baffd640 1 --2- 172.21.15.19:0/3768778867 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9a40047c0 0x7fa9a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:48.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.466+0000 7fa9baffd640 1 --2- 172.21.15.19:0/3768778867 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9a40052a0 0x7fa9a400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:48.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.466+0000 7fa9baffd640 1 -- 172.21.15.19:0/3768778867 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9bc0a3060 con 0x7fa9a40052a0 2023-11-04T15:37:48.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.466+0000 7fa9baffd640 1 -- 172.21.15.19:0/3768778867 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a400c170 con 0x7fa9a4003970 2023-11-04T15:37:48.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.466+0000 7fa9baffd640 1 -- 172.21.15.19:0/3768778867 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a400c330 con 0x7fa9a40047c0 2023-11-04T15:37:48.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.466+0000 7fa9bbfff640 1 --2- 172.21.15.19:0/3768778867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a4003970 0x7fa9a4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:48.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.466+0000 7fa9c0de8640 1 --2- 172.21.15.19:0/3768778867 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9a40052a0 0x7fa9a400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:48.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.466+0000 7fa9bb7fe640 1 --2- 172.21.15.19:0/3768778867 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9a40047c0 0x7fa9a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:48.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.466+0000 7fa9bbfff640 1 -- 172.21.15.19:0/3768778867 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9a40047c0 msgr2=0x7fa9a4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:48.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.466+0000 7fa9bbfff640 1 --2- 172.21.15.19:0/3768778867 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9a40047c0 0x7fa9a4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:48.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.466+0000 7fa9bbfff640 1 -- 172.21.15.19:0/3768778867 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9a40052a0 msgr2=0x7fa9a400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:37:48.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.466+0000 7fa9bbfff640 1 --2- 172.21.15.19:0/3768778867 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9a40052a0 0x7fa9a400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:48.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.466+0000 7fa9bbfff640 1 -- 172.21.15.19:0/3768778867 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a4003520 con 0x7fa9a4003970 2023-11-04T15:37:48.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.466+0000 7fa9c0de8640 1 --2- 172.21.15.19:0/3768778867 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9a40052a0 0x7fa9a400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T15:37:48.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.466+0000 7fa9c0de8640 1 -- 172.21.15.19:0/3768778867 reap_dead start 2023-11-04T15:37:48.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.467+0000 7fa9bbfff640 1 --2- 172.21.15.19:0/3768778867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a4003970 0x7fa9a4003d90 secure :-1 s=READY pgs=2765 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac009a90 tx=0x7fa9a40057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=881055153044ae2e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:48.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.467+0000 7fa9baffd640 1 -- 172.21.15.19:0/3768778867 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac02c600 con 0x7fa9a4003970 2023-11-04T15:37:48.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.467+0000 7fa9baffd640 1 -- 172.21.15.19:0/3768778867 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9ac02c760 con 0x7fa9a4003970 2023-11-04T15:37:48.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.467+0000 7fa9baffd640 1 -- 172.21.15.19:0/3768778867 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac02caf0 con 0x7fa9a4003970 2023-11-04T15:37:48.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.468+0000 7fa9c284b640 1 -- 172.21.15.19:0/3768778867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a4003970 msgr2=0x7fa9a4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:48.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.468+0000 7fa9c284b640 1 --2- 172.21.15.19:0/3768778867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a4003970 0x7fa9a4003d90 secure :-1 s=READY pgs=2765 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac009a90 tx=0x7fa9a40057f0 comp rx=0 tx=0).stop 2023-11-04T15:37:48.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.468+0000 7fa9c284b640 1 -- 172.21.15.19:0/3768778867 shutdown_connections 2023-11-04T15:37:48.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.468+0000 7fa9c284b640 1 --2- 172.21.15.19:0/3768778867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a4003970 0x7fa9a4003d90 unknown :-1 s=CLOSED pgs=2765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:48.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.468+0000 7fa9c284b640 1 -- 172.21.15.19:0/3768778867 >> 172.21.15.19:0/3768778867 conn(0x7fa9bc0a8d70 msgr2=0x7fa9bc0a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:48.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.468+0000 7fa9c284b640 1 -- 172.21.15.19:0/3768778867 shutdown_connections 2023-11-04T15:37:48.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.468+0000 7fa9c284b640 1 -- 172.21.15.19:0/3768778867 wait complete. 2023-11-04T15:37:48.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.469+0000 7fa9c284b640 1 Processor -- start 2023-11-04T15:37:48.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.469+0000 7fa9c284b640 1 -- start start 2023-11-04T15:37:48.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.470+0000 7fa9c284b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a4003970 0x7fa9bc1cee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:48.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.470+0000 7fa9c284b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9bc1cf390 0x7fa9bc1cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.470+0000 7fa9c284b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9bc098cb0 0x7fa9bc099160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.470+0000 7fa9c284b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9bc09c130 con 0x7fa9bc1cf390 2023-11-04T15:37:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.470+0000 7fa9c284b640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9bc09d7f0 con 0x7fa9a4003970 2023-11-04T15:37:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.470+0000 7fa9c284b640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9bc09b520 con 0x7fa9bc098cb0 2023-11-04T15:37:48.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.470+0000 7fa9bb7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9bc1cf390 0x7fa9bc1cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:48.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.470+0000 7fa9bb7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9bc1cf390 0x7fa9bc1cf7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46318/0 (socket says 172.21.15.19:46318) 2023-11-04T15:37:48.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.470+0000 7fa9bb7fe640 1 -- 172.21.15.19:0/4004368381 learned_addr learned my addr 172.21.15.19:0/4004368381 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:37:48.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.470+0000 7fa9bbfff640 1 --2- 172.21.15.19:0/4004368381 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a4003970 0x7fa9bc1cee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:48.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.470+0000 7fa9c0de8640 1 --2- 172.21.15.19:0/4004368381 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9bc098cb0 0x7fa9bc099160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:48.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.470+0000 7fa9bb7fe640 1 -- 172.21.15.19:0/4004368381 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9bc098cb0 msgr2=0x7fa9bc099160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:48.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.470+0000 7fa9bb7fe640 1 --2- 172.21.15.19:0/4004368381 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9bc098cb0 0x7fa9bc099160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:48.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.470+0000 7fa9bb7fe640 1 -- 172.21.15.19:0/4004368381 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a4003970 msgr2=0x7fa9bc1cee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:48.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.470+0000 7fa9bb7fe640 1 --2- 172.21.15.19:0/4004368381 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a4003970 0x7fa9bc1cee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:48.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.470+0000 7fa9bb7fe640 1 -- 172.21.15.19:0/4004368381 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9bc09c590 con 0x7fa9bc1cf390 2023-11-04T15:37:48.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.470+0000 7fa9bbfff640 1 --2- 172.21.15.19:0/4004368381 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a4003970 0x7fa9bc1cee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T15:37:48.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.470+0000 7fa9c0de8640 1 --2- 172.21.15.19:0/4004368381 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9bc098cb0 0x7fa9bc099160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T15:37:48.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.470+0000 7fa9bb7fe640 1 --2- 172.21.15.19:0/4004368381 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9bc1cf390 0x7fa9bc1cf7f0 secure :-1 s=READY pgs=3774 cs=0 l=1 rev1=1 crypto rx=0x7fa9b000f520 tx=0x7fa9b000f9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:48.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.470+0000 7fa9b8ff9640 1 -- 172.21.15.19:0/4004368381 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b00053a0 con 0x7fa9bc1cf390 2023-11-04T15:37:48.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.470+0000 7fa9b8ff9640 1 -- 172.21.15.19:0/4004368381 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b00035f0 con 0x7fa9bc1cf390 2023-11-04T15:37:48.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.470+0000 7fa9b8ff9640 1 -- 172.21.15.19:0/4004368381 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b00039a0 con 0x7fa9bc1cf390 2023-11-04T15:37:48.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.470+0000 7fa9c284b640 1 -- 172.21.15.19:0/4004368381 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9bc09c850 con 0x7fa9bc1cf390 2023-11-04T15:37:48.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.471+0000 7fa9c284b640 1 -- 172.21.15.19:0/4004368381 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9bc09d2c0 con 0x7fa9bc1cf390 2023-11-04T15:37:48.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.471+0000 7fa9c284b640 1 -- 172.21.15.19:0/4004368381 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9bc09d4e0 con 0x7fa9bc1cf390 2023-11-04T15:37:48.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.472+0000 7fa9b8ff9640 1 -- 172.21.15.19:0/4004368381 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa9b0003b00 con 0x7fa9bc1cf390 2023-11-04T15:37:48.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.472+0000 7fa9b8ff9640 1 --2- 172.21.15.19:0/4004368381 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa9a806a430 0x7fa9a806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:37:48.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.473+0000 7fa9b8ff9640 1 -- 172.21.15.19:0/4004368381 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4434+0+0 (secure 0 0 0) 0x7fa9b00880c0 con 0x7fa9bc1cf390 2023-11-04T15:37:48.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.473+0000 7fa9bbfff640 1 --2- 172.21.15.19:0/4004368381 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa9a806a430 0x7fa9a806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:37:48.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.473+0000 7fa9bbfff640 1 --2- 172.21.15.19:0/4004368381 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa9a806a430 0x7fa9a806c8f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac036000 tx=0x7fa9ac030000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:37:48.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.477+0000 7fa9b8ff9640 1 -- 172.21.15.19:0/4004368381 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa9b0053ce0 con 0x7fa9bc1cf390 2023-11-04T15:37:48.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.650+0000 7fa9c284b640 1 -- 172.21.15.19:0/4004368381 --> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa9bc0a5340 con 0x7fa9a806a430 2023-11-04T15:37:48.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.657+0000 7fa9b8ff9640 1 -- 172.21.15.19:0/4004368381 <== mgr.4114 v2:172.21.15.96:6816/83123 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277527 (secure 0 0 0) 0x7fa9ac0041c0 con 0x7fa9a806a430 2023-11-04T15:37:48.662 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:37:48.663 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-11-04T15:37:48.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.660+0000 7fa9c284b640 1 -- 172.21.15.19:0/4004368381 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa9a806a430 msgr2=0x7fa9a806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:48.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.660+0000 7fa9c284b640 1 --2- 172.21.15.19:0/4004368381 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa9a806a430 0x7fa9a806c8f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac036000 tx=0x7fa9ac030000 comp rx=0 tx=0).stop 2023-11-04T15:37:48.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.660+0000 7fa9c284b640 1 -- 172.21.15.19:0/4004368381 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9bc1cf390 msgr2=0x7fa9bc1cf7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:37:48.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.660+0000 7fa9c284b640 1 --2- 172.21.15.19:0/4004368381 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9bc1cf390 0x7fa9bc1cf7f0 secure :-1 s=READY pgs=3774 cs=0 l=1 rev1=1 crypto rx=0x7fa9b000f520 tx=0x7fa9b000f9e0 comp rx=0 tx=0).stop 2023-11-04T15:37:48.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.660+0000 7fa9c284b640 1 -- 172.21.15.19:0/4004368381 shutdown_connections 2023-11-04T15:37:48.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.660+0000 7fa9c284b640 1 --2- 172.21.15.19:0/4004368381 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa9a806a430 0x7fa9a806c8f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:48.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.660+0000 7fa9c284b640 1 --2- 172.21.15.19:0/4004368381 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9bc098cb0 0x7fa9bc099160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:48.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.660+0000 7fa9c284b640 1 --2- 172.21.15.19:0/4004368381 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9bc1cf390 0x7fa9bc1cf7f0 unknown :-1 s=CLOSED pgs=3774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:48.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.660+0000 7fa9c284b640 1 --2- 172.21.15.19:0/4004368381 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a4003970 0x7fa9bc1cee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:37:48.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.660+0000 7fa9c284b640 1 -- 172.21.15.19:0/4004368381 >> 172.21.15.19:0/4004368381 conn(0x7fa9bc0a8d70 msgr2=0x7fa9bc0aae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:37:48.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.660+0000 7fa9c284b640 1 -- 172.21.15.19:0/4004368381 shutdown_connections 2023-11-04T15:37:48.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:37:48.660+0000 7fa9c284b640 1 -- 172.21.15.19:0/4004368381 wait complete. 2023-11-04T15:37:48.673 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":352,"stamp":"2023-11-04T15:37:47.065784+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":431453382,"num_objects":220,"num_object_clones":25,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":8,"num_read":352,"num_read_kb":3468,"num_write":158437,"num_write_kb":940563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1707,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":307559,"ondisk_log_size":307559,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":3253552,"kb_used_data":844816,"kb_used_omap":0,"kb_used_meta":2408704,"kb_avail":374233808,"statfs":{"total":386547056640,"available":383215419392,"internally_reserved":0,"allocated":865091584,"data_stored":863631522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2466512896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1207,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002967"},"pg_stats":[{"pgid":"4.3f","version":"40'3514","reported_seq":2962,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:08.783037+0000","last_change":"2023-11-04T15:37:08.783192+0000","last_active":"2023-11-04T15:37:08.783037+0000","last_peered":"2023-11-04T15:37:08.783037+0000","last_clean":"2023-11-04T15:37:08.783037+0000","last_became_active":"2023-11-04T15:27:36.150296+0000","last_became_peered":"2023-11-04T15:27:36.150296+0000","last_unstale":"2023-11-04T15:37:08.783037+0000","last_undegraded":"2023-11-04T15:37:08.783037+0000","last_fullsized":"2023-11-04T15:37:08.783037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3514","last_scrub_stamp":"2023-11-04T15:37:08.783013+0000","last_deep_scrub":"40'3514","last_deep_scrub_stamp":"2023-11-04T15:37:08.783013+0000","last_clean_scrub_stamp":"2023-11-04T15:37:08.783013+0000","objects_scrubbed":0,"log_size":3514,"log_dups_size":0,"ondisk_log_size":3514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:20:34.659393+0000","scrub_duration":0.0030156520000000002,"objects_trimmed":0,"snaptrim_duration":0.074678280999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1112,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"43'3332","reported_seq":2784,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720237+0000","last_change":"2023-11-04T15:36:55.781000+0000","last_active":"2023-11-04T15:37:04.720237+0000","last_peered":"2023-11-04T15:37:04.720237+0000","last_clean":"2023-11-04T15:37:04.720237+0000","last_became_active":"2023-11-04T15:27:36.148939+0000","last_became_peered":"2023-11-04T15:27:36.148939+0000","last_unstale":"2023-11-04T15:37:04.720237+0000","last_undegraded":"2023-11-04T15:37:04.720237+0000","last_fullsized":"2023-11-04T15:37:04.720237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3332,"log_dups_size":0,"ondisk_log_size":3332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059113046000000002,"stat_sum":{"num_bytes":35,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1118,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"40'3527","reported_seq":3000,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719132+0000","last_change":"2023-11-04T15:36:55.822917+0000","last_active":"2023-11-04T15:37:04.719132+0000","last_peered":"2023-11-04T15:37:04.719132+0000","last_clean":"2023-11-04T15:37:04.719132+0000","last_became_active":"2023-11-04T15:27:36.149748+0000","last_became_peered":"2023-11-04T15:27:36.149748+0000","last_unstale":"2023-11-04T15:37:04.719132+0000","last_undegraded":"2023-11-04T15:37:04.719132+0000","last_fullsized":"2023-11-04T15:37:04.719132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3527,"log_dups_size":0,"ondisk_log_size":3527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101592565,"stat_sum":{"num_bytes":8206,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":1149,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"40'3602","reported_seq":2985,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.150840+0000","last_change":"2023-11-04T15:36:55.770578+0000","last_active":"2023-11-04T15:37:07.150840+0000","last_peered":"2023-11-04T15:37:07.150840+0000","last_clean":"2023-11-04T15:37:07.150840+0000","last_became_active":"2023-11-04T15:27:36.139761+0000","last_became_peered":"2023-11-04T15:27:36.139761+0000","last_unstale":"2023-11-04T15:37:07.150840+0000","last_undegraded":"2023-11-04T15:37:07.150840+0000","last_fullsized":"2023-11-04T15:37:07.150840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3602,"log_dups_size":0,"ondisk_log_size":3602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052924038,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1171,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"40'3725","reported_seq":3119,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:06.226599+0000","last_change":"2023-11-04T15:36:55.798093+0000","last_active":"2023-11-04T15:37:06.226599+0000","last_peered":"2023-11-04T15:37:06.226599+0000","last_clean":"2023-11-04T15:37:06.226599+0000","last_became_active":"2023-11-04T15:27:36.150017+0000","last_became_peered":"2023-11-04T15:27:36.150017+0000","last_unstale":"2023-11-04T15:37:06.226599+0000","last_undegraded":"2023-11-04T15:37:06.226599+0000","last_fullsized":"2023-11-04T15:37:06.226599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3725,"log_dups_size":0,"ondisk_log_size":3725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.073241305000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1192,"num_write_kb":641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"40'3327","reported_seq":2771,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.611630+0000","last_change":"2023-11-04T15:36:55.824394+0000","last_active":"2023-11-04T15:37:07.611630+0000","last_peered":"2023-11-04T15:37:07.611630+0000","last_clean":"2023-11-04T15:37:07.611630+0000","last_became_active":"2023-11-04T15:27:36.139036+0000","last_became_peered":"2023-11-04T15:27:36.139036+0000","last_unstale":"2023-11-04T15:37:07.611630+0000","last_undegraded":"2023-11-04T15:37:07.611630+0000","last_fullsized":"2023-11-04T15:37:07.611630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3327,"log_dups_size":0,"ondisk_log_size":3327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.102154117,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1074,"num_write_kb":603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"44'3356","reported_seq":2819,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:26.478185+0000","last_change":"2023-11-04T15:37:26.478185+0000","last_active":"2023-11-04T15:37:26.478185+0000","last_peered":"2023-11-04T15:37:26.478185+0000","last_clean":"2023-11-04T15:37:26.478185+0000","last_became_active":"2023-11-04T15:27:36.139121+0000","last_became_peered":"2023-11-04T15:27:36.139121+0000","last_unstale":"2023-11-04T15:37:26.478185+0000","last_undegraded":"2023-11-04T15:37:26.478185+0000","last_fullsized":"2023-11-04T15:37:26.478185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3356","last_scrub_stamp":"2023-11-04T15:37:26.478037+0000","last_deep_scrub":"44'3356","last_deep_scrub_stamp":"2023-11-04T15:37:26.478037+0000","last_clean_scrub_stamp":"2023-11-04T15:37:26.478037+0000","objects_scrubbed":5,"log_size":3356,"log_dups_size":0,"ondisk_log_size":3356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:38:01.386862+0000","scrub_duration":0.011615044999999999,"objects_trimmed":0,"snaptrim_duration":0.099827518000000004,"stat_sum":{"num_bytes":4117,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":2,"num_read_kb":1,"num_write":1086,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"40'3425","reported_seq":2844,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.611595+0000","last_change":"2023-11-04T15:36:55.816551+0000","last_active":"2023-11-04T15:37:07.611595+0000","last_peered":"2023-11-04T15:37:07.611595+0000","last_clean":"2023-11-04T15:37:07.611595+0000","last_became_active":"2023-11-04T15:27:36.147050+0000","last_became_peered":"2023-11-04T15:27:36.147050+0000","last_unstale":"2023-11-04T15:37:07.611595+0000","last_undegraded":"2023-11-04T15:37:07.611595+0000","last_fullsized":"2023-11-04T15:37:07.611595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3425,"log_dups_size":0,"ondisk_log_size":3425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.098810337999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"40'3561","reported_seq":2965,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:06.226649+0000","last_change":"2023-11-04T15:36:55.796038+0000","last_active":"2023-11-04T15:37:06.226649+0000","last_peered":"2023-11-04T15:37:06.226649+0000","last_clean":"2023-11-04T15:37:06.226649+0000","last_became_active":"2023-11-04T15:27:36.145825+0000","last_became_peered":"2023-11-04T15:27:36.145825+0000","last_unstale":"2023-11-04T15:37:06.226649+0000","last_undegraded":"2023-11-04T15:37:06.226649+0000","last_fullsized":"2023-11-04T15:37:06.226649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3561,"log_dups_size":0,"ondisk_log_size":3561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072094483000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"40'3327","reported_seq":2844,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.611585+0000","last_change":"2023-11-04T15:36:55.817992+0000","last_active":"2023-11-04T15:37:07.611585+0000","last_peered":"2023-11-04T15:37:07.611585+0000","last_clean":"2023-11-04T15:37:07.611585+0000","last_became_active":"2023-11-04T15:27:36.150307+0000","last_became_peered":"2023-11-04T15:27:36.150307+0000","last_unstale":"2023-11-04T15:37:07.611585+0000","last_undegraded":"2023-11-04T15:37:07.611585+0000","last_fullsized":"2023-11-04T15:37:07.611585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3327,"log_dups_size":0,"ondisk_log_size":3327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10012518099999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1064,"num_write_kb":572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"40'3202","reported_seq":2721,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.150819+0000","last_change":"2023-11-04T15:36:55.770571+0000","last_active":"2023-11-04T15:37:07.150819+0000","last_peered":"2023-11-04T15:37:07.150819+0000","last_clean":"2023-11-04T15:37:07.150819+0000","last_became_active":"2023-11-04T15:27:36.144988+0000","last_became_peered":"2023-11-04T15:27:36.144988+0000","last_unstale":"2023-11-04T15:37:07.150819+0000","last_undegraded":"2023-11-04T15:37:07.150819+0000","last_fullsized":"2023-11-04T15:37:07.150819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3202,"log_dups_size":0,"ondisk_log_size":3202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052379294999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1028,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"40'3394","reported_seq":2823,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:06.688553+0000","last_change":"2023-11-04T15:36:55.782106+0000","last_active":"2023-11-04T15:37:06.688553+0000","last_peered":"2023-11-04T15:37:06.688553+0000","last_clean":"2023-11-04T15:37:06.688553+0000","last_became_active":"2023-11-04T15:27:36.149156+0000","last_became_peered":"2023-11-04T15:27:36.149156+0000","last_unstale":"2023-11-04T15:37:06.688553+0000","last_undegraded":"2023-11-04T15:37:06.688553+0000","last_fullsized":"2023-11-04T15:37:06.688553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3394,"log_dups_size":0,"ondisk_log_size":3394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.064372897999999998,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1159,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"40'3255","reported_seq":2744,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:06.226588+0000","last_change":"2023-11-04T15:36:55.792591+0000","last_active":"2023-11-04T15:37:06.226588+0000","last_peered":"2023-11-04T15:37:06.226588+0000","last_clean":"2023-11-04T15:37:06.226588+0000","last_became_active":"2023-11-04T15:27:36.139824+0000","last_became_peered":"2023-11-04T15:27:36.139824+0000","last_unstale":"2023-11-04T15:37:06.226588+0000","last_undegraded":"2023-11-04T15:37:06.226588+0000","last_fullsized":"2023-11-04T15:37:06.226588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3255,"log_dups_size":0,"ondisk_log_size":3255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070068697999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1062,"num_write_kb":575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"40'3538","reported_seq":2918,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718794+0000","last_change":"2023-11-04T15:36:55.774374+0000","last_active":"2023-11-04T15:37:04.718794+0000","last_peered":"2023-11-04T15:37:04.718794+0000","last_clean":"2023-11-04T15:37:04.718794+0000","last_became_active":"2023-11-04T15:27:36.147273+0000","last_became_peered":"2023-11-04T15:27:36.147273+0000","last_unstale":"2023-11-04T15:37:04.718794+0000","last_undegraded":"2023-11-04T15:37:04.718794+0000","last_fullsized":"2023-11-04T15:37:04.718794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3538,"log_dups_size":0,"ondisk_log_size":3538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055716603000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"40'3766","reported_seq":3159,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718379+0000","last_change":"2023-11-04T15:36:55.780005+0000","last_active":"2023-11-04T15:37:04.718379+0000","last_peered":"2023-11-04T15:37:04.718379+0000","last_clean":"2023-11-04T15:37:04.718379+0000","last_became_active":"2023-11-04T15:27:36.148932+0000","last_became_peered":"2023-11-04T15:27:36.148932+0000","last_unstale":"2023-11-04T15:37:04.718379+0000","last_undegraded":"2023-11-04T15:37:04.718379+0000","last_fullsized":"2023-11-04T15:37:04.718379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3766,"log_dups_size":0,"ondisk_log_size":3766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062648212999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1209,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"40'3538","reported_seq":2946,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718524+0000","last_change":"2023-11-04T15:36:55.818096+0000","last_active":"2023-11-04T15:37:04.718524+0000","last_peered":"2023-11-04T15:37:04.718524+0000","last_clean":"2023-11-04T15:37:04.718524+0000","last_became_active":"2023-11-04T15:27:36.150856+0000","last_became_peered":"2023-11-04T15:27:36.150856+0000","last_unstale":"2023-11-04T15:37:04.718524+0000","last_undegraded":"2023-11-04T15:37:04.718524+0000","last_fullsized":"2023-11-04T15:37:04.718524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3538,"log_dups_size":0,"ondisk_log_size":3538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.099772735000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"40'3671","reported_seq":3000,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795770+0000","last_change":"2023-11-04T15:36:55.797112+0000","last_active":"2023-11-04T15:37:04.795770+0000","last_peered":"2023-11-04T15:37:04.795770+0000","last_clean":"2023-11-04T15:37:04.795770+0000","last_became_active":"2023-11-04T15:27:36.144997+0000","last_became_peered":"2023-11-04T15:27:36.144997+0000","last_unstale":"2023-11-04T15:37:04.795770+0000","last_undegraded":"2023-11-04T15:37:04.795770+0000","last_fullsized":"2023-11-04T15:37:04.795770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3671,"log_dups_size":0,"ondisk_log_size":3671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072563297999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1270,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"44'3139","reported_seq":2656,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:43.481415+0000","last_change":"2023-11-04T15:37:43.481511+0000","last_active":"2023-11-04T15:37:43.481415+0000","last_peered":"2023-11-04T15:37:43.481415+0000","last_clean":"2023-11-04T15:37:43.481415+0000","last_became_active":"2023-11-04T15:27:36.150555+0000","last_became_peered":"2023-11-04T15:27:36.150555+0000","last_unstale":"2023-11-04T15:37:43.481415+0000","last_undegraded":"2023-11-04T15:37:43.481415+0000","last_fullsized":"2023-11-04T15:37:43.481415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3139","last_scrub_stamp":"2023-11-04T15:37:43.481392+0000","last_deep_scrub":"44'3139","last_deep_scrub_stamp":"2023-11-04T15:37:43.481392+0000","last_clean_scrub_stamp":"2023-11-04T15:37:43.481392+0000","objects_scrubbed":2,"log_size":3139,"log_dups_size":0,"ondisk_log_size":3139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:46:29.890357+0000","scrub_duration":0.010710094,"objects_trimmed":0,"snaptrim_duration":0.101696772,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1042,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"40'3390","reported_seq":2813,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795930+0000","last_change":"2023-11-04T15:36:55.795034+0000","last_active":"2023-11-04T15:37:04.795930+0000","last_peered":"2023-11-04T15:37:04.795930+0000","last_clean":"2023-11-04T15:37:04.795930+0000","last_became_active":"2023-11-04T15:27:36.147745+0000","last_became_peered":"2023-11-04T15:27:36.147745+0000","last_unstale":"2023-11-04T15:37:04.795930+0000","last_undegraded":"2023-11-04T15:37:04.795930+0000","last_fullsized":"2023-11-04T15:37:04.795930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3390,"log_dups_size":0,"ondisk_log_size":3390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071588252000000005,"stat_sum":{"num_bytes":4128,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1173,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"40'3505","reported_seq":2916,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719201+0000","last_change":"2023-11-04T15:36:55.815381+0000","last_active":"2023-11-04T15:37:04.719201+0000","last_peered":"2023-11-04T15:37:04.719201+0000","last_clean":"2023-11-04T15:37:04.719201+0000","last_became_active":"2023-11-04T15:27:36.150687+0000","last_became_peered":"2023-11-04T15:27:36.150687+0000","last_unstale":"2023-11-04T15:37:04.719201+0000","last_undegraded":"2023-11-04T15:37:04.719201+0000","last_fullsized":"2023-11-04T15:37:04.719201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3505,"log_dups_size":0,"ondisk_log_size":3505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.097896176000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1154,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"43'3544","reported_seq":2982,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.717966+0000","last_change":"2023-11-04T15:36:55.776770+0000","last_active":"2023-11-04T15:37:04.717966+0000","last_peered":"2023-11-04T15:37:04.717966+0000","last_clean":"2023-11-04T15:37:04.717966+0000","last_became_active":"2023-11-04T15:27:36.143551+0000","last_became_peered":"2023-11-04T15:27:36.143551+0000","last_unstale":"2023-11-04T15:37:04.717966+0000","last_undegraded":"2023-11-04T15:37:04.717966+0000","last_fullsized":"2023-11-04T15:37:04.717966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3544,"log_dups_size":0,"ondisk_log_size":3544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056037475000000003,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1178,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"40'3728","reported_seq":3086,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795181+0000","last_change":"2023-11-04T15:36:55.794625+0000","last_active":"2023-11-04T15:37:04.795181+0000","last_peered":"2023-11-04T15:37:04.795181+0000","last_clean":"2023-11-04T15:37:04.795181+0000","last_became_active":"2023-11-04T15:27:36.145943+0000","last_became_peered":"2023-11-04T15:27:36.145943+0000","last_unstale":"2023-11-04T15:37:04.795181+0000","last_undegraded":"2023-11-04T15:37:04.795181+0000","last_fullsized":"2023-11-04T15:37:04.795181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3728,"log_dups_size":0,"ondisk_log_size":3728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071549077000000003,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1242,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"40'3454","reported_seq":2890,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719444+0000","last_change":"2023-11-04T15:36:55.777772+0000","last_active":"2023-11-04T15:37:04.719444+0000","last_peered":"2023-11-04T15:37:04.719444+0000","last_clean":"2023-11-04T15:37:04.719444+0000","last_became_active":"2023-11-04T15:27:36.144083+0000","last_became_peered":"2023-11-04T15:27:36.144083+0000","last_unstale":"2023-11-04T15:37:04.719444+0000","last_undegraded":"2023-11-04T15:37:04.719444+0000","last_fullsized":"2023-11-04T15:37:04.719444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3454,"log_dups_size":0,"ondisk_log_size":3454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.060959410999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1127,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"40'3632","reported_seq":2992,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.717704+0000","last_change":"2023-11-04T15:36:55.821483+0000","last_active":"2023-11-04T15:37:04.717704+0000","last_peered":"2023-11-04T15:37:04.717704+0000","last_clean":"2023-11-04T15:37:04.717704+0000","last_became_active":"2023-11-04T15:27:36.146546+0000","last_became_peered":"2023-11-04T15:27:36.146546+0000","last_unstale":"2023-11-04T15:37:04.717704+0000","last_undegraded":"2023-11-04T15:37:04.717704+0000","last_fullsized":"2023-11-04T15:37:04.717704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3632,"log_dups_size":0,"ondisk_log_size":3632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.102597439,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1222,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"40'3166","reported_seq":2629,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720999+0000","last_change":"2023-11-04T15:36:55.783207+0000","last_active":"2023-11-04T15:37:04.720999+0000","last_peered":"2023-11-04T15:37:04.720999+0000","last_clean":"2023-11-04T15:37:04.720999+0000","last_became_active":"2023-11-04T15:27:36.144047+0000","last_became_peered":"2023-11-04T15:27:36.144047+0000","last_unstale":"2023-11-04T15:37:04.720999+0000","last_undegraded":"2023-11-04T15:37:04.720999+0000","last_fullsized":"2023-11-04T15:37:04.720999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3166,"log_dups_size":0,"ondisk_log_size":3166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.064725415999999994,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1115,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"40'3493","reported_seq":2894,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720410+0000","last_change":"2023-11-04T15:36:55.784865+0000","last_active":"2023-11-04T15:37:04.720410+0000","last_peered":"2023-11-04T15:37:04.720410+0000","last_clean":"2023-11-04T15:37:04.720410+0000","last_became_active":"2023-11-04T15:27:36.144458+0000","last_became_peered":"2023-11-04T15:27:36.144458+0000","last_unstale":"2023-11-04T15:37:04.720410+0000","last_undegraded":"2023-11-04T15:37:04.720410+0000","last_fullsized":"2023-11-04T15:37:04.720410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3493,"log_dups_size":0,"ondisk_log_size":3493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.066118209999999997,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"44'3387","reported_seq":2838,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:38.464862+0000","last_change":"2023-11-04T15:37:38.465038+0000","last_active":"2023-11-04T15:37:38.464862+0000","last_peered":"2023-11-04T15:37:38.464862+0000","last_clean":"2023-11-04T15:37:38.464862+0000","last_became_active":"2023-11-04T15:27:36.150270+0000","last_became_peered":"2023-11-04T15:27:36.150270+0000","last_unstale":"2023-11-04T15:37:38.464862+0000","last_undegraded":"2023-11-04T15:37:38.464862+0000","last_fullsized":"2023-11-04T15:37:38.464862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3387","last_scrub_stamp":"2023-11-04T15:37:38.464840+0000","last_deep_scrub":"44'3387","last_deep_scrub_stamp":"2023-11-04T15:37:38.464840+0000","last_clean_scrub_stamp":"2023-11-04T15:37:38.464840+0000","objects_scrubbed":1,"log_size":3387,"log_dups_size":0,"ondisk_log_size":3387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:40:18.070984+0000","scrub_duration":0.0081071519999999994,"objects_trimmed":0,"snaptrim_duration":0.104674168,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"40'3286","reported_seq":2718,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795538+0000","last_change":"2023-11-04T15:36:55.799791+0000","last_active":"2023-11-04T15:37:04.795538+0000","last_peered":"2023-11-04T15:37:04.795538+0000","last_clean":"2023-11-04T15:37:04.795538+0000","last_became_active":"2023-11-04T15:28:20.871378+0000","last_became_peered":"2023-11-04T15:28:20.871378+0000","last_unstale":"2023-11-04T15:37:04.795538+0000","last_undegraded":"2023-11-04T15:37:04.795538+0000","last_fullsized":"2023-11-04T15:37:04.795538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3286,"log_dups_size":0,"ondisk_log_size":3286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.074381663000000001,"stat_sum":{"num_bytes":9,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1152,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"40'3578","reported_seq":3008,"reported_epoch":44,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-04T15:37:06.226529+0000","last_change":"2023-11-04T15:37:43.477932+0000","last_active":"2023-11-04T15:37:06.226529+0000","last_peered":"2023-11-04T15:37:06.226529+0000","last_clean":"2023-11-04T15:37:06.226529+0000","last_became_active":"2023-11-04T15:27:36.145392+0000","last_became_peered":"2023-11-04T15:27:36.145392+0000","last_unstale":"2023-11-04T15:37:06.226529+0000","last_undegraded":"2023-11-04T15:37:06.226529+0000","last_fullsized":"2023-11-04T15:37:06.226529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3578,"log_dups_size":0,"ondisk_log_size":3578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070714202000000004,"stat_sum":{"num_bytes":12288,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1167,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"40'3386","reported_seq":2873,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:10.551465+0000","last_change":"2023-11-04T15:37:10.551561+0000","last_active":"2023-11-04T15:37:10.551465+0000","last_peered":"2023-11-04T15:37:10.551465+0000","last_clean":"2023-11-04T15:37:10.551465+0000","last_became_active":"2023-11-04T15:27:36.145273+0000","last_became_peered":"2023-11-04T15:27:36.145273+0000","last_unstale":"2023-11-04T15:37:10.551465+0000","last_undegraded":"2023-11-04T15:37:10.551465+0000","last_fullsized":"2023-11-04T15:37:10.551465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3386","last_scrub_stamp":"2023-11-04T15:37:10.551443+0000","last_deep_scrub":"40'3386","last_deep_scrub_stamp":"2023-11-04T15:37:10.551443+0000","last_clean_scrub_stamp":"2023-11-04T15:37:10.551443+0000","objects_scrubbed":0,"log_size":3386,"log_dups_size":0,"ondisk_log_size":3386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:21:56.476755+0000","scrub_duration":0.005704687,"objects_trimmed":0,"snaptrim_duration":0.101784969,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1155,"num_write_kb":603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"40'3889","reported_seq":3214,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719444+0000","last_change":"2023-11-04T15:36:55.778888+0000","last_active":"2023-11-04T15:37:04.719444+0000","last_peered":"2023-11-04T15:37:04.719444+0000","last_clean":"2023-11-04T15:37:04.719444+0000","last_became_active":"2023-11-04T15:27:36.144053+0000","last_became_peered":"2023-11-04T15:27:36.144053+0000","last_unstale":"2023-11-04T15:37:04.719444+0000","last_undegraded":"2023-11-04T15:37:04.719444+0000","last_fullsized":"2023-11-04T15:37:04.719444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3889,"log_dups_size":0,"ondisk_log_size":3889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061944979999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1328,"num_write_kb":706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"40'3720","reported_seq":3105,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.717917+0000","last_change":"2023-11-04T15:36:55.775709+0000","last_active":"2023-11-04T15:37:04.717917+0000","last_peered":"2023-11-04T15:37:04.717917+0000","last_clean":"2023-11-04T15:37:04.717917+0000","last_became_active":"2023-11-04T15:27:36.148342+0000","last_became_peered":"2023-11-04T15:27:36.148342+0000","last_unstale":"2023-11-04T15:37:04.717917+0000","last_undegraded":"2023-11-04T15:37:04.717917+0000","last_fullsized":"2023-11-04T15:37:04.717917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3720,"log_dups_size":0,"ondisk_log_size":3720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056486557999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"40'3424","reported_seq":2826,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720693+0000","last_change":"2023-11-04T15:36:55.784869+0000","last_active":"2023-11-04T15:37:04.720693+0000","last_peered":"2023-11-04T15:37:04.720693+0000","last_clean":"2023-11-04T15:37:04.720693+0000","last_became_active":"2023-11-04T15:27:36.148951+0000","last_became_peered":"2023-11-04T15:27:36.148951+0000","last_unstale":"2023-11-04T15:37:04.720693+0000","last_undegraded":"2023-11-04T15:37:04.720693+0000","last_fullsized":"2023-11-04T15:37:04.720693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3424,"log_dups_size":0,"ondisk_log_size":3424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.066218149000000004,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1176,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"40'2984","reported_seq":3025,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718897+0000","last_change":"2023-11-04T15:27:35.775931+0000","last_active":"2023-11-04T15:37:04.718897+0000","last_peered":"2023-11-04T15:37:04.718897+0000","last_clean":"2023-11-04T15:37:04.718897+0000","last_became_active":"2023-11-04T15:27:35.775616+0000","last_became_peered":"2023-11-04T15:27:35.775616+0000","last_unstale":"2023-11-04T15:37:04.718897+0000","last_undegraded":"2023-11-04T15:37:04.718897+0000","last_fullsized":"2023-11-04T15:37:04.718897+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2984,"log_dups_size":0,"ondisk_log_size":2984,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2984,"num_write_kb":24202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"40'3308","reported_seq":2727,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.611520+0000","last_change":"2023-11-04T15:36:55.822910+0000","last_active":"2023-11-04T15:37:07.611520+0000","last_peered":"2023-11-04T15:37:07.611520+0000","last_clean":"2023-11-04T15:37:07.611520+0000","last_became_active":"2023-11-04T15:27:36.150276+0000","last_became_peered":"2023-11-04T15:27:36.150276+0000","last_unstale":"2023-11-04T15:37:07.611520+0000","last_undegraded":"2023-11-04T15:37:07.611520+0000","last_fullsized":"2023-11-04T15:37:07.611520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3308,"log_dups_size":0,"ondisk_log_size":3308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101095329,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1177,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"37'462","reported_seq":503,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795171+0000","last_change":"2023-11-04T15:27:35.776610+0000","last_active":"2023-11-04T15:37:04.795171+0000","last_peered":"2023-11-04T15:37:04.795171+0000","last_clean":"2023-11-04T15:37:04.795171+0000","last_became_active":"2023-11-04T15:27:35.776297+0000","last_became_peered":"2023-11-04T15:27:35.776297+0000","last_unstale":"2023-11-04T15:37:04.795171+0000","last_undegraded":"2023-11-04T15:37:04.795171+0000","last_fullsized":"2023-11-04T15:37:04.795171+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":462,"num_write_kb":12396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"44'3489","reported_seq":2923,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:22.680227+0000","last_change":"2023-11-04T15:37:22.680321+0000","last_active":"2023-11-04T15:37:22.680227+0000","last_peered":"2023-11-04T15:37:22.680227+0000","last_clean":"2023-11-04T15:37:22.680227+0000","last_became_active":"2023-11-04T15:27:36.139580+0000","last_became_peered":"2023-11-04T15:27:36.139580+0000","last_unstale":"2023-11-04T15:37:22.680227+0000","last_undegraded":"2023-11-04T15:37:22.680227+0000","last_fullsized":"2023-11-04T15:37:22.680227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3489","last_scrub_stamp":"2023-11-04T15:37:22.680205+0000","last_deep_scrub":"44'3489","last_deep_scrub_stamp":"2023-11-04T15:37:22.680205+0000","last_clean_scrub_stamp":"2023-11-04T15:37:22.680205+0000","objects_scrubbed":4,"log_size":3489,"log_dups_size":0,"ondisk_log_size":3489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:18:28.360934+0000","scrub_duration":0.013912934,"objects_trimmed":0,"snaptrim_duration":0.074768939000000006,"stat_sum":{"num_bytes":8192,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1207,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"40'717","reported_seq":758,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718608+0000","last_change":"2023-11-04T15:27:35.775977+0000","last_active":"2023-11-04T15:37:04.718608+0000","last_peered":"2023-11-04T15:37:04.718608+0000","last_clean":"2023-11-04T15:37:04.718608+0000","last_became_active":"2023-11-04T15:27:35.775486+0000","last_became_peered":"2023-11-04T15:27:35.775486+0000","last_unstale":"2023-11-04T15:37:04.718608+0000","last_undegraded":"2023-11-04T15:37:04.718608+0000","last_fullsized":"2023-11-04T15:37:04.718608+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":707,"num_write_kb":16815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"40'3443","reported_seq":2876,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:06.226433+0000","last_change":"2023-11-04T15:36:55.799083+0000","last_active":"2023-11-04T15:37:06.226433+0000","last_peered":"2023-11-04T15:37:06.226433+0000","last_clean":"2023-11-04T15:37:06.226433+0000","last_became_active":"2023-11-04T15:27:36.139789+0000","last_became_peered":"2023-11-04T15:27:36.139789+0000","last_unstale":"2023-11-04T15:37:06.226433+0000","last_undegraded":"2023-11-04T15:37:06.226433+0000","last_fullsized":"2023-11-04T15:37:06.226433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3443,"log_dups_size":0,"ondisk_log_size":3443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.073936136,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"44'1621","reported_seq":1673,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:25.495184+0000","last_change":"2023-11-04T15:37:25.495295+0000","last_active":"2023-11-04T15:37:25.495184+0000","last_peered":"2023-11-04T15:37:25.495184+0000","last_clean":"2023-11-04T15:37:25.495184+0000","last_became_active":"2023-11-04T15:27:35.775895+0000","last_became_peered":"2023-11-04T15:27:35.775895+0000","last_unstale":"2023-11-04T15:37:25.495184+0000","last_undegraded":"2023-11-04T15:37:25.495184+0000","last_fullsized":"2023-11-04T15:37:25.495184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1621","last_scrub_stamp":"2023-11-04T15:37:25.495162+0000","last_deep_scrub":"44'1621","last_deep_scrub_stamp":"2023-11-04T15:37:25.495162+0000","last_clean_scrub_stamp":"2023-11-04T15:37:25.495162+0000","objects_scrubbed":7,"log_size":1621,"log_dups_size":0,"ondisk_log_size":1621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:31:16.990792+0000","scrub_duration":0.024403523,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":1625,"num_write_kb":22714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"43'1198","reported_seq":1239,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718987+0000","last_change":"2023-11-04T15:27:35.767890+0000","last_active":"2023-11-04T15:37:04.718987+0000","last_peered":"2023-11-04T15:37:04.718987+0000","last_clean":"2023-11-04T15:37:04.718987+0000","last_became_active":"2023-11-04T15:27:35.767594+0000","last_became_peered":"2023-11-04T15:27:35.767594+0000","last_unstale":"2023-11-04T15:37:04.718987+0000","last_undegraded":"2023-11-04T15:37:04.718987+0000","last_fullsized":"2023-11-04T15:37:04.718987+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1198,"log_dups_size":0,"ondisk_log_size":1198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1190,"num_write_kb":15478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"40'3688","reported_seq":3062,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:14.480922+0000","last_change":"2023-11-04T15:37:14.481041+0000","last_active":"2023-11-04T15:37:14.480922+0000","last_peered":"2023-11-04T15:37:14.480922+0000","last_clean":"2023-11-04T15:37:14.480922+0000","last_became_active":"2023-11-04T15:27:36.148282+0000","last_became_peered":"2023-11-04T15:27:36.148282+0000","last_unstale":"2023-11-04T15:37:14.480922+0000","last_undegraded":"2023-11-04T15:37:14.480922+0000","last_fullsized":"2023-11-04T15:37:14.480922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3688","last_scrub_stamp":"2023-11-04T15:37:14.480897+0000","last_deep_scrub":"40'3688","last_deep_scrub_stamp":"2023-11-04T15:37:14.480897+0000","last_clean_scrub_stamp":"2023-11-04T15:37:14.480897+0000","objects_scrubbed":0,"log_size":3688,"log_dups_size":0,"ondisk_log_size":3688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:24:49.251475+0000","scrub_duration":0.0044870750000000001,"objects_trimmed":0,"snaptrim_duration":0.102136719,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1244,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"37'2392","reported_seq":2433,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720477+0000","last_change":"2023-11-04T15:27:35.771839+0000","last_active":"2023-11-04T15:37:04.720477+0000","last_peered":"2023-11-04T15:37:04.720477+0000","last_clean":"2023-11-04T15:37:04.720477+0000","last_became_active":"2023-11-04T15:27:35.771554+0000","last_became_peered":"2023-11-04T15:27:35.771554+0000","last_unstale":"2023-11-04T15:37:04.720477+0000","last_undegraded":"2023-11-04T15:37:04.720477+0000","last_fullsized":"2023-11-04T15:37:04.720477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2392,"log_dups_size":0,"ondisk_log_size":2392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2386,"num_write_kb":21701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"44'3603","reported_seq":3000,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:25.600198+0000","last_change":"2023-11-04T15:37:25.600392+0000","last_active":"2023-11-04T15:37:25.600198+0000","last_peered":"2023-11-04T15:37:25.600198+0000","last_clean":"2023-11-04T15:37:25.600198+0000","last_became_active":"2023-11-04T15:27:36.149146+0000","last_became_peered":"2023-11-04T15:27:36.149146+0000","last_unstale":"2023-11-04T15:37:25.600198+0000","last_undegraded":"2023-11-04T15:37:25.600198+0000","last_fullsized":"2023-11-04T15:37:25.600198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3603","last_scrub_stamp":"2023-11-04T15:37:25.600176+0000","last_deep_scrub":"44'3603","last_deep_scrub_stamp":"2023-11-04T15:37:25.600176+0000","last_clean_scrub_stamp":"2023-11-04T15:37:25.600176+0000","objects_scrubbed":3,"log_size":3603,"log_dups_size":0,"ondisk_log_size":3603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:18:31.280905+0000","scrub_duration":0.0137854,"objects_trimmed":0,"snaptrim_duration":0.055767874000000002,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"40'3587","reported_seq":3628,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720018+0000","last_change":"2023-11-04T15:27:35.773978+0000","last_active":"2023-11-04T15:37:04.720018+0000","last_peered":"2023-11-04T15:37:04.720018+0000","last_clean":"2023-11-04T15:37:04.720018+0000","last_became_active":"2023-11-04T15:27:35.773689+0000","last_became_peered":"2023-11-04T15:27:35.773689+0000","last_unstale":"2023-11-04T15:37:04.720018+0000","last_undegraded":"2023-11-04T15:37:04.720018+0000","last_fullsized":"2023-11-04T15:37:04.720018+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3587,"log_dups_size":0,"ondisk_log_size":3587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582982,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3581,"num_write_kb":38716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"44'3514","reported_seq":2912,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:14.746158+0000","last_change":"2023-11-04T15:37:14.746264+0000","last_active":"2023-11-04T15:37:14.746158+0000","last_peered":"2023-11-04T15:37:14.746158+0000","last_clean":"2023-11-04T15:37:14.746158+0000","last_became_active":"2023-11-04T15:27:36.141695+0000","last_became_peered":"2023-11-04T15:27:36.141695+0000","last_unstale":"2023-11-04T15:37:14.746158+0000","last_undegraded":"2023-11-04T15:37:14.746158+0000","last_fullsized":"2023-11-04T15:37:14.746158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3514","last_scrub_stamp":"2023-11-04T15:37:14.746134+0000","last_deep_scrub":"44'3514","last_deep_scrub_stamp":"2023-11-04T15:37:14.746134+0000","last_clean_scrub_stamp":"2023-11-04T15:37:14.746134+0000","objects_scrubbed":3,"log_size":3514,"log_dups_size":0,"ondisk_log_size":3514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:36.355741+0000","scrub_duration":0.013556656,"objects_trimmed":0,"snaptrim_duration":0.057953993000000002,"stat_sum":{"num_bytes":4107,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1230,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"40'1577","reported_seq":1618,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719659+0000","last_change":"2023-11-04T15:27:35.774108+0000","last_active":"2023-11-04T15:37:04.719659+0000","last_peered":"2023-11-04T15:37:04.719659+0000","last_clean":"2023-11-04T15:37:04.719659+0000","last_became_active":"2023-11-04T15:27:35.773818+0000","last_became_peered":"2023-11-04T15:27:35.773818+0000","last_unstale":"2023-11-04T15:37:04.719659+0000","last_undegraded":"2023-11-04T15:37:04.719659+0000","last_fullsized":"2023-11-04T15:37:04.719659+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1577,"log_dups_size":0,"ondisk_log_size":1577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1569,"num_write_kb":30603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"40'3300","reported_seq":2749,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795330+0000","last_change":"2023-11-04T15:36:55.793529+0000","last_active":"2023-11-04T15:37:04.795330+0000","last_peered":"2023-11-04T15:37:04.795330+0000","last_clean":"2023-11-04T15:37:04.795330+0000","last_became_active":"2023-11-04T15:27:36.150653+0000","last_became_peered":"2023-11-04T15:27:36.150653+0000","last_unstale":"2023-11-04T15:37:04.795330+0000","last_undegraded":"2023-11-04T15:37:04.795330+0000","last_fullsized":"2023-11-04T15:37:04.795330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3300,"log_dups_size":0,"ondisk_log_size":3300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070970674999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1129,"num_write_kb":600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"44'4025","reported_seq":4077,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:41.344060+0000","last_change":"2023-11-04T15:37:41.344248+0000","last_active":"2023-11-04T15:37:41.344060+0000","last_peered":"2023-11-04T15:37:41.344060+0000","last_clean":"2023-11-04T15:37:41.344060+0000","last_became_active":"2023-11-04T15:27:35.772815+0000","last_became_peered":"2023-11-04T15:27:35.772815+0000","last_unstale":"2023-11-04T15:37:41.344060+0000","last_undegraded":"2023-11-04T15:37:41.344060+0000","last_fullsized":"2023-11-04T15:37:41.344060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4025","last_scrub_stamp":"2023-11-04T15:37:41.344035+0000","last_deep_scrub":"44'4025","last_deep_scrub_stamp":"2023-11-04T15:37:41.344035+0000","last_clean_scrub_stamp":"2023-11-04T15:37:41.344035+0000","objects_scrubbed":4,"log_size":4025,"log_dups_size":0,"ondisk_log_size":4025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:07:54.974697+0000","scrub_duration":0.037607953,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4019,"num_write_kb":36923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1207,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"40'3784","reported_seq":3140,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:21.440173+0000","last_change":"2023-11-04T15:37:21.440272+0000","last_active":"2023-11-04T15:37:21.440173+0000","last_peered":"2023-11-04T15:37:21.440173+0000","last_clean":"2023-11-04T15:37:21.440173+0000","last_became_active":"2023-11-04T15:27:36.150667+0000","last_became_peered":"2023-11-04T15:27:36.150667+0000","last_unstale":"2023-11-04T15:37:21.440173+0000","last_undegraded":"2023-11-04T15:37:21.440173+0000","last_fullsized":"2023-11-04T15:37:21.440173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3784","last_scrub_stamp":"2023-11-04T15:37:21.440149+0000","last_deep_scrub":"40'3784","last_deep_scrub_stamp":"2023-11-04T15:37:21.440149+0000","last_clean_scrub_stamp":"2023-11-04T15:37:21.440149+0000","objects_scrubbed":0,"log_size":3784,"log_dups_size":0,"ondisk_log_size":3784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:35.107882+0000","scrub_duration":0.0057867910000000003,"objects_trimmed":0,"snaptrim_duration":0.098687114000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1287,"num_write_kb":684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"37'2125","reported_seq":2166,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720555+0000","last_change":"2023-11-04T15:27:35.775559+0000","last_active":"2023-11-04T15:37:04.720555+0000","last_peered":"2023-11-04T15:37:04.720555+0000","last_clean":"2023-11-04T15:37:04.720555+0000","last_became_active":"2023-11-04T15:27:35.775063+0000","last_became_peered":"2023-11-04T15:27:35.775063+0000","last_unstale":"2023-11-04T15:37:04.720555+0000","last_undegraded":"2023-11-04T15:37:04.720555+0000","last_fullsized":"2023-11-04T15:37:04.720555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2125,"log_dups_size":0,"ondisk_log_size":2125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2118,"num_write_kb":30816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"40'3317","reported_seq":2788,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719341+0000","last_change":"2023-11-04T15:36:55.826358+0000","last_active":"2023-11-04T15:37:04.719341+0000","last_peered":"2023-11-04T15:37:04.719341+0000","last_clean":"2023-11-04T15:37:04.719341+0000","last_became_active":"2023-11-04T15:27:36.139103+0000","last_became_peered":"2023-11-04T15:27:36.139103+0000","last_unstale":"2023-11-04T15:37:04.719341+0000","last_undegraded":"2023-11-04T15:37:04.719341+0000","last_fullsized":"2023-11-04T15:37:04.719341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3317,"log_dups_size":0,"ondisk_log_size":3317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10468400899999999,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1091,"num_write_kb":593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"37'1934","reported_seq":1975,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718699+0000","last_change":"2023-11-04T15:27:35.773686+0000","last_active":"2023-11-04T15:37:04.718699+0000","last_peered":"2023-11-04T15:37:04.718699+0000","last_clean":"2023-11-04T15:37:04.718699+0000","last_became_active":"2023-11-04T15:27:35.773449+0000","last_became_peered":"2023-11-04T15:27:35.773449+0000","last_unstale":"2023-11-04T15:37:04.718699+0000","last_undegraded":"2023-11-04T15:37:04.718699+0000","last_fullsized":"2023-11-04T15:37:04.718699+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1934,"log_dups_size":0,"ondisk_log_size":1934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1929,"num_write_kb":17119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"40'3519","reported_seq":2953,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:23.652533+0000","last_change":"2023-11-04T15:37:23.652627+0000","last_active":"2023-11-04T15:37:23.652533+0000","last_peered":"2023-11-04T15:37:23.652533+0000","last_clean":"2023-11-04T15:37:23.652533+0000","last_became_active":"2023-11-04T15:27:36.141086+0000","last_became_peered":"2023-11-04T15:27:36.141086+0000","last_unstale":"2023-11-04T15:37:23.652533+0000","last_undegraded":"2023-11-04T15:37:23.652533+0000","last_fullsized":"2023-11-04T15:37:23.652533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3519","last_scrub_stamp":"2023-11-04T15:37:23.652509+0000","last_deep_scrub":"40'3519","last_deep_scrub_stamp":"2023-11-04T15:37:23.652509+0000","last_clean_scrub_stamp":"2023-11-04T15:37:23.652509+0000","objects_scrubbed":0,"log_size":3519,"log_dups_size":0,"ondisk_log_size":3519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:28.689310+0000","scrub_duration":0.0061970940000000002,"objects_trimmed":0,"snaptrim_duration":0.059170119,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1142,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"37'655","reported_seq":696,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719906+0000","last_change":"2023-11-04T15:27:35.770858+0000","last_active":"2023-11-04T15:37:04.719906+0000","last_peered":"2023-11-04T15:37:04.719906+0000","last_clean":"2023-11-04T15:37:04.719906+0000","last_became_active":"2023-11-04T15:27:35.769001+0000","last_became_peered":"2023-11-04T15:27:35.769001+0000","last_unstale":"2023-11-04T15:37:04.719906+0000","last_undegraded":"2023-11-04T15:37:04.719906+0000","last_fullsized":"2023-11-04T15:37:04.719906+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":656,"num_write_kb":15166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"44'3666","reported_seq":3094,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:24.311230+0000","last_change":"2023-11-04T15:37:24.311349+0000","last_active":"2023-11-04T15:37:24.311230+0000","last_peered":"2023-11-04T15:37:24.311230+0000","last_clean":"2023-11-04T15:37:24.311230+0000","last_became_active":"2023-11-04T15:27:36.147034+0000","last_became_peered":"2023-11-04T15:27:36.147034+0000","last_unstale":"2023-11-04T15:37:24.311230+0000","last_undegraded":"2023-11-04T15:37:24.311230+0000","last_fullsized":"2023-11-04T15:37:24.311230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3666","last_scrub_stamp":"2023-11-04T15:37:24.311202+0000","last_deep_scrub":"44'3666","last_deep_scrub_stamp":"2023-11-04T15:37:24.311202+0000","last_clean_scrub_stamp":"2023-11-04T15:37:24.311202+0000","objects_scrubbed":3,"log_size":3666,"log_dups_size":0,"ondisk_log_size":3666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:56:38.113824+0000","scrub_duration":0.0088871530000000001,"objects_trimmed":0,"snaptrim_duration":0.064750725999999995,"stat_sum":{"num_bytes":4196,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1197,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":198,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.611391+0000","last_change":"2023-11-04T15:27:26.267129+0000","last_active":"2023-11-04T15:37:07.611391+0000","last_peered":"2023-11-04T15:37:07.611391+0000","last_clean":"2023-11-04T15:37:07.611391+0000","last_became_active":"2023-11-04T15:27:26.266242+0000","last_became_peered":"2023-11-04T15:27:26.266242+0000","last_unstale":"2023-11-04T15:37:07.611391+0000","last_undegraded":"2023-11-04T15:37:07.611391+0000","last_fullsized":"2023-11-04T15:37:07.611391+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:25.163848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:25.163848+0000","last_clean_scrub_stamp":"2023-11-04T15:27:25.163848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718937+0000","last_change":"2023-11-04T15:27:31.620178+0000","last_active":"2023-11-04T15:37:04.718937+0000","last_peered":"2023-11-04T15:37:04.718937+0000","last_clean":"2023-11-04T15:37:04.718937+0000","last_became_active":"2023-11-04T15:27:31.619798+0000","last_became_peered":"2023-11-04T15:27:31.619798+0000","last_unstale":"2023-11-04T15:37:04.718937+0000","last_undegraded":"2023-11-04T15:37:04.718937+0000","last_fullsized":"2023-11-04T15:37:04.718937+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"39'3629","reported_seq":3670,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720110+0000","last_change":"2023-11-04T15:27:35.769689+0000","last_active":"2023-11-04T15:37:04.720110+0000","last_peered":"2023-11-04T15:37:04.720110+0000","last_clean":"2023-11-04T15:37:04.720110+0000","last_became_active":"2023-11-04T15:27:35.769150+0000","last_became_peered":"2023-11-04T15:27:35.769150+0000","last_unstale":"2023-11-04T15:37:04.720110+0000","last_undegraded":"2023-11-04T15:37:04.720110+0000","last_fullsized":"2023-11-04T15:37:04.720110+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3629,"log_dups_size":0,"ondisk_log_size":3629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3620,"num_write_kb":52059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"40'3668","reported_seq":3075,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720004+0000","last_change":"2023-11-04T15:36:55.827884+0000","last_active":"2023-11-04T15:37:04.720004+0000","last_peered":"2023-11-04T15:37:04.720004+0000","last_clean":"2023-11-04T15:37:04.720004+0000","last_became_active":"2023-11-04T15:27:36.140619+0000","last_became_peered":"2023-11-04T15:27:36.140619+0000","last_unstale":"2023-11-04T15:37:04.720004+0000","last_undegraded":"2023-11-04T15:37:04.720004+0000","last_fullsized":"2023-11-04T15:37:04.720004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3668,"log_dups_size":0,"ondisk_log_size":3668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10532783499999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.611213+0000","last_change":"2023-11-04T15:27:31.622106+0000","last_active":"2023-11-04T15:37:07.611213+0000","last_peered":"2023-11-04T15:37:07.611213+0000","last_clean":"2023-11-04T15:37:07.611213+0000","last_became_active":"2023-11-04T15:27:31.621889+0000","last_became_peered":"2023-11-04T15:27:31.621889+0000","last_unstale":"2023-11-04T15:37:07.611213+0000","last_undegraded":"2023-11-04T15:37:07.611213+0000","last_fullsized":"2023-11-04T15:37:07.611213+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"43'3684","reported_seq":3891,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795087+0000","last_change":"2023-11-04T15:27:35.771207+0000","last_active":"2023-11-04T15:37:04.795087+0000","last_peered":"2023-11-04T15:37:04.795087+0000","last_clean":"2023-11-04T15:37:04.795087+0000","last_became_active":"2023-11-04T15:27:35.770364+0000","last_became_peered":"2023-11-04T15:27:35.770364+0000","last_unstale":"2023-11-04T15:37:04.795087+0000","last_undegraded":"2023-11-04T15:37:04.795087+0000","last_fullsized":"2023-11-04T15:37:04.795087+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3684,"log_dups_size":0,"ondisk_log_size":3684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15883313,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":166,"num_read_kb":3338,"num_write":3668,"num_write_kb":29714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"44'3553","reported_seq":2997,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:24.639590+0000","last_change":"2023-11-04T15:37:24.639702+0000","last_active":"2023-11-04T15:37:24.639590+0000","last_peered":"2023-11-04T15:37:24.639590+0000","last_clean":"2023-11-04T15:37:24.639590+0000","last_became_active":"2023-11-04T15:27:36.144459+0000","last_became_peered":"2023-11-04T15:27:36.144459+0000","last_unstale":"2023-11-04T15:37:24.639590+0000","last_undegraded":"2023-11-04T15:37:24.639590+0000","last_fullsized":"2023-11-04T15:37:24.639590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3553","last_scrub_stamp":"2023-11-04T15:37:24.639567+0000","last_deep_scrub":"44'3553","last_deep_scrub_stamp":"2023-11-04T15:37:24.639567+0000","last_clean_scrub_stamp":"2023-11-04T15:37:24.639567+0000","objects_scrubbed":2,"log_size":3553,"log_dups_size":0,"ondisk_log_size":3553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:38.307301+0000","scrub_duration":0.010629794999999999,"objects_trimmed":0,"snaptrim_duration":0.072685394,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719755+0000","last_change":"2023-11-04T15:27:31.622710+0000","last_active":"2023-11-04T15:37:04.719755+0000","last_peered":"2023-11-04T15:37:04.719755+0000","last_clean":"2023-11-04T15:37:04.719755+0000","last_became_active":"2023-11-04T15:27:31.622378+0000","last_became_peered":"2023-11-04T15:27:31.622378+0000","last_unstale":"2023-11-04T15:37:04.719755+0000","last_undegraded":"2023-11-04T15:37:04.719755+0000","last_fullsized":"2023-11-04T15:37:04.719755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"40'6079","reported_seq":6121,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:06.688256+0000","last_change":"2023-11-04T15:27:35.774630+0000","last_active":"2023-11-04T15:37:06.688256+0000","last_peered":"2023-11-04T15:37:06.688256+0000","last_clean":"2023-11-04T15:37:06.688256+0000","last_became_active":"2023-11-04T15:27:35.774339+0000","last_became_peered":"2023-11-04T15:27:35.774339+0000","last_unstale":"2023-11-04T15:37:06.688256+0000","last_undegraded":"2023-11-04T15:37:06.688256+0000","last_fullsized":"2023-11-04T15:37:06.688256+0000","mapping_epoch":16,"log_start":"26'400","ondisk_log_start":"26'400","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":5679,"log_dups_size":0,"ondisk_log_size":5679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6078,"num_write_kb":43849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"44'3173","reported_seq":2650,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:10.304885+0000","last_change":"2023-11-04T15:37:10.305048+0000","last_active":"2023-11-04T15:37:10.304885+0000","last_peered":"2023-11-04T15:37:10.304885+0000","last_clean":"2023-11-04T15:37:10.304885+0000","last_became_active":"2023-11-04T15:27:36.146930+0000","last_became_peered":"2023-11-04T15:27:36.146930+0000","last_unstale":"2023-11-04T15:37:10.304885+0000","last_undegraded":"2023-11-04T15:37:10.304885+0000","last_fullsized":"2023-11-04T15:37:10.304885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3173","last_scrub_stamp":"2023-11-04T15:37:10.304861+0000","last_deep_scrub":"44'3173","last_deep_scrub_stamp":"2023-11-04T15:37:10.304861+0000","last_clean_scrub_stamp":"2023-11-04T15:37:10.304861+0000","objects_scrubbed":1,"log_size":3173,"log_dups_size":0,"ondisk_log_size":3173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:31.914468+0000","scrub_duration":0.0078700769999999996,"objects_trimmed":0,"snaptrim_duration":0.067233409999999993,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1111,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":44,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720647+0000","last_change":"2023-11-04T15:27:31.622105+0000","last_active":"2023-11-04T15:37:04.720647+0000","last_peered":"2023-11-04T15:37:04.720647+0000","last_clean":"2023-11-04T15:37:04.720647+0000","last_became_active":"2023-11-04T15:27:31.621849+0000","last_became_peered":"2023-11-04T15:27:31.621849+0000","last_unstale":"2023-11-04T15:37:04.720647+0000","last_undegraded":"2023-11-04T15:37:04.720647+0000","last_fullsized":"2023-11-04T15:37:04.720647+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"44'3280","reported_seq":3332,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:27.659977+0000","last_change":"2023-11-04T15:37:27.660076+0000","last_active":"2023-11-04T15:37:27.659977+0000","last_peered":"2023-11-04T15:37:27.659977+0000","last_clean":"2023-11-04T15:37:27.659977+0000","last_became_active":"2023-11-04T15:27:35.769730+0000","last_became_peered":"2023-11-04T15:27:35.769730+0000","last_unstale":"2023-11-04T15:37:27.659977+0000","last_undegraded":"2023-11-04T15:37:27.659977+0000","last_fullsized":"2023-11-04T15:37:27.659977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3280","last_scrub_stamp":"2023-11-04T15:37:27.659954+0000","last_deep_scrub":"44'3280","last_deep_scrub_stamp":"2023-11-04T15:37:27.659954+0000","last_clean_scrub_stamp":"2023-11-04T15:37:27.659954+0000","objects_scrubbed":5,"log_size":3280,"log_dups_size":0,"ondisk_log_size":3280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:41.327688+0000","scrub_duration":0.054452754999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3258,"num_write_kb":30072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"44'3434","reported_seq":2863,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:18.421603+0000","last_change":"2023-11-04T15:37:18.421706+0000","last_active":"2023-11-04T15:37:18.421603+0000","last_peered":"2023-11-04T15:37:18.421603+0000","last_clean":"2023-11-04T15:37:18.421603+0000","last_became_active":"2023-11-04T15:27:36.144417+0000","last_became_peered":"2023-11-04T15:27:36.144417+0000","last_unstale":"2023-11-04T15:37:18.421603+0000","last_undegraded":"2023-11-04T15:37:18.421603+0000","last_fullsized":"2023-11-04T15:37:18.421603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3434","last_scrub_stamp":"2023-11-04T15:37:18.421580+0000","last_deep_scrub":"44'3434","last_deep_scrub_stamp":"2023-11-04T15:37:18.421580+0000","last_clean_scrub_stamp":"2023-11-04T15:37:18.421580+0000","objects_scrubbed":3,"log_size":3434,"log_dups_size":0,"ondisk_log_size":3434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:37:14.873581+0000","scrub_duration":0.011594345000000001,"objects_trimmed":0,"snaptrim_duration":0.067418286999999993,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"44'3108","reported_seq":3160,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:28.595136+0000","last_change":"2023-11-04T15:37:28.595288+0000","last_active":"2023-11-04T15:37:28.595136+0000","last_peered":"2023-11-04T15:37:28.595136+0000","last_clean":"2023-11-04T15:37:28.595136+0000","last_became_active":"2023-11-04T15:27:35.769772+0000","last_became_peered":"2023-11-04T15:27:35.769772+0000","last_unstale":"2023-11-04T15:37:28.595136+0000","last_undegraded":"2023-11-04T15:37:28.595136+0000","last_fullsized":"2023-11-04T15:37:28.595136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3108","last_scrub_stamp":"2023-11-04T15:37:28.595114+0000","last_deep_scrub":"44'3108","last_deep_scrub_stamp":"2023-11-04T15:37:28.595114+0000","last_clean_scrub_stamp":"2023-11-04T15:37:28.595114+0000","objects_scrubbed":3,"log_size":3108,"log_dups_size":0,"ondisk_log_size":3108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:56:42.397736+0000","scrub_duration":0.034473323,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3101,"num_write_kb":32806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":44,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720931+0000","last_change":"2023-11-04T15:27:31.622663+0000","last_active":"2023-11-04T15:37:04.720931+0000","last_peered":"2023-11-04T15:37:04.720931+0000","last_clean":"2023-11-04T15:37:04.720931+0000","last_became_active":"2023-11-04T15:27:31.622350+0000","last_became_peered":"2023-11-04T15:27:31.622350+0000","last_unstale":"2023-11-04T15:37:04.720931+0000","last_undegraded":"2023-11-04T15:37:04.720931+0000","last_fullsized":"2023-11-04T15:37:04.720931+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"43'3419","reported_seq":2905,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:09.350809+0000","last_change":"2023-11-04T15:37:09.350908+0000","last_active":"2023-11-04T15:37:09.350809+0000","last_peered":"2023-11-04T15:37:09.350809+0000","last_clean":"2023-11-04T15:37:09.350809+0000","last_became_active":"2023-11-04T15:27:36.143991+0000","last_became_peered":"2023-11-04T15:27:36.143991+0000","last_unstale":"2023-11-04T15:37:09.350809+0000","last_undegraded":"2023-11-04T15:37:09.350809+0000","last_fullsized":"2023-11-04T15:37:09.350809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3419","last_scrub_stamp":"2023-11-04T15:37:09.350786+0000","last_deep_scrub":"43'3419","last_deep_scrub_stamp":"2023-11-04T15:37:09.350786+0000","last_clean_scrub_stamp":"2023-11-04T15:37:09.350786+0000","objects_scrubbed":2,"log_size":3419,"log_dups_size":0,"ondisk_log_size":3419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:20:35.227166+0000","scrub_duration":0.0074817540000000002,"objects_trimmed":0,"snaptrim_duration":0.062728023999999993,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":1116,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"40'4464","reported_seq":4505,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720851+0000","last_change":"2023-11-04T15:27:35.769416+0000","last_active":"2023-11-04T15:37:04.720851+0000","last_peered":"2023-11-04T15:37:04.720851+0000","last_clean":"2023-11-04T15:37:04.720851+0000","last_became_active":"2023-11-04T15:27:35.769095+0000","last_became_peered":"2023-11-04T15:27:35.769095+0000","last_unstale":"2023-11-04T15:37:04.720851+0000","last_undegraded":"2023-11-04T15:37:04.720851+0000","last_fullsized":"2023-11-04T15:37:04.720851+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":4464,"log_dups_size":0,"ondisk_log_size":4464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4451,"num_write_kb":27035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720156+0000","last_change":"2023-11-04T15:27:31.619973+0000","last_active":"2023-11-04T15:37:04.720156+0000","last_peered":"2023-11-04T15:37:04.720156+0000","last_clean":"2023-11-04T15:37:04.720156+0000","last_became_active":"2023-11-04T15:27:31.619702+0000","last_became_peered":"2023-11-04T15:27:31.619702+0000","last_unstale":"2023-11-04T15:37:04.720156+0000","last_undegraded":"2023-11-04T15:37:04.720156+0000","last_fullsized":"2023-11-04T15:37:04.720156+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"40'3558","reported_seq":2955,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:19.665748+0000","last_change":"2023-11-04T15:37:19.665851+0000","last_active":"2023-11-04T15:37:19.665748+0000","last_peered":"2023-11-04T15:37:19.665748+0000","last_clean":"2023-11-04T15:37:19.665748+0000","last_became_active":"2023-11-04T15:27:36.139707+0000","last_became_peered":"2023-11-04T15:27:36.139707+0000","last_unstale":"2023-11-04T15:37:19.665748+0000","last_undegraded":"2023-11-04T15:37:19.665748+0000","last_fullsized":"2023-11-04T15:37:19.665748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3558","last_scrub_stamp":"2023-11-04T15:37:19.665726+0000","last_deep_scrub":"40'3558","last_deep_scrub_stamp":"2023-11-04T15:37:19.665726+0000","last_clean_scrub_stamp":"2023-11-04T15:37:19.665726+0000","objects_scrubbed":0,"log_size":3558,"log_dups_size":0,"ondisk_log_size":3558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:24:54.436304+0000","scrub_duration":0.0061987099999999996,"objects_trimmed":0,"snaptrim_duration":0.073815121999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"37'1214","reported_seq":1255,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.721285+0000","last_change":"2023-11-04T15:27:35.768818+0000","last_active":"2023-11-04T15:37:04.721285+0000","last_peered":"2023-11-04T15:37:04.721285+0000","last_clean":"2023-11-04T15:37:04.721285+0000","last_became_active":"2023-11-04T15:27:35.768320+0000","last_became_peered":"2023-11-04T15:27:35.768320+0000","last_unstale":"2023-11-04T15:37:04.721285+0000","last_undegraded":"2023-11-04T15:37:04.721285+0000","last_fullsized":"2023-11-04T15:37:04.721285+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1214,"log_dups_size":0,"ondisk_log_size":1214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1211,"num_write_kb":18003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:42.307837+0000","last_change":"2023-11-04T15:37:42.307944+0000","last_active":"2023-11-04T15:37:42.307837+0000","last_peered":"2023-11-04T15:37:42.307837+0000","last_clean":"2023-11-04T15:37:42.307837+0000","last_became_active":"2023-11-04T15:27:31.624347+0000","last_became_peered":"2023-11-04T15:27:31.624347+0000","last_unstale":"2023-11-04T15:37:42.307837+0000","last_undegraded":"2023-11-04T15:37:42.307837+0000","last_fullsized":"2023-11-04T15:37:42.307837+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:37:42.307817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:37:42.307817+0000","last_clean_scrub_stamp":"2023-11-04T15:37:42.307817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:40:21.913960+0000","scrub_duration":0.002137136,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"40'3608","reported_seq":3014,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:06.226333+0000","last_change":"2023-11-04T15:36:55.791977+0000","last_active":"2023-11-04T15:37:06.226333+0000","last_peered":"2023-11-04T15:37:06.226333+0000","last_clean":"2023-11-04T15:37:06.226333+0000","last_became_active":"2023-11-04T15:27:36.137897+0000","last_became_peered":"2023-11-04T15:27:36.137897+0000","last_unstale":"2023-11-04T15:37:06.226333+0000","last_undegraded":"2023-11-04T15:37:06.226333+0000","last_fullsized":"2023-11-04T15:37:06.226333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3608,"log_dups_size":0,"ondisk_log_size":3608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.069534850999999995,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"44'829","reported_seq":870,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:06.226281+0000","last_change":"2023-11-04T15:27:35.772416+0000","last_active":"2023-11-04T15:37:06.226281+0000","last_peered":"2023-11-04T15:37:06.226281+0000","last_clean":"2023-11-04T15:37:06.226281+0000","last_became_active":"2023-11-04T15:27:35.772121+0000","last_became_peered":"2023-11-04T15:27:35.772121+0000","last_unstale":"2023-11-04T15:37:06.226281+0000","last_undegraded":"2023-11-04T15:37:06.226281+0000","last_fullsized":"2023-11-04T15:37:06.226281+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":960,"num_write_kb":25976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719859+0000","last_change":"2023-11-04T15:27:31.620235+0000","last_active":"2023-11-04T15:37:04.719859+0000","last_peered":"2023-11-04T15:37:04.719859+0000","last_clean":"2023-11-04T15:37:04.719859+0000","last_became_active":"2023-11-04T15:27:31.619831+0000","last_became_peered":"2023-11-04T15:27:31.619831+0000","last_unstale":"2023-11-04T15:37:04.719859+0000","last_undegraded":"2023-11-04T15:37:04.719859+0000","last_fullsized":"2023-11-04T15:37:04.719859+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"44'3481","reported_seq":2936,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:10.702812+0000","last_change":"2023-11-04T15:37:10.702911+0000","last_active":"2023-11-04T15:37:10.702812+0000","last_peered":"2023-11-04T15:37:10.702812+0000","last_clean":"2023-11-04T15:37:10.702812+0000","last_became_active":"2023-11-04T15:27:36.140871+0000","last_became_peered":"2023-11-04T15:27:36.140871+0000","last_unstale":"2023-11-04T15:37:10.702812+0000","last_undegraded":"2023-11-04T15:37:10.702812+0000","last_fullsized":"2023-11-04T15:37:10.702812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3481","last_scrub_stamp":"2023-11-04T15:37:10.702789+0000","last_deep_scrub":"44'3481","last_deep_scrub_stamp":"2023-11-04T15:37:10.702789+0000","last_clean_scrub_stamp":"2023-11-04T15:37:10.702789+0000","objects_scrubbed":1,"log_size":3481,"log_dups_size":0,"ondisk_log_size":3481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:23:02.723895+0000","scrub_duration":0.008399541,"objects_trimmed":0,"snaptrim_duration":0.058381362999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"40'3644","reported_seq":3059,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:22.638939+0000","last_change":"2023-11-04T15:37:22.639061+0000","last_active":"2023-11-04T15:37:22.638939+0000","last_peered":"2023-11-04T15:37:22.638939+0000","last_clean":"2023-11-04T15:37:22.638939+0000","last_became_active":"2023-11-04T15:27:36.139487+0000","last_became_peered":"2023-11-04T15:27:36.139487+0000","last_unstale":"2023-11-04T15:37:22.638939+0000","last_undegraded":"2023-11-04T15:37:22.638939+0000","last_fullsized":"2023-11-04T15:37:22.638939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3644","last_scrub_stamp":"2023-11-04T15:37:22.638916+0000","last_deep_scrub":"40'3644","last_deep_scrub_stamp":"2023-11-04T15:37:22.638916+0000","last_clean_scrub_stamp":"2023-11-04T15:37:22.638916+0000","objects_scrubbed":0,"log_size":3644,"log_dups_size":0,"ondisk_log_size":3644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:37:19.090917+0000","scrub_duration":0.0049130600000000003,"objects_trimmed":0,"snaptrim_duration":0.056621590999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"44'2776","reported_seq":2828,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:42.474185+0000","last_change":"2023-11-04T15:37:42.474282+0000","last_active":"2023-11-04T15:37:42.474185+0000","last_peered":"2023-11-04T15:37:42.474185+0000","last_clean":"2023-11-04T15:37:42.474185+0000","last_became_active":"2023-11-04T15:27:35.775356+0000","last_became_peered":"2023-11-04T15:27:35.775356+0000","last_unstale":"2023-11-04T15:37:42.474185+0000","last_undegraded":"2023-11-04T15:37:42.474185+0000","last_fullsized":"2023-11-04T15:37:42.474185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2776","last_scrub_stamp":"2023-11-04T15:37:42.474162+0000","last_deep_scrub":"44'2776","last_deep_scrub_stamp":"2023-11-04T15:37:42.474162+0000","last_clean_scrub_stamp":"2023-11-04T15:37:42.474162+0000","objects_scrubbed":5,"log_size":2776,"log_dups_size":0,"ondisk_log_size":2776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:55:13.607739+0000","scrub_duration":0.030546663000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2770,"num_write_kb":31342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"40'3525","reported_seq":2933,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719969+0000","last_change":"2023-11-04T15:36:55.781878+0000","last_active":"2023-11-04T15:37:04.719969+0000","last_peered":"2023-11-04T15:37:04.719969+0000","last_clean":"2023-11-04T15:37:04.719969+0000","last_became_active":"2023-11-04T15:27:36.146464+0000","last_became_peered":"2023-11-04T15:27:36.146464+0000","last_unstale":"2023-11-04T15:37:04.719969+0000","last_undegraded":"2023-11-04T15:37:04.719969+0000","last_fullsized":"2023-11-04T15:37:04.719969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3525,"log_dups_size":0,"ondisk_log_size":3525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.064516859999999995,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"43'3742","reported_seq":3783,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.150547+0000","last_change":"2023-11-04T15:27:35.770401+0000","last_active":"2023-11-04T15:37:07.150547+0000","last_peered":"2023-11-04T15:37:07.150547+0000","last_clean":"2023-11-04T15:37:07.150547+0000","last_became_active":"2023-11-04T15:27:35.769904+0000","last_became_peered":"2023-11-04T15:27:35.769904+0000","last_unstale":"2023-11-04T15:37:07.150547+0000","last_undegraded":"2023-11-04T15:37:07.150547+0000","last_fullsized":"2023-11-04T15:37:07.150547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3742,"log_dups_size":0,"ondisk_log_size":3742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3740,"num_write_kb":21755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"40'3554","reported_seq":3595,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.150549+0000","last_change":"2023-11-04T15:27:35.768689+0000","last_active":"2023-11-04T15:37:07.150549+0000","last_peered":"2023-11-04T15:37:07.150549+0000","last_clean":"2023-11-04T15:37:07.150549+0000","last_became_active":"2023-11-04T15:27:35.768413+0000","last_became_peered":"2023-11-04T15:27:35.768413+0000","last_unstale":"2023-11-04T15:37:07.150549+0000","last_undegraded":"2023-11-04T15:37:07.150549+0000","last_fullsized":"2023-11-04T15:37:07.150549+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3554,"log_dups_size":0,"ondisk_log_size":3554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3537,"num_write_kb":29647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"40'3937","reported_seq":3332,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:42.530756+0000","last_change":"2023-11-04T15:37:42.530849+0000","last_active":"2023-11-04T15:37:42.530756+0000","last_peered":"2023-11-04T15:37:42.530756+0000","last_clean":"2023-11-04T15:37:42.530756+0000","last_became_active":"2023-11-04T15:27:36.139524+0000","last_became_peered":"2023-11-04T15:27:36.139524+0000","last_unstale":"2023-11-04T15:37:42.530756+0000","last_undegraded":"2023-11-04T15:37:42.530756+0000","last_fullsized":"2023-11-04T15:37:42.530756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3937","last_scrub_stamp":"2023-11-04T15:37:42.530734+0000","last_deep_scrub":"40'3937","last_deep_scrub_stamp":"2023-11-04T15:37:42.530734+0000","last_clean_scrub_stamp":"2023-11-04T15:37:42.530734+0000","objects_scrubbed":0,"log_size":3937,"log_dups_size":0,"ondisk_log_size":3937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:07:56.161396+0000","scrub_duration":0.0048541679999999999,"objects_trimmed":0,"snaptrim_duration":0.068494678000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1248,"num_write_kb":670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"37'1637","reported_seq":1678,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:06.226344+0000","last_change":"2023-11-04T15:27:35.776242+0000","last_active":"2023-11-04T15:37:06.226344+0000","last_peered":"2023-11-04T15:37:06.226344+0000","last_clean":"2023-11-04T15:37:06.226344+0000","last_became_active":"2023-11-04T15:27:35.775917+0000","last_became_peered":"2023-11-04T15:27:35.775917+0000","last_unstale":"2023-11-04T15:37:06.226344+0000","last_undegraded":"2023-11-04T15:37:06.226344+0000","last_fullsized":"2023-11-04T15:37:06.226344+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1637,"log_dups_size":0,"ondisk_log_size":1637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1634,"num_write_kb":25426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"44'3473","reported_seq":2906,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:21.407271+0000","last_change":"2023-11-04T15:37:21.407382+0000","last_active":"2023-11-04T15:37:21.407271+0000","last_peered":"2023-11-04T15:37:21.407271+0000","last_clean":"2023-11-04T15:37:21.407271+0000","last_became_active":"2023-11-04T15:27:36.150557+0000","last_became_peered":"2023-11-04T15:27:36.150557+0000","last_unstale":"2023-11-04T15:37:21.407271+0000","last_undegraded":"2023-11-04T15:37:21.407271+0000","last_fullsized":"2023-11-04T15:37:21.407271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3473","last_scrub_stamp":"2023-11-04T15:37:21.407243+0000","last_deep_scrub":"44'3473","last_deep_scrub_stamp":"2023-11-04T15:37:21.407243+0000","last_clean_scrub_stamp":"2023-11-04T15:37:21.407243+0000","objects_scrubbed":1,"log_size":3473,"log_dups_size":0,"ondisk_log_size":3473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:18:27.087972+0000","scrub_duration":0.0082048629999999997,"objects_trimmed":0,"snaptrim_duration":0.062631718000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"40'3228","reported_seq":2711,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719603+0000","last_change":"2023-11-04T15:36:55.826604+0000","last_active":"2023-11-04T15:37:04.719603+0000","last_peered":"2023-11-04T15:37:04.719603+0000","last_clean":"2023-11-04T15:37:04.719603+0000","last_became_active":"2023-11-04T15:27:36.149831+0000","last_became_peered":"2023-11-04T15:27:36.149831+0000","last_unstale":"2023-11-04T15:37:04.719603+0000","last_undegraded":"2023-11-04T15:37:04.719603+0000","last_fullsized":"2023-11-04T15:37:04.719603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3228,"log_dups_size":0,"ondisk_log_size":3228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.103639325,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1060,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"44'4779","reported_seq":4831,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:19.478819+0000","last_change":"2023-11-04T15:37:19.478909+0000","last_active":"2023-11-04T15:37:19.478819+0000","last_peered":"2023-11-04T15:37:19.478819+0000","last_clean":"2023-11-04T15:37:19.478819+0000","last_became_active":"2023-11-04T15:27:35.770022+0000","last_became_peered":"2023-11-04T15:27:35.770022+0000","last_unstale":"2023-11-04T15:37:19.478819+0000","last_undegraded":"2023-11-04T15:37:19.478819+0000","last_fullsized":"2023-11-04T15:37:19.478819+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4779","last_scrub_stamp":"2023-11-04T15:37:19.478796+0000","last_deep_scrub":"44'4779","last_deep_scrub_stamp":"2023-11-04T15:37:19.478796+0000","last_clean_scrub_stamp":"2023-11-04T15:37:19.478796+0000","objects_scrubbed":7,"log_size":4779,"log_dups_size":0,"ondisk_log_size":4779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:24.515597+0000","scrub_duration":0.083030119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28974830,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4772,"num_write_kb":50744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"43'3333","reported_seq":2778,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:06.226514+0000","last_change":"2023-11-04T15:36:55.797686+0000","last_active":"2023-11-04T15:37:06.226514+0000","last_peered":"2023-11-04T15:37:06.226514+0000","last_clean":"2023-11-04T15:37:06.226514+0000","last_became_active":"2023-11-04T15:27:36.138908+0000","last_became_peered":"2023-11-04T15:27:36.138908+0000","last_unstale":"2023-11-04T15:37:06.226514+0000","last_undegraded":"2023-11-04T15:37:06.226514+0000","last_fullsized":"2023-11-04T15:37:06.226514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3333,"log_dups_size":0,"ondisk_log_size":3333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.073000567000000002,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":1157,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"44'784","reported_seq":836,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:23.362195+0000","last_change":"2023-11-04T15:37:23.362327+0000","last_active":"2023-11-04T15:37:23.362195+0000","last_peered":"2023-11-04T15:37:23.362195+0000","last_clean":"2023-11-04T15:37:23.362195+0000","last_became_active":"2023-11-04T15:27:35.767858+0000","last_became_peered":"2023-11-04T15:27:35.767858+0000","last_unstale":"2023-11-04T15:37:23.362195+0000","last_undegraded":"2023-11-04T15:37:23.362195+0000","last_fullsized":"2023-11-04T15:37:23.362195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'784","last_scrub_stamp":"2023-11-04T15:37:23.362171+0000","last_deep_scrub":"44'784","last_deep_scrub_stamp":"2023-11-04T15:37:23.362171+0000","last_clean_scrub_stamp":"2023-11-04T15:37:23.362171+0000","objects_scrubbed":4,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:37.029904+0000","scrub_duration":0.042357839000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":779,"num_write_kb":20966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"40'3359","reported_seq":2795,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:25.666192+0000","last_change":"2023-11-04T15:37:25.666192+0000","last_active":"2023-11-04T15:37:25.666192+0000","last_peered":"2023-11-04T15:37:25.666192+0000","last_clean":"2023-11-04T15:37:25.666192+0000","last_became_active":"2023-11-04T15:27:36.143442+0000","last_became_peered":"2023-11-04T15:27:36.143442+0000","last_unstale":"2023-11-04T15:37:25.666192+0000","last_undegraded":"2023-11-04T15:37:25.666192+0000","last_fullsized":"2023-11-04T15:37:25.666192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3359","last_scrub_stamp":"2023-11-04T15:37:25.666058+0000","last_deep_scrub":"40'3359","last_deep_scrub_stamp":"2023-11-04T15:37:25.666058+0000","last_clean_scrub_stamp":"2023-11-04T15:37:25.666058+0000","objects_scrubbed":0,"log_size":3359,"log_dups_size":0,"ondisk_log_size":3359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:56:39.468680+0000","scrub_duration":0.003764154,"objects_trimmed":0,"snaptrim_duration":0.072078296,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1167,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"37'3778","reported_seq":3819,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.150579+0000","last_change":"2023-11-04T15:27:35.771653+0000","last_active":"2023-11-04T15:37:07.150579+0000","last_peered":"2023-11-04T15:37:07.150579+0000","last_clean":"2023-11-04T15:37:07.150579+0000","last_became_active":"2023-11-04T15:27:35.770539+0000","last_became_peered":"2023-11-04T15:27:35.770539+0000","last_unstale":"2023-11-04T15:37:07.150579+0000","last_undegraded":"2023-11-04T15:37:07.150579+0000","last_fullsized":"2023-11-04T15:37:07.150579+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3778,"log_dups_size":0,"ondisk_log_size":3778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3770,"num_write_kb":38321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"40'3791","reported_seq":3147,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:06.688498+0000","last_change":"2023-11-04T15:36:55.780664+0000","last_active":"2023-11-04T15:37:06.688498+0000","last_peered":"2023-11-04T15:37:06.688498+0000","last_clean":"2023-11-04T15:37:06.688498+0000","last_became_active":"2023-11-04T15:27:36.146477+0000","last_became_peered":"2023-11-04T15:27:36.146477+0000","last_unstale":"2023-11-04T15:37:06.688498+0000","last_undegraded":"2023-11-04T15:37:06.688498+0000","last_fullsized":"2023-11-04T15:37:06.688498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3791,"log_dups_size":0,"ondisk_log_size":3791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063144525000000007,"stat_sum":{"num_bytes":8192,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1270,"num_write_kb":694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"40'2943","reported_seq":2984,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:06.226317+0000","last_change":"2023-11-04T15:27:35.772092+0000","last_active":"2023-11-04T15:37:06.226317+0000","last_peered":"2023-11-04T15:37:06.226317+0000","last_clean":"2023-11-04T15:37:06.226317+0000","last_became_active":"2023-11-04T15:27:35.771316+0000","last_became_peered":"2023-11-04T15:27:35.771316+0000","last_unstale":"2023-11-04T15:37:06.226317+0000","last_undegraded":"2023-11-04T15:37:06.226317+0000","last_fullsized":"2023-11-04T15:37:06.226317+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":2943,"log_dups_size":0,"ondisk_log_size":2943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2943,"num_write_kb":28401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"44'3597","reported_seq":3019,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:09.671026+0000","last_change":"2023-11-04T15:37:09.671026+0000","last_active":"2023-11-04T15:37:09.671026+0000","last_peered":"2023-11-04T15:37:09.671026+0000","last_clean":"2023-11-04T15:37:09.671026+0000","last_became_active":"2023-11-04T15:27:36.144066+0000","last_became_peered":"2023-11-04T15:27:36.144066+0000","last_unstale":"2023-11-04T15:37:09.671026+0000","last_undegraded":"2023-11-04T15:37:09.671026+0000","last_fullsized":"2023-11-04T15:37:09.671026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3597","last_scrub_stamp":"2023-11-04T15:37:09.670901+0000","last_deep_scrub":"44'3597","last_deep_scrub_stamp":"2023-11-04T15:37:09.670901+0000","last_clean_scrub_stamp":"2023-11-04T15:37:09.670901+0000","objects_scrubbed":2,"log_size":3597,"log_dups_size":0,"ondisk_log_size":3597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T22:52:59.961460+0000","scrub_duration":0.010082327,"objects_trimmed":0,"snaptrim_duration":0.057889772999999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1118,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"41'926","reported_seq":967,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.150640+0000","last_change":"2023-11-04T15:27:35.768679+0000","last_active":"2023-11-04T15:37:07.150640+0000","last_peered":"2023-11-04T15:37:07.150640+0000","last_clean":"2023-11-04T15:37:07.150640+0000","last_became_active":"2023-11-04T15:27:35.767852+0000","last_became_peered":"2023-11-04T15:27:35.767852+0000","last_unstale":"2023-11-04T15:37:07.150640+0000","last_undegraded":"2023-11-04T15:37:07.150640+0000","last_fullsized":"2023-11-04T15:37:07.150640+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":926,"log_dups_size":0,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":923,"num_write_kb":21087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"40'3552","reported_seq":2974,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.150675+0000","last_change":"2023-11-04T15:36:55.776553+0000","last_active":"2023-11-04T15:37:07.150675+0000","last_peered":"2023-11-04T15:37:07.150675+0000","last_clean":"2023-11-04T15:37:07.150675+0000","last_became_active":"2023-11-04T15:27:36.141167+0000","last_became_peered":"2023-11-04T15:27:36.141167+0000","last_unstale":"2023-11-04T15:37:07.150675+0000","last_undegraded":"2023-11-04T15:37:07.150675+0000","last_fullsized":"2023-11-04T15:37:07.150675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3552,"log_dups_size":0,"ondisk_log_size":3552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057363947999999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1127,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"44'3229","reported_seq":3281,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:37.512770+0000","last_change":"2023-11-04T15:37:37.512913+0000","last_active":"2023-11-04T15:37:37.512770+0000","last_peered":"2023-11-04T15:37:37.512770+0000","last_clean":"2023-11-04T15:37:37.512770+0000","last_became_active":"2023-11-04T15:27:35.775171+0000","last_became_peered":"2023-11-04T15:27:35.775171+0000","last_unstale":"2023-11-04T15:37:37.512770+0000","last_undegraded":"2023-11-04T15:37:37.512770+0000","last_fullsized":"2023-11-04T15:37:37.512770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3229","last_scrub_stamp":"2023-11-04T15:37:37.512732+0000","last_deep_scrub":"44'3229","last_deep_scrub_stamp":"2023-11-04T15:37:37.512732+0000","last_clean_scrub_stamp":"2023-11-04T15:37:37.512732+0000","objects_scrubbed":4,"log_size":3229,"log_dups_size":0,"ondisk_log_size":3229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:07:51.143393+0000","scrub_duration":0.039893972,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3214,"num_write_kb":42509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"44'3490","reported_seq":2947,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:09.749095+0000","last_change":"2023-11-04T15:37:09.749095+0000","last_active":"2023-11-04T15:37:09.749095+0000","last_peered":"2023-11-04T15:37:09.749095+0000","last_clean":"2023-11-04T15:37:09.749095+0000","last_became_active":"2023-11-04T15:27:36.145560+0000","last_became_peered":"2023-11-04T15:27:36.145560+0000","last_unstale":"2023-11-04T15:37:09.749095+0000","last_undegraded":"2023-11-04T15:37:09.749095+0000","last_fullsized":"2023-11-04T15:37:09.749095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3490","last_scrub_stamp":"2023-11-04T15:37:09.748973+0000","last_deep_scrub":"44'3490","last_deep_scrub_stamp":"2023-11-04T15:37:09.748973+0000","last_clean_scrub_stamp":"2023-11-04T15:37:09.748973+0000","objects_scrubbed":5,"log_size":3490,"log_dups_size":0,"ondisk_log_size":3490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:31.358580+0000","scrub_duration":0.011863093,"objects_trimmed":0,"snaptrim_duration":0.07011676,"stat_sum":{"num_bytes":4151,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":1159,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"40'4214","reported_seq":4256,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:06.226350+0000","last_change":"2023-11-04T15:27:35.771225+0000","last_active":"2023-11-04T15:37:06.226350+0000","last_peered":"2023-11-04T15:37:06.226350+0000","last_clean":"2023-11-04T15:37:06.226350+0000","last_became_active":"2023-11-04T15:27:35.770873+0000","last_became_peered":"2023-11-04T15:27:35.770873+0000","last_unstale":"2023-11-04T15:37:06.226350+0000","last_undegraded":"2023-11-04T15:37:06.226350+0000","last_fullsized":"2023-11-04T15:37:06.226350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":4214,"log_dups_size":0,"ondisk_log_size":4214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4214,"num_write_kb":32525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"44'4092","reported_seq":3407,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:13.735284+0000","last_change":"2023-11-04T15:37:13.735284+0000","last_active":"2023-11-04T15:37:13.735284+0000","last_peered":"2023-11-04T15:37:13.735284+0000","last_clean":"2023-11-04T15:37:13.735284+0000","last_became_active":"2023-11-04T15:27:36.147535+0000","last_became_peered":"2023-11-04T15:27:36.147535+0000","last_unstale":"2023-11-04T15:37:13.735284+0000","last_undegraded":"2023-11-04T15:37:13.735284+0000","last_fullsized":"2023-11-04T15:37:13.735284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4092","last_scrub_stamp":"2023-11-04T15:37:13.735159+0000","last_deep_scrub":"44'4092","last_deep_scrub_stamp":"2023-11-04T15:37:13.735159+0000","last_clean_scrub_stamp":"2023-11-04T15:37:13.735159+0000","objects_scrubbed":2,"log_size":4092,"log_dups_size":0,"ondisk_log_size":4092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:20:39.611539+0000","scrub_duration":0.012119325,"objects_trimmed":0,"snaptrim_duration":0.055801837,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1294,"num_write_kb":719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"40'1589","reported_seq":1630,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795958+0000","last_change":"2023-11-04T15:27:35.776315+0000","last_active":"2023-11-04T15:37:04.795958+0000","last_peered":"2023-11-04T15:37:04.795958+0000","last_clean":"2023-11-04T15:37:04.795958+0000","last_became_active":"2023-11-04T15:27:35.775918+0000","last_became_peered":"2023-11-04T15:27:35.775918+0000","last_unstale":"2023-11-04T15:37:04.795958+0000","last_undegraded":"2023-11-04T15:37:04.795958+0000","last_fullsized":"2023-11-04T15:37:04.795958+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1589,"log_dups_size":0,"ondisk_log_size":1589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1587,"num_write_kb":12658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":127433,"num_objects":92,"num_object_clones":25,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":8,"num_read":46,"num_read_kb":30,"num_write":74822,"num_write_kb":40603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":254672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224327,"ondisk_log_size":224327,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":430735581,"num_objects":126,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":126,"num_whiteouts":0,"num_read":190,"num_read_kb":3338,"num_write":83456,"num_write_kb":897544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1707,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":861528064,"data_stored":861471162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83115,"ondisk_log_size":83115,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705792,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":663648,"kb_used_data":173208,"kb_used_omap":0,"kb_used_meta":490432,"kb_avail":93708192,"statfs":{"total":96636764160,"available":95957188608,"internally_reserved":0,"allocated":177364992,"data_stored":176999461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":502202368},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.435,"15min":0.40000000000000002},"min":{"1min":0.23000000000000001,"5min":0.17000000000000001,"15min":0.156},"max":{"1min":10.488,"5min":10.488,"15min":10.488},"last":0.51300000000000001},{"interface":"front","average":{"1min":1.0509999999999999,"5min":0.58399999999999996,"15min":0.45500000000000002},"min":{"1min":0.21199999999999999,"5min":0.186,"15min":0.186},"max":{"1min":11.621,"5min":13.055,"15min":13.055},"last":0.46800000000000003}]},{"osd":1,"last update":"Sat Nov 4 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.496,"15min":0.433},"min":{"1min":0.219,"5min":0.188,"15min":0.188},"max":{"1min":12.347,"5min":12.347,"15min":12.347},"last":0.495},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.48999999999999999,"15min":0.438},"min":{"1min":0.23699999999999999,"5min":0.21299999999999999,"15min":0.186},"max":{"1min":12.853999999999999,"5min":12.853999999999999,"15min":12.853999999999999},"last":0.44900000000000001}]},{"osd":2,"last update":"Sat Nov 4 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.41299999999999998,"15min":0.34499999999999997},"min":{"1min":0.16900000000000001,"5min":0.153,"15min":0.153},"max":{"1min":11.709,"5min":11.709,"15min":11.709},"last":0.37},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.40300000000000002,"15min":0.35599999999999998},"min":{"1min":0.19500000000000001,"5min":0.14899999999999999,"15min":0.14899999999999999},"max":{"1min":9.2629999999999999,"5min":9.2629999999999999,"15min":9.2629999999999999},"last":0.39200000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705791,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":952424,"kb_used_data":245472,"kb_used_omap":0,"kb_used_meta":706944,"kb_avail":93419416,"statfs":{"total":96636764160,"available":95661481984,"internally_reserved":0,"allocated":251363328,"data_stored":250991590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":723910656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 15:37:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":0.64800000000000002,"15min":0.46600000000000003},"min":{"1min":0.20599999999999999,"5min":0.153,"15min":0.151},"max":{"1min":21.297999999999998,"5min":21.297999999999998,"15min":21.297999999999998},"last":0.435},{"interface":"front","average":{"1min":1.252,"5min":0.55900000000000005,"15min":0.432},"min":{"1min":0.26000000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":17.809000000000001,"5min":17.809000000000001,"15min":17.809000000000001},"last":0.45300000000000001}]},{"osd":1,"last update":"Sat Nov 4 15:37:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":0.53800000000000003,"15min":0.44700000000000001},"min":{"1min":0.379,"5min":0.192,"15min":0.17100000000000001},"max":{"1min":10.851000000000001,"5min":10.851000000000001,"15min":10.851000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":1.2509999999999999,"5min":0.54200000000000004,"15min":0.46100000000000002},"min":{"1min":0.37,"5min":0.20899999999999999,"15min":0.20399999999999999},"max":{"1min":8.9740000000000002,"5min":8.9740000000000002,"15min":8.9740000000000002},"last":0.41699999999999998}]},{"osd":3,"last update":"Sat Nov 4 15:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.33700000000000002,"15min":0.32400000000000001},"min":{"1min":0.19700000000000001,"5min":0.152,"15min":0.14699999999999999},"max":{"1min":3.3929999999999998,"5min":3.3929999999999998,"15min":3.3929999999999998},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.874,"5min":0.43099999999999999,"15min":0.373},"min":{"1min":0.248,"5min":0.159,"15min":0.14899999999999999},"max":{"1min":10.887,"5min":10.887,"15min":10.887},"last":0.35099999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705790,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":719272,"kb_used_data":188640,"kb_used_omap":0,"kb_used_meta":530624,"kb_avail":93652568,"statfs":{"total":96636764160,"available":95900229632,"internally_reserved":0,"allocated":193167360,"data_stored":192807863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":543358976},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.40699999999999997,"15min":0.318},"min":{"1min":0.17100000000000001,"5min":0.14399999999999999,"15min":0.14399999999999999},"max":{"1min":1.012,"5min":12.768000000000001,"15min":12.768000000000001},"last":0.377},{"interface":"front","average":{"1min":0.248,"5min":0.30399999999999999,"15min":0.29499999999999998},"min":{"1min":0.19,"5min":0.14399999999999999,"15min":0.14399999999999999},"max":{"1min":0.377,"5min":8.609,"15min":8.609},"last":0.39400000000000002}]},{"osd":2,"last update":"Sat Nov 4 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.40400000000000003,"15min":0.44},"min":{"1min":0.28499999999999998,"5min":0.19600000000000001,"15min":0.189},"max":{"1min":1.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.624},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.39000000000000001,"15min":0.42399999999999999},"min":{"1min":0.29599999999999999,"5min":0.19600000000000001,"15min":0.192},"max":{"1min":0.98199999999999998,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.55500000000000005}]},{"osd":3,"last update":"Sat Nov 4 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.42099999999999999,"15min":0.438},"min":{"1min":0.309,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.65200000000000002,"5min":6.7679999999999998,"15min":6.7679999999999998},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.41999999999999998,"15min":0.45000000000000001},"min":{"1min":0.32100000000000001,"5min":0.249,"15min":0.24299999999999999},"max":{"1min":1.446,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.58399999999999996}]}]},{"osd":0,"up_from":9,"seq":38654705791,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":918208,"kb_used_data":237496,"kb_used_omap":0,"kb_used_meta":680704,"kb_avail":93453632,"statfs":{"total":96636764160,"available":95696519168,"internally_reserved":0,"allocated":243195904,"data_stored":242832608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":697040896},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 15:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.45500000000000002,"15min":0.32100000000000001},"min":{"1min":0.187,"5min":0.14499999999999999,"15min":0.13500000000000001},"max":{"1min":12.731,"5min":12.731,"15min":12.731},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.30199999999999999,"15min":0.27500000000000002},"min":{"1min":0.185,"5min":0.16400000000000001,"15min":0.155},"max":{"1min":0.5,"5min":4.1200000000000001,"15min":4.1200000000000001},"last":0.28899999999999998}]},{"osd":2,"last update":"Sat Nov 4 15:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.45600000000000002,"15min":0.42899999999999999},"min":{"1min":0.252,"5min":0.19400000000000001,"15min":0.17599999999999999},"max":{"1min":1.8169999999999999,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.443,"15min":0.42899999999999999},"min":{"1min":0.255,"5min":0.21099999999999999,"15min":0.187},"max":{"1min":3.6749999999999998,"5min":3.6749999999999998,"15min":3.6749999999999998},"last":0.50800000000000001}]},{"osd":3,"last update":"Sat Nov 4 15:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.442},"min":{"1min":0.26700000000000002,"5min":0.20899999999999999,"15min":0.20300000000000001},"max":{"1min":0.68899999999999995,"5min":6.4660000000000002,"15min":6.4660000000000002},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.47699999999999998,"15min":0.44800000000000001},"min":{"1min":0.29199999999999998,"5min":0.23899999999999999,"15min":0.23000000000000001},"max":{"1min":0.68400000000000005,"5min":6.3540000000000001,"15min":6.3540000000000001},"last":0.60899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":242003968,"data_stored":241991173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":192552960,"data_stored":192552686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":250785792,"data_stored":250765155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":176185344,"data_stored":176162148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":69829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":73939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":45197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":65707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T15:37:48.679 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.680 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.680 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.680 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.681 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.681 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.681 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.682 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.682 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.682 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.682 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.683 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.683 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.683 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.684 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.684 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.684 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.685 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.685 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.685 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.686 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.686 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.686 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.687 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.687 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.687 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.688 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.688 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.688 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.688 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.689 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.689 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.689 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.690 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.690 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.690 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.691 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.691 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.691 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.692 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.692 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.692 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.693 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-04T15:27:25.163848+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=25, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.693 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-04T15:27:30.611946+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.693 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.693 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.694 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-04T15:27:30.611946+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.694 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.694 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-04T15:27:30.611946+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.695 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.695 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-04T15:27:30.611946+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.695 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-04T15:27:30.611946+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.696 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.696 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-04T15:27:30.611946+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.696 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.697 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.697 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.697 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-04T15:27:30.611946+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.698 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.698 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.698 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.699 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.699 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.699 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.700 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.700 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.700 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.701 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.701 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.701 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.701 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:37:48.702 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-04T15:38:03.977 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:38:03.980 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:38:03.983 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:38:08.703 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T15:38:08.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.825+0000 7fd710ff0640 1 Processor -- start 2023-11-04T15:38:08.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.825+0000 7fd710ff0640 1 -- start start 2023-11-04T15:38:08.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.825+0000 7fd710ff0640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd70c137320 0x7fd70c13a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:38:08.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.825+0000 7fd710ff0640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd70c06ae80 con 0x7fd70c137700 2023-11-04T15:38:08.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.825+0000 7fd710ff0640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd70c06c430 con 0x7fd70c06b590 2023-11-04T15:38:08.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.825+0000 7fd710ff0640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c06c6d0 con 0x7fd70c137320 2023-11-04T15:38:08.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.825+0000 7fd70ad9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd70c137700 0x7fd70c142340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42642/0 (socket says 172.21.15.19:42642) 2023-11-04T15:38:08.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.825+0000 7fd70ad9d640 1 -- 172.21.15.19:0/2131117262 learned_addr learned my addr 172.21.15.19:0/2131117262 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:38:08.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.826+0000 7fd70959a640 1 -- 172.21.15.19:0/2131117262 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1875148999 0 0) 0x7fd70c06ae80 con 0x7fd70c137700 2023-11-04T15:38:08.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.826+0000 7fd70a59c640 1 --2- 172.21.15.19:0/2131117262 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd70c137320 0x7fd70c13a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:38:08.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.826+0000 7fd70959a640 1 -- 172.21.15.19:0/2131117262 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6f4003520 con 0x7fd70c137700 2023-11-04T15:38:08.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.826+0000 7fd70959a640 1 -- 172.21.15.19:0/2131117262 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2145478393 0 0) 0x7fd6f4003520 con 0x7fd70c137700 2023-11-04T15:38:08.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.826+0000 7fd70959a640 1 -- 172.21.15.19:0/2131117262 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd70c137320 msgr2=0x7fd70c13a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:38:08.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.826+0000 7fd70959a640 1 --2- 172.21.15.19:0/2131117262 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd70c137320 0x7fd70c13a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:38:08.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.826+0000 7fd70959a640 1 -- 172.21.15.19:0/2131117262 >> v1:172.21.15.96:6789/0 conn(0x7fd70c06b590 legacy=0x7fd70c13a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:38:08.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.826+0000 7fd70959a640 1 -- 172.21.15.19:0/2131117262 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70c0a6810 con 0x7fd70c137700 2023-11-04T15:38:08.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.826+0000 7fd70959a640 1 -- 172.21.15.19:0/2131117262 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3646097784 0 0) 0x7fd7040019f0 con 0x7fd70c137700 2023-11-04T15:38:08.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.826+0000 7fd70959a640 1 -- 172.21.15.19:0/2131117262 >> v1:172.21.15.19:6789/0 conn(0x7fd70c137700 legacy=0x7fd70c142340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:38:08.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.826+0000 7fd70959a640 1 --2- 172.21.15.19:0/2131117262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6f40039a0 0x7fd6f4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:38:08.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.826+0000 7fd70959a640 1 --2- 172.21.15.19:0/2131117262 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd70c137320 0x7fd6f40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:38:08.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.826+0000 7fd70959a640 1 --2- 172.21.15.19:0/2131117262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6f4004d00 0x7fd6f4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:38:08.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.826+0000 7fd70959a640 1 -- 172.21.15.19:0/2131117262 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c06c6d0 con 0x7fd6f40039a0 2023-11-04T15:38:08.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.826+0000 7fd70959a640 1 -- 172.21.15.19:0/2131117262 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f400bab0 con 0x7fd6f4004d00 2023-11-04T15:38:08.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.826+0000 7fd70959a640 1 -- 172.21.15.19:0/2131117262 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f400bc70 con 0x7fd70c137320 2023-11-04T15:38:08.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.826+0000 7fd70a59c640 1 --2- 172.21.15.19:0/2131117262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6f40039a0 0x7fd6f4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:38:08.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.826+0000 7fd709d9b640 1 --2- 172.21.15.19:0/2131117262 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd70c137320 0x7fd6f40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:38:08.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.826+0000 7fd70ad9d640 1 --2- 172.21.15.19:0/2131117262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6f4004d00 0x7fd6f4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:38:08.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.827+0000 7fd70a59c640 1 -- 172.21.15.19:0/2131117262 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd70c137320 msgr2=0x7fd6f40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:38:08.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.827+0000 7fd70a59c640 1 --2- 172.21.15.19:0/2131117262 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd70c137320 0x7fd6f40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:38:08.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.827+0000 7fd70a59c640 1 -- 172.21.15.19:0/2131117262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6f4004d00 msgr2=0x7fd6f4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:38:08.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.827+0000 7fd70a59c640 1 --2- 172.21.15.19:0/2131117262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6f4004d00 0x7fd6f4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:38:08.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.827+0000 7fd70a59c640 1 -- 172.21.15.19:0/2131117262 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f4003520 con 0x7fd6f40039a0 2023-11-04T15:38:08.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.827+0000 7fd70a59c640 1 --2- 172.21.15.19:0/2131117262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6f40039a0 0x7fd6f4003dc0 secure :-1 s=READY pgs=3776 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc009ac0 tx=0x7fd6f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b2a84c39c3c10c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:38:08.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.827+0000 7fd70959a640 1 -- 172.21.15.19:0/2131117262 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc02c600 con 0x7fd6f40039a0 2023-11-04T15:38:08.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.827+0000 7fd70959a640 1 -- 172.21.15.19:0/2131117262 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6fc02c760 con 0x7fd6f40039a0 2023-11-04T15:38:08.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.827+0000 7fd70959a640 1 -- 172.21.15.19:0/2131117262 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc02caf0 con 0x7fd6f40039a0 2023-11-04T15:38:08.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.828+0000 7fd710ff0640 1 -- 172.21.15.19:0/2131117262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6f40039a0 msgr2=0x7fd6f4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:38:08.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.828+0000 7fd710ff0640 1 --2- 172.21.15.19:0/2131117262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6f40039a0 0x7fd6f4003dc0 secure :-1 s=READY pgs=3776 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc009ac0 tx=0x7fd6f40057f0 comp rx=0 tx=0).stop 2023-11-04T15:38:08.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.828+0000 7fd70ad9d640 1 -- 172.21.15.19:0/2131117262 reap_dead start 2023-11-04T15:38:08.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.828+0000 7fd710ff0640 1 -- 172.21.15.19:0/2131117262 shutdown_connections 2023-11-04T15:38:08.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.828+0000 7fd710ff0640 1 -- 172.21.15.19:0/2131117262 >> 172.21.15.19:0/2131117262 conn(0x7fd70c0a6b70 msgr2=0x7fd70c0a6f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:38:08.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.828+0000 7fd710ff0640 1 -- 172.21.15.19:0/2131117262 shutdown_connections 2023-11-04T15:38:08.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.828+0000 7fd710ff0640 1 -- 172.21.15.19:0/2131117262 wait complete. 2023-11-04T15:38:08.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.829+0000 7fd710ff0640 1 Processor -- start 2023-11-04T15:38:08.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.829+0000 7fd710ff0640 1 -- start start 2023-11-04T15:38:08.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.830+0000 7fd710ff0640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd6f40039a0 0x7fd70c120720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:38:08.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.830+0000 7fd710ff0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd70c120c60 0x7fd70c1210a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:38:08.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.830+0000 7fd710ff0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd70c1cecc0 0x7fd70c1cf170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:38:08.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.830+0000 7fd710ff0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c1215e0 con 0x7fd70c1cecc0 2023-11-04T15:38:08.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.830+0000 7fd710ff0640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c122e80 con 0x7fd70c120c60 2023-11-04T15:38:08.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.830+0000 7fd710ff0640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c1225a0 con 0x7fd6f40039a0 2023-11-04T15:38:08.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.830+0000 7fd70ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd70c1cecc0 0x7fd70c1cf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:38:08.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.830+0000 7fd70ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd70c1cecc0 0x7fd70c1cf170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44816/0 (socket says 172.21.15.19:44816) 2023-11-04T15:38:08.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.830+0000 7fd70ad9d640 1 -- 172.21.15.19:0/2409672236 learned_addr learned my addr 172.21.15.19:0/2409672236 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:38:08.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.830+0000 7fd709d9b640 1 --2- 172.21.15.19:0/2409672236 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd70c120c60 0x7fd70c1210a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:38:08.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.830+0000 7fd70a59c640 1 --2- 172.21.15.19:0/2409672236 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd6f40039a0 0x7fd70c120720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:38:08.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.830+0000 7fd70ad9d640 1 -- 172.21.15.19:0/2409672236 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd6f40039a0 msgr2=0x7fd70c120720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:38:08.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.830+0000 7fd70ad9d640 1 --2- 172.21.15.19:0/2409672236 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd6f40039a0 0x7fd70c120720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:38:08.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.830+0000 7fd70ad9d640 1 -- 172.21.15.19:0/2409672236 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd70c120c60 msgr2=0x7fd70c1210a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:38:08.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.830+0000 7fd70ad9d640 1 --2- 172.21.15.19:0/2409672236 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd70c120c60 0x7fd70c1210a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:38:08.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.830+0000 7fd70ad9d640 1 -- 172.21.15.19:0/2409672236 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70c1242f0 con 0x7fd70c1cecc0 2023-11-04T15:38:08.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.830+0000 7fd70a59c640 1 --2- 172.21.15.19:0/2409672236 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd6f40039a0 0x7fd70c120720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:38:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.830+0000 7fd70ad9d640 1 --2- 172.21.15.19:0/2409672236 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd70c1cecc0 0x7fd70c1cf170 secure :-1 s=READY pgs=3777 cs=0 l=1 rev1=1 crypto rx=0x7fd70c06d060 tx=0x7fd704007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:38:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.831+0000 7fd6faffd640 1 -- 172.21.15.19:0/2409672236 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70400ac30 con 0x7fd70c1cecc0 2023-11-04T15:38:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.831+0000 7fd6faffd640 1 -- 172.21.15.19:0/2409672236 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70400add0 con 0x7fd70c1cecc0 2023-11-04T15:38:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.831+0000 7fd710ff0640 1 -- 172.21.15.19:0/2409672236 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd70c123820 con 0x7fd70c1cecc0 2023-11-04T15:38:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.831+0000 7fd6faffd640 1 -- 172.21.15.19:0/2409672236 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd704013630 con 0x7fd70c1cecc0 2023-11-04T15:38:08.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.831+0000 7fd710ff0640 1 -- 172.21.15.19:0/2409672236 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd70c1232a0 con 0x7fd70c1cecc0 2023-11-04T15:38:08.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.832+0000 7fd710ff0640 1 -- 172.21.15.19:0/2409672236 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd70c067d60 con 0x7fd70c1cecc0 2023-11-04T15:38:08.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.832+0000 7fd6faffd640 1 -- 172.21.15.19:0/2409672236 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd704013790 con 0x7fd70c1cecc0 2023-11-04T15:38:08.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.833+0000 7fd6faffd640 1 --2- 172.21.15.19:0/2409672236 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fd6ec06a430 0x7fd6ec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:38:08.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.833+0000 7fd6faffd640 1 -- 172.21.15.19:0/2409672236 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4434+0+0 (secure 0 0 0) 0x7fd704088b80 con 0x7fd70c1cecc0 2023-11-04T15:38:08.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.833+0000 7fd70a59c640 1 --2- 172.21.15.19:0/2409672236 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fd6ec06a430 0x7fd6ec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:38:08.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.833+0000 7fd70a59c640 1 --2- 172.21.15.19:0/2409672236 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fd6ec06a430 0x7fd6ec06c8f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc036000 tx=0x7fd6fc030000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:38:08.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:08.837+0000 7fd6faffd640 1 -- 172.21.15.19:0/2409672236 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd704054650 con 0x7fd70c1cecc0 2023-11-04T15:38:09.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:09.011+0000 7fd710ff0640 1 -- 172.21.15.19:0/2409672236 --> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd70c122fc0 con 0x7fd6ec06a430 2023-11-04T15:38:09.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:09.018+0000 7fd6faffd640 1 -- 172.21.15.19:0/2409672236 <== mgr.4114 v2:172.21.15.96:6816/83123 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279085 (secure 0 0 0) 0x7fd70c122fc0 con 0x7fd6ec06a430 2023-11-04T15:38:09.023 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:38:09.024 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-11-04T15:38:09.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:09.021+0000 7fd710ff0640 1 -- 172.21.15.19:0/2409672236 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fd6ec06a430 msgr2=0x7fd6ec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:38:09.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:09.021+0000 7fd710ff0640 1 --2- 172.21.15.19:0/2409672236 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fd6ec06a430 0x7fd6ec06c8f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc036000 tx=0x7fd6fc030000 comp rx=0 tx=0).stop 2023-11-04T15:38:09.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:09.021+0000 7fd710ff0640 1 -- 172.21.15.19:0/2409672236 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd70c1cecc0 msgr2=0x7fd70c1cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:38:09.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:09.021+0000 7fd710ff0640 1 --2- 172.21.15.19:0/2409672236 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd70c1cecc0 0x7fd70c1cf170 secure :-1 s=READY pgs=3777 cs=0 l=1 rev1=1 crypto rx=0x7fd70c06d060 tx=0x7fd704007bd0 comp rx=0 tx=0).stop 2023-11-04T15:38:09.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:09.021+0000 7fd710ff0640 1 -- 172.21.15.19:0/2409672236 shutdown_connections 2023-11-04T15:38:09.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:09.021+0000 7fd710ff0640 1 --2- 172.21.15.19:0/2409672236 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fd6ec06a430 0x7fd6ec06c8f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:38:09.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:09.021+0000 7fd710ff0640 1 --2- 172.21.15.19:0/2409672236 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd70c1cecc0 0x7fd70c1cf170 unknown :-1 s=CLOSED pgs=3777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:38:09.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:09.021+0000 7fd710ff0640 1 --2- 172.21.15.19:0/2409672236 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd70c120c60 0x7fd70c1210a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:38:09.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:09.021+0000 7fd710ff0640 1 --2- 172.21.15.19:0/2409672236 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd6f40039a0 0x7fd70c120720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:38:09.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:09.021+0000 7fd710ff0640 1 -- 172.21.15.19:0/2409672236 >> 172.21.15.19:0/2409672236 conn(0x7fd70c0a6b70 msgr2=0x7fd70c0a7e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:38:09.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:09.021+0000 7fd710ff0640 1 -- 172.21.15.19:0/2409672236 shutdown_connections 2023-11-04T15:38:09.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:09.021+0000 7fd710ff0640 1 -- 172.21.15.19:0/2409672236 wait complete. 2023-11-04T15:38:09.034 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":362,"stamp":"2023-11-04T15:38:07.071040+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":431453382,"num_objects":220,"num_object_clones":25,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":8,"num_read":352,"num_read_kb":3468,"num_write":158437,"num_write_kb":940563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6707,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":307630,"ondisk_log_size":307630,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":3253552,"kb_used_data":844816,"kb_used_omap":0,"kb_used_meta":2408704,"kb_avail":374233808,"statfs":{"total":386547056640,"available":383215419392,"internally_reserved":0,"allocated":865091584,"data_stored":863631522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2466512896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003008"},"pg_stats":[{"pgid":"4.3f","version":"40'3514","reported_seq":2963,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:08.783192+0000","last_change":"2023-11-04T15:37:08.783192+0000","last_active":"2023-11-04T15:37:08.783192+0000","last_peered":"2023-11-04T15:37:08.783192+0000","last_clean":"2023-11-04T15:37:08.783192+0000","last_became_active":"2023-11-04T15:27:36.150296+0000","last_became_peered":"2023-11-04T15:27:36.150296+0000","last_unstale":"2023-11-04T15:37:08.783192+0000","last_undegraded":"2023-11-04T15:37:08.783192+0000","last_fullsized":"2023-11-04T15:37:08.783192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3514","last_scrub_stamp":"2023-11-04T15:37:08.783013+0000","last_deep_scrub":"40'3514","last_deep_scrub_stamp":"2023-11-04T15:37:08.783013+0000","last_clean_scrub_stamp":"2023-11-04T15:37:08.783013+0000","objects_scrubbed":0,"log_size":3514,"log_dups_size":0,"ondisk_log_size":3514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:20:34.659393+0000","scrub_duration":0.0030156520000000002,"objects_trimmed":0,"snaptrim_duration":0.074678280999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1112,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"43'3332","reported_seq":2785,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.150860+0000","last_change":"2023-11-04T15:36:55.781000+0000","last_active":"2023-11-04T15:37:07.150860+0000","last_peered":"2023-11-04T15:37:07.150860+0000","last_clean":"2023-11-04T15:37:07.150860+0000","last_became_active":"2023-11-04T15:27:36.148939+0000","last_became_peered":"2023-11-04T15:27:36.148939+0000","last_unstale":"2023-11-04T15:37:07.150860+0000","last_undegraded":"2023-11-04T15:37:07.150860+0000","last_fullsized":"2023-11-04T15:37:07.150860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3332,"log_dups_size":0,"ondisk_log_size":3332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059113046000000002,"stat_sum":{"num_bytes":35,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1118,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"40'3527","reported_seq":3001,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.611673+0000","last_change":"2023-11-04T15:36:55.822917+0000","last_active":"2023-11-04T15:37:07.611673+0000","last_peered":"2023-11-04T15:37:07.611673+0000","last_clean":"2023-11-04T15:37:07.611673+0000","last_became_active":"2023-11-04T15:27:36.149748+0000","last_became_peered":"2023-11-04T15:27:36.149748+0000","last_unstale":"2023-11-04T15:37:07.611673+0000","last_undegraded":"2023-11-04T15:37:07.611673+0000","last_fullsized":"2023-11-04T15:37:07.611673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3527,"log_dups_size":0,"ondisk_log_size":3527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101592565,"stat_sum":{"num_bytes":8206,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":1149,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"40'3602","reported_seq":2985,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.150840+0000","last_change":"2023-11-04T15:36:55.770578+0000","last_active":"2023-11-04T15:37:07.150840+0000","last_peered":"2023-11-04T15:37:07.150840+0000","last_clean":"2023-11-04T15:37:07.150840+0000","last_became_active":"2023-11-04T15:27:36.139761+0000","last_became_peered":"2023-11-04T15:27:36.139761+0000","last_unstale":"2023-11-04T15:37:07.150840+0000","last_undegraded":"2023-11-04T15:37:07.150840+0000","last_fullsized":"2023-11-04T15:37:07.150840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3602,"log_dups_size":0,"ondisk_log_size":3602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052924038,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1171,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"40'3725","reported_seq":3130,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:49.526048+0000","last_change":"2023-11-04T15:37:49.526154+0000","last_active":"2023-11-04T15:37:49.526048+0000","last_peered":"2023-11-04T15:37:49.526048+0000","last_clean":"2023-11-04T15:37:49.526048+0000","last_became_active":"2023-11-04T15:27:36.150017+0000","last_became_peered":"2023-11-04T15:27:36.150017+0000","last_unstale":"2023-11-04T15:37:49.526048+0000","last_undegraded":"2023-11-04T15:37:49.526048+0000","last_fullsized":"2023-11-04T15:37:49.526048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3725","last_scrub_stamp":"2023-11-04T15:37:49.526022+0000","last_deep_scrub":"40'3725","last_deep_scrub_stamp":"2023-11-04T15:37:49.526022+0000","last_clean_scrub_stamp":"2023-11-04T15:37:49.526022+0000","objects_scrubbed":0,"log_size":3725,"log_dups_size":0,"ondisk_log_size":3725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:46:35.934988+0000","scrub_duration":0.0051336519999999998,"objects_trimmed":0,"snaptrim_duration":0.073241305000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1192,"num_write_kb":641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"40'3327","reported_seq":2771,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.611630+0000","last_change":"2023-11-04T15:36:55.824394+0000","last_active":"2023-11-04T15:37:07.611630+0000","last_peered":"2023-11-04T15:37:07.611630+0000","last_clean":"2023-11-04T15:37:07.611630+0000","last_became_active":"2023-11-04T15:27:36.139036+0000","last_became_peered":"2023-11-04T15:27:36.139036+0000","last_unstale":"2023-11-04T15:37:07.611630+0000","last_undegraded":"2023-11-04T15:37:07.611630+0000","last_fullsized":"2023-11-04T15:37:07.611630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3327,"log_dups_size":0,"ondisk_log_size":3327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.102154117,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1074,"num_write_kb":603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"44'3356","reported_seq":2819,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:26.478185+0000","last_change":"2023-11-04T15:37:26.478185+0000","last_active":"2023-11-04T15:37:26.478185+0000","last_peered":"2023-11-04T15:37:26.478185+0000","last_clean":"2023-11-04T15:37:26.478185+0000","last_became_active":"2023-11-04T15:27:36.139121+0000","last_became_peered":"2023-11-04T15:27:36.139121+0000","last_unstale":"2023-11-04T15:37:26.478185+0000","last_undegraded":"2023-11-04T15:37:26.478185+0000","last_fullsized":"2023-11-04T15:37:26.478185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3356","last_scrub_stamp":"2023-11-04T15:37:26.478037+0000","last_deep_scrub":"44'3356","last_deep_scrub_stamp":"2023-11-04T15:37:26.478037+0000","last_clean_scrub_stamp":"2023-11-04T15:37:26.478037+0000","objects_scrubbed":5,"log_size":3356,"log_dups_size":0,"ondisk_log_size":3356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:38:01.386862+0000","scrub_duration":0.011615044999999999,"objects_trimmed":0,"snaptrim_duration":0.099827518000000004,"stat_sum":{"num_bytes":4117,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":2,"num_read_kb":1,"num_write":1086,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"40'3425","reported_seq":2844,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.611595+0000","last_change":"2023-11-04T15:36:55.816551+0000","last_active":"2023-11-04T15:37:07.611595+0000","last_peered":"2023-11-04T15:37:07.611595+0000","last_clean":"2023-11-04T15:37:07.611595+0000","last_became_active":"2023-11-04T15:27:36.147050+0000","last_became_peered":"2023-11-04T15:27:36.147050+0000","last_unstale":"2023-11-04T15:37:07.611595+0000","last_undegraded":"2023-11-04T15:37:07.611595+0000","last_fullsized":"2023-11-04T15:37:07.611595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3425,"log_dups_size":0,"ondisk_log_size":3425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.098810337999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"40'3561","reported_seq":2965,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:06.226649+0000","last_change":"2023-11-04T15:36:55.796038+0000","last_active":"2023-11-04T15:37:06.226649+0000","last_peered":"2023-11-04T15:37:06.226649+0000","last_clean":"2023-11-04T15:37:06.226649+0000","last_became_active":"2023-11-04T15:27:36.145825+0000","last_became_peered":"2023-11-04T15:27:36.145825+0000","last_unstale":"2023-11-04T15:37:06.226649+0000","last_undegraded":"2023-11-04T15:37:06.226649+0000","last_fullsized":"2023-11-04T15:37:06.226649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3561,"log_dups_size":0,"ondisk_log_size":3561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072094483000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"44'3329","reported_seq":2857,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:55.514489+0000","last_change":"2023-11-04T15:37:55.514590+0000","last_active":"2023-11-04T15:37:55.514489+0000","last_peered":"2023-11-04T15:37:55.514489+0000","last_clean":"2023-11-04T15:37:55.514489+0000","last_became_active":"2023-11-04T15:27:36.150307+0000","last_became_peered":"2023-11-04T15:27:36.150307+0000","last_unstale":"2023-11-04T15:37:55.514489+0000","last_undegraded":"2023-11-04T15:37:55.514489+0000","last_fullsized":"2023-11-04T15:37:55.514489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3329","last_scrub_stamp":"2023-11-04T15:37:55.514464+0000","last_deep_scrub":"44'3329","last_deep_scrub_stamp":"2023-11-04T15:37:55.514464+0000","last_clean_scrub_stamp":"2023-11-04T15:37:55.514464+0000","objects_scrubbed":2,"log_size":3329,"log_dups_size":0,"ondisk_log_size":3329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:11:45.335660+0000","scrub_duration":0.011217928,"objects_trimmed":0,"snaptrim_duration":0.10012518099999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1064,"num_write_kb":572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"40'3202","reported_seq":2721,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.150819+0000","last_change":"2023-11-04T15:36:55.770571+0000","last_active":"2023-11-04T15:37:07.150819+0000","last_peered":"2023-11-04T15:37:07.150819+0000","last_clean":"2023-11-04T15:37:07.150819+0000","last_became_active":"2023-11-04T15:27:36.144988+0000","last_became_peered":"2023-11-04T15:27:36.144988+0000","last_unstale":"2023-11-04T15:37:07.150819+0000","last_undegraded":"2023-11-04T15:37:07.150819+0000","last_fullsized":"2023-11-04T15:37:07.150819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3202,"log_dups_size":0,"ondisk_log_size":3202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052379294999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1028,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"40'3394","reported_seq":2823,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:06.688553+0000","last_change":"2023-11-04T15:36:55.782106+0000","last_active":"2023-11-04T15:37:06.688553+0000","last_peered":"2023-11-04T15:37:06.688553+0000","last_clean":"2023-11-04T15:37:06.688553+0000","last_became_active":"2023-11-04T15:27:36.149156+0000","last_became_peered":"2023-11-04T15:27:36.149156+0000","last_unstale":"2023-11-04T15:37:06.688553+0000","last_undegraded":"2023-11-04T15:37:06.688553+0000","last_fullsized":"2023-11-04T15:37:06.688553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3394,"log_dups_size":0,"ondisk_log_size":3394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.064372897999999998,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1159,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"40'3255","reported_seq":2744,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:06.226588+0000","last_change":"2023-11-04T15:36:55.792591+0000","last_active":"2023-11-04T15:37:06.226588+0000","last_peered":"2023-11-04T15:37:06.226588+0000","last_clean":"2023-11-04T15:37:06.226588+0000","last_became_active":"2023-11-04T15:27:36.139824+0000","last_became_peered":"2023-11-04T15:27:36.139824+0000","last_unstale":"2023-11-04T15:37:06.226588+0000","last_undegraded":"2023-11-04T15:37:06.226588+0000","last_fullsized":"2023-11-04T15:37:06.226588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3255,"log_dups_size":0,"ondisk_log_size":3255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070068697999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1062,"num_write_kb":575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"40'3538","reported_seq":2918,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718794+0000","last_change":"2023-11-04T15:36:55.774374+0000","last_active":"2023-11-04T15:37:04.718794+0000","last_peered":"2023-11-04T15:37:04.718794+0000","last_clean":"2023-11-04T15:37:04.718794+0000","last_became_active":"2023-11-04T15:27:36.147273+0000","last_became_peered":"2023-11-04T15:27:36.147273+0000","last_unstale":"2023-11-04T15:37:04.718794+0000","last_undegraded":"2023-11-04T15:37:04.718794+0000","last_fullsized":"2023-11-04T15:37:04.718794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3538,"log_dups_size":0,"ondisk_log_size":3538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055716603000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"40'3766","reported_seq":3159,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718379+0000","last_change":"2023-11-04T15:36:55.780005+0000","last_active":"2023-11-04T15:37:04.718379+0000","last_peered":"2023-11-04T15:37:04.718379+0000","last_clean":"2023-11-04T15:37:04.718379+0000","last_became_active":"2023-11-04T15:27:36.148932+0000","last_became_peered":"2023-11-04T15:27:36.148932+0000","last_unstale":"2023-11-04T15:37:04.718379+0000","last_undegraded":"2023-11-04T15:37:04.718379+0000","last_fullsized":"2023-11-04T15:37:04.718379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3766,"log_dups_size":0,"ondisk_log_size":3766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062648212999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1209,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"40'3538","reported_seq":2946,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718524+0000","last_change":"2023-11-04T15:36:55.818096+0000","last_active":"2023-11-04T15:37:04.718524+0000","last_peered":"2023-11-04T15:37:04.718524+0000","last_clean":"2023-11-04T15:37:04.718524+0000","last_became_active":"2023-11-04T15:27:36.150856+0000","last_became_peered":"2023-11-04T15:27:36.150856+0000","last_unstale":"2023-11-04T15:37:04.718524+0000","last_undegraded":"2023-11-04T15:37:04.718524+0000","last_fullsized":"2023-11-04T15:37:04.718524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3538,"log_dups_size":0,"ondisk_log_size":3538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.099772735000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"40'3671","reported_seq":3000,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795770+0000","last_change":"2023-11-04T15:36:55.797112+0000","last_active":"2023-11-04T15:37:04.795770+0000","last_peered":"2023-11-04T15:37:04.795770+0000","last_clean":"2023-11-04T15:37:04.795770+0000","last_became_active":"2023-11-04T15:27:36.144997+0000","last_became_peered":"2023-11-04T15:27:36.144997+0000","last_unstale":"2023-11-04T15:37:04.795770+0000","last_undegraded":"2023-11-04T15:37:04.795770+0000","last_fullsized":"2023-11-04T15:37:04.795770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3671,"log_dups_size":0,"ondisk_log_size":3671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072563297999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1270,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"44'3139","reported_seq":2656,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:43.481415+0000","last_change":"2023-11-04T15:37:43.481511+0000","last_active":"2023-11-04T15:37:43.481415+0000","last_peered":"2023-11-04T15:37:43.481415+0000","last_clean":"2023-11-04T15:37:43.481415+0000","last_became_active":"2023-11-04T15:27:36.150555+0000","last_became_peered":"2023-11-04T15:27:36.150555+0000","last_unstale":"2023-11-04T15:37:43.481415+0000","last_undegraded":"2023-11-04T15:37:43.481415+0000","last_fullsized":"2023-11-04T15:37:43.481415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3139","last_scrub_stamp":"2023-11-04T15:37:43.481392+0000","last_deep_scrub":"44'3139","last_deep_scrub_stamp":"2023-11-04T15:37:43.481392+0000","last_clean_scrub_stamp":"2023-11-04T15:37:43.481392+0000","objects_scrubbed":2,"log_size":3139,"log_dups_size":0,"ondisk_log_size":3139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:46:29.890357+0000","scrub_duration":0.010710094,"objects_trimmed":0,"snaptrim_duration":0.101696772,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1042,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"40'3390","reported_seq":2813,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795930+0000","last_change":"2023-11-04T15:36:55.795034+0000","last_active":"2023-11-04T15:37:04.795930+0000","last_peered":"2023-11-04T15:37:04.795930+0000","last_clean":"2023-11-04T15:37:04.795930+0000","last_became_active":"2023-11-04T15:27:36.147745+0000","last_became_peered":"2023-11-04T15:27:36.147745+0000","last_unstale":"2023-11-04T15:37:04.795930+0000","last_undegraded":"2023-11-04T15:37:04.795930+0000","last_fullsized":"2023-11-04T15:37:04.795930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3390,"log_dups_size":0,"ondisk_log_size":3390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071588252000000005,"stat_sum":{"num_bytes":4128,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1173,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"44'3507","reported_seq":2929,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:47.451001+0000","last_change":"2023-11-04T15:37:47.451113+0000","last_active":"2023-11-04T15:37:47.451001+0000","last_peered":"2023-11-04T15:37:47.451001+0000","last_clean":"2023-11-04T15:37:47.451001+0000","last_became_active":"2023-11-04T15:27:36.150687+0000","last_became_peered":"2023-11-04T15:27:36.150687+0000","last_unstale":"2023-11-04T15:37:47.451001+0000","last_undegraded":"2023-11-04T15:37:47.451001+0000","last_fullsized":"2023-11-04T15:37:47.451001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3507","last_scrub_stamp":"2023-11-04T15:37:47.450975+0000","last_deep_scrub":"44'3507","last_deep_scrub_stamp":"2023-11-04T15:37:47.450975+0000","last_clean_scrub_stamp":"2023-11-04T15:37:47.450975+0000","objects_scrubbed":2,"log_size":3507,"log_dups_size":0,"ondisk_log_size":3507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:21:13.505376+0000","scrub_duration":0.0096580350000000006,"objects_trimmed":0,"snaptrim_duration":0.097896176000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1154,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"43'3544","reported_seq":2982,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.717966+0000","last_change":"2023-11-04T15:36:55.776770+0000","last_active":"2023-11-04T15:37:04.717966+0000","last_peered":"2023-11-04T15:37:04.717966+0000","last_clean":"2023-11-04T15:37:04.717966+0000","last_became_active":"2023-11-04T15:27:36.143551+0000","last_became_peered":"2023-11-04T15:27:36.143551+0000","last_unstale":"2023-11-04T15:37:04.717966+0000","last_undegraded":"2023-11-04T15:37:04.717966+0000","last_fullsized":"2023-11-04T15:37:04.717966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3544,"log_dups_size":0,"ondisk_log_size":3544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056037475000000003,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1178,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"40'3728","reported_seq":3086,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795181+0000","last_change":"2023-11-04T15:36:55.794625+0000","last_active":"2023-11-04T15:37:04.795181+0000","last_peered":"2023-11-04T15:37:04.795181+0000","last_clean":"2023-11-04T15:37:04.795181+0000","last_became_active":"2023-11-04T15:27:36.145943+0000","last_became_peered":"2023-11-04T15:27:36.145943+0000","last_unstale":"2023-11-04T15:37:04.795181+0000","last_undegraded":"2023-11-04T15:37:04.795181+0000","last_fullsized":"2023-11-04T15:37:04.795181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3728,"log_dups_size":0,"ondisk_log_size":3728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071549077000000003,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1242,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"40'3454","reported_seq":2890,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719444+0000","last_change":"2023-11-04T15:36:55.777772+0000","last_active":"2023-11-04T15:37:04.719444+0000","last_peered":"2023-11-04T15:37:04.719444+0000","last_clean":"2023-11-04T15:37:04.719444+0000","last_became_active":"2023-11-04T15:27:36.144083+0000","last_became_peered":"2023-11-04T15:27:36.144083+0000","last_unstale":"2023-11-04T15:37:04.719444+0000","last_undegraded":"2023-11-04T15:37:04.719444+0000","last_fullsized":"2023-11-04T15:37:04.719444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3454,"log_dups_size":0,"ondisk_log_size":3454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.060959410999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1127,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"40'3632","reported_seq":2992,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.717704+0000","last_change":"2023-11-04T15:36:55.821483+0000","last_active":"2023-11-04T15:37:04.717704+0000","last_peered":"2023-11-04T15:37:04.717704+0000","last_clean":"2023-11-04T15:37:04.717704+0000","last_became_active":"2023-11-04T15:27:36.146546+0000","last_became_peered":"2023-11-04T15:27:36.146546+0000","last_unstale":"2023-11-04T15:37:04.717704+0000","last_undegraded":"2023-11-04T15:37:04.717704+0000","last_fullsized":"2023-11-04T15:37:04.717704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3632,"log_dups_size":0,"ondisk_log_size":3632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.102597439,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1222,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"40'3166","reported_seq":2629,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720999+0000","last_change":"2023-11-04T15:36:55.783207+0000","last_active":"2023-11-04T15:37:04.720999+0000","last_peered":"2023-11-04T15:37:04.720999+0000","last_clean":"2023-11-04T15:37:04.720999+0000","last_became_active":"2023-11-04T15:27:36.144047+0000","last_became_peered":"2023-11-04T15:27:36.144047+0000","last_unstale":"2023-11-04T15:37:04.720999+0000","last_undegraded":"2023-11-04T15:37:04.720999+0000","last_fullsized":"2023-11-04T15:37:04.720999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3166,"log_dups_size":0,"ondisk_log_size":3166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.064725415999999994,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1115,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"40'3493","reported_seq":2894,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720410+0000","last_change":"2023-11-04T15:36:55.784865+0000","last_active":"2023-11-04T15:37:04.720410+0000","last_peered":"2023-11-04T15:37:04.720410+0000","last_clean":"2023-11-04T15:37:04.720410+0000","last_became_active":"2023-11-04T15:27:36.144458+0000","last_became_peered":"2023-11-04T15:27:36.144458+0000","last_unstale":"2023-11-04T15:37:04.720410+0000","last_undegraded":"2023-11-04T15:37:04.720410+0000","last_fullsized":"2023-11-04T15:37:04.720410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3493,"log_dups_size":0,"ondisk_log_size":3493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.066118209999999997,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"44'3387","reported_seq":2838,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:38.464862+0000","last_change":"2023-11-04T15:37:38.465038+0000","last_active":"2023-11-04T15:37:38.464862+0000","last_peered":"2023-11-04T15:37:38.464862+0000","last_clean":"2023-11-04T15:37:38.464862+0000","last_became_active":"2023-11-04T15:27:36.150270+0000","last_became_peered":"2023-11-04T15:27:36.150270+0000","last_unstale":"2023-11-04T15:37:38.464862+0000","last_undegraded":"2023-11-04T15:37:38.464862+0000","last_fullsized":"2023-11-04T15:37:38.464862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3387","last_scrub_stamp":"2023-11-04T15:37:38.464840+0000","last_deep_scrub":"44'3387","last_deep_scrub_stamp":"2023-11-04T15:37:38.464840+0000","last_clean_scrub_stamp":"2023-11-04T15:37:38.464840+0000","objects_scrubbed":1,"log_size":3387,"log_dups_size":0,"ondisk_log_size":3387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:40:18.070984+0000","scrub_duration":0.0081071519999999994,"objects_trimmed":0,"snaptrim_duration":0.104674168,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"40'3286","reported_seq":2718,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795538+0000","last_change":"2023-11-04T15:36:55.799791+0000","last_active":"2023-11-04T15:37:04.795538+0000","last_peered":"2023-11-04T15:37:04.795538+0000","last_clean":"2023-11-04T15:37:04.795538+0000","last_became_active":"2023-11-04T15:28:20.871378+0000","last_became_peered":"2023-11-04T15:28:20.871378+0000","last_unstale":"2023-11-04T15:37:04.795538+0000","last_undegraded":"2023-11-04T15:37:04.795538+0000","last_fullsized":"2023-11-04T15:37:04.795538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3286,"log_dups_size":0,"ondisk_log_size":3286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.074381663000000001,"stat_sum":{"num_bytes":9,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1152,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"40'3578","reported_seq":3009,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:43.477932+0000","last_change":"2023-11-04T15:38:05.231832+0000","last_active":"2023-11-04T15:37:43.477932+0000","last_peered":"2023-11-04T15:37:43.477932+0000","last_clean":"2023-11-04T15:37:43.477932+0000","last_became_active":"2023-11-04T15:27:36.145392+0000","last_became_peered":"2023-11-04T15:27:36.145392+0000","last_unstale":"2023-11-04T15:37:43.477932+0000","last_undegraded":"2023-11-04T15:37:43.477932+0000","last_fullsized":"2023-11-04T15:37:43.477932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3578,"log_dups_size":0,"ondisk_log_size":3578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070714202000000004,"stat_sum":{"num_bytes":12288,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1167,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"40'3386","reported_seq":2874,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:10.551561+0000","last_change":"2023-11-04T15:37:10.551561+0000","last_active":"2023-11-04T15:37:10.551561+0000","last_peered":"2023-11-04T15:37:10.551561+0000","last_clean":"2023-11-04T15:37:10.551561+0000","last_became_active":"2023-11-04T15:27:36.145273+0000","last_became_peered":"2023-11-04T15:27:36.145273+0000","last_unstale":"2023-11-04T15:37:10.551561+0000","last_undegraded":"2023-11-04T15:37:10.551561+0000","last_fullsized":"2023-11-04T15:37:10.551561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3386","last_scrub_stamp":"2023-11-04T15:37:10.551443+0000","last_deep_scrub":"40'3386","last_deep_scrub_stamp":"2023-11-04T15:37:10.551443+0000","last_clean_scrub_stamp":"2023-11-04T15:37:10.551443+0000","objects_scrubbed":0,"log_size":3386,"log_dups_size":0,"ondisk_log_size":3386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:21:56.476755+0000","scrub_duration":0.005704687,"objects_trimmed":0,"snaptrim_duration":0.101784969,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1155,"num_write_kb":603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"40'3889","reported_seq":3215,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:06.688446+0000","last_change":"2023-11-04T15:36:55.778888+0000","last_active":"2023-11-04T15:37:06.688446+0000","last_peered":"2023-11-04T15:37:06.688446+0000","last_clean":"2023-11-04T15:37:06.688446+0000","last_became_active":"2023-11-04T15:27:36.144053+0000","last_became_peered":"2023-11-04T15:27:36.144053+0000","last_unstale":"2023-11-04T15:37:06.688446+0000","last_undegraded":"2023-11-04T15:37:06.688446+0000","last_fullsized":"2023-11-04T15:37:06.688446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3889,"log_dups_size":0,"ondisk_log_size":3889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061944979999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1328,"num_write_kb":706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"40'3720","reported_seq":3106,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.150769+0000","last_change":"2023-11-04T15:36:55.775709+0000","last_active":"2023-11-04T15:37:07.150769+0000","last_peered":"2023-11-04T15:37:07.150769+0000","last_clean":"2023-11-04T15:37:07.150769+0000","last_became_active":"2023-11-04T15:27:36.148342+0000","last_became_peered":"2023-11-04T15:27:36.148342+0000","last_unstale":"2023-11-04T15:37:07.150769+0000","last_undegraded":"2023-11-04T15:37:07.150769+0000","last_fullsized":"2023-11-04T15:37:07.150769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3720,"log_dups_size":0,"ondisk_log_size":3720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056486557999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"40'3424","reported_seq":2826,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720693+0000","last_change":"2023-11-04T15:36:55.784869+0000","last_active":"2023-11-04T15:37:04.720693+0000","last_peered":"2023-11-04T15:37:04.720693+0000","last_clean":"2023-11-04T15:37:04.720693+0000","last_became_active":"2023-11-04T15:27:36.148951+0000","last_became_peered":"2023-11-04T15:27:36.148951+0000","last_unstale":"2023-11-04T15:37:04.720693+0000","last_undegraded":"2023-11-04T15:37:04.720693+0000","last_fullsized":"2023-11-04T15:37:04.720693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3424,"log_dups_size":0,"ondisk_log_size":3424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.066218149000000004,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1176,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"44'2988","reported_seq":3040,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:52.513259+0000","last_change":"2023-11-04T15:37:52.513356+0000","last_active":"2023-11-04T15:37:52.513259+0000","last_peered":"2023-11-04T15:37:52.513259+0000","last_clean":"2023-11-04T15:37:52.513259+0000","last_became_active":"2023-11-04T15:27:35.775616+0000","last_became_peered":"2023-11-04T15:27:35.775616+0000","last_unstale":"2023-11-04T15:37:52.513259+0000","last_undegraded":"2023-11-04T15:37:52.513259+0000","last_fullsized":"2023-11-04T15:37:52.513259+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2988","last_scrub_stamp":"2023-11-04T15:37:52.513236+0000","last_deep_scrub":"44'2988","last_deep_scrub_stamp":"2023-11-04T15:37:52.513236+0000","last_clean_scrub_stamp":"2023-11-04T15:37:52.513236+0000","objects_scrubbed":4,"log_size":2988,"log_dups_size":0,"ondisk_log_size":2988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:52:02.610178+0000","scrub_duration":0.028368865,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2984,"num_write_kb":24202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"40'3308","reported_seq":2727,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.611520+0000","last_change":"2023-11-04T15:36:55.822910+0000","last_active":"2023-11-04T15:37:07.611520+0000","last_peered":"2023-11-04T15:37:07.611520+0000","last_clean":"2023-11-04T15:37:07.611520+0000","last_became_active":"2023-11-04T15:27:36.150276+0000","last_became_peered":"2023-11-04T15:27:36.150276+0000","last_unstale":"2023-11-04T15:37:07.611520+0000","last_undegraded":"2023-11-04T15:37:07.611520+0000","last_fullsized":"2023-11-04T15:37:07.611520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3308,"log_dups_size":0,"ondisk_log_size":3308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101095329,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1177,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"44'464","reported_seq":516,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:01.615465+0000","last_change":"2023-11-04T15:38:01.615577+0000","last_active":"2023-11-04T15:38:01.615465+0000","last_peered":"2023-11-04T15:38:01.615465+0000","last_clean":"2023-11-04T15:38:01.615465+0000","last_became_active":"2023-11-04T15:27:35.776297+0000","last_became_peered":"2023-11-04T15:27:35.776297+0000","last_unstale":"2023-11-04T15:38:01.615465+0000","last_undegraded":"2023-11-04T15:38:01.615465+0000","last_fullsized":"2023-11-04T15:38:01.615465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'464","last_scrub_stamp":"2023-11-04T15:38:01.615441+0000","last_deep_scrub":"44'464","last_deep_scrub_stamp":"2023-11-04T15:38:01.615441+0000","last_clean_scrub_stamp":"2023-11-04T15:38:01.615441+0000","objects_scrubbed":2,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:11:51.436637+0000","scrub_duration":0.021155086,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":462,"num_write_kb":12396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"44'3489","reported_seq":2923,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:22.680227+0000","last_change":"2023-11-04T15:37:22.680321+0000","last_active":"2023-11-04T15:37:22.680227+0000","last_peered":"2023-11-04T15:37:22.680227+0000","last_clean":"2023-11-04T15:37:22.680227+0000","last_became_active":"2023-11-04T15:27:36.139580+0000","last_became_peered":"2023-11-04T15:27:36.139580+0000","last_unstale":"2023-11-04T15:37:22.680227+0000","last_undegraded":"2023-11-04T15:37:22.680227+0000","last_fullsized":"2023-11-04T15:37:22.680227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3489","last_scrub_stamp":"2023-11-04T15:37:22.680205+0000","last_deep_scrub":"44'3489","last_deep_scrub_stamp":"2023-11-04T15:37:22.680205+0000","last_clean_scrub_stamp":"2023-11-04T15:37:22.680205+0000","objects_scrubbed":4,"log_size":3489,"log_dups_size":0,"ondisk_log_size":3489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:18:28.360934+0000","scrub_duration":0.013912934,"objects_trimmed":0,"snaptrim_duration":0.074768939000000006,"stat_sum":{"num_bytes":8192,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1207,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"44'721","reported_seq":773,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:46.471555+0000","last_change":"2023-11-04T15:37:46.471682+0000","last_active":"2023-11-04T15:37:46.471555+0000","last_peered":"2023-11-04T15:37:46.471555+0000","last_clean":"2023-11-04T15:37:46.471555+0000","last_became_active":"2023-11-04T15:27:35.775486+0000","last_became_peered":"2023-11-04T15:27:35.775486+0000","last_unstale":"2023-11-04T15:37:46.471555+0000","last_undegraded":"2023-11-04T15:37:46.471555+0000","last_fullsized":"2023-11-04T15:37:46.471555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'721","last_scrub_stamp":"2023-11-04T15:37:46.471516+0000","last_deep_scrub":"44'721","last_deep_scrub_stamp":"2023-11-04T15:37:46.471516+0000","last_clean_scrub_stamp":"2023-11-04T15:37:46.471516+0000","objects_scrubbed":4,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:43.323066+0000","scrub_duration":0.043075086999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":707,"num_write_kb":16815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"40'3443","reported_seq":2876,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:06.226433+0000","last_change":"2023-11-04T15:36:55.799083+0000","last_active":"2023-11-04T15:37:06.226433+0000","last_peered":"2023-11-04T15:37:06.226433+0000","last_clean":"2023-11-04T15:37:06.226433+0000","last_became_active":"2023-11-04T15:27:36.139789+0000","last_became_peered":"2023-11-04T15:27:36.139789+0000","last_unstale":"2023-11-04T15:37:06.226433+0000","last_undegraded":"2023-11-04T15:37:06.226433+0000","last_fullsized":"2023-11-04T15:37:06.226433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3443,"log_dups_size":0,"ondisk_log_size":3443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.073936136,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"44'1621","reported_seq":1673,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:25.495184+0000","last_change":"2023-11-04T15:37:25.495295+0000","last_active":"2023-11-04T15:37:25.495184+0000","last_peered":"2023-11-04T15:37:25.495184+0000","last_clean":"2023-11-04T15:37:25.495184+0000","last_became_active":"2023-11-04T15:27:35.775895+0000","last_became_peered":"2023-11-04T15:27:35.775895+0000","last_unstale":"2023-11-04T15:37:25.495184+0000","last_undegraded":"2023-11-04T15:37:25.495184+0000","last_fullsized":"2023-11-04T15:37:25.495184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1621","last_scrub_stamp":"2023-11-04T15:37:25.495162+0000","last_deep_scrub":"44'1621","last_deep_scrub_stamp":"2023-11-04T15:37:25.495162+0000","last_clean_scrub_stamp":"2023-11-04T15:37:25.495162+0000","objects_scrubbed":7,"log_size":1621,"log_dups_size":0,"ondisk_log_size":1621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:31:16.990792+0000","scrub_duration":0.024403523,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":1625,"num_write_kb":22714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"44'1200","reported_seq":1252,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:53.730416+0000","last_change":"2023-11-04T15:37:53.730547+0000","last_active":"2023-11-04T15:37:53.730416+0000","last_peered":"2023-11-04T15:37:53.730416+0000","last_clean":"2023-11-04T15:37:53.730416+0000","last_became_active":"2023-11-04T15:27:35.767594+0000","last_became_peered":"2023-11-04T15:27:35.767594+0000","last_unstale":"2023-11-04T15:37:53.730416+0000","last_undegraded":"2023-11-04T15:37:53.730416+0000","last_fullsized":"2023-11-04T15:37:53.730416+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1200","last_scrub_stamp":"2023-11-04T15:37:53.730377+0000","last_deep_scrub":"44'1200","last_deep_scrub_stamp":"2023-11-04T15:37:53.730377+0000","last_clean_scrub_stamp":"2023-11-04T15:37:53.730377+0000","objects_scrubbed":2,"log_size":1200,"log_dups_size":0,"ondisk_log_size":1200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:46:40.139343+0000","scrub_duration":0.015421646000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1190,"num_write_kb":15478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"40'3688","reported_seq":3062,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:14.480922+0000","last_change":"2023-11-04T15:37:14.481041+0000","last_active":"2023-11-04T15:37:14.480922+0000","last_peered":"2023-11-04T15:37:14.480922+0000","last_clean":"2023-11-04T15:37:14.480922+0000","last_became_active":"2023-11-04T15:27:36.148282+0000","last_became_peered":"2023-11-04T15:27:36.148282+0000","last_unstale":"2023-11-04T15:37:14.480922+0000","last_undegraded":"2023-11-04T15:37:14.480922+0000","last_fullsized":"2023-11-04T15:37:14.480922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3688","last_scrub_stamp":"2023-11-04T15:37:14.480897+0000","last_deep_scrub":"40'3688","last_deep_scrub_stamp":"2023-11-04T15:37:14.480897+0000","last_clean_scrub_stamp":"2023-11-04T15:37:14.480897+0000","objects_scrubbed":0,"log_size":3688,"log_dups_size":0,"ondisk_log_size":3688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:24:49.251475+0000","scrub_duration":0.0044870750000000001,"objects_trimmed":0,"snaptrim_duration":0.102136719,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1244,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"44'2395","reported_seq":2447,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:45.652933+0000","last_change":"2023-11-04T15:37:45.653046+0000","last_active":"2023-11-04T15:37:45.652933+0000","last_peered":"2023-11-04T15:37:45.652933+0000","last_clean":"2023-11-04T15:37:45.652933+0000","last_became_active":"2023-11-04T15:27:35.771554+0000","last_became_peered":"2023-11-04T15:27:35.771554+0000","last_unstale":"2023-11-04T15:37:45.652933+0000","last_undegraded":"2023-11-04T15:37:45.652933+0000","last_fullsized":"2023-11-04T15:37:45.652933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2395","last_scrub_stamp":"2023-11-04T15:37:45.652911+0000","last_deep_scrub":"44'2395","last_deep_scrub_stamp":"2023-11-04T15:37:45.652911+0000","last_clean_scrub_stamp":"2023-11-04T15:37:45.652911+0000","objects_scrubbed":3,"log_size":2395,"log_dups_size":0,"ondisk_log_size":2395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:07:59.283572+0000","scrub_duration":0.025961439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2386,"num_write_kb":21701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"44'3603","reported_seq":3000,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:25.600198+0000","last_change":"2023-11-04T15:37:25.600392+0000","last_active":"2023-11-04T15:37:25.600198+0000","last_peered":"2023-11-04T15:37:25.600198+0000","last_clean":"2023-11-04T15:37:25.600198+0000","last_became_active":"2023-11-04T15:27:36.149146+0000","last_became_peered":"2023-11-04T15:27:36.149146+0000","last_unstale":"2023-11-04T15:37:25.600198+0000","last_undegraded":"2023-11-04T15:37:25.600198+0000","last_fullsized":"2023-11-04T15:37:25.600198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3603","last_scrub_stamp":"2023-11-04T15:37:25.600176+0000","last_deep_scrub":"44'3603","last_deep_scrub_stamp":"2023-11-04T15:37:25.600176+0000","last_clean_scrub_stamp":"2023-11-04T15:37:25.600176+0000","objects_scrubbed":3,"log_size":3603,"log_dups_size":0,"ondisk_log_size":3603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:18:31.280905+0000","scrub_duration":0.0137854,"objects_trimmed":0,"snaptrim_duration":0.055767874000000002,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"40'3587","reported_seq":3628,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720018+0000","last_change":"2023-11-04T15:27:35.773978+0000","last_active":"2023-11-04T15:37:04.720018+0000","last_peered":"2023-11-04T15:37:04.720018+0000","last_clean":"2023-11-04T15:37:04.720018+0000","last_became_active":"2023-11-04T15:27:35.773689+0000","last_became_peered":"2023-11-04T15:27:35.773689+0000","last_unstale":"2023-11-04T15:37:04.720018+0000","last_undegraded":"2023-11-04T15:37:04.720018+0000","last_fullsized":"2023-11-04T15:37:04.720018+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3587,"log_dups_size":0,"ondisk_log_size":3587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582982,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3581,"num_write_kb":38716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"44'3514","reported_seq":2912,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:14.746158+0000","last_change":"2023-11-04T15:37:14.746264+0000","last_active":"2023-11-04T15:37:14.746158+0000","last_peered":"2023-11-04T15:37:14.746158+0000","last_clean":"2023-11-04T15:37:14.746158+0000","last_became_active":"2023-11-04T15:27:36.141695+0000","last_became_peered":"2023-11-04T15:27:36.141695+0000","last_unstale":"2023-11-04T15:37:14.746158+0000","last_undegraded":"2023-11-04T15:37:14.746158+0000","last_fullsized":"2023-11-04T15:37:14.746158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3514","last_scrub_stamp":"2023-11-04T15:37:14.746134+0000","last_deep_scrub":"44'3514","last_deep_scrub_stamp":"2023-11-04T15:37:14.746134+0000","last_clean_scrub_stamp":"2023-11-04T15:37:14.746134+0000","objects_scrubbed":3,"log_size":3514,"log_dups_size":0,"ondisk_log_size":3514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:36.355741+0000","scrub_duration":0.013556656,"objects_trimmed":0,"snaptrim_duration":0.057953993000000002,"stat_sum":{"num_bytes":4107,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1230,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"40'1577","reported_seq":1618,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719659+0000","last_change":"2023-11-04T15:27:35.774108+0000","last_active":"2023-11-04T15:37:04.719659+0000","last_peered":"2023-11-04T15:37:04.719659+0000","last_clean":"2023-11-04T15:37:04.719659+0000","last_became_active":"2023-11-04T15:27:35.773818+0000","last_became_peered":"2023-11-04T15:27:35.773818+0000","last_unstale":"2023-11-04T15:37:04.719659+0000","last_undegraded":"2023-11-04T15:37:04.719659+0000","last_fullsized":"2023-11-04T15:37:04.719659+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1577,"log_dups_size":0,"ondisk_log_size":1577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1569,"num_write_kb":30603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"40'3300","reported_seq":2760,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:48.498605+0000","last_change":"2023-11-04T15:37:48.498756+0000","last_active":"2023-11-04T15:37:48.498605+0000","last_peered":"2023-11-04T15:37:48.498605+0000","last_clean":"2023-11-04T15:37:48.498605+0000","last_became_active":"2023-11-04T15:27:36.150653+0000","last_became_peered":"2023-11-04T15:27:36.150653+0000","last_unstale":"2023-11-04T15:37:48.498605+0000","last_undegraded":"2023-11-04T15:37:48.498605+0000","last_fullsized":"2023-11-04T15:37:48.498605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3300","last_scrub_stamp":"2023-11-04T15:37:48.498559+0000","last_deep_scrub":"40'3300","last_deep_scrub_stamp":"2023-11-04T15:37:48.498559+0000","last_clean_scrub_stamp":"2023-11-04T15:37:48.498559+0000","objects_scrubbed":0,"log_size":3300,"log_dups_size":0,"ondisk_log_size":3300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:55:19.632136+0000","scrub_duration":0.0039129610000000004,"objects_trimmed":0,"snaptrim_duration":0.070970674999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1129,"num_write_kb":600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"44'4025","reported_seq":4077,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:41.344060+0000","last_change":"2023-11-04T15:37:41.344248+0000","last_active":"2023-11-04T15:37:41.344060+0000","last_peered":"2023-11-04T15:37:41.344060+0000","last_clean":"2023-11-04T15:37:41.344060+0000","last_became_active":"2023-11-04T15:27:35.772815+0000","last_became_peered":"2023-11-04T15:27:35.772815+0000","last_unstale":"2023-11-04T15:37:41.344060+0000","last_undegraded":"2023-11-04T15:37:41.344060+0000","last_fullsized":"2023-11-04T15:37:41.344060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4025","last_scrub_stamp":"2023-11-04T15:37:41.344035+0000","last_deep_scrub":"44'4025","last_deep_scrub_stamp":"2023-11-04T15:37:41.344035+0000","last_clean_scrub_stamp":"2023-11-04T15:37:41.344035+0000","objects_scrubbed":4,"log_size":4025,"log_dups_size":0,"ondisk_log_size":4025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:07:54.974697+0000","scrub_duration":0.037607953,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4019,"num_write_kb":36923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1207,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"40'3784","reported_seq":3140,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:21.440173+0000","last_change":"2023-11-04T15:37:21.440272+0000","last_active":"2023-11-04T15:37:21.440173+0000","last_peered":"2023-11-04T15:37:21.440173+0000","last_clean":"2023-11-04T15:37:21.440173+0000","last_became_active":"2023-11-04T15:27:36.150667+0000","last_became_peered":"2023-11-04T15:27:36.150667+0000","last_unstale":"2023-11-04T15:37:21.440173+0000","last_undegraded":"2023-11-04T15:37:21.440173+0000","last_fullsized":"2023-11-04T15:37:21.440173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3784","last_scrub_stamp":"2023-11-04T15:37:21.440149+0000","last_deep_scrub":"40'3784","last_deep_scrub_stamp":"2023-11-04T15:37:21.440149+0000","last_clean_scrub_stamp":"2023-11-04T15:37:21.440149+0000","objects_scrubbed":0,"log_size":3784,"log_dups_size":0,"ondisk_log_size":3784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:35.107882+0000","scrub_duration":0.0057867910000000003,"objects_trimmed":0,"snaptrim_duration":0.098687114000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1287,"num_write_kb":684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"44'2127","reported_seq":2179,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:02.404969+0000","last_change":"2023-11-04T15:38:02.405082+0000","last_active":"2023-11-04T15:38:02.404969+0000","last_peered":"2023-11-04T15:38:02.404969+0000","last_clean":"2023-11-04T15:38:02.404969+0000","last_became_active":"2023-11-04T15:27:35.775063+0000","last_became_peered":"2023-11-04T15:27:35.775063+0000","last_unstale":"2023-11-04T15:38:02.404969+0000","last_undegraded":"2023-11-04T15:38:02.404969+0000","last_fullsized":"2023-11-04T15:38:02.404969+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2127","last_scrub_stamp":"2023-11-04T15:38:02.404947+0000","last_deep_scrub":"44'2127","last_deep_scrub_stamp":"2023-11-04T15:38:02.404947+0000","last_clean_scrub_stamp":"2023-11-04T15:38:02.404947+0000","objects_scrubbed":2,"log_size":2127,"log_dups_size":0,"ondisk_log_size":2127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:43:59.858069+0000","scrub_duration":0.024080308000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2118,"num_write_kb":30816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"40'3317","reported_seq":2788,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719341+0000","last_change":"2023-11-04T15:36:55.826358+0000","last_active":"2023-11-04T15:37:04.719341+0000","last_peered":"2023-11-04T15:37:04.719341+0000","last_clean":"2023-11-04T15:37:04.719341+0000","last_became_active":"2023-11-04T15:27:36.139103+0000","last_became_peered":"2023-11-04T15:27:36.139103+0000","last_unstale":"2023-11-04T15:37:04.719341+0000","last_undegraded":"2023-11-04T15:37:04.719341+0000","last_fullsized":"2023-11-04T15:37:04.719341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3317,"log_dups_size":0,"ondisk_log_size":3317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10468400899999999,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1091,"num_write_kb":593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"37'1934","reported_seq":1975,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718699+0000","last_change":"2023-11-04T15:27:35.773686+0000","last_active":"2023-11-04T15:37:04.718699+0000","last_peered":"2023-11-04T15:37:04.718699+0000","last_clean":"2023-11-04T15:37:04.718699+0000","last_became_active":"2023-11-04T15:27:35.773449+0000","last_became_peered":"2023-11-04T15:27:35.773449+0000","last_unstale":"2023-11-04T15:37:04.718699+0000","last_undegraded":"2023-11-04T15:37:04.718699+0000","last_fullsized":"2023-11-04T15:37:04.718699+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1934,"log_dups_size":0,"ondisk_log_size":1934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1929,"num_write_kb":17119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"40'3519","reported_seq":2953,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:23.652533+0000","last_change":"2023-11-04T15:37:23.652627+0000","last_active":"2023-11-04T15:37:23.652533+0000","last_peered":"2023-11-04T15:37:23.652533+0000","last_clean":"2023-11-04T15:37:23.652533+0000","last_became_active":"2023-11-04T15:27:36.141086+0000","last_became_peered":"2023-11-04T15:27:36.141086+0000","last_unstale":"2023-11-04T15:37:23.652533+0000","last_undegraded":"2023-11-04T15:37:23.652533+0000","last_fullsized":"2023-11-04T15:37:23.652533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3519","last_scrub_stamp":"2023-11-04T15:37:23.652509+0000","last_deep_scrub":"40'3519","last_deep_scrub_stamp":"2023-11-04T15:37:23.652509+0000","last_clean_scrub_stamp":"2023-11-04T15:37:23.652509+0000","objects_scrubbed":0,"log_size":3519,"log_dups_size":0,"ondisk_log_size":3519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:28.689310+0000","scrub_duration":0.0061970940000000002,"objects_trimmed":0,"snaptrim_duration":0.059170119,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1142,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"37'655","reported_seq":696,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719906+0000","last_change":"2023-11-04T15:27:35.770858+0000","last_active":"2023-11-04T15:37:04.719906+0000","last_peered":"2023-11-04T15:37:04.719906+0000","last_clean":"2023-11-04T15:37:04.719906+0000","last_became_active":"2023-11-04T15:27:35.769001+0000","last_became_peered":"2023-11-04T15:27:35.769001+0000","last_unstale":"2023-11-04T15:37:04.719906+0000","last_undegraded":"2023-11-04T15:37:04.719906+0000","last_fullsized":"2023-11-04T15:37:04.719906+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":656,"num_write_kb":15166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"44'3666","reported_seq":3094,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:24.311230+0000","last_change":"2023-11-04T15:37:24.311349+0000","last_active":"2023-11-04T15:37:24.311230+0000","last_peered":"2023-11-04T15:37:24.311230+0000","last_clean":"2023-11-04T15:37:24.311230+0000","last_became_active":"2023-11-04T15:27:36.147034+0000","last_became_peered":"2023-11-04T15:27:36.147034+0000","last_unstale":"2023-11-04T15:37:24.311230+0000","last_undegraded":"2023-11-04T15:37:24.311230+0000","last_fullsized":"2023-11-04T15:37:24.311230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3666","last_scrub_stamp":"2023-11-04T15:37:24.311202+0000","last_deep_scrub":"44'3666","last_deep_scrub_stamp":"2023-11-04T15:37:24.311202+0000","last_clean_scrub_stamp":"2023-11-04T15:37:24.311202+0000","objects_scrubbed":3,"log_size":3666,"log_dups_size":0,"ondisk_log_size":3666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:56:38.113824+0000","scrub_duration":0.0088871530000000001,"objects_trimmed":0,"snaptrim_duration":0.064750725999999995,"stat_sum":{"num_bytes":4196,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1197,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":198,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.611391+0000","last_change":"2023-11-04T15:27:26.267129+0000","last_active":"2023-11-04T15:37:07.611391+0000","last_peered":"2023-11-04T15:37:07.611391+0000","last_clean":"2023-11-04T15:37:07.611391+0000","last_became_active":"2023-11-04T15:27:26.266242+0000","last_became_peered":"2023-11-04T15:27:26.266242+0000","last_unstale":"2023-11-04T15:37:07.611391+0000","last_undegraded":"2023-11-04T15:37:07.611391+0000","last_fullsized":"2023-11-04T15:37:07.611391+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:25.163848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:25.163848+0000","last_clean_scrub_stamp":"2023-11-04T15:27:25.163848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.611240+0000","last_change":"2023-11-04T15:27:31.620178+0000","last_active":"2023-11-04T15:37:07.611240+0000","last_peered":"2023-11-04T15:37:07.611240+0000","last_clean":"2023-11-04T15:37:07.611240+0000","last_became_active":"2023-11-04T15:27:31.619798+0000","last_became_peered":"2023-11-04T15:27:31.619798+0000","last_unstale":"2023-11-04T15:37:07.611240+0000","last_undegraded":"2023-11-04T15:37:07.611240+0000","last_fullsized":"2023-11-04T15:37:07.611240+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"44'3636","reported_seq":3689,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:51.207512+0000","last_change":"2023-11-04T15:37:51.207512+0000","last_active":"2023-11-04T15:37:51.207512+0000","last_peered":"2023-11-04T15:37:51.207512+0000","last_clean":"2023-11-04T15:37:51.207512+0000","last_became_active":"2023-11-04T15:27:35.769150+0000","last_became_peered":"2023-11-04T15:27:35.769150+0000","last_unstale":"2023-11-04T15:37:51.207512+0000","last_undegraded":"2023-11-04T15:37:51.207512+0000","last_fullsized":"2023-11-04T15:37:51.207512+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3636","last_scrub_stamp":"2023-11-04T15:37:51.207371+0000","last_deep_scrub":"44'3636","last_deep_scrub_stamp":"2023-11-04T15:37:51.207371+0000","last_clean_scrub_stamp":"2023-11-04T15:37:51.207371+0000","objects_scrubbed":7,"log_size":3636,"log_dups_size":0,"ondisk_log_size":3636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:21:17.261772+0000","scrub_duration":0.064187266000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3620,"num_write_kb":52059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"44'3669","reported_seq":3088,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:03.410603+0000","last_change":"2023-11-04T15:38:03.410603+0000","last_active":"2023-11-04T15:38:03.410603+0000","last_peered":"2023-11-04T15:38:03.410603+0000","last_clean":"2023-11-04T15:38:03.410603+0000","last_became_active":"2023-11-04T15:27:36.140619+0000","last_became_peered":"2023-11-04T15:27:36.140619+0000","last_unstale":"2023-11-04T15:38:03.410603+0000","last_undegraded":"2023-11-04T15:38:03.410603+0000","last_fullsized":"2023-11-04T15:38:03.410603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3669","last_scrub_stamp":"2023-11-04T15:38:03.410431+0000","last_deep_scrub":"44'3669","last_deep_scrub_stamp":"2023-11-04T15:38:03.410431+0000","last_clean_scrub_stamp":"2023-11-04T15:38:03.410431+0000","objects_scrubbed":1,"log_size":3669,"log_dups_size":0,"ondisk_log_size":3669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:20.868712+0000","scrub_duration":0.009666315,"objects_trimmed":0,"snaptrim_duration":0.10532783499999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.611213+0000","last_change":"2023-11-04T15:27:31.622106+0000","last_active":"2023-11-04T15:37:07.611213+0000","last_peered":"2023-11-04T15:37:07.611213+0000","last_clean":"2023-11-04T15:37:07.611213+0000","last_became_active":"2023-11-04T15:27:31.621889+0000","last_became_peered":"2023-11-04T15:27:31.621889+0000","last_unstale":"2023-11-04T15:37:07.611213+0000","last_undegraded":"2023-11-04T15:37:07.611213+0000","last_fullsized":"2023-11-04T15:37:07.611213+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"44'3688","reported_seq":3907,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:52.624125+0000","last_change":"2023-11-04T15:37:52.624125+0000","last_active":"2023-11-04T15:37:52.624125+0000","last_peered":"2023-11-04T15:37:52.624125+0000","last_clean":"2023-11-04T15:37:52.624125+0000","last_became_active":"2023-11-04T15:27:35.770364+0000","last_became_peered":"2023-11-04T15:27:35.770364+0000","last_unstale":"2023-11-04T15:37:52.624125+0000","last_undegraded":"2023-11-04T15:37:52.624125+0000","last_fullsized":"2023-11-04T15:37:52.624125+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3688","last_scrub_stamp":"2023-11-04T15:37:52.623993+0000","last_deep_scrub":"44'3688","last_deep_scrub_stamp":"2023-11-04T15:37:52.623993+0000","last_clean_scrub_stamp":"2023-11-04T15:37:52.623993+0000","objects_scrubbed":4,"log_size":3688,"log_dups_size":0,"ondisk_log_size":3688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:49.475542+0000","scrub_duration":0.043049095000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15883313,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":166,"num_read_kb":3338,"num_write":3668,"num_write_kb":29714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"44'3553","reported_seq":2997,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:24.639590+0000","last_change":"2023-11-04T15:37:24.639702+0000","last_active":"2023-11-04T15:37:24.639590+0000","last_peered":"2023-11-04T15:37:24.639590+0000","last_clean":"2023-11-04T15:37:24.639590+0000","last_became_active":"2023-11-04T15:27:36.144459+0000","last_became_peered":"2023-11-04T15:27:36.144459+0000","last_unstale":"2023-11-04T15:37:24.639590+0000","last_undegraded":"2023-11-04T15:37:24.639590+0000","last_fullsized":"2023-11-04T15:37:24.639590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3553","last_scrub_stamp":"2023-11-04T15:37:24.639567+0000","last_deep_scrub":"44'3553","last_deep_scrub_stamp":"2023-11-04T15:37:24.639567+0000","last_clean_scrub_stamp":"2023-11-04T15:37:24.639567+0000","objects_scrubbed":2,"log_size":3553,"log_dups_size":0,"ondisk_log_size":3553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:38.307301+0000","scrub_duration":0.010629794999999999,"objects_trimmed":0,"snaptrim_duration":0.072685394,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:46.281358+0000","last_change":"2023-11-04T15:37:46.281358+0000","last_active":"2023-11-04T15:37:46.281358+0000","last_peered":"2023-11-04T15:37:46.281358+0000","last_clean":"2023-11-04T15:37:46.281358+0000","last_became_active":"2023-11-04T15:27:31.622378+0000","last_became_peered":"2023-11-04T15:27:31.622378+0000","last_unstale":"2023-11-04T15:37:46.281358+0000","last_undegraded":"2023-11-04T15:37:46.281358+0000","last_fullsized":"2023-11-04T15:37:46.281358+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:37:46.281232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:37:46.281232+0000","last_clean_scrub_stamp":"2023-11-04T15:37:46.281232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:55:17.414809+0000","scrub_duration":0.0016098729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"44'6085","reported_seq":6139,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:50.250495+0000","last_change":"2023-11-04T15:37:50.250593+0000","last_active":"2023-11-04T15:37:50.250495+0000","last_peered":"2023-11-04T15:37:50.250495+0000","last_clean":"2023-11-04T15:37:50.250495+0000","last_became_active":"2023-11-04T15:27:35.774339+0000","last_became_peered":"2023-11-04T15:27:35.774339+0000","last_unstale":"2023-11-04T15:37:50.250495+0000","last_undegraded":"2023-11-04T15:37:50.250495+0000","last_fullsized":"2023-11-04T15:37:50.250495+0000","mapping_epoch":16,"log_start":"26'400","ondisk_log_start":"26'400","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'6085","last_scrub_stamp":"2023-11-04T15:37:50.250469+0000","last_deep_scrub":"44'6085","last_deep_scrub_stamp":"2023-11-04T15:37:50.250469+0000","last_clean_scrub_stamp":"2023-11-04T15:37:50.250469+0000","objects_scrubbed":6,"log_size":5685,"log_dups_size":0,"ondisk_log_size":5685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:47.102018+0000","scrub_duration":0.070893610999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6078,"num_write_kb":43849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"44'3173","reported_seq":2650,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:10.304885+0000","last_change":"2023-11-04T15:37:10.305048+0000","last_active":"2023-11-04T15:37:10.304885+0000","last_peered":"2023-11-04T15:37:10.304885+0000","last_clean":"2023-11-04T15:37:10.304885+0000","last_became_active":"2023-11-04T15:27:36.146930+0000","last_became_peered":"2023-11-04T15:27:36.146930+0000","last_unstale":"2023-11-04T15:37:10.304885+0000","last_undegraded":"2023-11-04T15:37:10.304885+0000","last_fullsized":"2023-11-04T15:37:10.304885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3173","last_scrub_stamp":"2023-11-04T15:37:10.304861+0000","last_deep_scrub":"44'3173","last_deep_scrub_stamp":"2023-11-04T15:37:10.304861+0000","last_clean_scrub_stamp":"2023-11-04T15:37:10.304861+0000","objects_scrubbed":1,"log_size":3173,"log_dups_size":0,"ondisk_log_size":3173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:31.914468+0000","scrub_duration":0.0078700769999999996,"objects_trimmed":0,"snaptrim_duration":0.067233409999999993,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1111,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.611188+0000","last_change":"2023-11-04T15:27:31.622105+0000","last_active":"2023-11-04T15:37:07.611188+0000","last_peered":"2023-11-04T15:37:07.611188+0000","last_clean":"2023-11-04T15:37:07.611188+0000","last_became_active":"2023-11-04T15:27:31.621849+0000","last_became_peered":"2023-11-04T15:27:31.621849+0000","last_unstale":"2023-11-04T15:37:07.611188+0000","last_undegraded":"2023-11-04T15:37:07.611188+0000","last_fullsized":"2023-11-04T15:37:07.611188+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"44'3280","reported_seq":3333,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:27.660076+0000","last_change":"2023-11-04T15:37:27.660076+0000","last_active":"2023-11-04T15:37:27.660076+0000","last_peered":"2023-11-04T15:37:27.660076+0000","last_clean":"2023-11-04T15:37:27.660076+0000","last_became_active":"2023-11-04T15:27:35.769730+0000","last_became_peered":"2023-11-04T15:27:35.769730+0000","last_unstale":"2023-11-04T15:37:27.660076+0000","last_undegraded":"2023-11-04T15:37:27.660076+0000","last_fullsized":"2023-11-04T15:37:27.660076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3280","last_scrub_stamp":"2023-11-04T15:37:27.659954+0000","last_deep_scrub":"44'3280","last_deep_scrub_stamp":"2023-11-04T15:37:27.659954+0000","last_clean_scrub_stamp":"2023-11-04T15:37:27.659954+0000","objects_scrubbed":5,"log_size":3280,"log_dups_size":0,"ondisk_log_size":3280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:41.327688+0000","scrub_duration":0.054452754999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3258,"num_write_kb":30072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"44'3434","reported_seq":2864,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:18.421706+0000","last_change":"2023-11-04T15:37:18.421706+0000","last_active":"2023-11-04T15:37:18.421706+0000","last_peered":"2023-11-04T15:37:18.421706+0000","last_clean":"2023-11-04T15:37:18.421706+0000","last_became_active":"2023-11-04T15:27:36.144417+0000","last_became_peered":"2023-11-04T15:27:36.144417+0000","last_unstale":"2023-11-04T15:37:18.421706+0000","last_undegraded":"2023-11-04T15:37:18.421706+0000","last_fullsized":"2023-11-04T15:37:18.421706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3434","last_scrub_stamp":"2023-11-04T15:37:18.421580+0000","last_deep_scrub":"44'3434","last_deep_scrub_stamp":"2023-11-04T15:37:18.421580+0000","last_clean_scrub_stamp":"2023-11-04T15:37:18.421580+0000","objects_scrubbed":3,"log_size":3434,"log_dups_size":0,"ondisk_log_size":3434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:37:14.873581+0000","scrub_duration":0.011594345000000001,"objects_trimmed":0,"snaptrim_duration":0.067418286999999993,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"44'3108","reported_seq":3161,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:28.595288+0000","last_change":"2023-11-04T15:37:28.595288+0000","last_active":"2023-11-04T15:37:28.595288+0000","last_peered":"2023-11-04T15:37:28.595288+0000","last_clean":"2023-11-04T15:37:28.595288+0000","last_became_active":"2023-11-04T15:27:35.769772+0000","last_became_peered":"2023-11-04T15:27:35.769772+0000","last_unstale":"2023-11-04T15:37:28.595288+0000","last_undegraded":"2023-11-04T15:37:28.595288+0000","last_fullsized":"2023-11-04T15:37:28.595288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3108","last_scrub_stamp":"2023-11-04T15:37:28.595114+0000","last_deep_scrub":"44'3108","last_deep_scrub_stamp":"2023-11-04T15:37:28.595114+0000","last_clean_scrub_stamp":"2023-11-04T15:37:28.595114+0000","objects_scrubbed":3,"log_size":3108,"log_dups_size":0,"ondisk_log_size":3108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:56:42.397736+0000","scrub_duration":0.034473323,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3101,"num_write_kb":32806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:47.235098+0000","last_change":"2023-11-04T15:37:47.235098+0000","last_active":"2023-11-04T15:37:47.235098+0000","last_peered":"2023-11-04T15:37:47.235098+0000","last_clean":"2023-11-04T15:37:47.235098+0000","last_became_active":"2023-11-04T15:27:31.622350+0000","last_became_peered":"2023-11-04T15:27:31.622350+0000","last_unstale":"2023-11-04T15:37:47.235098+0000","last_undegraded":"2023-11-04T15:37:47.235098+0000","last_fullsized":"2023-11-04T15:37:47.235098+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:37:47.234970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:37:47.234970+0000","last_clean_scrub_stamp":"2023-11-04T15:37:47.234970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:46:33.643935+0000","scrub_duration":0.00154751,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"43'3419","reported_seq":2906,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:09.350908+0000","last_change":"2023-11-04T15:37:09.350908+0000","last_active":"2023-11-04T15:37:09.350908+0000","last_peered":"2023-11-04T15:37:09.350908+0000","last_clean":"2023-11-04T15:37:09.350908+0000","last_became_active":"2023-11-04T15:27:36.143991+0000","last_became_peered":"2023-11-04T15:27:36.143991+0000","last_unstale":"2023-11-04T15:37:09.350908+0000","last_undegraded":"2023-11-04T15:37:09.350908+0000","last_fullsized":"2023-11-04T15:37:09.350908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3419","last_scrub_stamp":"2023-11-04T15:37:09.350786+0000","last_deep_scrub":"43'3419","last_deep_scrub_stamp":"2023-11-04T15:37:09.350786+0000","last_clean_scrub_stamp":"2023-11-04T15:37:09.350786+0000","objects_scrubbed":2,"log_size":3419,"log_dups_size":0,"ondisk_log_size":3419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:20:35.227166+0000","scrub_duration":0.0074817540000000002,"objects_trimmed":0,"snaptrim_duration":0.062728023999999993,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":1116,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"44'4469","reported_seq":4522,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:56.224142+0000","last_change":"2023-11-04T15:37:56.224142+0000","last_active":"2023-11-04T15:37:56.224142+0000","last_peered":"2023-11-04T15:37:56.224142+0000","last_clean":"2023-11-04T15:37:56.224142+0000","last_became_active":"2023-11-04T15:27:35.769095+0000","last_became_peered":"2023-11-04T15:27:35.769095+0000","last_unstale":"2023-11-04T15:37:56.224142+0000","last_undegraded":"2023-11-04T15:37:56.224142+0000","last_fullsized":"2023-11-04T15:37:56.224142+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4469","last_scrub_stamp":"2023-11-04T15:37:56.224006+0000","last_deep_scrub":"44'4469","last_deep_scrub_stamp":"2023-11-04T15:37:56.224006+0000","last_clean_scrub_stamp":"2023-11-04T15:37:56.224006+0000","objects_scrubbed":5,"log_size":4469,"log_dups_size":0,"ondisk_log_size":4469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:52:06.320947+0000","scrub_duration":0.052842531999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4451,"num_write_kb":27035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.611229+0000","last_change":"2023-11-04T15:27:31.619973+0000","last_active":"2023-11-04T15:37:07.611229+0000","last_peered":"2023-11-04T15:37:07.611229+0000","last_clean":"2023-11-04T15:37:07.611229+0000","last_became_active":"2023-11-04T15:27:31.619702+0000","last_became_peered":"2023-11-04T15:27:31.619702+0000","last_unstale":"2023-11-04T15:37:07.611229+0000","last_undegraded":"2023-11-04T15:37:07.611229+0000","last_fullsized":"2023-11-04T15:37:07.611229+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"40'3558","reported_seq":2956,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:19.665851+0000","last_change":"2023-11-04T15:37:19.665851+0000","last_active":"2023-11-04T15:37:19.665851+0000","last_peered":"2023-11-04T15:37:19.665851+0000","last_clean":"2023-11-04T15:37:19.665851+0000","last_became_active":"2023-11-04T15:27:36.139707+0000","last_became_peered":"2023-11-04T15:27:36.139707+0000","last_unstale":"2023-11-04T15:37:19.665851+0000","last_undegraded":"2023-11-04T15:37:19.665851+0000","last_fullsized":"2023-11-04T15:37:19.665851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3558","last_scrub_stamp":"2023-11-04T15:37:19.665726+0000","last_deep_scrub":"40'3558","last_deep_scrub_stamp":"2023-11-04T15:37:19.665726+0000","last_clean_scrub_stamp":"2023-11-04T15:37:19.665726+0000","objects_scrubbed":0,"log_size":3558,"log_dups_size":0,"ondisk_log_size":3558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:24:54.436304+0000","scrub_duration":0.0061987099999999996,"objects_trimmed":0,"snaptrim_duration":0.073815121999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"44'1219","reported_seq":1271,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:59.151014+0000","last_change":"2023-11-04T15:37:59.151132+0000","last_active":"2023-11-04T15:37:59.151014+0000","last_peered":"2023-11-04T15:37:59.151014+0000","last_clean":"2023-11-04T15:37:59.151014+0000","last_became_active":"2023-11-04T15:27:35.768320+0000","last_became_peered":"2023-11-04T15:27:35.768320+0000","last_unstale":"2023-11-04T15:37:59.151014+0000","last_undegraded":"2023-11-04T15:37:59.151014+0000","last_fullsized":"2023-11-04T15:37:59.151014+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1219","last_scrub_stamp":"2023-11-04T15:37:59.150991+0000","last_deep_scrub":"44'1219","last_deep_scrub_stamp":"2023-11-04T15:37:59.150991+0000","last_clean_scrub_stamp":"2023-11-04T15:37:59.150991+0000","objects_scrubbed":5,"log_size":1219,"log_dups_size":0,"ondisk_log_size":1219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:11:48.972187+0000","scrub_duration":0.031930034000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1211,"num_write_kb":18003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:42.307837+0000","last_change":"2023-11-04T15:37:42.307944+0000","last_active":"2023-11-04T15:37:42.307837+0000","last_peered":"2023-11-04T15:37:42.307837+0000","last_clean":"2023-11-04T15:37:42.307837+0000","last_became_active":"2023-11-04T15:27:31.624347+0000","last_became_peered":"2023-11-04T15:27:31.624347+0000","last_unstale":"2023-11-04T15:37:42.307837+0000","last_undegraded":"2023-11-04T15:37:42.307837+0000","last_fullsized":"2023-11-04T15:37:42.307837+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:37:42.307817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:37:42.307817+0000","last_clean_scrub_stamp":"2023-11-04T15:37:42.307817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:40:21.913960+0000","scrub_duration":0.002137136,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"40'3608","reported_seq":3014,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:06.226333+0000","last_change":"2023-11-04T15:36:55.791977+0000","last_active":"2023-11-04T15:37:06.226333+0000","last_peered":"2023-11-04T15:37:06.226333+0000","last_clean":"2023-11-04T15:37:06.226333+0000","last_became_active":"2023-11-04T15:27:36.137897+0000","last_became_peered":"2023-11-04T15:27:36.137897+0000","last_unstale":"2023-11-04T15:37:06.226333+0000","last_undegraded":"2023-11-04T15:37:06.226333+0000","last_fullsized":"2023-11-04T15:37:06.226333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3608,"log_dups_size":0,"ondisk_log_size":3608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.069534850999999995,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"44'835","reported_seq":887,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:58.635547+0000","last_change":"2023-11-04T15:37:58.635650+0000","last_active":"2023-11-04T15:37:58.635547+0000","last_peered":"2023-11-04T15:37:58.635547+0000","last_clean":"2023-11-04T15:37:58.635547+0000","last_became_active":"2023-11-04T15:27:35.772121+0000","last_became_peered":"2023-11-04T15:27:35.772121+0000","last_unstale":"2023-11-04T15:37:58.635547+0000","last_undegraded":"2023-11-04T15:37:58.635547+0000","last_fullsized":"2023-11-04T15:37:58.635547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'835","last_scrub_stamp":"2023-11-04T15:37:58.635523+0000","last_deep_scrub":"44'835","last_deep_scrub_stamp":"2023-11-04T15:37:58.635523+0000","last_clean_scrub_stamp":"2023-11-04T15:37:58.635523+0000","objects_scrubbed":6,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:52:08.732465+0000","scrub_duration":0.064600797000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":960,"num_write_kb":25976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719859+0000","last_change":"2023-11-04T15:27:31.620235+0000","last_active":"2023-11-04T15:37:04.719859+0000","last_peered":"2023-11-04T15:37:04.719859+0000","last_clean":"2023-11-04T15:37:04.719859+0000","last_became_active":"2023-11-04T15:27:31.619831+0000","last_became_peered":"2023-11-04T15:27:31.619831+0000","last_unstale":"2023-11-04T15:37:04.719859+0000","last_undegraded":"2023-11-04T15:37:04.719859+0000","last_fullsized":"2023-11-04T15:37:04.719859+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:30.611946+0000","last_clean_scrub_stamp":"2023-11-04T15:27:30.611946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"44'3481","reported_seq":2937,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:10.702911+0000","last_change":"2023-11-04T15:37:10.702911+0000","last_active":"2023-11-04T15:37:10.702911+0000","last_peered":"2023-11-04T15:37:10.702911+0000","last_clean":"2023-11-04T15:37:10.702911+0000","last_became_active":"2023-11-04T15:27:36.140871+0000","last_became_peered":"2023-11-04T15:27:36.140871+0000","last_unstale":"2023-11-04T15:37:10.702911+0000","last_undegraded":"2023-11-04T15:37:10.702911+0000","last_fullsized":"2023-11-04T15:37:10.702911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3481","last_scrub_stamp":"2023-11-04T15:37:10.702789+0000","last_deep_scrub":"44'3481","last_deep_scrub_stamp":"2023-11-04T15:37:10.702789+0000","last_clean_scrub_stamp":"2023-11-04T15:37:10.702789+0000","objects_scrubbed":1,"log_size":3481,"log_dups_size":0,"ondisk_log_size":3481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:23:02.723895+0000","scrub_duration":0.008399541,"objects_trimmed":0,"snaptrim_duration":0.058381362999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"40'3644","reported_seq":3059,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:22.638939+0000","last_change":"2023-11-04T15:37:22.639061+0000","last_active":"2023-11-04T15:37:22.638939+0000","last_peered":"2023-11-04T15:37:22.638939+0000","last_clean":"2023-11-04T15:37:22.638939+0000","last_became_active":"2023-11-04T15:27:36.139487+0000","last_became_peered":"2023-11-04T15:27:36.139487+0000","last_unstale":"2023-11-04T15:37:22.638939+0000","last_undegraded":"2023-11-04T15:37:22.638939+0000","last_fullsized":"2023-11-04T15:37:22.638939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3644","last_scrub_stamp":"2023-11-04T15:37:22.638916+0000","last_deep_scrub":"40'3644","last_deep_scrub_stamp":"2023-11-04T15:37:22.638916+0000","last_clean_scrub_stamp":"2023-11-04T15:37:22.638916+0000","objects_scrubbed":0,"log_size":3644,"log_dups_size":0,"ondisk_log_size":3644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:37:19.090917+0000","scrub_duration":0.0049130600000000003,"objects_trimmed":0,"snaptrim_duration":0.056621590999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"44'2776","reported_seq":2828,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:42.474185+0000","last_change":"2023-11-04T15:37:42.474282+0000","last_active":"2023-11-04T15:37:42.474185+0000","last_peered":"2023-11-04T15:37:42.474185+0000","last_clean":"2023-11-04T15:37:42.474185+0000","last_became_active":"2023-11-04T15:27:35.775356+0000","last_became_peered":"2023-11-04T15:27:35.775356+0000","last_unstale":"2023-11-04T15:37:42.474185+0000","last_undegraded":"2023-11-04T15:37:42.474185+0000","last_fullsized":"2023-11-04T15:37:42.474185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2776","last_scrub_stamp":"2023-11-04T15:37:42.474162+0000","last_deep_scrub":"44'2776","last_deep_scrub_stamp":"2023-11-04T15:37:42.474162+0000","last_clean_scrub_stamp":"2023-11-04T15:37:42.474162+0000","objects_scrubbed":5,"log_size":2776,"log_dups_size":0,"ondisk_log_size":2776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:55:13.607739+0000","scrub_duration":0.030546663000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2770,"num_write_kb":31342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"40'3525","reported_seq":2933,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719969+0000","last_change":"2023-11-04T15:36:55.781878+0000","last_active":"2023-11-04T15:37:04.719969+0000","last_peered":"2023-11-04T15:37:04.719969+0000","last_clean":"2023-11-04T15:37:04.719969+0000","last_became_active":"2023-11-04T15:27:36.146464+0000","last_became_peered":"2023-11-04T15:27:36.146464+0000","last_unstale":"2023-11-04T15:37:04.719969+0000","last_undegraded":"2023-11-04T15:37:04.719969+0000","last_fullsized":"2023-11-04T15:37:04.719969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3525,"log_dups_size":0,"ondisk_log_size":3525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.064516859999999995,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"44'3745","reported_seq":3797,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:57.703309+0000","last_change":"2023-11-04T15:37:57.703411+0000","last_active":"2023-11-04T15:37:57.703309+0000","last_peered":"2023-11-04T15:37:57.703309+0000","last_clean":"2023-11-04T15:37:57.703309+0000","last_became_active":"2023-11-04T15:27:35.769904+0000","last_became_peered":"2023-11-04T15:27:35.769904+0000","last_unstale":"2023-11-04T15:37:57.703309+0000","last_undegraded":"2023-11-04T15:37:57.703309+0000","last_fullsized":"2023-11-04T15:37:57.703309+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3745","last_scrub_stamp":"2023-11-04T15:37:57.703286+0000","last_deep_scrub":"44'3745","last_deep_scrub_stamp":"2023-11-04T15:37:57.703286+0000","last_clean_scrub_stamp":"2023-11-04T15:37:57.703286+0000","objects_scrubbed":3,"log_size":3745,"log_dups_size":0,"ondisk_log_size":3745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:21:23.757688+0000","scrub_duration":0.020686982,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3740,"num_write_kb":21755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"44'3556","reported_seq":3608,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:02.674712+0000","last_change":"2023-11-04T15:38:02.674801+0000","last_active":"2023-11-04T15:38:02.674712+0000","last_peered":"2023-11-04T15:38:02.674712+0000","last_clean":"2023-11-04T15:38:02.674712+0000","last_became_active":"2023-11-04T15:27:35.768413+0000","last_became_peered":"2023-11-04T15:27:35.768413+0000","last_unstale":"2023-11-04T15:38:02.674712+0000","last_undegraded":"2023-11-04T15:38:02.674712+0000","last_fullsized":"2023-11-04T15:38:02.674712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3556","last_scrub_stamp":"2023-11-04T15:38:02.674689+0000","last_deep_scrub":"44'3556","last_deep_scrub_stamp":"2023-11-04T15:38:02.674689+0000","last_clean_scrub_stamp":"2023-11-04T15:38:02.674689+0000","objects_scrubbed":2,"log_size":3556,"log_dups_size":0,"ondisk_log_size":3556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:52:12.771630+0000","scrub_duration":0.025634852,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3537,"num_write_kb":29647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"40'3937","reported_seq":3332,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:42.530756+0000","last_change":"2023-11-04T15:37:42.530849+0000","last_active":"2023-11-04T15:37:42.530756+0000","last_peered":"2023-11-04T15:37:42.530756+0000","last_clean":"2023-11-04T15:37:42.530756+0000","last_became_active":"2023-11-04T15:27:36.139524+0000","last_became_peered":"2023-11-04T15:27:36.139524+0000","last_unstale":"2023-11-04T15:37:42.530756+0000","last_undegraded":"2023-11-04T15:37:42.530756+0000","last_fullsized":"2023-11-04T15:37:42.530756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3937","last_scrub_stamp":"2023-11-04T15:37:42.530734+0000","last_deep_scrub":"40'3937","last_deep_scrub_stamp":"2023-11-04T15:37:42.530734+0000","last_clean_scrub_stamp":"2023-11-04T15:37:42.530734+0000","objects_scrubbed":0,"log_size":3937,"log_dups_size":0,"ondisk_log_size":3937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:07:56.161396+0000","scrub_duration":0.0048541679999999999,"objects_trimmed":0,"snaptrim_duration":0.068494678000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1248,"num_write_kb":670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"37'1637","reported_seq":1678,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:06.226344+0000","last_change":"2023-11-04T15:27:35.776242+0000","last_active":"2023-11-04T15:37:06.226344+0000","last_peered":"2023-11-04T15:37:06.226344+0000","last_clean":"2023-11-04T15:37:06.226344+0000","last_became_active":"2023-11-04T15:27:35.775917+0000","last_became_peered":"2023-11-04T15:27:35.775917+0000","last_unstale":"2023-11-04T15:37:06.226344+0000","last_undegraded":"2023-11-04T15:37:06.226344+0000","last_fullsized":"2023-11-04T15:37:06.226344+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1637,"log_dups_size":0,"ondisk_log_size":1637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1634,"num_write_kb":25426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"44'3473","reported_seq":2906,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:21.407271+0000","last_change":"2023-11-04T15:37:21.407382+0000","last_active":"2023-11-04T15:37:21.407271+0000","last_peered":"2023-11-04T15:37:21.407271+0000","last_clean":"2023-11-04T15:37:21.407271+0000","last_became_active":"2023-11-04T15:27:36.150557+0000","last_became_peered":"2023-11-04T15:27:36.150557+0000","last_unstale":"2023-11-04T15:37:21.407271+0000","last_undegraded":"2023-11-04T15:37:21.407271+0000","last_fullsized":"2023-11-04T15:37:21.407271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3473","last_scrub_stamp":"2023-11-04T15:37:21.407243+0000","last_deep_scrub":"44'3473","last_deep_scrub_stamp":"2023-11-04T15:37:21.407243+0000","last_clean_scrub_stamp":"2023-11-04T15:37:21.407243+0000","objects_scrubbed":1,"log_size":3473,"log_dups_size":0,"ondisk_log_size":3473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:18:27.087972+0000","scrub_duration":0.0082048629999999997,"objects_trimmed":0,"snaptrim_duration":0.062631718000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"40'3228","reported_seq":2712,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.611499+0000","last_change":"2023-11-04T15:36:55.826604+0000","last_active":"2023-11-04T15:37:07.611499+0000","last_peered":"2023-11-04T15:37:07.611499+0000","last_clean":"2023-11-04T15:37:07.611499+0000","last_became_active":"2023-11-04T15:27:36.149831+0000","last_became_peered":"2023-11-04T15:27:36.149831+0000","last_unstale":"2023-11-04T15:37:07.611499+0000","last_undegraded":"2023-11-04T15:37:07.611499+0000","last_fullsized":"2023-11-04T15:37:07.611499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3228,"log_dups_size":0,"ondisk_log_size":3228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.103639325,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1060,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"44'4779","reported_seq":4831,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:19.478819+0000","last_change":"2023-11-04T15:37:19.478909+0000","last_active":"2023-11-04T15:37:19.478819+0000","last_peered":"2023-11-04T15:37:19.478819+0000","last_clean":"2023-11-04T15:37:19.478819+0000","last_became_active":"2023-11-04T15:27:35.770022+0000","last_became_peered":"2023-11-04T15:27:35.770022+0000","last_unstale":"2023-11-04T15:37:19.478819+0000","last_undegraded":"2023-11-04T15:37:19.478819+0000","last_fullsized":"2023-11-04T15:37:19.478819+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4779","last_scrub_stamp":"2023-11-04T15:37:19.478796+0000","last_deep_scrub":"44'4779","last_deep_scrub_stamp":"2023-11-04T15:37:19.478796+0000","last_clean_scrub_stamp":"2023-11-04T15:37:19.478796+0000","objects_scrubbed":7,"log_size":4779,"log_dups_size":0,"ondisk_log_size":4779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:24.515597+0000","scrub_duration":0.083030119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28974830,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4772,"num_write_kb":50744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"43'3333","reported_seq":2778,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:06.226514+0000","last_change":"2023-11-04T15:36:55.797686+0000","last_active":"2023-11-04T15:37:06.226514+0000","last_peered":"2023-11-04T15:37:06.226514+0000","last_clean":"2023-11-04T15:37:06.226514+0000","last_became_active":"2023-11-04T15:27:36.138908+0000","last_became_peered":"2023-11-04T15:27:36.138908+0000","last_unstale":"2023-11-04T15:37:06.226514+0000","last_undegraded":"2023-11-04T15:37:06.226514+0000","last_fullsized":"2023-11-04T15:37:06.226514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3333,"log_dups_size":0,"ondisk_log_size":3333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.073000567000000002,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":1157,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"44'784","reported_seq":836,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:23.362195+0000","last_change":"2023-11-04T15:37:23.362327+0000","last_active":"2023-11-04T15:37:23.362195+0000","last_peered":"2023-11-04T15:37:23.362195+0000","last_clean":"2023-11-04T15:37:23.362195+0000","last_became_active":"2023-11-04T15:27:35.767858+0000","last_became_peered":"2023-11-04T15:27:35.767858+0000","last_unstale":"2023-11-04T15:37:23.362195+0000","last_undegraded":"2023-11-04T15:37:23.362195+0000","last_fullsized":"2023-11-04T15:37:23.362195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'784","last_scrub_stamp":"2023-11-04T15:37:23.362171+0000","last_deep_scrub":"44'784","last_deep_scrub_stamp":"2023-11-04T15:37:23.362171+0000","last_clean_scrub_stamp":"2023-11-04T15:37:23.362171+0000","objects_scrubbed":4,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:37.029904+0000","scrub_duration":0.042357839000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":779,"num_write_kb":20966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"40'3359","reported_seq":2795,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:25.666192+0000","last_change":"2023-11-04T15:37:25.666192+0000","last_active":"2023-11-04T15:37:25.666192+0000","last_peered":"2023-11-04T15:37:25.666192+0000","last_clean":"2023-11-04T15:37:25.666192+0000","last_became_active":"2023-11-04T15:27:36.143442+0000","last_became_peered":"2023-11-04T15:27:36.143442+0000","last_unstale":"2023-11-04T15:37:25.666192+0000","last_undegraded":"2023-11-04T15:37:25.666192+0000","last_fullsized":"2023-11-04T15:37:25.666192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3359","last_scrub_stamp":"2023-11-04T15:37:25.666058+0000","last_deep_scrub":"40'3359","last_deep_scrub_stamp":"2023-11-04T15:37:25.666058+0000","last_clean_scrub_stamp":"2023-11-04T15:37:25.666058+0000","objects_scrubbed":0,"log_size":3359,"log_dups_size":0,"ondisk_log_size":3359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:56:39.468680+0000","scrub_duration":0.003764154,"objects_trimmed":0,"snaptrim_duration":0.072078296,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1167,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"44'3780","reported_seq":3832,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:56.657179+0000","last_change":"2023-11-04T15:37:56.657328+0000","last_active":"2023-11-04T15:37:56.657179+0000","last_peered":"2023-11-04T15:37:56.657179+0000","last_clean":"2023-11-04T15:37:56.657179+0000","last_became_active":"2023-11-04T15:27:35.770539+0000","last_became_peered":"2023-11-04T15:27:35.770539+0000","last_unstale":"2023-11-04T15:37:56.657179+0000","last_undegraded":"2023-11-04T15:37:56.657179+0000","last_fullsized":"2023-11-04T15:37:56.657179+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3780","last_scrub_stamp":"2023-11-04T15:37:56.657156+0000","last_deep_scrub":"44'3780","last_deep_scrub_stamp":"2023-11-04T15:37:56.657156+0000","last_clean_scrub_stamp":"2023-11-04T15:37:56.657156+0000","objects_scrubbed":2,"log_size":3780,"log_dups_size":0,"ondisk_log_size":3780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:53.508705+0000","scrub_duration":0.023445829000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3770,"num_write_kb":38321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"40'3791","reported_seq":3147,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:06.688498+0000","last_change":"2023-11-04T15:36:55.780664+0000","last_active":"2023-11-04T15:37:06.688498+0000","last_peered":"2023-11-04T15:37:06.688498+0000","last_clean":"2023-11-04T15:37:06.688498+0000","last_became_active":"2023-11-04T15:27:36.146477+0000","last_became_peered":"2023-11-04T15:27:36.146477+0000","last_unstale":"2023-11-04T15:37:06.688498+0000","last_undegraded":"2023-11-04T15:37:06.688498+0000","last_fullsized":"2023-11-04T15:37:06.688498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3791,"log_dups_size":0,"ondisk_log_size":3791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063144525000000007,"stat_sum":{"num_bytes":8192,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1270,"num_write_kb":694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"44'2947","reported_seq":2999,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:53.659127+0000","last_change":"2023-11-04T15:37:53.659229+0000","last_active":"2023-11-04T15:37:53.659127+0000","last_peered":"2023-11-04T15:37:53.659127+0000","last_clean":"2023-11-04T15:37:53.659127+0000","last_became_active":"2023-11-04T15:27:35.771316+0000","last_became_peered":"2023-11-04T15:27:35.771316+0000","last_unstale":"2023-11-04T15:37:53.659127+0000","last_undegraded":"2023-11-04T15:37:53.659127+0000","last_fullsized":"2023-11-04T15:37:53.659127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2947","last_scrub_stamp":"2023-11-04T15:37:53.659103+0000","last_deep_scrub":"44'2947","last_deep_scrub_stamp":"2023-11-04T15:37:53.659103+0000","last_clean_scrub_stamp":"2023-11-04T15:37:53.659103+0000","objects_scrubbed":4,"log_size":2947,"log_dups_size":0,"ondisk_log_size":2947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:21:19.713505+0000","scrub_duration":0.039096767999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2943,"num_write_kb":28401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"44'3597","reported_seq":3019,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:09.671026+0000","last_change":"2023-11-04T15:37:09.671026+0000","last_active":"2023-11-04T15:37:09.671026+0000","last_peered":"2023-11-04T15:37:09.671026+0000","last_clean":"2023-11-04T15:37:09.671026+0000","last_became_active":"2023-11-04T15:27:36.144066+0000","last_became_peered":"2023-11-04T15:27:36.144066+0000","last_unstale":"2023-11-04T15:37:09.671026+0000","last_undegraded":"2023-11-04T15:37:09.671026+0000","last_fullsized":"2023-11-04T15:37:09.671026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3597","last_scrub_stamp":"2023-11-04T15:37:09.670901+0000","last_deep_scrub":"44'3597","last_deep_scrub_stamp":"2023-11-04T15:37:09.670901+0000","last_clean_scrub_stamp":"2023-11-04T15:37:09.670901+0000","objects_scrubbed":2,"log_size":3597,"log_dups_size":0,"ondisk_log_size":3597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T22:52:59.961460+0000","scrub_duration":0.010082327,"objects_trimmed":0,"snaptrim_duration":0.057889772999999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1118,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"44'931","reported_seq":983,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:46.627662+0000","last_change":"2023-11-04T15:37:46.627792+0000","last_active":"2023-11-04T15:37:46.627662+0000","last_peered":"2023-11-04T15:37:46.627662+0000","last_clean":"2023-11-04T15:37:46.627662+0000","last_became_active":"2023-11-04T15:27:35.767852+0000","last_became_peered":"2023-11-04T15:27:35.767852+0000","last_unstale":"2023-11-04T15:37:46.627662+0000","last_undegraded":"2023-11-04T15:37:46.627662+0000","last_fullsized":"2023-11-04T15:37:46.627662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'931","last_scrub_stamp":"2023-11-04T15:37:46.627638+0000","last_deep_scrub":"44'931","last_deep_scrub_stamp":"2023-11-04T15:37:46.627638+0000","last_clean_scrub_stamp":"2023-11-04T15:37:46.627638+0000","objects_scrubbed":5,"log_size":931,"log_dups_size":0,"ondisk_log_size":931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:40:26.233782+0000","scrub_duration":0.040590909000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":923,"num_write_kb":21087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"40'3552","reported_seq":2974,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.150675+0000","last_change":"2023-11-04T15:36:55.776553+0000","last_active":"2023-11-04T15:37:07.150675+0000","last_peered":"2023-11-04T15:37:07.150675+0000","last_clean":"2023-11-04T15:37:07.150675+0000","last_became_active":"2023-11-04T15:27:36.141167+0000","last_became_peered":"2023-11-04T15:27:36.141167+0000","last_unstale":"2023-11-04T15:37:07.150675+0000","last_undegraded":"2023-11-04T15:37:07.150675+0000","last_fullsized":"2023-11-04T15:37:07.150675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3552,"log_dups_size":0,"ondisk_log_size":3552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057363947999999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1127,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"44'3229","reported_seq":3281,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:37.512770+0000","last_change":"2023-11-04T15:37:37.512913+0000","last_active":"2023-11-04T15:37:37.512770+0000","last_peered":"2023-11-04T15:37:37.512770+0000","last_clean":"2023-11-04T15:37:37.512770+0000","last_became_active":"2023-11-04T15:27:35.775171+0000","last_became_peered":"2023-11-04T15:27:35.775171+0000","last_unstale":"2023-11-04T15:37:37.512770+0000","last_undegraded":"2023-11-04T15:37:37.512770+0000","last_fullsized":"2023-11-04T15:37:37.512770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3229","last_scrub_stamp":"2023-11-04T15:37:37.512732+0000","last_deep_scrub":"44'3229","last_deep_scrub_stamp":"2023-11-04T15:37:37.512732+0000","last_clean_scrub_stamp":"2023-11-04T15:37:37.512732+0000","objects_scrubbed":4,"log_size":3229,"log_dups_size":0,"ondisk_log_size":3229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:07:51.143393+0000","scrub_duration":0.039893972,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3214,"num_write_kb":42509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"44'3490","reported_seq":2947,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:09.749095+0000","last_change":"2023-11-04T15:37:09.749095+0000","last_active":"2023-11-04T15:37:09.749095+0000","last_peered":"2023-11-04T15:37:09.749095+0000","last_clean":"2023-11-04T15:37:09.749095+0000","last_became_active":"2023-11-04T15:27:36.145560+0000","last_became_peered":"2023-11-04T15:27:36.145560+0000","last_unstale":"2023-11-04T15:37:09.749095+0000","last_undegraded":"2023-11-04T15:37:09.749095+0000","last_fullsized":"2023-11-04T15:37:09.749095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3490","last_scrub_stamp":"2023-11-04T15:37:09.748973+0000","last_deep_scrub":"44'3490","last_deep_scrub_stamp":"2023-11-04T15:37:09.748973+0000","last_clean_scrub_stamp":"2023-11-04T15:37:09.748973+0000","objects_scrubbed":5,"log_size":3490,"log_dups_size":0,"ondisk_log_size":3490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:31.358580+0000","scrub_duration":0.011863093,"objects_trimmed":0,"snaptrim_duration":0.07011676,"stat_sum":{"num_bytes":4151,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":1159,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"40'4214","reported_seq":4256,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:06.226350+0000","last_change":"2023-11-04T15:27:35.771225+0000","last_active":"2023-11-04T15:37:06.226350+0000","last_peered":"2023-11-04T15:37:06.226350+0000","last_clean":"2023-11-04T15:37:06.226350+0000","last_became_active":"2023-11-04T15:27:35.770873+0000","last_became_peered":"2023-11-04T15:27:35.770873+0000","last_unstale":"2023-11-04T15:37:06.226350+0000","last_undegraded":"2023-11-04T15:37:06.226350+0000","last_fullsized":"2023-11-04T15:37:06.226350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":4214,"log_dups_size":0,"ondisk_log_size":4214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4214,"num_write_kb":32525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"44'4092","reported_seq":3407,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:13.735284+0000","last_change":"2023-11-04T15:37:13.735284+0000","last_active":"2023-11-04T15:37:13.735284+0000","last_peered":"2023-11-04T15:37:13.735284+0000","last_clean":"2023-11-04T15:37:13.735284+0000","last_became_active":"2023-11-04T15:27:36.147535+0000","last_became_peered":"2023-11-04T15:27:36.147535+0000","last_unstale":"2023-11-04T15:37:13.735284+0000","last_undegraded":"2023-11-04T15:37:13.735284+0000","last_fullsized":"2023-11-04T15:37:13.735284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4092","last_scrub_stamp":"2023-11-04T15:37:13.735159+0000","last_deep_scrub":"44'4092","last_deep_scrub_stamp":"2023-11-04T15:37:13.735159+0000","last_clean_scrub_stamp":"2023-11-04T15:37:13.735159+0000","objects_scrubbed":2,"log_size":4092,"log_dups_size":0,"ondisk_log_size":4092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:20:39.611539+0000","scrub_duration":0.012119325,"objects_trimmed":0,"snaptrim_duration":0.055801837,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1294,"num_write_kb":719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"40'1589","reported_seq":1631,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:06.226369+0000","last_change":"2023-11-04T15:27:35.776315+0000","last_active":"2023-11-04T15:37:06.226369+0000","last_peered":"2023-11-04T15:37:06.226369+0000","last_clean":"2023-11-04T15:37:06.226369+0000","last_became_active":"2023-11-04T15:27:35.775918+0000","last_became_peered":"2023-11-04T15:27:35.775918+0000","last_unstale":"2023-11-04T15:37:06.226369+0000","last_undegraded":"2023-11-04T15:37:06.226369+0000","last_fullsized":"2023-11-04T15:37:06.226369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1589,"log_dups_size":0,"ondisk_log_size":1589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1587,"num_write_kb":12658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":127433,"num_objects":92,"num_object_clones":25,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":8,"num_read":46,"num_read_kb":30,"num_write":74822,"num_write_kb":40603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":254672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224332,"ondisk_log_size":224332,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":430735581,"num_objects":126,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":126,"num_whiteouts":0,"num_read":190,"num_read_kb":3338,"num_write":83456,"num_write_kb":897544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6707,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":861528064,"data_stored":861471162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83181,"ondisk_log_size":83181,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705796,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":663648,"kb_used_data":173208,"kb_used_omap":0,"kb_used_meta":490432,"kb_avail":93708192,"statfs":{"total":96636764160,"available":95957188608,"internally_reserved":0,"allocated":177364992,"data_stored":176999461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":502202368},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 15:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47899999999999998,"15min":0.40400000000000003},"min":{"1min":0.28899999999999998,"5min":0.182,"15min":0.156},"max":{"1min":0.67900000000000005,"5min":10.488,"15min":10.488},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.628,"15min":0.45800000000000002},"min":{"1min":0.218,"5min":0.20200000000000001,"15min":0.186},"max":{"1min":0.61599999999999999,"5min":13.055,"15min":13.055},"last":0.46899999999999997}]},{"osd":1,"last update":"Sat Nov 4 15:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.54000000000000004,"15min":0.435},"min":{"1min":0.23499999999999999,"5min":0.20200000000000001,"15min":0.188},"max":{"1min":0.71199999999999997,"5min":12.347,"15min":12.347},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.53000000000000003,"15min":0.439},"min":{"1min":0.26600000000000001,"5min":0.23100000000000001,"15min":0.186},"max":{"1min":0.65300000000000002,"5min":12.853999999999999,"15min":12.853999999999999},"last":0.44}]},{"osd":2,"last update":"Sat Nov 4 15:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.441,"15min":0.34499999999999997},"min":{"1min":0.17199999999999999,"5min":0.153,"15min":0.153},"max":{"1min":0.46100000000000002,"5min":11.709,"15min":11.709},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.42899999999999999,"15min":0.35499999999999998},"min":{"1min":0.22600000000000001,"5min":0.161,"15min":0.14899999999999999},"max":{"1min":0.47899999999999998,"5min":9.2629999999999999,"15min":9.2629999999999999},"last":0.29799999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705795,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":952424,"kb_used_data":245472,"kb_used_omap":0,"kb_used_meta":706944,"kb_avail":93419416,"statfs":{"total":96636764160,"available":95661481984,"internally_reserved":0,"allocated":251363328,"data_stored":250991590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":723910656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 15:37:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":0.64800000000000002,"15min":0.46600000000000003},"min":{"1min":0.20599999999999999,"5min":0.153,"15min":0.151},"max":{"1min":21.297999999999998,"5min":21.297999999999998,"15min":21.297999999999998},"last":0.54800000000000004},{"interface":"front","average":{"1min":1.252,"5min":0.55900000000000005,"15min":0.432},"min":{"1min":0.26000000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":17.809000000000001,"5min":17.809000000000001,"15min":17.809000000000001},"last":0.50600000000000001}]},{"osd":1,"last update":"Sat Nov 4 15:37:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":0.53800000000000003,"15min":0.44700000000000001},"min":{"1min":0.379,"5min":0.192,"15min":0.17100000000000001},"max":{"1min":10.851000000000001,"5min":10.851000000000001,"15min":10.851000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":0.54200000000000004,"15min":0.46100000000000002},"min":{"1min":0.37,"5min":0.20899999999999999,"15min":0.20399999999999999},"max":{"1min":8.9740000000000002,"5min":8.9740000000000002,"15min":8.9740000000000002},"last":0.64000000000000001}]},{"osd":3,"last update":"Sat Nov 4 15:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.33700000000000002,"15min":0.32400000000000001},"min":{"1min":0.19700000000000001,"5min":0.152,"15min":0.14699999999999999},"max":{"1min":3.3929999999999998,"5min":3.3929999999999998,"15min":3.3929999999999998},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.874,"5min":0.43099999999999999,"15min":0.373},"min":{"1min":0.248,"5min":0.159,"15min":0.14899999999999999},"max":{"1min":10.887,"5min":10.887,"15min":10.887},"last":0.32000000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705794,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":719272,"kb_used_data":188640,"kb_used_omap":0,"kb_used_meta":530624,"kb_avail":93652568,"statfs":{"total":96636764160,"available":95900229632,"internally_reserved":0,"allocated":193167360,"data_stored":192807863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":543358976},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 15:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.28699999999999998,"5min":0.42899999999999999,"15min":0.318},"min":{"1min":0.20499999999999999,"5min":0.152,"15min":0.14399999999999999},"max":{"1min":0.377,"5min":12.768000000000001,"15min":12.768000000000001},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.33800000000000002,"15min":0.29999999999999999},"min":{"1min":0.22500000000000001,"5min":0.14399999999999999,"15min":0.14399999999999999},"max":{"1min":1.847,"5min":8.609,"15min":8.609},"last":0.30299999999999999}]},{"osd":2,"last update":"Sat Nov 4 15:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.44400000000000001,"15min":0.438},"min":{"1min":0.215,"5min":0.19600000000000001,"15min":0.189},"max":{"1min":0.624,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.434,"5min":0.42199999999999999,"15min":0.41999999999999998},"min":{"1min":0.27400000000000002,"5min":0.21299999999999999,"15min":0.192},"max":{"1min":0.56799999999999995,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.61199999999999999}]},{"osd":3,"last update":"Sat Nov 4 15:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.45100000000000001,"15min":0.435},"min":{"1min":0.26200000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.621,"5min":6.7679999999999998,"15min":6.7679999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.45200000000000001,"15min":0.44700000000000001},"min":{"1min":0.26600000000000001,"5min":0.25600000000000001,"15min":0.24299999999999999},"max":{"1min":0.58399999999999996,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.49299999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705795,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":918208,"kb_used_data":237496,"kb_used_omap":0,"kb_used_meta":680704,"kb_avail":93453632,"statfs":{"total":96636764160,"available":95696519168,"internally_reserved":0,"allocated":243195904,"data_stored":242832608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":697040896},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 15:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.45500000000000002,"15min":0.32100000000000001},"min":{"1min":0.187,"5min":0.14499999999999999,"15min":0.13500000000000001},"max":{"1min":12.731,"5min":12.731,"15min":12.731},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.30199999999999999,"15min":0.27500000000000002},"min":{"1min":0.185,"5min":0.16400000000000001,"15min":0.155},"max":{"1min":0.5,"5min":4.1200000000000001,"15min":4.1200000000000001},"last":0.27500000000000002}]},{"osd":2,"last update":"Sat Nov 4 15:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.45600000000000002,"15min":0.42899999999999999},"min":{"1min":0.252,"5min":0.19400000000000001,"15min":0.17599999999999999},"max":{"1min":1.8169999999999999,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.443,"15min":0.42899999999999999},"min":{"1min":0.255,"5min":0.21099999999999999,"15min":0.187},"max":{"1min":3.6749999999999998,"5min":3.6749999999999998,"15min":3.6749999999999998},"last":0.72999999999999998}]},{"osd":3,"last update":"Sat Nov 4 15:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.442},"min":{"1min":0.26700000000000002,"5min":0.20899999999999999,"15min":0.20300000000000001},"max":{"1min":0.68899999999999995,"5min":6.4660000000000002,"15min":6.4660000000000002},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.47699999999999998,"15min":0.44800000000000001},"min":{"1min":0.29199999999999998,"5min":0.23899999999999999,"15min":0.23000000000000001},"max":{"1min":0.68400000000000005,"5min":6.3540000000000001,"15min":6.3540000000000001},"last":0.60199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":242003968,"data_stored":241991173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":192552960,"data_stored":192552686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":250785792,"data_stored":250765155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":176185344,"data_stored":176162148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":69829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":73939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":45197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":65707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T15:38:09.040 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.041 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.041 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.041 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.041 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.042 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.042 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.042 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.043 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.043 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.043 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.044 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.044 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.044 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.045 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.045 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.045 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.045 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.046 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.046 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.046 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.047 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.047 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.047 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.048 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.048 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.048 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.049 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.049 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.049 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.050 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.050 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.050 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-04T15:27:25.163848+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=25, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.051 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-04T15:27:30.611946+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.051 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-04T15:27:30.611946+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.051 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-04T15:27:30.611946+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.052 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-04T15:27:30.611946+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.052 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.052 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-04T15:27:30.611946+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=30, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.053 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.053 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.053 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.054 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.054 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.054 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.055 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.055 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:09.055 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-04T15:38:29.057 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T15:38:29.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.175+0000 7f797ccb9640 1 Processor -- start 2023-11-04T15:38:29.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.175+0000 7f797ccb9640 1 -- start start 2023-11-04T15:38:29.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.176+0000 7f797ccb9640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7978137270 0x7f79780a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:38:29.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.176+0000 7f797ccb9640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f79780a3e90 0x7f7978139f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:38:29.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.176+0000 7f797ccb9640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79780a4c20 con 0x7f7978137650 2023-11-04T15:38:29.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.176+0000 7f797ccb9640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79780a3060 con 0x7f79780a3e90 2023-11-04T15:38:29.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.176+0000 7f797ccb9640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79780a5080 con 0x7f7978137270 2023-11-04T15:38:29.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.176+0000 7f7975d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f79780a3e90 0x7f7978139f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:38:29.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.176+0000 7f7975d9b640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f79780a3e90 0x7f7978139f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44436/0 (socket says 172.21.15.19:44436) 2023-11-04T15:38:29.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.176+0000 7f7975d9b640 1 -- 172.21.15.19:0/2283232283 learned_addr learned my addr 172.21.15.19:0/2283232283 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:38:29.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.176+0000 7f797659c640 1 --2- 172.21.15.19:0/2283232283 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7978137270 0x7f79780a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:38:29.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.176+0000 7f7975d9b640 1 -- 172.21.15.19:0/2283232283 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7978137270 msgr2=0x7f79780a6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:38:29.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.176+0000 7f7975d9b640 1 --2- 172.21.15.19:0/2283232283 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7978137270 0x7f79780a6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:38:29.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.176+0000 7f7975d9b640 1 -- 172.21.15.19:0/2283232283 >> v1:172.21.15.96:6789/0 conn(0x7f7978137650 legacy=0x7f797813a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:38:29.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.176+0000 7f7975d9b640 1 -- 172.21.15.19:0/2283232283 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79780a3440 con 0x7f79780a3e90 2023-11-04T15:38:29.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.177+0000 7f7975d9b640 1 --2- 172.21.15.19:0/2283232283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79780a3e90 0x7f7978139f60 secure :-1 s=READY pgs=3778 cs=0 l=1 rev1=1 crypto rx=0x7f796c009870 tx=0x7f796c02b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bb555d6cd5939d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:38:29.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.177+0000 7f797559a640 1 -- 172.21.15.19:0/2283232283 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c031740 con 0x7f79780a3e90 2023-11-04T15:38:29.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.177+0000 7f797559a640 1 -- 172.21.15.19:0/2283232283 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796c0318a0 con 0x7f79780a3e90 2023-11-04T15:38:29.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.177+0000 7f797559a640 1 -- 172.21.15.19:0/2283232283 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c031c30 con 0x7f79780a3e90 2023-11-04T15:38:29.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.178+0000 7f797ccb9640 1 -- 172.21.15.19:0/2283232283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79780a3e90 msgr2=0x7f7978139f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:38:29.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.178+0000 7f797ccb9640 1 --2- 172.21.15.19:0/2283232283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79780a3e90 0x7f7978139f60 secure :-1 s=READY pgs=3778 cs=0 l=1 rev1=1 crypto rx=0x7f796c009870 tx=0x7f796c02b7e0 comp rx=0 tx=0).stop 2023-11-04T15:38:29.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.178+0000 7f797ccb9640 1 -- 172.21.15.19:0/2283232283 shutdown_connections 2023-11-04T15:38:29.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.178+0000 7f797ccb9640 1 --2- 172.21.15.19:0/2283232283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79780a3e90 0x7f7978139f60 unknown :-1 s=CLOSED pgs=3778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:38:29.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.178+0000 7f797ccb9640 1 --2- 172.21.15.19:0/2283232283 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7978137270 0x7f79780a6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:38:29.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.178+0000 7f797ccb9640 1 -- 172.21.15.19:0/2283232283 >> 172.21.15.19:0/2283232283 conn(0x7f79780a8d70 msgr2=0x7f79780a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:38:29.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.178+0000 7f797ccb9640 1 -- 172.21.15.19:0/2283232283 shutdown_connections 2023-11-04T15:38:29.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.178+0000 7f797ccb9640 1 -- 172.21.15.19:0/2283232283 wait complete. 2023-11-04T15:38:29.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.179+0000 7f797ccb9640 1 Processor -- start 2023-11-04T15:38:29.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.179+0000 7f797ccb9640 1 -- start start 2023-11-04T15:38:29.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.180+0000 7f797ccb9640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f79780a3e90 0x7f79781cef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:38:29.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.180+0000 7f797ccb9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7978137270 0x7f79781cf470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:38:29.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.180+0000 7f797ccb9640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7978137650 0x7f79781cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:38:29.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.180+0000 7f797ccb9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79780a2010 con 0x7f7978137270 2023-11-04T15:38:29.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.180+0000 7f797ccb9640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797809f6e0 con 0x7f7978137650 2023-11-04T15:38:29.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.180+0000 7f797ccb9640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797809fed0 con 0x7f79780a3e90 2023-11-04T15:38:29.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.180+0000 7f7975d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7978137270 0x7f79781cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:38:29.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.180+0000 7f7975d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7978137270 0x7f79781cf470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44450/0 (socket says 172.21.15.19:44450) 2023-11-04T15:38:29.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.180+0000 7f7975d9b640 1 -- 172.21.15.19:0/1261832880 learned_addr learned my addr 172.21.15.19:0/1261832880 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:38:29.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.180+0000 7f797659c640 1 --2- 172.21.15.19:0/1261832880 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f79780a3e90 0x7f79781cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:38:29.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.180+0000 7f7976d9d640 1 --2- 172.21.15.19:0/1261832880 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7978137650 0x7f79781cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:38:29.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.180+0000 7f7975d9b640 1 -- 172.21.15.19:0/1261832880 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f79780a3e90 msgr2=0x7f79781cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:38:29.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.180+0000 7f7975d9b640 1 --2- 172.21.15.19:0/1261832880 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f79780a3e90 0x7f79781cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:38:29.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.180+0000 7f7975d9b640 1 -- 172.21.15.19:0/1261832880 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7978137650 msgr2=0x7f79781cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:38:29.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.180+0000 7f7975d9b640 1 --2- 172.21.15.19:0/1261832880 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7978137650 0x7f79781cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:38:29.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.180+0000 7f7975d9b640 1 -- 172.21.15.19:0/1261832880 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796c0094d0 con 0x7f7978137270 2023-11-04T15:38:29.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.180+0000 7f7976d9d640 1 --2- 172.21.15.19:0/1261832880 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7978137650 0x7f79781cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:38:29.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.180+0000 7f7975d9b640 1 --2- 172.21.15.19:0/1261832880 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7978137270 0x7f79781cf470 secure :-1 s=READY pgs=3779 cs=0 l=1 rev1=1 crypto rx=0x7f796c000c00 tx=0x7f796c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:38:29.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.180+0000 7f7966ffd640 1 -- 172.21.15.19:0/1261832880 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c033d60 con 0x7f7978137270 2023-11-04T15:38:29.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.180+0000 7f7966ffd640 1 -- 172.21.15.19:0/1261832880 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796c03c400 con 0x7f7978137270 2023-11-04T15:38:29.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.180+0000 7f797ccb9640 1 -- 172.21.15.19:0/1261832880 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f797809f440 con 0x7f7978137270 2023-11-04T15:38:29.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.180+0000 7f7966ffd640 1 -- 172.21.15.19:0/1261832880 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c03c7b0 con 0x7f7978137270 2023-11-04T15:38:29.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.180+0000 7f797ccb9640 1 -- 172.21.15.19:0/1261832880 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f797809fbf0 con 0x7f7978137270 2023-11-04T15:38:29.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.181+0000 7f797ccb9640 1 -- 172.21.15.19:0/1261832880 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79780a2180 con 0x7f7978137270 2023-11-04T15:38:29.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.182+0000 7f7966ffd640 1 -- 172.21.15.19:0/1261832880 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f796c03a040 con 0x7f7978137270 2023-11-04T15:38:29.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.182+0000 7f7966ffd640 1 --2- 172.21.15.19:0/1261832880 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f795806a430 0x7f795806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:38:29.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.182+0000 7f7966ffd640 1 -- 172.21.15.19:0/1261832880 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4434+0+0 (secure 0 0 0) 0x7f796c0aa070 con 0x7f7978137270 2023-11-04T15:38:29.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.183+0000 7f797659c640 1 --2- 172.21.15.19:0/1261832880 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f795806a430 0x7f795806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:38:29.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.183+0000 7f797659c640 1 --2- 172.21.15.19:0/1261832880 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f795806a430 0x7f795806c8f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f796800aac0 tx=0x7f7968008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:38:29.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.187+0000 7f7966ffd640 1 -- 172.21.15.19:0/1261832880 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f796c075db0 con 0x7f7978137270 2023-11-04T15:38:29.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.362+0000 7f797ccb9640 1 -- 172.21.15.19:0/1261832880 --> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f79780a5340 con 0x7f795806a430 2023-11-04T15:38:29.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.369+0000 7f7966ffd640 1 -- 172.21.15.19:0/1261832880 <== mgr.4114 v2:172.21.15.96:6816/83123 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280851 (secure 0 0 0) 0x7f796800c040 con 0x7f795806a430 2023-11-04T15:38:29.374 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:38:29.376 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-11-04T15:38:29.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.372+0000 7f797ccb9640 1 -- 172.21.15.19:0/1261832880 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f795806a430 msgr2=0x7f795806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:38:29.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.372+0000 7f797ccb9640 1 --2- 172.21.15.19:0/1261832880 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f795806a430 0x7f795806c8f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f796800aac0 tx=0x7f7968008040 comp rx=0 tx=0).stop 2023-11-04T15:38:29.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.372+0000 7f797ccb9640 1 -- 172.21.15.19:0/1261832880 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7978137270 msgr2=0x7f79781cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:38:29.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.372+0000 7f797ccb9640 1 --2- 172.21.15.19:0/1261832880 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7978137270 0x7f79781cf470 secure :-1 s=READY pgs=3779 cs=0 l=1 rev1=1 crypto rx=0x7f796c000c00 tx=0x7f796c0046c0 comp rx=0 tx=0).stop 2023-11-04T15:38:29.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.372+0000 7f797ccb9640 1 -- 172.21.15.19:0/1261832880 shutdown_connections 2023-11-04T15:38:29.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.372+0000 7f797ccb9640 1 --2- 172.21.15.19:0/1261832880 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f795806a430 0x7f795806c8f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:38:29.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.372+0000 7f797ccb9640 1 --2- 172.21.15.19:0/1261832880 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7978137650 0x7f79781cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:38:29.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.372+0000 7f797ccb9640 1 --2- 172.21.15.19:0/1261832880 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7978137270 0x7f79781cf470 unknown :-1 s=CLOSED pgs=3779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:38:29.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.372+0000 7f797ccb9640 1 --2- 172.21.15.19:0/1261832880 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f79780a3e90 0x7f79781cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:38:29.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.372+0000 7f797ccb9640 1 -- 172.21.15.19:0/1261832880 >> 172.21.15.19:0/1261832880 conn(0x7f79780a8d70 msgr2=0x7f7978136720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:38:29.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.372+0000 7f797ccb9640 1 -- 172.21.15.19:0/1261832880 shutdown_connections 2023-11-04T15:38:29.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:29.372+0000 7f797ccb9640 1 -- 172.21.15.19:0/1261832880 wait complete. 2023-11-04T15:38:29.384 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":373,"stamp":"2023-11-04T15:38:29.076486+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":431453382,"num_objects":220,"num_object_clones":25,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":8,"num_read":352,"num_read_kb":3468,"num_write":158437,"num_write_kb":940563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7850,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":307667,"ondisk_log_size":307667,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":3253552,"kb_used_data":844816,"kb_used_omap":0,"kb_used_meta":2408704,"kb_avail":374233808,"statfs":{"total":386547056640,"available":383215419392,"internally_reserved":0,"allocated":865091584,"data_stored":863631522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2466512896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002896"},"pg_stats":[{"pgid":"4.3f","version":"40'3514","reported_seq":2963,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:08.783192+0000","last_change":"2023-11-04T15:37:08.783192+0000","last_active":"2023-11-04T15:37:08.783192+0000","last_peered":"2023-11-04T15:37:08.783192+0000","last_clean":"2023-11-04T15:37:08.783192+0000","last_became_active":"2023-11-04T15:27:36.150296+0000","last_became_peered":"2023-11-04T15:27:36.150296+0000","last_unstale":"2023-11-04T15:37:08.783192+0000","last_undegraded":"2023-11-04T15:37:08.783192+0000","last_fullsized":"2023-11-04T15:37:08.783192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3514","last_scrub_stamp":"2023-11-04T15:37:08.783013+0000","last_deep_scrub":"40'3514","last_deep_scrub_stamp":"2023-11-04T15:37:08.783013+0000","last_clean_scrub_stamp":"2023-11-04T15:37:08.783013+0000","objects_scrubbed":0,"log_size":3514,"log_dups_size":0,"ondisk_log_size":3514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:20:34.659393+0000","scrub_duration":0.0030156520000000002,"objects_trimmed":0,"snaptrim_duration":0.074678280999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1112,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"43'3332","reported_seq":2785,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.150860+0000","last_change":"2023-11-04T15:36:55.781000+0000","last_active":"2023-11-04T15:37:07.150860+0000","last_peered":"2023-11-04T15:37:07.150860+0000","last_clean":"2023-11-04T15:37:07.150860+0000","last_became_active":"2023-11-04T15:27:36.148939+0000","last_became_peered":"2023-11-04T15:27:36.148939+0000","last_unstale":"2023-11-04T15:37:07.150860+0000","last_undegraded":"2023-11-04T15:37:07.150860+0000","last_fullsized":"2023-11-04T15:37:07.150860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3332,"log_dups_size":0,"ondisk_log_size":3332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059113046000000002,"stat_sum":{"num_bytes":35,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1118,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"40'3527","reported_seq":3001,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.611673+0000","last_change":"2023-11-04T15:36:55.822917+0000","last_active":"2023-11-04T15:37:07.611673+0000","last_peered":"2023-11-04T15:37:07.611673+0000","last_clean":"2023-11-04T15:37:07.611673+0000","last_became_active":"2023-11-04T15:27:36.149748+0000","last_became_peered":"2023-11-04T15:27:36.149748+0000","last_unstale":"2023-11-04T15:37:07.611673+0000","last_undegraded":"2023-11-04T15:37:07.611673+0000","last_fullsized":"2023-11-04T15:37:07.611673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3527,"log_dups_size":0,"ondisk_log_size":3527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101592565,"stat_sum":{"num_bytes":8206,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":1149,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"40'3602","reported_seq":2996,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:13.718129+0000","last_change":"2023-11-04T15:38:13.718234+0000","last_active":"2023-11-04T15:38:13.718129+0000","last_peered":"2023-11-04T15:38:13.718129+0000","last_clean":"2023-11-04T15:38:13.718129+0000","last_became_active":"2023-11-04T15:27:36.139761+0000","last_became_peered":"2023-11-04T15:27:36.139761+0000","last_unstale":"2023-11-04T15:38:13.718129+0000","last_undegraded":"2023-11-04T15:38:13.718129+0000","last_fullsized":"2023-11-04T15:38:13.718129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3602","last_scrub_stamp":"2023-11-04T15:38:13.718107+0000","last_deep_scrub":"40'3602","last_deep_scrub_stamp":"2023-11-04T15:38:13.718107+0000","last_clean_scrub_stamp":"2023-11-04T15:38:13.718107+0000","objects_scrubbed":0,"log_size":3602,"log_dups_size":0,"ondisk_log_size":3602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:31.176388+0000","scrub_duration":0.0074235689999999997,"objects_trimmed":0,"snaptrim_duration":0.052924038,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1171,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"40'3725","reported_seq":3130,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:49.526048+0000","last_change":"2023-11-04T15:37:49.526154+0000","last_active":"2023-11-04T15:37:49.526048+0000","last_peered":"2023-11-04T15:37:49.526048+0000","last_clean":"2023-11-04T15:37:49.526048+0000","last_became_active":"2023-11-04T15:27:36.150017+0000","last_became_peered":"2023-11-04T15:27:36.150017+0000","last_unstale":"2023-11-04T15:37:49.526048+0000","last_undegraded":"2023-11-04T15:37:49.526048+0000","last_fullsized":"2023-11-04T15:37:49.526048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3725","last_scrub_stamp":"2023-11-04T15:37:49.526022+0000","last_deep_scrub":"40'3725","last_deep_scrub_stamp":"2023-11-04T15:37:49.526022+0000","last_clean_scrub_stamp":"2023-11-04T15:37:49.526022+0000","objects_scrubbed":0,"log_size":3725,"log_dups_size":0,"ondisk_log_size":3725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:46:35.934988+0000","scrub_duration":0.0051336519999999998,"objects_trimmed":0,"snaptrim_duration":0.073241305000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1192,"num_write_kb":641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"40'3327","reported_seq":2771,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.611630+0000","last_change":"2023-11-04T15:36:55.824394+0000","last_active":"2023-11-04T15:37:07.611630+0000","last_peered":"2023-11-04T15:37:07.611630+0000","last_clean":"2023-11-04T15:37:07.611630+0000","last_became_active":"2023-11-04T15:27:36.139036+0000","last_became_peered":"2023-11-04T15:27:36.139036+0000","last_unstale":"2023-11-04T15:37:07.611630+0000","last_undegraded":"2023-11-04T15:37:07.611630+0000","last_fullsized":"2023-11-04T15:37:07.611630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3327,"log_dups_size":0,"ondisk_log_size":3327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.102154117,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1074,"num_write_kb":603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"44'3356","reported_seq":2819,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:26.478185+0000","last_change":"2023-11-04T15:37:26.478185+0000","last_active":"2023-11-04T15:37:26.478185+0000","last_peered":"2023-11-04T15:37:26.478185+0000","last_clean":"2023-11-04T15:37:26.478185+0000","last_became_active":"2023-11-04T15:27:36.139121+0000","last_became_peered":"2023-11-04T15:27:36.139121+0000","last_unstale":"2023-11-04T15:37:26.478185+0000","last_undegraded":"2023-11-04T15:37:26.478185+0000","last_fullsized":"2023-11-04T15:37:26.478185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3356","last_scrub_stamp":"2023-11-04T15:37:26.478037+0000","last_deep_scrub":"44'3356","last_deep_scrub_stamp":"2023-11-04T15:37:26.478037+0000","last_clean_scrub_stamp":"2023-11-04T15:37:26.478037+0000","objects_scrubbed":5,"log_size":3356,"log_dups_size":0,"ondisk_log_size":3356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:38:01.386862+0000","scrub_duration":0.011615044999999999,"objects_trimmed":0,"snaptrim_duration":0.099827518000000004,"stat_sum":{"num_bytes":4117,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":2,"num_read_kb":1,"num_write":1086,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"40'3425","reported_seq":2844,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.611595+0000","last_change":"2023-11-04T15:36:55.816551+0000","last_active":"2023-11-04T15:37:07.611595+0000","last_peered":"2023-11-04T15:37:07.611595+0000","last_clean":"2023-11-04T15:37:07.611595+0000","last_became_active":"2023-11-04T15:27:36.147050+0000","last_became_peered":"2023-11-04T15:27:36.147050+0000","last_unstale":"2023-11-04T15:37:07.611595+0000","last_undegraded":"2023-11-04T15:37:07.611595+0000","last_fullsized":"2023-11-04T15:37:07.611595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3425,"log_dups_size":0,"ondisk_log_size":3425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.098810337999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"40'3561","reported_seq":2965,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:06.226649+0000","last_change":"2023-11-04T15:36:55.796038+0000","last_active":"2023-11-04T15:37:06.226649+0000","last_peered":"2023-11-04T15:37:06.226649+0000","last_clean":"2023-11-04T15:37:06.226649+0000","last_became_active":"2023-11-04T15:27:36.145825+0000","last_became_peered":"2023-11-04T15:27:36.145825+0000","last_unstale":"2023-11-04T15:37:06.226649+0000","last_undegraded":"2023-11-04T15:37:06.226649+0000","last_fullsized":"2023-11-04T15:37:06.226649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3561,"log_dups_size":0,"ondisk_log_size":3561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072094483000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"44'3329","reported_seq":2857,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:55.514489+0000","last_change":"2023-11-04T15:37:55.514590+0000","last_active":"2023-11-04T15:37:55.514489+0000","last_peered":"2023-11-04T15:37:55.514489+0000","last_clean":"2023-11-04T15:37:55.514489+0000","last_became_active":"2023-11-04T15:27:36.150307+0000","last_became_peered":"2023-11-04T15:27:36.150307+0000","last_unstale":"2023-11-04T15:37:55.514489+0000","last_undegraded":"2023-11-04T15:37:55.514489+0000","last_fullsized":"2023-11-04T15:37:55.514489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3329","last_scrub_stamp":"2023-11-04T15:37:55.514464+0000","last_deep_scrub":"44'3329","last_deep_scrub_stamp":"2023-11-04T15:37:55.514464+0000","last_clean_scrub_stamp":"2023-11-04T15:37:55.514464+0000","objects_scrubbed":2,"log_size":3329,"log_dups_size":0,"ondisk_log_size":3329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:11:45.335660+0000","scrub_duration":0.011217928,"objects_trimmed":0,"snaptrim_duration":0.10012518099999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1064,"num_write_kb":572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"40'3202","reported_seq":2732,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:12.694264+0000","last_change":"2023-11-04T15:38:12.694422+0000","last_active":"2023-11-04T15:38:12.694264+0000","last_peered":"2023-11-04T15:38:12.694264+0000","last_clean":"2023-11-04T15:38:12.694264+0000","last_became_active":"2023-11-04T15:27:36.144988+0000","last_became_peered":"2023-11-04T15:27:36.144988+0000","last_unstale":"2023-11-04T15:38:12.694264+0000","last_undegraded":"2023-11-04T15:38:12.694264+0000","last_fullsized":"2023-11-04T15:38:12.694264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3202","last_scrub_stamp":"2023-11-04T15:38:12.694227+0000","last_deep_scrub":"40'3202","last_deep_scrub_stamp":"2023-11-04T15:38:12.694227+0000","last_clean_scrub_stamp":"2023-11-04T15:38:12.694227+0000","objects_scrubbed":0,"log_size":3202,"log_dups_size":0,"ondisk_log_size":3202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:44:10.147349+0000","scrub_duration":0.0048418030000000004,"objects_trimmed":0,"snaptrim_duration":0.052379294999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1028,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"44'3395","reported_seq":2835,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:21.176452+0000","last_change":"2023-11-04T15:38:21.176557+0000","last_active":"2023-11-04T15:38:21.176452+0000","last_peered":"2023-11-04T15:38:21.176452+0000","last_clean":"2023-11-04T15:38:21.176452+0000","last_became_active":"2023-11-04T15:27:36.149156+0000","last_became_peered":"2023-11-04T15:27:36.149156+0000","last_unstale":"2023-11-04T15:38:21.176452+0000","last_undegraded":"2023-11-04T15:38:21.176452+0000","last_fullsized":"2023-11-04T15:38:21.176452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3395","last_scrub_stamp":"2023-11-04T15:38:21.176427+0000","last_deep_scrub":"44'3395","last_deep_scrub_stamp":"2023-11-04T15:38:21.176427+0000","last_clean_scrub_stamp":"2023-11-04T15:38:21.176427+0000","objects_scrubbed":1,"log_size":3395,"log_dups_size":0,"ondisk_log_size":3395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:29:26.395550+0000","scrub_duration":0.011035761999999999,"objects_trimmed":0,"snaptrim_duration":0.064372897999999998,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1159,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"40'3255","reported_seq":2755,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:24.864365+0000","last_change":"2023-11-04T15:38:24.864474+0000","last_active":"2023-11-04T15:38:24.864365+0000","last_peered":"2023-11-04T15:38:24.864365+0000","last_clean":"2023-11-04T15:38:24.864365+0000","last_became_active":"2023-11-04T15:27:36.139824+0000","last_became_peered":"2023-11-04T15:27:36.139824+0000","last_unstale":"2023-11-04T15:38:24.864365+0000","last_undegraded":"2023-11-04T15:38:24.864365+0000","last_fullsized":"2023-11-04T15:38:24.864365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3255","last_scrub_stamp":"2023-11-04T15:38:24.864341+0000","last_deep_scrub":"40'3255","last_deep_scrub_stamp":"2023-11-04T15:38:24.864341+0000","last_clean_scrub_stamp":"2023-11-04T15:38:24.864341+0000","objects_scrubbed":0,"log_size":3255,"log_dups_size":0,"ondisk_log_size":3255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:32:57.678216+0000","scrub_duration":0.0057894940000000001,"objects_trimmed":0,"snaptrim_duration":0.070068697999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1062,"num_write_kb":575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"44'3539","reported_seq":2930,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:24.652046+0000","last_change":"2023-11-04T15:38:24.652151+0000","last_active":"2023-11-04T15:38:24.652046+0000","last_peered":"2023-11-04T15:38:24.652046+0000","last_clean":"2023-11-04T15:38:24.652046+0000","last_became_active":"2023-11-04T15:27:36.147273+0000","last_became_peered":"2023-11-04T15:27:36.147273+0000","last_unstale":"2023-11-04T15:38:24.652046+0000","last_undegraded":"2023-11-04T15:38:24.652046+0000","last_fullsized":"2023-11-04T15:38:24.652046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3539","last_scrub_stamp":"2023-11-04T15:38:24.652022+0000","last_deep_scrub":"44'3539","last_deep_scrub_stamp":"2023-11-04T15:38:24.652022+0000","last_clean_scrub_stamp":"2023-11-04T15:38:24.652022+0000","objects_scrubbed":1,"log_size":3539,"log_dups_size":0,"ondisk_log_size":3539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:16:59.050291+0000","scrub_duration":0.0093328639999999997,"objects_trimmed":0,"snaptrim_duration":0.055716603000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"40'3766","reported_seq":3170,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:15.722839+0000","last_change":"2023-11-04T15:38:15.722956+0000","last_active":"2023-11-04T15:38:15.722839+0000","last_peered":"2023-11-04T15:38:15.722839+0000","last_clean":"2023-11-04T15:38:15.722839+0000","last_became_active":"2023-11-04T15:27:36.148932+0000","last_became_peered":"2023-11-04T15:27:36.148932+0000","last_unstale":"2023-11-04T15:38:15.722839+0000","last_undegraded":"2023-11-04T15:38:15.722839+0000","last_fullsized":"2023-11-04T15:38:15.722839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3766","last_scrub_stamp":"2023-11-04T15:38:15.722815+0000","last_deep_scrub":"40'3766","last_deep_scrub_stamp":"2023-11-04T15:38:15.722815+0000","last_clean_scrub_stamp":"2023-11-04T15:38:15.722815+0000","objects_scrubbed":0,"log_size":3766,"log_dups_size":0,"ondisk_log_size":3766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:03:16.395834+0000","scrub_duration":0.0047167329999999999,"objects_trimmed":0,"snaptrim_duration":0.062648212999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1209,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"40'3538","reported_seq":2946,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718524+0000","last_change":"2023-11-04T15:36:55.818096+0000","last_active":"2023-11-04T15:37:04.718524+0000","last_peered":"2023-11-04T15:37:04.718524+0000","last_clean":"2023-11-04T15:37:04.718524+0000","last_became_active":"2023-11-04T15:27:36.150856+0000","last_became_peered":"2023-11-04T15:27:36.150856+0000","last_unstale":"2023-11-04T15:37:04.718524+0000","last_undegraded":"2023-11-04T15:37:04.718524+0000","last_fullsized":"2023-11-04T15:37:04.718524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3538,"log_dups_size":0,"ondisk_log_size":3538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.099772735000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"40'3671","reported_seq":3000,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795770+0000","last_change":"2023-11-04T15:36:55.797112+0000","last_active":"2023-11-04T15:37:04.795770+0000","last_peered":"2023-11-04T15:37:04.795770+0000","last_clean":"2023-11-04T15:37:04.795770+0000","last_became_active":"2023-11-04T15:27:36.144997+0000","last_became_peered":"2023-11-04T15:27:36.144997+0000","last_unstale":"2023-11-04T15:37:04.795770+0000","last_undegraded":"2023-11-04T15:37:04.795770+0000","last_fullsized":"2023-11-04T15:37:04.795770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3671,"log_dups_size":0,"ondisk_log_size":3671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072563297999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1270,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"44'3139","reported_seq":2656,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:43.481415+0000","last_change":"2023-11-04T15:37:43.481511+0000","last_active":"2023-11-04T15:37:43.481415+0000","last_peered":"2023-11-04T15:37:43.481415+0000","last_clean":"2023-11-04T15:37:43.481415+0000","last_became_active":"2023-11-04T15:27:36.150555+0000","last_became_peered":"2023-11-04T15:27:36.150555+0000","last_unstale":"2023-11-04T15:37:43.481415+0000","last_undegraded":"2023-11-04T15:37:43.481415+0000","last_fullsized":"2023-11-04T15:37:43.481415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3139","last_scrub_stamp":"2023-11-04T15:37:43.481392+0000","last_deep_scrub":"44'3139","last_deep_scrub_stamp":"2023-11-04T15:37:43.481392+0000","last_clean_scrub_stamp":"2023-11-04T15:37:43.481392+0000","objects_scrubbed":2,"log_size":3139,"log_dups_size":0,"ondisk_log_size":3139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:46:29.890357+0000","scrub_duration":0.010710094,"objects_trimmed":0,"snaptrim_duration":0.101696772,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1042,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"44'3392","reported_seq":2826,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:20.801183+0000","last_change":"2023-11-04T15:38:20.801299+0000","last_active":"2023-11-04T15:38:20.801183+0000","last_peered":"2023-11-04T15:38:20.801183+0000","last_clean":"2023-11-04T15:38:20.801183+0000","last_became_active":"2023-11-04T15:27:36.147745+0000","last_became_peered":"2023-11-04T15:27:36.147745+0000","last_unstale":"2023-11-04T15:38:20.801183+0000","last_undegraded":"2023-11-04T15:38:20.801183+0000","last_fullsized":"2023-11-04T15:38:20.801183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3392","last_scrub_stamp":"2023-11-04T15:38:20.801150+0000","last_deep_scrub":"44'3392","last_deep_scrub_stamp":"2023-11-04T15:38:20.801150+0000","last_clean_scrub_stamp":"2023-11-04T15:38:20.801150+0000","objects_scrubbed":2,"log_size":3392,"log_dups_size":0,"ondisk_log_size":3392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:16:55.199419+0000","scrub_duration":0.0083994859999999994,"objects_trimmed":0,"snaptrim_duration":0.071588252000000005,"stat_sum":{"num_bytes":4128,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1173,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"44'3507","reported_seq":2929,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:47.451001+0000","last_change":"2023-11-04T15:37:47.451113+0000","last_active":"2023-11-04T15:37:47.451001+0000","last_peered":"2023-11-04T15:37:47.451001+0000","last_clean":"2023-11-04T15:37:47.451001+0000","last_became_active":"2023-11-04T15:27:36.150687+0000","last_became_peered":"2023-11-04T15:27:36.150687+0000","last_unstale":"2023-11-04T15:37:47.451001+0000","last_undegraded":"2023-11-04T15:37:47.451001+0000","last_fullsized":"2023-11-04T15:37:47.451001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3507","last_scrub_stamp":"2023-11-04T15:37:47.450975+0000","last_deep_scrub":"44'3507","last_deep_scrub_stamp":"2023-11-04T15:37:47.450975+0000","last_clean_scrub_stamp":"2023-11-04T15:37:47.450975+0000","objects_scrubbed":2,"log_size":3507,"log_dups_size":0,"ondisk_log_size":3507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:21:13.505376+0000","scrub_duration":0.0096580350000000006,"objects_trimmed":0,"snaptrim_duration":0.097896176000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1154,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"44'3547","reported_seq":2996,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:18.707502+0000","last_change":"2023-11-04T15:38:18.707619+0000","last_active":"2023-11-04T15:38:18.707502+0000","last_peered":"2023-11-04T15:38:18.707502+0000","last_clean":"2023-11-04T15:38:18.707502+0000","last_became_active":"2023-11-04T15:27:36.143551+0000","last_became_peered":"2023-11-04T15:27:36.143551+0000","last_unstale":"2023-11-04T15:38:18.707502+0000","last_undegraded":"2023-11-04T15:38:18.707502+0000","last_fullsized":"2023-11-04T15:38:18.707502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3547","last_scrub_stamp":"2023-11-04T15:38:18.707479+0000","last_deep_scrub":"44'3547","last_deep_scrub_stamp":"2023-11-04T15:38:18.707479+0000","last_clean_scrub_stamp":"2023-11-04T15:38:18.707479+0000","objects_scrubbed":3,"log_size":3547,"log_dups_size":0,"ondisk_log_size":3547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:16:47.482996+0000","scrub_duration":0.01049517,"objects_trimmed":0,"snaptrim_duration":0.056037475000000003,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1178,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"44'3730","reported_seq":3099,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:14.873759+0000","last_change":"2023-11-04T15:38:14.873894+0000","last_active":"2023-11-04T15:38:14.873759+0000","last_peered":"2023-11-04T15:38:14.873759+0000","last_clean":"2023-11-04T15:38:14.873759+0000","last_became_active":"2023-11-04T15:27:36.145943+0000","last_became_peered":"2023-11-04T15:27:36.145943+0000","last_unstale":"2023-11-04T15:38:14.873759+0000","last_undegraded":"2023-11-04T15:38:14.873759+0000","last_fullsized":"2023-11-04T15:38:14.873759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3730","last_scrub_stamp":"2023-11-04T15:38:14.873735+0000","last_deep_scrub":"44'3730","last_deep_scrub_stamp":"2023-11-04T15:38:14.873735+0000","last_clean_scrub_stamp":"2023-11-04T15:38:14.873735+0000","objects_scrubbed":2,"log_size":3730,"log_dups_size":0,"ondisk_log_size":3730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:16:43.649252+0000","scrub_duration":0.011526497,"objects_trimmed":0,"snaptrim_duration":0.071549077000000003,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1242,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"40'3454","reported_seq":2901,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:22.189149+0000","last_change":"2023-11-04T15:38:22.189283+0000","last_active":"2023-11-04T15:38:22.189149+0000","last_peered":"2023-11-04T15:38:22.189149+0000","last_clean":"2023-11-04T15:38:22.189149+0000","last_became_active":"2023-11-04T15:27:36.144083+0000","last_became_peered":"2023-11-04T15:27:36.144083+0000","last_unstale":"2023-11-04T15:38:22.189149+0000","last_undegraded":"2023-11-04T15:38:22.189149+0000","last_fullsized":"2023-11-04T15:38:22.189149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3454","last_scrub_stamp":"2023-11-04T15:38:22.189124+0000","last_deep_scrub":"40'3454","last_deep_scrub_stamp":"2023-11-04T15:38:22.189124+0000","last_clean_scrub_stamp":"2023-11-04T15:38:22.189124+0000","objects_scrubbed":0,"log_size":3454,"log_dups_size":0,"ondisk_log_size":3454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:32:55.002998+0000","scrub_duration":0.0043707939999999999,"objects_trimmed":0,"snaptrim_duration":0.060959410999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1127,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"40'3632","reported_seq":2992,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.717704+0000","last_change":"2023-11-04T15:36:55.821483+0000","last_active":"2023-11-04T15:37:04.717704+0000","last_peered":"2023-11-04T15:37:04.717704+0000","last_clean":"2023-11-04T15:37:04.717704+0000","last_became_active":"2023-11-04T15:27:36.146546+0000","last_became_peered":"2023-11-04T15:27:36.146546+0000","last_unstale":"2023-11-04T15:37:04.717704+0000","last_undegraded":"2023-11-04T15:37:04.717704+0000","last_fullsized":"2023-11-04T15:37:04.717704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3632,"log_dups_size":0,"ondisk_log_size":3632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.102597439,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1222,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"44'3167","reported_seq":2641,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:18.169633+0000","last_change":"2023-11-04T15:38:18.169777+0000","last_active":"2023-11-04T15:38:18.169633+0000","last_peered":"2023-11-04T15:38:18.169633+0000","last_clean":"2023-11-04T15:38:18.169633+0000","last_became_active":"2023-11-04T15:27:36.144047+0000","last_became_peered":"2023-11-04T15:27:36.144047+0000","last_unstale":"2023-11-04T15:38:18.169633+0000","last_undegraded":"2023-11-04T15:38:18.169633+0000","last_fullsized":"2023-11-04T15:38:18.169633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3167","last_scrub_stamp":"2023-11-04T15:38:18.169609+0000","last_deep_scrub":"44'3167","last_deep_scrub_stamp":"2023-11-04T15:38:18.169609+0000","last_clean_scrub_stamp":"2023-11-04T15:38:18.169609+0000","objects_scrubbed":1,"log_size":3167,"log_dups_size":0,"ondisk_log_size":3167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:16:52.567878+0000","scrub_duration":0.0076393160000000002,"objects_trimmed":0,"snaptrim_duration":0.064725415999999994,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1115,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"40'3493","reported_seq":2894,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720410+0000","last_change":"2023-11-04T15:36:55.784865+0000","last_active":"2023-11-04T15:37:04.720410+0000","last_peered":"2023-11-04T15:37:04.720410+0000","last_clean":"2023-11-04T15:37:04.720410+0000","last_became_active":"2023-11-04T15:27:36.144458+0000","last_became_peered":"2023-11-04T15:27:36.144458+0000","last_unstale":"2023-11-04T15:37:04.720410+0000","last_undegraded":"2023-11-04T15:37:04.720410+0000","last_fullsized":"2023-11-04T15:37:04.720410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3493,"log_dups_size":0,"ondisk_log_size":3493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.066118209999999997,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"44'3387","reported_seq":2838,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:38.464862+0000","last_change":"2023-11-04T15:37:38.465038+0000","last_active":"2023-11-04T15:37:38.464862+0000","last_peered":"2023-11-04T15:37:38.464862+0000","last_clean":"2023-11-04T15:37:38.464862+0000","last_became_active":"2023-11-04T15:27:36.150270+0000","last_became_peered":"2023-11-04T15:27:36.150270+0000","last_unstale":"2023-11-04T15:37:38.464862+0000","last_undegraded":"2023-11-04T15:37:38.464862+0000","last_fullsized":"2023-11-04T15:37:38.464862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3387","last_scrub_stamp":"2023-11-04T15:37:38.464840+0000","last_deep_scrub":"44'3387","last_deep_scrub_stamp":"2023-11-04T15:37:38.464840+0000","last_clean_scrub_stamp":"2023-11-04T15:37:38.464840+0000","objects_scrubbed":1,"log_size":3387,"log_dups_size":0,"ondisk_log_size":3387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:40:18.070984+0000","scrub_duration":0.0081071519999999994,"objects_trimmed":0,"snaptrim_duration":0.104674168,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"40'3286","reported_seq":2718,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.795538+0000","last_change":"2023-11-04T15:36:55.799791+0000","last_active":"2023-11-04T15:37:04.795538+0000","last_peered":"2023-11-04T15:37:04.795538+0000","last_clean":"2023-11-04T15:37:04.795538+0000","last_became_active":"2023-11-04T15:28:20.871378+0000","last_became_peered":"2023-11-04T15:28:20.871378+0000","last_unstale":"2023-11-04T15:37:04.795538+0000","last_undegraded":"2023-11-04T15:37:04.795538+0000","last_fullsized":"2023-11-04T15:37:04.795538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3286,"log_dups_size":0,"ondisk_log_size":3286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.074381663000000001,"stat_sum":{"num_bytes":9,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1152,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"40'3578","reported_seq":3009,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:43.477932+0000","last_change":"2023-11-04T15:38:05.231832+0000","last_active":"2023-11-04T15:37:43.477932+0000","last_peered":"2023-11-04T15:37:43.477932+0000","last_clean":"2023-11-04T15:37:43.477932+0000","last_became_active":"2023-11-04T15:27:36.145392+0000","last_became_peered":"2023-11-04T15:27:36.145392+0000","last_unstale":"2023-11-04T15:37:43.477932+0000","last_undegraded":"2023-11-04T15:37:43.477932+0000","last_fullsized":"2023-11-04T15:37:43.477932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3578,"log_dups_size":0,"ondisk_log_size":3578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070714202000000004,"stat_sum":{"num_bytes":12288,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1167,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"40'3386","reported_seq":2874,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:10.551561+0000","last_change":"2023-11-04T15:37:10.551561+0000","last_active":"2023-11-04T15:37:10.551561+0000","last_peered":"2023-11-04T15:37:10.551561+0000","last_clean":"2023-11-04T15:37:10.551561+0000","last_became_active":"2023-11-04T15:27:36.145273+0000","last_became_peered":"2023-11-04T15:27:36.145273+0000","last_unstale":"2023-11-04T15:37:10.551561+0000","last_undegraded":"2023-11-04T15:37:10.551561+0000","last_fullsized":"2023-11-04T15:37:10.551561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3386","last_scrub_stamp":"2023-11-04T15:37:10.551443+0000","last_deep_scrub":"40'3386","last_deep_scrub_stamp":"2023-11-04T15:37:10.551443+0000","last_clean_scrub_stamp":"2023-11-04T15:37:10.551443+0000","objects_scrubbed":0,"log_size":3386,"log_dups_size":0,"ondisk_log_size":3386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:21:56.476755+0000","scrub_duration":0.005704687,"objects_trimmed":0,"snaptrim_duration":0.101784969,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1155,"num_write_kb":603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"40'3889","reported_seq":3226,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:09.188765+0000","last_change":"2023-11-04T15:38:09.188849+0000","last_active":"2023-11-04T15:38:09.188765+0000","last_peered":"2023-11-04T15:38:09.188765+0000","last_clean":"2023-11-04T15:38:09.188765+0000","last_became_active":"2023-11-04T15:27:36.144053+0000","last_became_peered":"2023-11-04T15:27:36.144053+0000","last_unstale":"2023-11-04T15:38:09.188765+0000","last_undegraded":"2023-11-04T15:38:09.188765+0000","last_fullsized":"2023-11-04T15:38:09.188765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3889","last_scrub_stamp":"2023-11-04T15:38:09.188744+0000","last_deep_scrub":"40'3889","last_deep_scrub_stamp":"2023-11-04T15:38:09.188744+0000","last_clean_scrub_stamp":"2023-11-04T15:38:09.188744+0000","objects_scrubbed":0,"log_size":3889,"log_dups_size":0,"ondisk_log_size":3889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:03:09.861762+0000","scrub_duration":0.0044858370000000003,"objects_trimmed":0,"snaptrim_duration":0.061944979999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1328,"num_write_kb":706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"40'3720","reported_seq":3117,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:06.685722+0000","last_change":"2023-11-04T15:38:06.685839+0000","last_active":"2023-11-04T15:38:06.685722+0000","last_peered":"2023-11-04T15:38:06.685722+0000","last_clean":"2023-11-04T15:38:06.685722+0000","last_became_active":"2023-11-04T15:27:36.148342+0000","last_became_peered":"2023-11-04T15:27:36.148342+0000","last_unstale":"2023-11-04T15:38:06.685722+0000","last_undegraded":"2023-11-04T15:38:06.685722+0000","last_fullsized":"2023-11-04T15:38:06.685722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3720","last_scrub_stamp":"2023-11-04T15:38:06.685700+0000","last_deep_scrub":"40'3720","last_deep_scrub_stamp":"2023-11-04T15:38:06.685700+0000","last_clean_scrub_stamp":"2023-11-04T15:38:06.685700+0000","objects_scrubbed":0,"log_size":3720,"log_dups_size":0,"ondisk_log_size":3720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:11:56.506896+0000","scrub_duration":0.0061541349999999998,"objects_trimmed":0,"snaptrim_duration":0.056486557999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"44'3426","reported_seq":2839,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:12.141768+0000","last_change":"2023-11-04T15:38:12.141869+0000","last_active":"2023-11-04T15:38:12.141768+0000","last_peered":"2023-11-04T15:38:12.141768+0000","last_clean":"2023-11-04T15:38:12.141768+0000","last_became_active":"2023-11-04T15:27:36.148951+0000","last_became_peered":"2023-11-04T15:27:36.148951+0000","last_unstale":"2023-11-04T15:38:12.141768+0000","last_undegraded":"2023-11-04T15:38:12.141768+0000","last_fullsized":"2023-11-04T15:38:12.141768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3426","last_scrub_stamp":"2023-11-04T15:38:12.141744+0000","last_deep_scrub":"44'3426","last_deep_scrub_stamp":"2023-11-04T15:38:12.141744+0000","last_clean_scrub_stamp":"2023-11-04T15:38:12.141744+0000","objects_scrubbed":2,"log_size":3426,"log_dups_size":0,"ondisk_log_size":3426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:16:40.917261+0000","scrub_duration":0.011982881000000001,"objects_trimmed":0,"snaptrim_duration":0.066218149000000004,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1176,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"44'2988","reported_seq":3040,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:52.513259+0000","last_change":"2023-11-04T15:37:52.513356+0000","last_active":"2023-11-04T15:37:52.513259+0000","last_peered":"2023-11-04T15:37:52.513259+0000","last_clean":"2023-11-04T15:37:52.513259+0000","last_became_active":"2023-11-04T15:27:35.775616+0000","last_became_peered":"2023-11-04T15:27:35.775616+0000","last_unstale":"2023-11-04T15:37:52.513259+0000","last_undegraded":"2023-11-04T15:37:52.513259+0000","last_fullsized":"2023-11-04T15:37:52.513259+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2988","last_scrub_stamp":"2023-11-04T15:37:52.513236+0000","last_deep_scrub":"44'2988","last_deep_scrub_stamp":"2023-11-04T15:37:52.513236+0000","last_clean_scrub_stamp":"2023-11-04T15:37:52.513236+0000","objects_scrubbed":4,"log_size":2988,"log_dups_size":0,"ondisk_log_size":2988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:52:02.610178+0000","scrub_duration":0.028368865,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2984,"num_write_kb":24202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"40'3308","reported_seq":2727,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.611520+0000","last_change":"2023-11-04T15:36:55.822910+0000","last_active":"2023-11-04T15:37:07.611520+0000","last_peered":"2023-11-04T15:37:07.611520+0000","last_clean":"2023-11-04T15:37:07.611520+0000","last_became_active":"2023-11-04T15:27:36.150276+0000","last_became_peered":"2023-11-04T15:27:36.150276+0000","last_unstale":"2023-11-04T15:37:07.611520+0000","last_undegraded":"2023-11-04T15:37:07.611520+0000","last_fullsized":"2023-11-04T15:37:07.611520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3308,"log_dups_size":0,"ondisk_log_size":3308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101095329,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1177,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"44'464","reported_seq":516,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:01.615465+0000","last_change":"2023-11-04T15:38:01.615577+0000","last_active":"2023-11-04T15:38:01.615465+0000","last_peered":"2023-11-04T15:38:01.615465+0000","last_clean":"2023-11-04T15:38:01.615465+0000","last_became_active":"2023-11-04T15:27:35.776297+0000","last_became_peered":"2023-11-04T15:27:35.776297+0000","last_unstale":"2023-11-04T15:38:01.615465+0000","last_undegraded":"2023-11-04T15:38:01.615465+0000","last_fullsized":"2023-11-04T15:38:01.615465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'464","last_scrub_stamp":"2023-11-04T15:38:01.615441+0000","last_deep_scrub":"44'464","last_deep_scrub_stamp":"2023-11-04T15:38:01.615441+0000","last_clean_scrub_stamp":"2023-11-04T15:38:01.615441+0000","objects_scrubbed":2,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:11:51.436637+0000","scrub_duration":0.021155086,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":462,"num_write_kb":12396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"44'3489","reported_seq":2923,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:22.680227+0000","last_change":"2023-11-04T15:37:22.680321+0000","last_active":"2023-11-04T15:37:22.680227+0000","last_peered":"2023-11-04T15:37:22.680227+0000","last_clean":"2023-11-04T15:37:22.680227+0000","last_became_active":"2023-11-04T15:27:36.139580+0000","last_became_peered":"2023-11-04T15:27:36.139580+0000","last_unstale":"2023-11-04T15:37:22.680227+0000","last_undegraded":"2023-11-04T15:37:22.680227+0000","last_fullsized":"2023-11-04T15:37:22.680227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3489","last_scrub_stamp":"2023-11-04T15:37:22.680205+0000","last_deep_scrub":"44'3489","last_deep_scrub_stamp":"2023-11-04T15:37:22.680205+0000","last_clean_scrub_stamp":"2023-11-04T15:37:22.680205+0000","objects_scrubbed":4,"log_size":3489,"log_dups_size":0,"ondisk_log_size":3489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:18:28.360934+0000","scrub_duration":0.013912934,"objects_trimmed":0,"snaptrim_duration":0.074768939000000006,"stat_sum":{"num_bytes":8192,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1207,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"44'721","reported_seq":773,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:46.471555+0000","last_change":"2023-11-04T15:37:46.471682+0000","last_active":"2023-11-04T15:37:46.471555+0000","last_peered":"2023-11-04T15:37:46.471555+0000","last_clean":"2023-11-04T15:37:46.471555+0000","last_became_active":"2023-11-04T15:27:35.775486+0000","last_became_peered":"2023-11-04T15:27:35.775486+0000","last_unstale":"2023-11-04T15:37:46.471555+0000","last_undegraded":"2023-11-04T15:37:46.471555+0000","last_fullsized":"2023-11-04T15:37:46.471555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'721","last_scrub_stamp":"2023-11-04T15:37:46.471516+0000","last_deep_scrub":"44'721","last_deep_scrub_stamp":"2023-11-04T15:37:46.471516+0000","last_clean_scrub_stamp":"2023-11-04T15:37:46.471516+0000","objects_scrubbed":4,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:43.323066+0000","scrub_duration":0.043075086999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":707,"num_write_kb":16815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"44'3444","reported_seq":2888,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:23.861171+0000","last_change":"2023-11-04T15:38:23.861287+0000","last_active":"2023-11-04T15:38:23.861171+0000","last_peered":"2023-11-04T15:38:23.861171+0000","last_clean":"2023-11-04T15:38:23.861171+0000","last_became_active":"2023-11-04T15:27:36.139789+0000","last_became_peered":"2023-11-04T15:27:36.139789+0000","last_unstale":"2023-11-04T15:38:23.861171+0000","last_undegraded":"2023-11-04T15:38:23.861171+0000","last_fullsized":"2023-11-04T15:38:23.861171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3444","last_scrub_stamp":"2023-11-04T15:38:23.861140+0000","last_deep_scrub":"44'3444","last_deep_scrub_stamp":"2023-11-04T15:38:23.861140+0000","last_clean_scrub_stamp":"2023-11-04T15:38:23.861140+0000","objects_scrubbed":1,"log_size":3444,"log_dups_size":0,"ondisk_log_size":3444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:29:29.080263+0000","scrub_duration":0.0081163280000000008,"objects_trimmed":0,"snaptrim_duration":0.073936136,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"44'1621","reported_seq":1673,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:25.495184+0000","last_change":"2023-11-04T15:37:25.495295+0000","last_active":"2023-11-04T15:37:25.495184+0000","last_peered":"2023-11-04T15:37:25.495184+0000","last_clean":"2023-11-04T15:37:25.495184+0000","last_became_active":"2023-11-04T15:27:35.775895+0000","last_became_peered":"2023-11-04T15:27:35.775895+0000","last_unstale":"2023-11-04T15:37:25.495184+0000","last_undegraded":"2023-11-04T15:37:25.495184+0000","last_fullsized":"2023-11-04T15:37:25.495184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1621","last_scrub_stamp":"2023-11-04T15:37:25.495162+0000","last_deep_scrub":"44'1621","last_deep_scrub_stamp":"2023-11-04T15:37:25.495162+0000","last_clean_scrub_stamp":"2023-11-04T15:37:25.495162+0000","objects_scrubbed":7,"log_size":1621,"log_dups_size":0,"ondisk_log_size":1621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:31:16.990792+0000","scrub_duration":0.024403523,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":1625,"num_write_kb":22714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"44'1200","reported_seq":1252,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:53.730416+0000","last_change":"2023-11-04T15:37:53.730547+0000","last_active":"2023-11-04T15:37:53.730416+0000","last_peered":"2023-11-04T15:37:53.730416+0000","last_clean":"2023-11-04T15:37:53.730416+0000","last_became_active":"2023-11-04T15:27:35.767594+0000","last_became_peered":"2023-11-04T15:27:35.767594+0000","last_unstale":"2023-11-04T15:37:53.730416+0000","last_undegraded":"2023-11-04T15:37:53.730416+0000","last_fullsized":"2023-11-04T15:37:53.730416+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1200","last_scrub_stamp":"2023-11-04T15:37:53.730377+0000","last_deep_scrub":"44'1200","last_deep_scrub_stamp":"2023-11-04T15:37:53.730377+0000","last_clean_scrub_stamp":"2023-11-04T15:37:53.730377+0000","objects_scrubbed":2,"log_size":1200,"log_dups_size":0,"ondisk_log_size":1200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:46:40.139343+0000","scrub_duration":0.015421646000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1190,"num_write_kb":15478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"40'3688","reported_seq":3062,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:14.480922+0000","last_change":"2023-11-04T15:37:14.481041+0000","last_active":"2023-11-04T15:37:14.480922+0000","last_peered":"2023-11-04T15:37:14.480922+0000","last_clean":"2023-11-04T15:37:14.480922+0000","last_became_active":"2023-11-04T15:27:36.148282+0000","last_became_peered":"2023-11-04T15:27:36.148282+0000","last_unstale":"2023-11-04T15:37:14.480922+0000","last_undegraded":"2023-11-04T15:37:14.480922+0000","last_fullsized":"2023-11-04T15:37:14.480922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3688","last_scrub_stamp":"2023-11-04T15:37:14.480897+0000","last_deep_scrub":"40'3688","last_deep_scrub_stamp":"2023-11-04T15:37:14.480897+0000","last_clean_scrub_stamp":"2023-11-04T15:37:14.480897+0000","objects_scrubbed":0,"log_size":3688,"log_dups_size":0,"ondisk_log_size":3688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:24:49.251475+0000","scrub_duration":0.0044870750000000001,"objects_trimmed":0,"snaptrim_duration":0.102136719,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1244,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"44'2395","reported_seq":2447,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:45.652933+0000","last_change":"2023-11-04T15:37:45.653046+0000","last_active":"2023-11-04T15:37:45.652933+0000","last_peered":"2023-11-04T15:37:45.652933+0000","last_clean":"2023-11-04T15:37:45.652933+0000","last_became_active":"2023-11-04T15:27:35.771554+0000","last_became_peered":"2023-11-04T15:27:35.771554+0000","last_unstale":"2023-11-04T15:37:45.652933+0000","last_undegraded":"2023-11-04T15:37:45.652933+0000","last_fullsized":"2023-11-04T15:37:45.652933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2395","last_scrub_stamp":"2023-11-04T15:37:45.652911+0000","last_deep_scrub":"44'2395","last_deep_scrub_stamp":"2023-11-04T15:37:45.652911+0000","last_clean_scrub_stamp":"2023-11-04T15:37:45.652911+0000","objects_scrubbed":3,"log_size":2395,"log_dups_size":0,"ondisk_log_size":2395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:07:59.283572+0000","scrub_duration":0.025961439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2386,"num_write_kb":21701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"44'3603","reported_seq":3000,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:25.600198+0000","last_change":"2023-11-04T15:37:25.600392+0000","last_active":"2023-11-04T15:37:25.600198+0000","last_peered":"2023-11-04T15:37:25.600198+0000","last_clean":"2023-11-04T15:37:25.600198+0000","last_became_active":"2023-11-04T15:27:36.149146+0000","last_became_peered":"2023-11-04T15:27:36.149146+0000","last_unstale":"2023-11-04T15:37:25.600198+0000","last_undegraded":"2023-11-04T15:37:25.600198+0000","last_fullsized":"2023-11-04T15:37:25.600198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3603","last_scrub_stamp":"2023-11-04T15:37:25.600176+0000","last_deep_scrub":"44'3603","last_deep_scrub_stamp":"2023-11-04T15:37:25.600176+0000","last_clean_scrub_stamp":"2023-11-04T15:37:25.600176+0000","objects_scrubbed":3,"log_size":3603,"log_dups_size":0,"ondisk_log_size":3603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:18:31.280905+0000","scrub_duration":0.0137854,"objects_trimmed":0,"snaptrim_duration":0.055767874000000002,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"40'3587","reported_seq":3628,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.720018+0000","last_change":"2023-11-04T15:27:35.773978+0000","last_active":"2023-11-04T15:37:04.720018+0000","last_peered":"2023-11-04T15:37:04.720018+0000","last_clean":"2023-11-04T15:37:04.720018+0000","last_became_active":"2023-11-04T15:27:35.773689+0000","last_became_peered":"2023-11-04T15:27:35.773689+0000","last_unstale":"2023-11-04T15:37:04.720018+0000","last_undegraded":"2023-11-04T15:37:04.720018+0000","last_fullsized":"2023-11-04T15:37:04.720018+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":3587,"log_dups_size":0,"ondisk_log_size":3587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582982,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3581,"num_write_kb":38716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"44'3514","reported_seq":2912,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:14.746158+0000","last_change":"2023-11-04T15:37:14.746264+0000","last_active":"2023-11-04T15:37:14.746158+0000","last_peered":"2023-11-04T15:37:14.746158+0000","last_clean":"2023-11-04T15:37:14.746158+0000","last_became_active":"2023-11-04T15:27:36.141695+0000","last_became_peered":"2023-11-04T15:27:36.141695+0000","last_unstale":"2023-11-04T15:37:14.746158+0000","last_undegraded":"2023-11-04T15:37:14.746158+0000","last_fullsized":"2023-11-04T15:37:14.746158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3514","last_scrub_stamp":"2023-11-04T15:37:14.746134+0000","last_deep_scrub":"44'3514","last_deep_scrub_stamp":"2023-11-04T15:37:14.746134+0000","last_clean_scrub_stamp":"2023-11-04T15:37:14.746134+0000","objects_scrubbed":3,"log_size":3514,"log_dups_size":0,"ondisk_log_size":3514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:36.355741+0000","scrub_duration":0.013556656,"objects_trimmed":0,"snaptrim_duration":0.057953993000000002,"stat_sum":{"num_bytes":4107,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1230,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"44'1581","reported_seq":1633,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:05.474243+0000","last_change":"2023-11-04T15:38:05.474337+0000","last_active":"2023-11-04T15:38:05.474243+0000","last_peered":"2023-11-04T15:38:05.474243+0000","last_clean":"2023-11-04T15:38:05.474243+0000","last_became_active":"2023-11-04T15:27:35.773818+0000","last_became_peered":"2023-11-04T15:27:35.773818+0000","last_unstale":"2023-11-04T15:38:05.474243+0000","last_undegraded":"2023-11-04T15:38:05.474243+0000","last_fullsized":"2023-11-04T15:38:05.474243+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1581","last_scrub_stamp":"2023-11-04T15:38:05.474220+0000","last_deep_scrub":"44'1581","last_deep_scrub_stamp":"2023-11-04T15:38:05.474220+0000","last_clean_scrub_stamp":"2023-11-04T15:38:05.474220+0000","objects_scrubbed":4,"log_size":1581,"log_dups_size":0,"ondisk_log_size":1581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:03:06.147239+0000","scrub_duration":0.038580360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1569,"num_write_kb":30603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"40'3300","reported_seq":2760,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:48.498605+0000","last_change":"2023-11-04T15:37:48.498756+0000","last_active":"2023-11-04T15:37:48.498605+0000","last_peered":"2023-11-04T15:37:48.498605+0000","last_clean":"2023-11-04T15:37:48.498605+0000","last_became_active":"2023-11-04T15:27:36.150653+0000","last_became_peered":"2023-11-04T15:27:36.150653+0000","last_unstale":"2023-11-04T15:37:48.498605+0000","last_undegraded":"2023-11-04T15:37:48.498605+0000","last_fullsized":"2023-11-04T15:37:48.498605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3300","last_scrub_stamp":"2023-11-04T15:37:48.498559+0000","last_deep_scrub":"40'3300","last_deep_scrub_stamp":"2023-11-04T15:37:48.498559+0000","last_clean_scrub_stamp":"2023-11-04T15:37:48.498559+0000","objects_scrubbed":0,"log_size":3300,"log_dups_size":0,"ondisk_log_size":3300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:55:19.632136+0000","scrub_duration":0.0039129610000000004,"objects_trimmed":0,"snaptrim_duration":0.070970674999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1129,"num_write_kb":600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"44'4025","reported_seq":4077,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:41.344060+0000","last_change":"2023-11-04T15:37:41.344248+0000","last_active":"2023-11-04T15:37:41.344060+0000","last_peered":"2023-11-04T15:37:41.344060+0000","last_clean":"2023-11-04T15:37:41.344060+0000","last_became_active":"2023-11-04T15:27:35.772815+0000","last_became_peered":"2023-11-04T15:27:35.772815+0000","last_unstale":"2023-11-04T15:37:41.344060+0000","last_undegraded":"2023-11-04T15:37:41.344060+0000","last_fullsized":"2023-11-04T15:37:41.344060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4025","last_scrub_stamp":"2023-11-04T15:37:41.344035+0000","last_deep_scrub":"44'4025","last_deep_scrub_stamp":"2023-11-04T15:37:41.344035+0000","last_clean_scrub_stamp":"2023-11-04T15:37:41.344035+0000","objects_scrubbed":4,"log_size":4025,"log_dups_size":0,"ondisk_log_size":4025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:07:54.974697+0000","scrub_duration":0.037607953,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4019,"num_write_kb":36923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1207,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"40'3784","reported_seq":3140,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:21.440173+0000","last_change":"2023-11-04T15:37:21.440272+0000","last_active":"2023-11-04T15:37:21.440173+0000","last_peered":"2023-11-04T15:37:21.440173+0000","last_clean":"2023-11-04T15:37:21.440173+0000","last_became_active":"2023-11-04T15:27:36.150667+0000","last_became_peered":"2023-11-04T15:27:36.150667+0000","last_unstale":"2023-11-04T15:37:21.440173+0000","last_undegraded":"2023-11-04T15:37:21.440173+0000","last_fullsized":"2023-11-04T15:37:21.440173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3784","last_scrub_stamp":"2023-11-04T15:37:21.440149+0000","last_deep_scrub":"40'3784","last_deep_scrub_stamp":"2023-11-04T15:37:21.440149+0000","last_clean_scrub_stamp":"2023-11-04T15:37:21.440149+0000","objects_scrubbed":0,"log_size":3784,"log_dups_size":0,"ondisk_log_size":3784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:35.107882+0000","scrub_duration":0.0057867910000000003,"objects_trimmed":0,"snaptrim_duration":0.098687114000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1287,"num_write_kb":684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"44'2127","reported_seq":2180,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:02.405082+0000","last_change":"2023-11-04T15:38:02.405082+0000","last_active":"2023-11-04T15:38:02.405082+0000","last_peered":"2023-11-04T15:38:02.405082+0000","last_clean":"2023-11-04T15:38:02.405082+0000","last_became_active":"2023-11-04T15:27:35.775063+0000","last_became_peered":"2023-11-04T15:27:35.775063+0000","last_unstale":"2023-11-04T15:38:02.405082+0000","last_undegraded":"2023-11-04T15:38:02.405082+0000","last_fullsized":"2023-11-04T15:38:02.405082+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2127","last_scrub_stamp":"2023-11-04T15:38:02.404947+0000","last_deep_scrub":"44'2127","last_deep_scrub_stamp":"2023-11-04T15:38:02.404947+0000","last_clean_scrub_stamp":"2023-11-04T15:38:02.404947+0000","objects_scrubbed":2,"log_size":2127,"log_dups_size":0,"ondisk_log_size":2127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:43:59.858069+0000","scrub_duration":0.024080308000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2118,"num_write_kb":30816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"40'3317","reported_seq":2788,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719341+0000","last_change":"2023-11-04T15:36:55.826358+0000","last_active":"2023-11-04T15:37:04.719341+0000","last_peered":"2023-11-04T15:37:04.719341+0000","last_clean":"2023-11-04T15:37:04.719341+0000","last_became_active":"2023-11-04T15:27:36.139103+0000","last_became_peered":"2023-11-04T15:27:36.139103+0000","last_unstale":"2023-11-04T15:37:04.719341+0000","last_undegraded":"2023-11-04T15:37:04.719341+0000","last_fullsized":"2023-11-04T15:37:04.719341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3317,"log_dups_size":0,"ondisk_log_size":3317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10468400899999999,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1091,"num_write_kb":593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"37'1934","reported_seq":1976,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.611230+0000","last_change":"2023-11-04T15:27:35.773686+0000","last_active":"2023-11-04T15:37:07.611230+0000","last_peered":"2023-11-04T15:37:07.611230+0000","last_clean":"2023-11-04T15:37:07.611230+0000","last_became_active":"2023-11-04T15:27:35.773449+0000","last_became_peered":"2023-11-04T15:27:35.773449+0000","last_unstale":"2023-11-04T15:37:07.611230+0000","last_undegraded":"2023-11-04T15:37:07.611230+0000","last_fullsized":"2023-11-04T15:37:07.611230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:34.743438+0000","last_clean_scrub_stamp":"2023-11-04T15:27:34.743438+0000","objects_scrubbed":0,"log_size":1934,"log_dups_size":0,"ondisk_log_size":1934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1929,"num_write_kb":17119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"40'3519","reported_seq":2953,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:23.652533+0000","last_change":"2023-11-04T15:37:23.652627+0000","last_active":"2023-11-04T15:37:23.652533+0000","last_peered":"2023-11-04T15:37:23.652533+0000","last_clean":"2023-11-04T15:37:23.652533+0000","last_became_active":"2023-11-04T15:27:36.141086+0000","last_became_peered":"2023-11-04T15:27:36.141086+0000","last_unstale":"2023-11-04T15:37:23.652533+0000","last_undegraded":"2023-11-04T15:37:23.652533+0000","last_fullsized":"2023-11-04T15:37:23.652533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3519","last_scrub_stamp":"2023-11-04T15:37:23.652509+0000","last_deep_scrub":"40'3519","last_deep_scrub_stamp":"2023-11-04T15:37:23.652509+0000","last_clean_scrub_stamp":"2023-11-04T15:37:23.652509+0000","objects_scrubbed":0,"log_size":3519,"log_dups_size":0,"ondisk_log_size":3519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:28.689310+0000","scrub_duration":0.0061970940000000002,"objects_trimmed":0,"snaptrim_duration":0.059170119,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1142,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"44'657","reported_seq":710,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:06.186834+0000","last_change":"2023-11-04T15:38:06.186834+0000","last_active":"2023-11-04T15:38:06.186834+0000","last_peered":"2023-11-04T15:38:06.186834+0000","last_clean":"2023-11-04T15:38:06.186834+0000","last_became_active":"2023-11-04T15:27:35.769001+0000","last_became_peered":"2023-11-04T15:27:35.769001+0000","last_unstale":"2023-11-04T15:38:06.186834+0000","last_undegraded":"2023-11-04T15:38:06.186834+0000","last_fullsized":"2023-11-04T15:38:06.186834+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'657","last_scrub_stamp":"2023-11-04T15:38:06.186659+0000","last_deep_scrub":"44'657","last_deep_scrub_stamp":"2023-11-04T15:38:06.186659+0000","last_clean_scrub_stamp":"2023-11-04T15:38:06.186659+0000","objects_scrubbed":2,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:44:03.639782+0000","scrub_duration":0.022387719,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":656,"num_write_kb":15166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"44'3666","reported_seq":3094,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:24.311230+0000","last_change":"2023-11-04T15:37:24.311349+0000","last_active":"2023-11-04T15:37:24.311230+0000","last_peered":"2023-11-04T15:37:24.311230+0000","last_clean":"2023-11-04T15:37:24.311230+0000","last_became_active":"2023-11-04T15:27:36.147034+0000","last_became_peered":"2023-11-04T15:27:36.147034+0000","last_unstale":"2023-11-04T15:37:24.311230+0000","last_undegraded":"2023-11-04T15:37:24.311230+0000","last_fullsized":"2023-11-04T15:37:24.311230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3666","last_scrub_stamp":"2023-11-04T15:37:24.311202+0000","last_deep_scrub":"44'3666","last_deep_scrub_stamp":"2023-11-04T15:37:24.311202+0000","last_clean_scrub_stamp":"2023-11-04T15:37:24.311202+0000","objects_scrubbed":3,"log_size":3666,"log_dups_size":0,"ondisk_log_size":3666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:56:38.113824+0000","scrub_duration":0.0088871530000000001,"objects_trimmed":0,"snaptrim_duration":0.064750725999999995,"stat_sum":{"num_bytes":4196,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1197,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"44'119","reported_seq":211,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:08.425104+0000","last_change":"2023-11-04T15:38:08.425208+0000","last_active":"2023-11-04T15:38:08.425104+0000","last_peered":"2023-11-04T15:38:08.425104+0000","last_clean":"2023-11-04T15:38:08.425104+0000","last_became_active":"2023-11-04T15:27:26.266242+0000","last_became_peered":"2023-11-04T15:27:26.266242+0000","last_unstale":"2023-11-04T15:38:08.425104+0000","last_undegraded":"2023-11-04T15:38:08.425104+0000","last_fullsized":"2023-11-04T15:38:08.425104+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'119","last_scrub_stamp":"2023-11-04T15:38:08.425081+0000","last_deep_scrub":"44'119","last_deep_scrub_stamp":"2023-11-04T15:38:08.425081+0000","last_clean_scrub_stamp":"2023-11-04T15:38:08.425081+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:16:37.200598+0000","scrub_duration":0.0054415069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:17.352034+0000","last_change":"2023-11-04T15:38:17.352138+0000","last_active":"2023-11-04T15:38:17.352034+0000","last_peered":"2023-11-04T15:38:17.352034+0000","last_clean":"2023-11-04T15:38:17.352034+0000","last_became_active":"2023-11-04T15:27:31.619798+0000","last_became_peered":"2023-11-04T15:27:31.619798+0000","last_unstale":"2023-11-04T15:38:17.352034+0000","last_undegraded":"2023-11-04T15:38:17.352034+0000","last_fullsized":"2023-11-04T15:38:17.352034+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:38:17.352004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:38:17.352004+0000","last_clean_scrub_stamp":"2023-11-04T15:38:17.352004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:29:22.571127+0000","scrub_duration":0.0014758830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"44'3636","reported_seq":3689,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:51.207512+0000","last_change":"2023-11-04T15:37:51.207512+0000","last_active":"2023-11-04T15:37:51.207512+0000","last_peered":"2023-11-04T15:37:51.207512+0000","last_clean":"2023-11-04T15:37:51.207512+0000","last_became_active":"2023-11-04T15:27:35.769150+0000","last_became_peered":"2023-11-04T15:27:35.769150+0000","last_unstale":"2023-11-04T15:37:51.207512+0000","last_undegraded":"2023-11-04T15:37:51.207512+0000","last_fullsized":"2023-11-04T15:37:51.207512+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3636","last_scrub_stamp":"2023-11-04T15:37:51.207371+0000","last_deep_scrub":"44'3636","last_deep_scrub_stamp":"2023-11-04T15:37:51.207371+0000","last_clean_scrub_stamp":"2023-11-04T15:37:51.207371+0000","objects_scrubbed":7,"log_size":3636,"log_dups_size":0,"ondisk_log_size":3636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:21:17.261772+0000","scrub_duration":0.064187266000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3620,"num_write_kb":52059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"44'3669","reported_seq":3088,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:03.410603+0000","last_change":"2023-11-04T15:38:03.410603+0000","last_active":"2023-11-04T15:38:03.410603+0000","last_peered":"2023-11-04T15:38:03.410603+0000","last_clean":"2023-11-04T15:38:03.410603+0000","last_became_active":"2023-11-04T15:27:36.140619+0000","last_became_peered":"2023-11-04T15:27:36.140619+0000","last_unstale":"2023-11-04T15:38:03.410603+0000","last_undegraded":"2023-11-04T15:38:03.410603+0000","last_fullsized":"2023-11-04T15:38:03.410603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3669","last_scrub_stamp":"2023-11-04T15:38:03.410431+0000","last_deep_scrub":"44'3669","last_deep_scrub_stamp":"2023-11-04T15:38:03.410431+0000","last_clean_scrub_stamp":"2023-11-04T15:38:03.410431+0000","objects_scrubbed":1,"log_size":3669,"log_dups_size":0,"ondisk_log_size":3669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:20.868712+0000","scrub_duration":0.009666315,"objects_trimmed":0,"snaptrim_duration":0.10532783499999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:10.460636+0000","last_change":"2023-11-04T15:38:10.460766+0000","last_active":"2023-11-04T15:38:10.460636+0000","last_peered":"2023-11-04T15:38:10.460636+0000","last_clean":"2023-11-04T15:38:10.460636+0000","last_became_active":"2023-11-04T15:27:31.621889+0000","last_became_peered":"2023-11-04T15:27:31.621889+0000","last_unstale":"2023-11-04T15:38:10.460636+0000","last_undegraded":"2023-11-04T15:38:10.460636+0000","last_fullsized":"2023-11-04T15:38:10.460636+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:38:10.460616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:38:10.460616+0000","last_clean_scrub_stamp":"2023-11-04T15:38:10.460616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:47:50.200142+0000","scrub_duration":0.002140351,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"44'3688","reported_seq":3907,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:52.624125+0000","last_change":"2023-11-04T15:37:52.624125+0000","last_active":"2023-11-04T15:37:52.624125+0000","last_peered":"2023-11-04T15:37:52.624125+0000","last_clean":"2023-11-04T15:37:52.624125+0000","last_became_active":"2023-11-04T15:27:35.770364+0000","last_became_peered":"2023-11-04T15:27:35.770364+0000","last_unstale":"2023-11-04T15:37:52.624125+0000","last_undegraded":"2023-11-04T15:37:52.624125+0000","last_fullsized":"2023-11-04T15:37:52.624125+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3688","last_scrub_stamp":"2023-11-04T15:37:52.623993+0000","last_deep_scrub":"44'3688","last_deep_scrub_stamp":"2023-11-04T15:37:52.623993+0000","last_clean_scrub_stamp":"2023-11-04T15:37:52.623993+0000","objects_scrubbed":4,"log_size":3688,"log_dups_size":0,"ondisk_log_size":3688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:49.475542+0000","scrub_duration":0.043049095000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15883313,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":166,"num_read_kb":3338,"num_write":3668,"num_write_kb":29714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"44'3553","reported_seq":2997,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:24.639590+0000","last_change":"2023-11-04T15:37:24.639702+0000","last_active":"2023-11-04T15:37:24.639590+0000","last_peered":"2023-11-04T15:37:24.639590+0000","last_clean":"2023-11-04T15:37:24.639590+0000","last_became_active":"2023-11-04T15:27:36.144459+0000","last_became_peered":"2023-11-04T15:27:36.144459+0000","last_unstale":"2023-11-04T15:37:24.639590+0000","last_undegraded":"2023-11-04T15:37:24.639590+0000","last_fullsized":"2023-11-04T15:37:24.639590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3553","last_scrub_stamp":"2023-11-04T15:37:24.639567+0000","last_deep_scrub":"44'3553","last_deep_scrub_stamp":"2023-11-04T15:37:24.639567+0000","last_clean_scrub_stamp":"2023-11-04T15:37:24.639567+0000","objects_scrubbed":2,"log_size":3553,"log_dups_size":0,"ondisk_log_size":3553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:38.307301+0000","scrub_duration":0.010629794999999999,"objects_trimmed":0,"snaptrim_duration":0.072685394,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:46.281358+0000","last_change":"2023-11-04T15:37:46.281358+0000","last_active":"2023-11-04T15:37:46.281358+0000","last_peered":"2023-11-04T15:37:46.281358+0000","last_clean":"2023-11-04T15:37:46.281358+0000","last_became_active":"2023-11-04T15:27:31.622378+0000","last_became_peered":"2023-11-04T15:27:31.622378+0000","last_unstale":"2023-11-04T15:37:46.281358+0000","last_undegraded":"2023-11-04T15:37:46.281358+0000","last_fullsized":"2023-11-04T15:37:46.281358+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:37:46.281232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:37:46.281232+0000","last_clean_scrub_stamp":"2023-11-04T15:37:46.281232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:55:17.414809+0000","scrub_duration":0.0016098729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"44'6085","reported_seq":6139,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:50.250495+0000","last_change":"2023-11-04T15:37:50.250593+0000","last_active":"2023-11-04T15:37:50.250495+0000","last_peered":"2023-11-04T15:37:50.250495+0000","last_clean":"2023-11-04T15:37:50.250495+0000","last_became_active":"2023-11-04T15:27:35.774339+0000","last_became_peered":"2023-11-04T15:27:35.774339+0000","last_unstale":"2023-11-04T15:37:50.250495+0000","last_undegraded":"2023-11-04T15:37:50.250495+0000","last_fullsized":"2023-11-04T15:37:50.250495+0000","mapping_epoch":16,"log_start":"26'400","ondisk_log_start":"26'400","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'6085","last_scrub_stamp":"2023-11-04T15:37:50.250469+0000","last_deep_scrub":"44'6085","last_deep_scrub_stamp":"2023-11-04T15:37:50.250469+0000","last_clean_scrub_stamp":"2023-11-04T15:37:50.250469+0000","objects_scrubbed":6,"log_size":5685,"log_dups_size":0,"ondisk_log_size":5685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:47.102018+0000","scrub_duration":0.070893610999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6078,"num_write_kb":43849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"44'3173","reported_seq":2650,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:10.304885+0000","last_change":"2023-11-04T15:37:10.305048+0000","last_active":"2023-11-04T15:37:10.304885+0000","last_peered":"2023-11-04T15:37:10.304885+0000","last_clean":"2023-11-04T15:37:10.304885+0000","last_became_active":"2023-11-04T15:27:36.146930+0000","last_became_peered":"2023-11-04T15:27:36.146930+0000","last_unstale":"2023-11-04T15:37:10.304885+0000","last_undegraded":"2023-11-04T15:37:10.304885+0000","last_fullsized":"2023-11-04T15:37:10.304885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3173","last_scrub_stamp":"2023-11-04T15:37:10.304861+0000","last_deep_scrub":"44'3173","last_deep_scrub_stamp":"2023-11-04T15:37:10.304861+0000","last_clean_scrub_stamp":"2023-11-04T15:37:10.304861+0000","objects_scrubbed":1,"log_size":3173,"log_dups_size":0,"ondisk_log_size":3173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:31.914468+0000","scrub_duration":0.0078700769999999996,"objects_trimmed":0,"snaptrim_duration":0.067233409999999993,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1111,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:14.382747+0000","last_change":"2023-11-04T15:38:14.382871+0000","last_active":"2023-11-04T15:38:14.382747+0000","last_peered":"2023-11-04T15:38:14.382747+0000","last_clean":"2023-11-04T15:38:14.382747+0000","last_became_active":"2023-11-04T15:27:31.621849+0000","last_became_peered":"2023-11-04T15:27:31.621849+0000","last_unstale":"2023-11-04T15:38:14.382747+0000","last_undegraded":"2023-11-04T15:38:14.382747+0000","last_fullsized":"2023-11-04T15:38:14.382747+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:38:14.382726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:38:14.382726+0000","last_clean_scrub_stamp":"2023-11-04T15:38:14.382726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:16:48.780994+0000","scrub_duration":0.0020309239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"44'3280","reported_seq":3333,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:27.660076+0000","last_change":"2023-11-04T15:37:27.660076+0000","last_active":"2023-11-04T15:37:27.660076+0000","last_peered":"2023-11-04T15:37:27.660076+0000","last_clean":"2023-11-04T15:37:27.660076+0000","last_became_active":"2023-11-04T15:27:35.769730+0000","last_became_peered":"2023-11-04T15:27:35.769730+0000","last_unstale":"2023-11-04T15:37:27.660076+0000","last_undegraded":"2023-11-04T15:37:27.660076+0000","last_fullsized":"2023-11-04T15:37:27.660076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3280","last_scrub_stamp":"2023-11-04T15:37:27.659954+0000","last_deep_scrub":"44'3280","last_deep_scrub_stamp":"2023-11-04T15:37:27.659954+0000","last_clean_scrub_stamp":"2023-11-04T15:37:27.659954+0000","objects_scrubbed":5,"log_size":3280,"log_dups_size":0,"ondisk_log_size":3280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:41.327688+0000","scrub_duration":0.054452754999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3258,"num_write_kb":30072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"44'3434","reported_seq":2864,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:18.421706+0000","last_change":"2023-11-04T15:37:18.421706+0000","last_active":"2023-11-04T15:37:18.421706+0000","last_peered":"2023-11-04T15:37:18.421706+0000","last_clean":"2023-11-04T15:37:18.421706+0000","last_became_active":"2023-11-04T15:27:36.144417+0000","last_became_peered":"2023-11-04T15:27:36.144417+0000","last_unstale":"2023-11-04T15:37:18.421706+0000","last_undegraded":"2023-11-04T15:37:18.421706+0000","last_fullsized":"2023-11-04T15:37:18.421706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3434","last_scrub_stamp":"2023-11-04T15:37:18.421580+0000","last_deep_scrub":"44'3434","last_deep_scrub_stamp":"2023-11-04T15:37:18.421580+0000","last_clean_scrub_stamp":"2023-11-04T15:37:18.421580+0000","objects_scrubbed":3,"log_size":3434,"log_dups_size":0,"ondisk_log_size":3434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:37:14.873581+0000","scrub_duration":0.011594345000000001,"objects_trimmed":0,"snaptrim_duration":0.067418286999999993,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"44'3108","reported_seq":3161,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:28.595288+0000","last_change":"2023-11-04T15:37:28.595288+0000","last_active":"2023-11-04T15:37:28.595288+0000","last_peered":"2023-11-04T15:37:28.595288+0000","last_clean":"2023-11-04T15:37:28.595288+0000","last_became_active":"2023-11-04T15:27:35.769772+0000","last_became_peered":"2023-11-04T15:27:35.769772+0000","last_unstale":"2023-11-04T15:37:28.595288+0000","last_undegraded":"2023-11-04T15:37:28.595288+0000","last_fullsized":"2023-11-04T15:37:28.595288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3108","last_scrub_stamp":"2023-11-04T15:37:28.595114+0000","last_deep_scrub":"44'3108","last_deep_scrub_stamp":"2023-11-04T15:37:28.595114+0000","last_clean_scrub_stamp":"2023-11-04T15:37:28.595114+0000","objects_scrubbed":3,"log_size":3108,"log_dups_size":0,"ondisk_log_size":3108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:56:42.397736+0000","scrub_duration":0.034473323,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3101,"num_write_kb":32806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:47.235098+0000","last_change":"2023-11-04T15:37:47.235098+0000","last_active":"2023-11-04T15:37:47.235098+0000","last_peered":"2023-11-04T15:37:47.235098+0000","last_clean":"2023-11-04T15:37:47.235098+0000","last_became_active":"2023-11-04T15:27:31.622350+0000","last_became_peered":"2023-11-04T15:27:31.622350+0000","last_unstale":"2023-11-04T15:37:47.235098+0000","last_undegraded":"2023-11-04T15:37:47.235098+0000","last_fullsized":"2023-11-04T15:37:47.235098+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:37:47.234970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:37:47.234970+0000","last_clean_scrub_stamp":"2023-11-04T15:37:47.234970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:46:33.643935+0000","scrub_duration":0.00154751,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"43'3419","reported_seq":2906,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:09.350908+0000","last_change":"2023-11-04T15:37:09.350908+0000","last_active":"2023-11-04T15:37:09.350908+0000","last_peered":"2023-11-04T15:37:09.350908+0000","last_clean":"2023-11-04T15:37:09.350908+0000","last_became_active":"2023-11-04T15:27:36.143991+0000","last_became_peered":"2023-11-04T15:27:36.143991+0000","last_unstale":"2023-11-04T15:37:09.350908+0000","last_undegraded":"2023-11-04T15:37:09.350908+0000","last_fullsized":"2023-11-04T15:37:09.350908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3419","last_scrub_stamp":"2023-11-04T15:37:09.350786+0000","last_deep_scrub":"43'3419","last_deep_scrub_stamp":"2023-11-04T15:37:09.350786+0000","last_clean_scrub_stamp":"2023-11-04T15:37:09.350786+0000","objects_scrubbed":2,"log_size":3419,"log_dups_size":0,"ondisk_log_size":3419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:20:35.227166+0000","scrub_duration":0.0074817540000000002,"objects_trimmed":0,"snaptrim_duration":0.062728023999999993,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":1116,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"44'4469","reported_seq":4522,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:56.224142+0000","last_change":"2023-11-04T15:37:56.224142+0000","last_active":"2023-11-04T15:37:56.224142+0000","last_peered":"2023-11-04T15:37:56.224142+0000","last_clean":"2023-11-04T15:37:56.224142+0000","last_became_active":"2023-11-04T15:27:35.769095+0000","last_became_peered":"2023-11-04T15:27:35.769095+0000","last_unstale":"2023-11-04T15:37:56.224142+0000","last_undegraded":"2023-11-04T15:37:56.224142+0000","last_fullsized":"2023-11-04T15:37:56.224142+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4469","last_scrub_stamp":"2023-11-04T15:37:56.224006+0000","last_deep_scrub":"44'4469","last_deep_scrub_stamp":"2023-11-04T15:37:56.224006+0000","last_clean_scrub_stamp":"2023-11-04T15:37:56.224006+0000","objects_scrubbed":5,"log_size":4469,"log_dups_size":0,"ondisk_log_size":4469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:52:06.320947+0000","scrub_duration":0.052842531999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4451,"num_write_kb":27035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:23.393957+0000","last_change":"2023-11-04T15:38:23.394103+0000","last_active":"2023-11-04T15:38:23.393957+0000","last_peered":"2023-11-04T15:38:23.393957+0000","last_clean":"2023-11-04T15:38:23.393957+0000","last_became_active":"2023-11-04T15:27:31.619702+0000","last_became_peered":"2023-11-04T15:27:31.619702+0000","last_unstale":"2023-11-04T15:38:23.393957+0000","last_undegraded":"2023-11-04T15:38:23.393957+0000","last_fullsized":"2023-11-04T15:38:23.393957+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:38:23.393926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:38:23.393926+0000","last_clean_scrub_stamp":"2023-11-04T15:38:23.393926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:54:34.579281+0000","scrub_duration":0.001751711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"40'3558","reported_seq":2956,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:19.665851+0000","last_change":"2023-11-04T15:37:19.665851+0000","last_active":"2023-11-04T15:37:19.665851+0000","last_peered":"2023-11-04T15:37:19.665851+0000","last_clean":"2023-11-04T15:37:19.665851+0000","last_became_active":"2023-11-04T15:27:36.139707+0000","last_became_peered":"2023-11-04T15:27:36.139707+0000","last_unstale":"2023-11-04T15:37:19.665851+0000","last_undegraded":"2023-11-04T15:37:19.665851+0000","last_fullsized":"2023-11-04T15:37:19.665851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3558","last_scrub_stamp":"2023-11-04T15:37:19.665726+0000","last_deep_scrub":"40'3558","last_deep_scrub_stamp":"2023-11-04T15:37:19.665726+0000","last_clean_scrub_stamp":"2023-11-04T15:37:19.665726+0000","objects_scrubbed":0,"log_size":3558,"log_dups_size":0,"ondisk_log_size":3558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:24:54.436304+0000","scrub_duration":0.0061987099999999996,"objects_trimmed":0,"snaptrim_duration":0.073815121999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"44'1219","reported_seq":1272,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:59.151132+0000","last_change":"2023-11-04T15:37:59.151132+0000","last_active":"2023-11-04T15:37:59.151132+0000","last_peered":"2023-11-04T15:37:59.151132+0000","last_clean":"2023-11-04T15:37:59.151132+0000","last_became_active":"2023-11-04T15:27:35.768320+0000","last_became_peered":"2023-11-04T15:27:35.768320+0000","last_unstale":"2023-11-04T15:37:59.151132+0000","last_undegraded":"2023-11-04T15:37:59.151132+0000","last_fullsized":"2023-11-04T15:37:59.151132+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1219","last_scrub_stamp":"2023-11-04T15:37:59.150991+0000","last_deep_scrub":"44'1219","last_deep_scrub_stamp":"2023-11-04T15:37:59.150991+0000","last_clean_scrub_stamp":"2023-11-04T15:37:59.150991+0000","objects_scrubbed":5,"log_size":1219,"log_dups_size":0,"ondisk_log_size":1219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:11:48.972187+0000","scrub_duration":0.031930034000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1211,"num_write_kb":18003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:42.307944+0000","last_change":"2023-11-04T15:37:42.307944+0000","last_active":"2023-11-04T15:37:42.307944+0000","last_peered":"2023-11-04T15:37:42.307944+0000","last_clean":"2023-11-04T15:37:42.307944+0000","last_became_active":"2023-11-04T15:27:31.624347+0000","last_became_peered":"2023-11-04T15:27:31.624347+0000","last_unstale":"2023-11-04T15:37:42.307944+0000","last_undegraded":"2023-11-04T15:37:42.307944+0000","last_fullsized":"2023-11-04T15:37:42.307944+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:37:42.307817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:37:42.307817+0000","last_clean_scrub_stamp":"2023-11-04T15:37:42.307817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:40:21.913960+0000","scrub_duration":0.002137136,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"40'3608","reported_seq":3014,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:06.226333+0000","last_change":"2023-11-04T15:36:55.791977+0000","last_active":"2023-11-04T15:37:06.226333+0000","last_peered":"2023-11-04T15:37:06.226333+0000","last_clean":"2023-11-04T15:37:06.226333+0000","last_became_active":"2023-11-04T15:27:36.137897+0000","last_became_peered":"2023-11-04T15:27:36.137897+0000","last_unstale":"2023-11-04T15:37:06.226333+0000","last_undegraded":"2023-11-04T15:37:06.226333+0000","last_fullsized":"2023-11-04T15:37:06.226333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3608,"log_dups_size":0,"ondisk_log_size":3608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.069534850999999995,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"44'835","reported_seq":888,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:58.635650+0000","last_change":"2023-11-04T15:37:58.635650+0000","last_active":"2023-11-04T15:37:58.635650+0000","last_peered":"2023-11-04T15:37:58.635650+0000","last_clean":"2023-11-04T15:37:58.635650+0000","last_became_active":"2023-11-04T15:27:35.772121+0000","last_became_peered":"2023-11-04T15:27:35.772121+0000","last_unstale":"2023-11-04T15:37:58.635650+0000","last_undegraded":"2023-11-04T15:37:58.635650+0000","last_fullsized":"2023-11-04T15:37:58.635650+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'835","last_scrub_stamp":"2023-11-04T15:37:58.635523+0000","last_deep_scrub":"44'835","last_deep_scrub_stamp":"2023-11-04T15:37:58.635523+0000","last_clean_scrub_stamp":"2023-11-04T15:37:58.635523+0000","objects_scrubbed":6,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:52:08.732465+0000","scrub_duration":0.064600797000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":960,"num_write_kb":25976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:18.360275+0000","last_change":"2023-11-04T15:38:18.360275+0000","last_active":"2023-11-04T15:38:18.360275+0000","last_peered":"2023-11-04T15:38:18.360275+0000","last_clean":"2023-11-04T15:38:18.360275+0000","last_became_active":"2023-11-04T15:27:31.619831+0000","last_became_peered":"2023-11-04T15:27:31.619831+0000","last_unstale":"2023-11-04T15:38:18.360275+0000","last_undegraded":"2023-11-04T15:38:18.360275+0000","last_fullsized":"2023-11-04T15:38:18.360275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:38:18.360157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:38:18.360157+0000","last_clean_scrub_stamp":"2023-11-04T15:38:18.360157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:32:51.174031+0000","scrub_duration":0.0014914360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"44'3481","reported_seq":2937,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:10.702911+0000","last_change":"2023-11-04T15:37:10.702911+0000","last_active":"2023-11-04T15:37:10.702911+0000","last_peered":"2023-11-04T15:37:10.702911+0000","last_clean":"2023-11-04T15:37:10.702911+0000","last_became_active":"2023-11-04T15:27:36.140871+0000","last_became_peered":"2023-11-04T15:27:36.140871+0000","last_unstale":"2023-11-04T15:37:10.702911+0000","last_undegraded":"2023-11-04T15:37:10.702911+0000","last_fullsized":"2023-11-04T15:37:10.702911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3481","last_scrub_stamp":"2023-11-04T15:37:10.702789+0000","last_deep_scrub":"44'3481","last_deep_scrub_stamp":"2023-11-04T15:37:10.702789+0000","last_clean_scrub_stamp":"2023-11-04T15:37:10.702789+0000","objects_scrubbed":1,"log_size":3481,"log_dups_size":0,"ondisk_log_size":3481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:23:02.723895+0000","scrub_duration":0.008399541,"objects_trimmed":0,"snaptrim_duration":0.058381362999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"40'3644","reported_seq":3059,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:22.638939+0000","last_change":"2023-11-04T15:37:22.639061+0000","last_active":"2023-11-04T15:37:22.638939+0000","last_peered":"2023-11-04T15:37:22.638939+0000","last_clean":"2023-11-04T15:37:22.638939+0000","last_became_active":"2023-11-04T15:27:36.139487+0000","last_became_peered":"2023-11-04T15:27:36.139487+0000","last_unstale":"2023-11-04T15:37:22.638939+0000","last_undegraded":"2023-11-04T15:37:22.638939+0000","last_fullsized":"2023-11-04T15:37:22.638939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3644","last_scrub_stamp":"2023-11-04T15:37:22.638916+0000","last_deep_scrub":"40'3644","last_deep_scrub_stamp":"2023-11-04T15:37:22.638916+0000","last_clean_scrub_stamp":"2023-11-04T15:37:22.638916+0000","objects_scrubbed":0,"log_size":3644,"log_dups_size":0,"ondisk_log_size":3644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:37:19.090917+0000","scrub_duration":0.0049130600000000003,"objects_trimmed":0,"snaptrim_duration":0.056621590999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"44'2776","reported_seq":2828,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:42.474185+0000","last_change":"2023-11-04T15:37:42.474282+0000","last_active":"2023-11-04T15:37:42.474185+0000","last_peered":"2023-11-04T15:37:42.474185+0000","last_clean":"2023-11-04T15:37:42.474185+0000","last_became_active":"2023-11-04T15:27:35.775356+0000","last_became_peered":"2023-11-04T15:27:35.775356+0000","last_unstale":"2023-11-04T15:37:42.474185+0000","last_undegraded":"2023-11-04T15:37:42.474185+0000","last_fullsized":"2023-11-04T15:37:42.474185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2776","last_scrub_stamp":"2023-11-04T15:37:42.474162+0000","last_deep_scrub":"44'2776","last_deep_scrub_stamp":"2023-11-04T15:37:42.474162+0000","last_clean_scrub_stamp":"2023-11-04T15:37:42.474162+0000","objects_scrubbed":5,"log_size":2776,"log_dups_size":0,"ondisk_log_size":2776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:55:13.607739+0000","scrub_duration":0.030546663000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2770,"num_write_kb":31342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"44'3526","reported_seq":2945,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:07.150693+0000","last_change":"2023-11-04T15:38:07.150810+0000","last_active":"2023-11-04T15:38:07.150693+0000","last_peered":"2023-11-04T15:38:07.150693+0000","last_clean":"2023-11-04T15:38:07.150693+0000","last_became_active":"2023-11-04T15:27:36.146464+0000","last_became_peered":"2023-11-04T15:27:36.146464+0000","last_unstale":"2023-11-04T15:38:07.150693+0000","last_undegraded":"2023-11-04T15:38:07.150693+0000","last_fullsized":"2023-11-04T15:38:07.150693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3526","last_scrub_stamp":"2023-11-04T15:38:07.150668+0000","last_deep_scrub":"44'3526","last_deep_scrub_stamp":"2023-11-04T15:38:07.150668+0000","last_clean_scrub_stamp":"2023-11-04T15:38:07.150668+0000","objects_scrubbed":1,"log_size":3526,"log_dups_size":0,"ondisk_log_size":3526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:24.608949+0000","scrub_duration":0.0086108179999999993,"objects_trimmed":0,"snaptrim_duration":0.064516859999999995,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"44'3745","reported_seq":3797,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:57.703309+0000","last_change":"2023-11-04T15:37:57.703411+0000","last_active":"2023-11-04T15:37:57.703309+0000","last_peered":"2023-11-04T15:37:57.703309+0000","last_clean":"2023-11-04T15:37:57.703309+0000","last_became_active":"2023-11-04T15:27:35.769904+0000","last_became_peered":"2023-11-04T15:27:35.769904+0000","last_unstale":"2023-11-04T15:37:57.703309+0000","last_undegraded":"2023-11-04T15:37:57.703309+0000","last_fullsized":"2023-11-04T15:37:57.703309+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3745","last_scrub_stamp":"2023-11-04T15:37:57.703286+0000","last_deep_scrub":"44'3745","last_deep_scrub_stamp":"2023-11-04T15:37:57.703286+0000","last_clean_scrub_stamp":"2023-11-04T15:37:57.703286+0000","objects_scrubbed":3,"log_size":3745,"log_dups_size":0,"ondisk_log_size":3745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:21:23.757688+0000","scrub_duration":0.020686982,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3740,"num_write_kb":21755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"44'3556","reported_seq":3608,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:02.674712+0000","last_change":"2023-11-04T15:38:02.674801+0000","last_active":"2023-11-04T15:38:02.674712+0000","last_peered":"2023-11-04T15:38:02.674712+0000","last_clean":"2023-11-04T15:38:02.674712+0000","last_became_active":"2023-11-04T15:27:35.768413+0000","last_became_peered":"2023-11-04T15:27:35.768413+0000","last_unstale":"2023-11-04T15:38:02.674712+0000","last_undegraded":"2023-11-04T15:38:02.674712+0000","last_fullsized":"2023-11-04T15:38:02.674712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3556","last_scrub_stamp":"2023-11-04T15:38:02.674689+0000","last_deep_scrub":"44'3556","last_deep_scrub_stamp":"2023-11-04T15:38:02.674689+0000","last_clean_scrub_stamp":"2023-11-04T15:38:02.674689+0000","objects_scrubbed":2,"log_size":3556,"log_dups_size":0,"ondisk_log_size":3556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:52:12.771630+0000","scrub_duration":0.025634852,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3537,"num_write_kb":29647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"40'3937","reported_seq":3332,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:42.530756+0000","last_change":"2023-11-04T15:37:42.530849+0000","last_active":"2023-11-04T15:37:42.530756+0000","last_peered":"2023-11-04T15:37:42.530756+0000","last_clean":"2023-11-04T15:37:42.530756+0000","last_became_active":"2023-11-04T15:27:36.139524+0000","last_became_peered":"2023-11-04T15:27:36.139524+0000","last_unstale":"2023-11-04T15:37:42.530756+0000","last_undegraded":"2023-11-04T15:37:42.530756+0000","last_fullsized":"2023-11-04T15:37:42.530756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3937","last_scrub_stamp":"2023-11-04T15:37:42.530734+0000","last_deep_scrub":"40'3937","last_deep_scrub_stamp":"2023-11-04T15:37:42.530734+0000","last_clean_scrub_stamp":"2023-11-04T15:37:42.530734+0000","objects_scrubbed":0,"log_size":3937,"log_dups_size":0,"ondisk_log_size":3937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:07:56.161396+0000","scrub_duration":0.0048541679999999999,"objects_trimmed":0,"snaptrim_duration":0.068494678000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1248,"num_write_kb":670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"44'1642","reported_seq":1694,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:08.820848+0000","last_change":"2023-11-04T15:38:08.820939+0000","last_active":"2023-11-04T15:38:08.820848+0000","last_peered":"2023-11-04T15:38:08.820848+0000","last_clean":"2023-11-04T15:38:08.820848+0000","last_became_active":"2023-11-04T15:27:35.775917+0000","last_became_peered":"2023-11-04T15:27:35.775917+0000","last_unstale":"2023-11-04T15:38:08.820848+0000","last_undegraded":"2023-11-04T15:38:08.820848+0000","last_fullsized":"2023-11-04T15:38:08.820848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1642","last_scrub_stamp":"2023-11-04T15:38:08.820827+0000","last_deep_scrub":"44'1642","last_deep_scrub_stamp":"2023-11-04T15:38:08.820827+0000","last_clean_scrub_stamp":"2023-11-04T15:38:08.820827+0000","objects_scrubbed":5,"log_size":1642,"log_dups_size":0,"ondisk_log_size":1642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:44:06.273949+0000","scrub_duration":0.0476023,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1634,"num_write_kb":25426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"44'3473","reported_seq":2906,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:21.407271+0000","last_change":"2023-11-04T15:37:21.407382+0000","last_active":"2023-11-04T15:37:21.407271+0000","last_peered":"2023-11-04T15:37:21.407271+0000","last_clean":"2023-11-04T15:37:21.407271+0000","last_became_active":"2023-11-04T15:27:36.150557+0000","last_became_peered":"2023-11-04T15:27:36.150557+0000","last_unstale":"2023-11-04T15:37:21.407271+0000","last_undegraded":"2023-11-04T15:37:21.407271+0000","last_fullsized":"2023-11-04T15:37:21.407271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3473","last_scrub_stamp":"2023-11-04T15:37:21.407243+0000","last_deep_scrub":"44'3473","last_deep_scrub_stamp":"2023-11-04T15:37:21.407243+0000","last_clean_scrub_stamp":"2023-11-04T15:37:21.407243+0000","objects_scrubbed":1,"log_size":3473,"log_dups_size":0,"ondisk_log_size":3473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:18:27.087972+0000","scrub_duration":0.0082048629999999997,"objects_trimmed":0,"snaptrim_duration":0.062631718000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"40'3228","reported_seq":2712,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.611499+0000","last_change":"2023-11-04T15:36:55.826604+0000","last_active":"2023-11-04T15:37:07.611499+0000","last_peered":"2023-11-04T15:37:07.611499+0000","last_clean":"2023-11-04T15:37:07.611499+0000","last_became_active":"2023-11-04T15:27:36.149831+0000","last_became_peered":"2023-11-04T15:27:36.149831+0000","last_unstale":"2023-11-04T15:37:07.611499+0000","last_undegraded":"2023-11-04T15:37:07.611499+0000","last_fullsized":"2023-11-04T15:37:07.611499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3228,"log_dups_size":0,"ondisk_log_size":3228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.103639325,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1060,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"44'4779","reported_seq":4831,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:19.478819+0000","last_change":"2023-11-04T15:37:19.478909+0000","last_active":"2023-11-04T15:37:19.478819+0000","last_peered":"2023-11-04T15:37:19.478819+0000","last_clean":"2023-11-04T15:37:19.478819+0000","last_became_active":"2023-11-04T15:27:35.770022+0000","last_became_peered":"2023-11-04T15:27:35.770022+0000","last_unstale":"2023-11-04T15:37:19.478819+0000","last_undegraded":"2023-11-04T15:37:19.478819+0000","last_fullsized":"2023-11-04T15:37:19.478819+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4779","last_scrub_stamp":"2023-11-04T15:37:19.478796+0000","last_deep_scrub":"44'4779","last_deep_scrub_stamp":"2023-11-04T15:37:19.478796+0000","last_clean_scrub_stamp":"2023-11-04T15:37:19.478796+0000","objects_scrubbed":7,"log_size":4779,"log_dups_size":0,"ondisk_log_size":4779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:24.515597+0000","scrub_duration":0.083030119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28974830,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4772,"num_write_kb":50744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"44'3335","reported_seq":2791,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:16.935545+0000","last_change":"2023-11-04T15:38:16.935650+0000","last_active":"2023-11-04T15:38:16.935545+0000","last_peered":"2023-11-04T15:38:16.935545+0000","last_clean":"2023-11-04T15:38:16.935545+0000","last_became_active":"2023-11-04T15:27:36.138908+0000","last_became_peered":"2023-11-04T15:27:36.138908+0000","last_unstale":"2023-11-04T15:38:16.935545+0000","last_undegraded":"2023-11-04T15:38:16.935545+0000","last_fullsized":"2023-11-04T15:38:16.935545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3335","last_scrub_stamp":"2023-11-04T15:38:16.935521+0000","last_deep_scrub":"44'3335","last_deep_scrub_stamp":"2023-11-04T15:38:16.935521+0000","last_clean_scrub_stamp":"2023-11-04T15:38:16.935521+0000","objects_scrubbed":2,"log_size":3335,"log_dups_size":0,"ondisk_log_size":3335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:47:56.675047+0000","scrub_duration":0.010785885,"objects_trimmed":0,"snaptrim_duration":0.073000567000000002,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":1157,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"44'784","reported_seq":836,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:23.362195+0000","last_change":"2023-11-04T15:37:23.362327+0000","last_active":"2023-11-04T15:37:23.362195+0000","last_peered":"2023-11-04T15:37:23.362195+0000","last_clean":"2023-11-04T15:37:23.362195+0000","last_became_active":"2023-11-04T15:27:35.767858+0000","last_became_peered":"2023-11-04T15:27:35.767858+0000","last_unstale":"2023-11-04T15:37:23.362195+0000","last_undegraded":"2023-11-04T15:37:23.362195+0000","last_fullsized":"2023-11-04T15:37:23.362195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'784","last_scrub_stamp":"2023-11-04T15:37:23.362171+0000","last_deep_scrub":"44'784","last_deep_scrub_stamp":"2023-11-04T15:37:23.362171+0000","last_clean_scrub_stamp":"2023-11-04T15:37:23.362171+0000","objects_scrubbed":4,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:37.029904+0000","scrub_duration":0.042357839000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":779,"num_write_kb":20966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"40'3359","reported_seq":2795,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:25.666192+0000","last_change":"2023-11-04T15:37:25.666192+0000","last_active":"2023-11-04T15:37:25.666192+0000","last_peered":"2023-11-04T15:37:25.666192+0000","last_clean":"2023-11-04T15:37:25.666192+0000","last_became_active":"2023-11-04T15:27:36.143442+0000","last_became_peered":"2023-11-04T15:27:36.143442+0000","last_unstale":"2023-11-04T15:37:25.666192+0000","last_undegraded":"2023-11-04T15:37:25.666192+0000","last_fullsized":"2023-11-04T15:37:25.666192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3359","last_scrub_stamp":"2023-11-04T15:37:25.666058+0000","last_deep_scrub":"40'3359","last_deep_scrub_stamp":"2023-11-04T15:37:25.666058+0000","last_clean_scrub_stamp":"2023-11-04T15:37:25.666058+0000","objects_scrubbed":0,"log_size":3359,"log_dups_size":0,"ondisk_log_size":3359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:56:39.468680+0000","scrub_duration":0.003764154,"objects_trimmed":0,"snaptrim_duration":0.072078296,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1167,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"44'3780","reported_seq":3832,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:56.657179+0000","last_change":"2023-11-04T15:37:56.657328+0000","last_active":"2023-11-04T15:37:56.657179+0000","last_peered":"2023-11-04T15:37:56.657179+0000","last_clean":"2023-11-04T15:37:56.657179+0000","last_became_active":"2023-11-04T15:27:35.770539+0000","last_became_peered":"2023-11-04T15:27:35.770539+0000","last_unstale":"2023-11-04T15:37:56.657179+0000","last_undegraded":"2023-11-04T15:37:56.657179+0000","last_fullsized":"2023-11-04T15:37:56.657179+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3780","last_scrub_stamp":"2023-11-04T15:37:56.657156+0000","last_deep_scrub":"44'3780","last_deep_scrub_stamp":"2023-11-04T15:37:56.657156+0000","last_clean_scrub_stamp":"2023-11-04T15:37:56.657156+0000","objects_scrubbed":2,"log_size":3780,"log_dups_size":0,"ondisk_log_size":3780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:53.508705+0000","scrub_duration":0.023445829000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3770,"num_write_kb":38321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"44'3794","reported_seq":3161,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:14.135362+0000","last_change":"2023-11-04T15:38:14.135463+0000","last_active":"2023-11-04T15:38:14.135362+0000","last_peered":"2023-11-04T15:38:14.135362+0000","last_clean":"2023-11-04T15:38:14.135362+0000","last_became_active":"2023-11-04T15:27:36.146477+0000","last_became_peered":"2023-11-04T15:27:36.146477+0000","last_unstale":"2023-11-04T15:38:14.135362+0000","last_undegraded":"2023-11-04T15:38:14.135362+0000","last_fullsized":"2023-11-04T15:38:14.135362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3794","last_scrub_stamp":"2023-11-04T15:38:14.135338+0000","last_deep_scrub":"44'3794","last_deep_scrub_stamp":"2023-11-04T15:38:14.135338+0000","last_clean_scrub_stamp":"2023-11-04T15:38:14.135338+0000","objects_scrubbed":3,"log_size":3794,"log_dups_size":0,"ondisk_log_size":3794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:47:53.874864+0000","scrub_duration":0.014159603999999999,"objects_trimmed":0,"snaptrim_duration":0.063144525000000007,"stat_sum":{"num_bytes":8192,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1270,"num_write_kb":694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"44'2947","reported_seq":2999,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:53.659127+0000","last_change":"2023-11-04T15:37:53.659229+0000","last_active":"2023-11-04T15:37:53.659127+0000","last_peered":"2023-11-04T15:37:53.659127+0000","last_clean":"2023-11-04T15:37:53.659127+0000","last_became_active":"2023-11-04T15:27:35.771316+0000","last_became_peered":"2023-11-04T15:27:35.771316+0000","last_unstale":"2023-11-04T15:37:53.659127+0000","last_undegraded":"2023-11-04T15:37:53.659127+0000","last_fullsized":"2023-11-04T15:37:53.659127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2947","last_scrub_stamp":"2023-11-04T15:37:53.659103+0000","last_deep_scrub":"44'2947","last_deep_scrub_stamp":"2023-11-04T15:37:53.659103+0000","last_clean_scrub_stamp":"2023-11-04T15:37:53.659103+0000","objects_scrubbed":4,"log_size":2947,"log_dups_size":0,"ondisk_log_size":2947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:21:19.713505+0000","scrub_duration":0.039096767999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2943,"num_write_kb":28401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"44'3597","reported_seq":3019,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:09.671026+0000","last_change":"2023-11-04T15:37:09.671026+0000","last_active":"2023-11-04T15:37:09.671026+0000","last_peered":"2023-11-04T15:37:09.671026+0000","last_clean":"2023-11-04T15:37:09.671026+0000","last_became_active":"2023-11-04T15:27:36.144066+0000","last_became_peered":"2023-11-04T15:27:36.144066+0000","last_unstale":"2023-11-04T15:37:09.671026+0000","last_undegraded":"2023-11-04T15:37:09.671026+0000","last_fullsized":"2023-11-04T15:37:09.671026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3597","last_scrub_stamp":"2023-11-04T15:37:09.670901+0000","last_deep_scrub":"44'3597","last_deep_scrub_stamp":"2023-11-04T15:37:09.670901+0000","last_clean_scrub_stamp":"2023-11-04T15:37:09.670901+0000","objects_scrubbed":2,"log_size":3597,"log_dups_size":0,"ondisk_log_size":3597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T22:52:59.961460+0000","scrub_duration":0.010082327,"objects_trimmed":0,"snaptrim_duration":0.057889772999999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1118,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"44'931","reported_seq":983,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:46.627662+0000","last_change":"2023-11-04T15:37:46.627792+0000","last_active":"2023-11-04T15:37:46.627662+0000","last_peered":"2023-11-04T15:37:46.627662+0000","last_clean":"2023-11-04T15:37:46.627662+0000","last_became_active":"2023-11-04T15:27:35.767852+0000","last_became_peered":"2023-11-04T15:27:35.767852+0000","last_unstale":"2023-11-04T15:37:46.627662+0000","last_undegraded":"2023-11-04T15:37:46.627662+0000","last_fullsized":"2023-11-04T15:37:46.627662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'931","last_scrub_stamp":"2023-11-04T15:37:46.627638+0000","last_deep_scrub":"44'931","last_deep_scrub_stamp":"2023-11-04T15:37:46.627638+0000","last_clean_scrub_stamp":"2023-11-04T15:37:46.627638+0000","objects_scrubbed":5,"log_size":931,"log_dups_size":0,"ondisk_log_size":931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:40:26.233782+0000","scrub_duration":0.040590909000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":923,"num_write_kb":21087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"44'3553","reported_seq":2986,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:20.652542+0000","last_change":"2023-11-04T15:38:20.652681+0000","last_active":"2023-11-04T15:38:20.652542+0000","last_peered":"2023-11-04T15:38:20.652542+0000","last_clean":"2023-11-04T15:38:20.652542+0000","last_became_active":"2023-11-04T15:27:36.141167+0000","last_became_peered":"2023-11-04T15:27:36.141167+0000","last_unstale":"2023-11-04T15:38:20.652542+0000","last_undegraded":"2023-11-04T15:38:20.652542+0000","last_fullsized":"2023-11-04T15:38:20.652542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3553","last_scrub_stamp":"2023-11-04T15:38:20.652503+0000","last_deep_scrub":"44'3553","last_deep_scrub_stamp":"2023-11-04T15:38:20.652503+0000","last_clean_scrub_stamp":"2023-11-04T15:38:20.652503+0000","objects_scrubbed":1,"log_size":3553,"log_dups_size":0,"ondisk_log_size":3553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:48:00.392030+0000","scrub_duration":0.0095782799999999998,"objects_trimmed":0,"snaptrim_duration":0.057363947999999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1127,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"44'3229","reported_seq":3281,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:37.512770+0000","last_change":"2023-11-04T15:37:37.512913+0000","last_active":"2023-11-04T15:37:37.512770+0000","last_peered":"2023-11-04T15:37:37.512770+0000","last_clean":"2023-11-04T15:37:37.512770+0000","last_became_active":"2023-11-04T15:27:35.775171+0000","last_became_peered":"2023-11-04T15:27:35.775171+0000","last_unstale":"2023-11-04T15:37:37.512770+0000","last_undegraded":"2023-11-04T15:37:37.512770+0000","last_fullsized":"2023-11-04T15:37:37.512770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3229","last_scrub_stamp":"2023-11-04T15:37:37.512732+0000","last_deep_scrub":"44'3229","last_deep_scrub_stamp":"2023-11-04T15:37:37.512732+0000","last_clean_scrub_stamp":"2023-11-04T15:37:37.512732+0000","objects_scrubbed":4,"log_size":3229,"log_dups_size":0,"ondisk_log_size":3229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:07:51.143393+0000","scrub_duration":0.039893972,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3214,"num_write_kb":42509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"44'3490","reported_seq":2947,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:09.749095+0000","last_change":"2023-11-04T15:37:09.749095+0000","last_active":"2023-11-04T15:37:09.749095+0000","last_peered":"2023-11-04T15:37:09.749095+0000","last_clean":"2023-11-04T15:37:09.749095+0000","last_became_active":"2023-11-04T15:27:36.145560+0000","last_became_peered":"2023-11-04T15:27:36.145560+0000","last_unstale":"2023-11-04T15:37:09.749095+0000","last_undegraded":"2023-11-04T15:37:09.749095+0000","last_fullsized":"2023-11-04T15:37:09.749095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3490","last_scrub_stamp":"2023-11-04T15:37:09.748973+0000","last_deep_scrub":"44'3490","last_deep_scrub_stamp":"2023-11-04T15:37:09.748973+0000","last_clean_scrub_stamp":"2023-11-04T15:37:09.748973+0000","objects_scrubbed":5,"log_size":3490,"log_dups_size":0,"ondisk_log_size":3490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:31.358580+0000","scrub_duration":0.011863093,"objects_trimmed":0,"snaptrim_duration":0.07011676,"stat_sum":{"num_bytes":4151,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":1159,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"44'4215","reported_seq":4268,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:09.815711+0000","last_change":"2023-11-04T15:38:09.815860+0000","last_active":"2023-11-04T15:38:09.815711+0000","last_peered":"2023-11-04T15:38:09.815711+0000","last_clean":"2023-11-04T15:38:09.815711+0000","last_became_active":"2023-11-04T15:27:35.770873+0000","last_became_peered":"2023-11-04T15:27:35.770873+0000","last_unstale":"2023-11-04T15:38:09.815711+0000","last_undegraded":"2023-11-04T15:38:09.815711+0000","last_fullsized":"2023-11-04T15:38:09.815711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4215","last_scrub_stamp":"2023-11-04T15:38:09.815689+0000","last_deep_scrub":"44'4215","last_deep_scrub_stamp":"2023-11-04T15:38:09.815689+0000","last_clean_scrub_stamp":"2023-11-04T15:38:09.815689+0000","objects_scrubbed":1,"log_size":4215,"log_dups_size":0,"ondisk_log_size":4215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:27.273970+0000","scrub_duration":0.014824155,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4214,"num_write_kb":32525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"44'4092","reported_seq":3407,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:13.735284+0000","last_change":"2023-11-04T15:37:13.735284+0000","last_active":"2023-11-04T15:37:13.735284+0000","last_peered":"2023-11-04T15:37:13.735284+0000","last_clean":"2023-11-04T15:37:13.735284+0000","last_became_active":"2023-11-04T15:27:36.147535+0000","last_became_peered":"2023-11-04T15:27:36.147535+0000","last_unstale":"2023-11-04T15:37:13.735284+0000","last_undegraded":"2023-11-04T15:37:13.735284+0000","last_fullsized":"2023-11-04T15:37:13.735284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4092","last_scrub_stamp":"2023-11-04T15:37:13.735159+0000","last_deep_scrub":"44'4092","last_deep_scrub_stamp":"2023-11-04T15:37:13.735159+0000","last_clean_scrub_stamp":"2023-11-04T15:37:13.735159+0000","objects_scrubbed":2,"log_size":4092,"log_dups_size":0,"ondisk_log_size":4092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:20:39.611539+0000","scrub_duration":0.012119325,"objects_trimmed":0,"snaptrim_duration":0.055801837,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1294,"num_write_kb":719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"44'1592","reported_seq":1645,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:11.894655+0000","last_change":"2023-11-04T15:38:11.894759+0000","last_active":"2023-11-04T15:38:11.894655+0000","last_peered":"2023-11-04T15:38:11.894655+0000","last_clean":"2023-11-04T15:38:11.894655+0000","last_became_active":"2023-11-04T15:27:35.775918+0000","last_became_peered":"2023-11-04T15:27:35.775918+0000","last_unstale":"2023-11-04T15:38:11.894655+0000","last_undegraded":"2023-11-04T15:38:11.894655+0000","last_fullsized":"2023-11-04T15:38:11.894655+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1592","last_scrub_stamp":"2023-11-04T15:38:11.894631+0000","last_deep_scrub":"44'1592","last_deep_scrub_stamp":"2023-11-04T15:38:11.894631+0000","last_clean_scrub_stamp":"2023-11-04T15:38:11.894631+0000","objects_scrubbed":3,"log_size":1592,"log_dups_size":0,"ondisk_log_size":1592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:03:12.567650+0000","scrub_duration":0.018695843,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1587,"num_write_kb":12658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1143,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":127433,"num_objects":92,"num_object_clones":25,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":8,"num_read":46,"num_read_kb":30,"num_write":74822,"num_write_kb":40603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":254672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224352,"ondisk_log_size":224352,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":430735581,"num_objects":126,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":126,"num_whiteouts":0,"num_read":190,"num_read_kb":3338,"num_write":83456,"num_write_kb":897544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7850,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":861528064,"data_stored":861471162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83196,"ondisk_log_size":83196,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705800,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":663648,"kb_used_data":173208,"kb_used_omap":0,"kb_used_meta":490432,"kb_avail":93708192,"statfs":{"total":96636764160,"available":95957188608,"internally_reserved":0,"allocated":177364992,"data_stored":176999461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":502202368},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 15:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47899999999999998,"15min":0.40400000000000003},"min":{"1min":0.28899999999999998,"5min":0.182,"15min":0.156},"max":{"1min":0.67900000000000005,"5min":10.488,"15min":10.488},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.628,"15min":0.45800000000000002},"min":{"1min":0.218,"5min":0.20200000000000001,"15min":0.186},"max":{"1min":0.61599999999999999,"5min":13.055,"15min":13.055},"last":0.48899999999999999}]},{"osd":1,"last update":"Sat Nov 4 15:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.54000000000000004,"15min":0.435},"min":{"1min":0.23499999999999999,"5min":0.20200000000000001,"15min":0.188},"max":{"1min":0.71199999999999997,"5min":12.347,"15min":12.347},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.53000000000000003,"15min":0.439},"min":{"1min":0.26600000000000001,"5min":0.23100000000000001,"15min":0.186},"max":{"1min":0.65300000000000002,"5min":12.853999999999999,"15min":12.853999999999999},"last":0.55800000000000005}]},{"osd":2,"last update":"Sat Nov 4 15:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.441,"15min":0.34499999999999997},"min":{"1min":0.17199999999999999,"5min":0.153,"15min":0.153},"max":{"1min":0.46100000000000002,"5min":11.709,"15min":11.709},"last":0.308},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.42899999999999999,"15min":0.35499999999999998},"min":{"1min":0.22600000000000001,"5min":0.161,"15min":0.14899999999999999},"max":{"1min":0.47899999999999998,"5min":9.2629999999999999,"15min":9.2629999999999999},"last":0.32400000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705799,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":952424,"kb_used_data":245472,"kb_used_omap":0,"kb_used_meta":706944,"kb_avail":93419416,"statfs":{"total":96636764160,"available":95661481984,"internally_reserved":0,"allocated":251363328,"data_stored":250991590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":723910656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 15:37:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":0.64800000000000002,"15min":0.46600000000000003},"min":{"1min":0.20599999999999999,"5min":0.153,"15min":0.151},"max":{"1min":21.297999999999998,"5min":21.297999999999998,"15min":21.297999999999998},"last":0.432},{"interface":"front","average":{"1min":1.252,"5min":0.55900000000000005,"15min":0.432},"min":{"1min":0.26000000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":17.809000000000001,"5min":17.809000000000001,"15min":17.809000000000001},"last":0.41899999999999998}]},{"osd":1,"last update":"Sat Nov 4 15:37:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":0.53800000000000003,"15min":0.44700000000000001},"min":{"1min":0.379,"5min":0.192,"15min":0.17100000000000001},"max":{"1min":10.851000000000001,"5min":10.851000000000001,"15min":10.851000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":1.2509999999999999,"5min":0.54200000000000004,"15min":0.46100000000000002},"min":{"1min":0.37,"5min":0.20899999999999999,"15min":0.20399999999999999},"max":{"1min":8.9740000000000002,"5min":8.9740000000000002,"15min":8.9740000000000002},"last":0.45200000000000001}]},{"osd":3,"last update":"Sat Nov 4 15:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.33700000000000002,"15min":0.32400000000000001},"min":{"1min":0.19700000000000001,"5min":0.152,"15min":0.14699999999999999},"max":{"1min":3.3929999999999998,"5min":3.3929999999999998,"15min":3.3929999999999998},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.874,"5min":0.43099999999999999,"15min":0.373},"min":{"1min":0.248,"5min":0.159,"15min":0.14899999999999999},"max":{"1min":10.887,"5min":10.887,"15min":10.887},"last":0.35299999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705798,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":719272,"kb_used_data":188640,"kb_used_omap":0,"kb_used_meta":530624,"kb_avail":93652568,"statfs":{"total":96636764160,"available":95900229632,"internally_reserved":0,"allocated":193167360,"data_stored":192807863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":543358976},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 15:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.28699999999999998,"5min":0.42899999999999999,"15min":0.318},"min":{"1min":0.20499999999999999,"5min":0.152,"15min":0.14399999999999999},"max":{"1min":0.377,"5min":12.768000000000001,"15min":12.768000000000001},"last":0.21299999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.33800000000000002,"15min":0.29999999999999999},"min":{"1min":0.22500000000000001,"5min":0.14399999999999999,"15min":0.14399999999999999},"max":{"1min":1.847,"5min":8.609,"15min":8.609},"last":0.24099999999999999}]},{"osd":2,"last update":"Sat Nov 4 15:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.44400000000000001,"15min":0.438},"min":{"1min":0.215,"5min":0.19600000000000001,"15min":0.189},"max":{"1min":0.624,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.434,"5min":0.42199999999999999,"15min":0.41999999999999998},"min":{"1min":0.27400000000000002,"5min":0.21299999999999999,"15min":0.192},"max":{"1min":0.56799999999999995,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.52600000000000002}]},{"osd":3,"last update":"Sat Nov 4 15:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.45100000000000001,"15min":0.435},"min":{"1min":0.26200000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.621,"5min":6.7679999999999998,"15min":6.7679999999999998},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.45200000000000001,"15min":0.44700000000000001},"min":{"1min":0.26600000000000001,"5min":0.25600000000000001,"15min":0.24299999999999999},"max":{"1min":0.58399999999999996,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.51000000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705799,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":918208,"kb_used_data":237496,"kb_used_omap":0,"kb_used_meta":680704,"kb_avail":93453632,"statfs":{"total":96636764160,"available":95696519168,"internally_reserved":0,"allocated":243195904,"data_stored":242832608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":697040896},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 15:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.45500000000000002,"15min":0.32100000000000001},"min":{"1min":0.187,"5min":0.14499999999999999,"15min":0.13500000000000001},"max":{"1min":12.731,"5min":12.731,"15min":12.731},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.30199999999999999,"15min":0.27500000000000002},"min":{"1min":0.185,"5min":0.16400000000000001,"15min":0.155},"max":{"1min":0.5,"5min":4.1200000000000001,"15min":4.1200000000000001},"last":0.253}]},{"osd":2,"last update":"Sat Nov 4 15:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.45600000000000002,"15min":0.42899999999999999},"min":{"1min":0.252,"5min":0.19400000000000001,"15min":0.17599999999999999},"max":{"1min":1.8169999999999999,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.443,"15min":0.42899999999999999},"min":{"1min":0.255,"5min":0.21099999999999999,"15min":0.187},"max":{"1min":3.6749999999999998,"5min":3.6749999999999998,"15min":3.6749999999999998},"last":0.37}]},{"osd":3,"last update":"Sat Nov 4 15:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.442},"min":{"1min":0.26700000000000002,"5min":0.20899999999999999,"15min":0.20300000000000001},"max":{"1min":0.68899999999999995,"5min":6.4660000000000002,"15min":6.4660000000000002},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.47699999999999998,"15min":0.44800000000000001},"min":{"1min":0.29199999999999998,"5min":0.23899999999999999,"15min":0.23000000000000001},"max":{"1min":0.68400000000000005,"5min":6.3540000000000001,"15min":6.3540000000000001},"last":0.40600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":242003968,"data_stored":241991173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":192552960,"data_stored":192552686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":250785792,"data_stored":250765155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":176185344,"data_stored":176162148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":69829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":73939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":45197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":65707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T15:38:29.390 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:29.391 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:29.391 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:29.391 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:29.392 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:29.392 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:29.392 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:29.393 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:29.393 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:29.393 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:29.394 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:29.394 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:29.395 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:29.395 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:29.395 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-11-04T15:27:34.743438+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=34, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:29.396 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:29.397 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:29.397 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-04T15:38:34.098 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:38:34.101 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:38:34.104 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:38:49.398 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T15:38:49.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.515+0000 7ff204dce640 1 Processor -- start 2023-11-04T15:38:49.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.515+0000 7ff204dce640 1 -- start start 2023-11-04T15:38:49.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.516+0000 7ff204dce640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff200137270 0x7ff2000a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:38:49.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.516+0000 7ff204dce640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2000a4c20 con 0x7ff200137650 2023-11-04T15:38:49.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.516+0000 7ff204dce640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff20013ad80 con 0x7ff2000a3e90 2023-11-04T15:38:49.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.516+0000 7ff204dce640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2000a3060 con 0x7ff200137270 2023-11-04T15:38:49.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.516+0000 7ff1fe59c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff200137270 0x7ff2000a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:38:49.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.516+0000 7ff1fed9d640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff200137650 0x7ff20013a670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57814/0 (socket says 172.21.15.19:57814) 2023-11-04T15:38:49.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.516+0000 7ff1fed9d640 1 -- 172.21.15.19:0/3296830990 learned_addr learned my addr 172.21.15.19:0/3296830990 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:38:49.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.516+0000 7ff1fe59c640 1 -- 172.21.15.19:0/3296830990 >> v1:172.21.15.96:6789/0 conn(0x7ff2000a3e90 legacy=0x7ff200139f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:38:49.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.516+0000 7ff1fe59c640 1 -- 172.21.15.19:0/3296830990 >> v1:172.21.15.19:6789/0 conn(0x7ff200137650 legacy=0x7ff20013a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:38:49.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.516+0000 7ff1fd59a640 1 -- 172.21.15.19:0/3296830990 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1039499910 0 0) 0x7ff2000a4c20 con 0x7ff200137650 2023-11-04T15:38:49.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.516+0000 7ff1fe59c640 1 -- 172.21.15.19:0/3296830990 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2000a5080 con 0x7ff200137270 2023-11-04T15:38:49.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.517+0000 7ff1fe59c640 1 --2- 172.21.15.19:0/3296830990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff200137270 0x7ff2000a6200 secure :-1 s=READY pgs=3781 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0009d90 tx=0x7ff1f002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=889fe77151aa1159 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:38:49.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.517+0000 7ff1fd59a640 1 -- 172.21.15.19:0/3296830990 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f002cbd0 con 0x7ff200137270 2023-11-04T15:38:49.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.517+0000 7ff1fd59a640 1 -- 172.21.15.19:0/3296830990 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f002cd30 con 0x7ff200137270 2023-11-04T15:38:49.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.517+0000 7ff1fd59a640 1 -- 172.21.15.19:0/3296830990 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f002cea0 con 0x7ff200137270 2023-11-04T15:38:49.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.518+0000 7ff204dce640 1 -- 172.21.15.19:0/3296830990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff200137270 msgr2=0x7ff2000a6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:38:49.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.518+0000 7ff204dce640 1 --2- 172.21.15.19:0/3296830990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff200137270 0x7ff2000a6200 secure :-1 s=READY pgs=3781 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0009d90 tx=0x7ff1f002be20 comp rx=0 tx=0).stop 2023-11-04T15:38:49.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.518+0000 7ff204dce640 1 -- 172.21.15.19:0/3296830990 shutdown_connections 2023-11-04T15:38:49.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.518+0000 7ff204dce640 1 --2- 172.21.15.19:0/3296830990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff200137270 0x7ff2000a6200 unknown :-1 s=CLOSED pgs=3781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:38:49.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.518+0000 7ff204dce640 1 -- 172.21.15.19:0/3296830990 >> 172.21.15.19:0/3296830990 conn(0x7ff2000a8d70 msgr2=0x7ff2000a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:38:49.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.518+0000 7ff204dce640 1 -- 172.21.15.19:0/3296830990 shutdown_connections 2023-11-04T15:38:49.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.518+0000 7ff204dce640 1 -- 172.21.15.19:0/3296830990 wait complete. 2023-11-04T15:38:49.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.519+0000 7ff204dce640 1 Processor -- start 2023-11-04T15:38:49.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.519+0000 7ff204dce640 1 -- start start 2023-11-04T15:38:49.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.520+0000 7ff204dce640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2000a3e90 0x7ff2001ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:38:49.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.520+0000 7ff204dce640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff200137270 0x7ff2001cf400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:38:49.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.520+0000 7ff204dce640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff200137650 0x7ff2001cf940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:38:49.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.520+0000 7ff204dce640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20009c3b0 con 0x7ff200137650 2023-11-04T15:38:49.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.520+0000 7ff204dce640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20009d980 con 0x7ff2000a3e90 2023-11-04T15:38:49.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.520+0000 7ff204dce640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20009aaf0 con 0x7ff200137270 2023-11-04T15:38:49.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.520+0000 7ff1fed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff200137650 0x7ff2001cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:38:49.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.520+0000 7ff1fed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff200137650 0x7ff2001cf940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34522/0 (socket says 172.21.15.19:34522) 2023-11-04T15:38:49.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.520+0000 7ff1fed9d640 1 -- 172.21.15.19:0/1925621269 learned_addr learned my addr 172.21.15.19:0/1925621269 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:38:49.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.520+0000 7ff1fe59c640 1 --2- 172.21.15.19:0/1925621269 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2000a3e90 0x7ff2001ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:38:49.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.520+0000 7ff1fdd9b640 1 --2- 172.21.15.19:0/1925621269 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff200137270 0x7ff2001cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:38:49.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.520+0000 7ff1fed9d640 1 -- 172.21.15.19:0/1925621269 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff200137270 msgr2=0x7ff2001cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:38:49.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.520+0000 7ff1fed9d640 1 --2- 172.21.15.19:0/1925621269 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff200137270 0x7ff2001cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:38:49.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.520+0000 7ff1fed9d640 1 -- 172.21.15.19:0/1925621269 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2000a3e90 msgr2=0x7ff2001ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:38:49.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.520+0000 7ff1fed9d640 1 --2- 172.21.15.19:0/1925621269 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2000a3e90 0x7ff2001ceec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:38:49.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.520+0000 7ff1fed9d640 1 -- 172.21.15.19:0/1925621269 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f0009a70 con 0x7ff200137650 2023-11-04T15:38:49.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.520+0000 7ff1fdd9b640 1 --2- 172.21.15.19:0/1925621269 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff200137270 0x7ff2001cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:38:49.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.520+0000 7ff1fed9d640 1 --2- 172.21.15.19:0/1925621269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff200137650 0x7ff2001cf940 secure :-1 s=READY pgs=3782 cs=0 l=1 rev1=1 crypto rx=0x7ff1f8001eb0 tx=0x7ff1f800c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:38:49.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.520+0000 7ff1f6ffd640 1 -- 172.21.15.19:0/1925621269 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f80074e0 con 0x7ff200137650 2023-11-04T15:38:49.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.521+0000 7ff1f6ffd640 1 -- 172.21.15.19:0/1925621269 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f8007640 con 0x7ff200137650 2023-11-04T15:38:49.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.521+0000 7ff204dce640 1 -- 172.21.15.19:0/1925621269 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff20009c800 con 0x7ff200137650 2023-11-04T15:38:49.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.521+0000 7ff1f6ffd640 1 -- 172.21.15.19:0/1925621269 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f8004a00 con 0x7ff200137650 2023-11-04T15:38:49.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.521+0000 7ff204dce640 1 -- 172.21.15.19:0/1925621269 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff20009a810 con 0x7ff200137650 2023-11-04T15:38:49.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.522+0000 7ff204dce640 1 -- 172.21.15.19:0/1925621269 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff200067d60 con 0x7ff200137650 2023-11-04T15:38:49.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.522+0000 7ff1f6ffd640 1 -- 172.21.15.19:0/1925621269 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff1f8004b60 con 0x7ff200137650 2023-11-04T15:38:49.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.522+0000 7ff1f6ffd640 1 --2- 172.21.15.19:0/1925621269 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7ff1e006a430 0x7ff1e006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:38:49.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.523+0000 7ff1f6ffd640 1 -- 172.21.15.19:0/1925621269 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4434+0+0 (secure 0 0 0) 0x7ff1f80881e0 con 0x7ff200137650 2023-11-04T15:38:49.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.523+0000 7ff1fe59c640 1 --2- 172.21.15.19:0/1925621269 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7ff1e006a430 0x7ff1e006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:38:49.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.523+0000 7ff1fe59c640 1 --2- 172.21.15.19:0/1925621269 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7ff1e006a430 0x7ff1e006c8f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0036000 tx=0x7ff1f0030000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:38:49.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.527+0000 7ff1f6ffd640 1 -- 172.21.15.19:0/1925621269 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff1f8053cb0 con 0x7ff200137650 2023-11-04T15:38:49.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.703+0000 7ff204dce640 1 -- 172.21.15.19:0/1925621269 --> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff2000a5340 con 0x7ff1e006a430 2023-11-04T15:38:49.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.711+0000 7ff1f6ffd640 1 -- 172.21.15.19:0/1925621269 <== mgr.4114 v2:172.21.15.96:6816/83123 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281623 (secure 0 0 0) 0x7ff1f0043070 con 0x7ff1e006a430 2023-11-04T15:38:49.716 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:38:49.717 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-11-04T15:38:49.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.714+0000 7ff204dce640 1 -- 172.21.15.19:0/1925621269 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7ff1e006a430 msgr2=0x7ff1e006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:38:49.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.714+0000 7ff204dce640 1 --2- 172.21.15.19:0/1925621269 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7ff1e006a430 0x7ff1e006c8f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0036000 tx=0x7ff1f0030000 comp rx=0 tx=0).stop 2023-11-04T15:38:49.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.714+0000 7ff204dce640 1 -- 172.21.15.19:0/1925621269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff200137650 msgr2=0x7ff2001cf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:38:49.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.714+0000 7ff204dce640 1 --2- 172.21.15.19:0/1925621269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff200137650 0x7ff2001cf940 secure :-1 s=READY pgs=3782 cs=0 l=1 rev1=1 crypto rx=0x7ff1f8001eb0 tx=0x7ff1f800c870 comp rx=0 tx=0).stop 2023-11-04T15:38:49.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.714+0000 7ff204dce640 1 -- 172.21.15.19:0/1925621269 shutdown_connections 2023-11-04T15:38:49.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.714+0000 7ff204dce640 1 --2- 172.21.15.19:0/1925621269 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7ff1e006a430 0x7ff1e006c8f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:38:49.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.714+0000 7ff204dce640 1 --2- 172.21.15.19:0/1925621269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff200137650 0x7ff2001cf940 unknown :-1 s=CLOSED pgs=3782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:38:49.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.714+0000 7ff204dce640 1 --2- 172.21.15.19:0/1925621269 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff200137270 0x7ff2001cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:38:49.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.714+0000 7ff204dce640 1 --2- 172.21.15.19:0/1925621269 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff2000a3e90 0x7ff2001ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:38:49.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.714+0000 7ff204dce640 1 -- 172.21.15.19:0/1925621269 >> 172.21.15.19:0/1925621269 conn(0x7ff2000a8d70 msgr2=0x7ff2000aa120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:38:49.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.714+0000 7ff204dce640 1 -- 172.21.15.19:0/1925621269 shutdown_connections 2023-11-04T15:38:49.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:38:49.714+0000 7ff204dce640 1 -- 172.21.15.19:0/1925621269 wait complete. 2023-11-04T15:38:49.727 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":383,"stamp":"2023-11-04T15:38:49.081740+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":431453382,"num_objects":220,"num_object_clones":25,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":8,"num_read":352,"num_read_kb":3468,"num_write":158437,"num_write_kb":940563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7850,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":307691,"ondisk_log_size":307691,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":3253552,"kb_used_data":844816,"kb_used_omap":0,"kb_used_meta":2408704,"kb_avail":374233808,"statfs":{"total":386547056640,"available":383215419392,"internally_reserved":0,"allocated":865091584,"data_stored":863631522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2466512896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003224"},"pg_stats":[{"pgid":"4.3f","version":"40'3514","reported_seq":2963,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:08.783192+0000","last_change":"2023-11-04T15:37:08.783192+0000","last_active":"2023-11-04T15:37:08.783192+0000","last_peered":"2023-11-04T15:37:08.783192+0000","last_clean":"2023-11-04T15:37:08.783192+0000","last_became_active":"2023-11-04T15:27:36.150296+0000","last_became_peered":"2023-11-04T15:27:36.150296+0000","last_unstale":"2023-11-04T15:37:08.783192+0000","last_undegraded":"2023-11-04T15:37:08.783192+0000","last_fullsized":"2023-11-04T15:37:08.783192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3514","last_scrub_stamp":"2023-11-04T15:37:08.783013+0000","last_deep_scrub":"40'3514","last_deep_scrub_stamp":"2023-11-04T15:37:08.783013+0000","last_clean_scrub_stamp":"2023-11-04T15:37:08.783013+0000","objects_scrubbed":0,"log_size":3514,"log_dups_size":0,"ondisk_log_size":3514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:20:34.659393+0000","scrub_duration":0.0030156520000000002,"objects_trimmed":0,"snaptrim_duration":0.074678280999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1112,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"44'3336","reported_seq":2800,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:27.770913+0000","last_change":"2023-11-04T15:38:27.771063+0000","last_active":"2023-11-04T15:38:27.770913+0000","last_peered":"2023-11-04T15:38:27.770913+0000","last_clean":"2023-11-04T15:38:27.770913+0000","last_became_active":"2023-11-04T15:27:36.148939+0000","last_became_peered":"2023-11-04T15:27:36.148939+0000","last_unstale":"2023-11-04T15:38:27.770913+0000","last_undegraded":"2023-11-04T15:38:27.770913+0000","last_fullsized":"2023-11-04T15:38:27.770913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3336","last_scrub_stamp":"2023-11-04T15:38:27.770889+0000","last_deep_scrub":"44'3336","last_deep_scrub_stamp":"2023-11-04T15:38:27.770889+0000","last_clean_scrub_stamp":"2023-11-04T15:38:27.770889+0000","objects_scrubbed":4,"log_size":3336,"log_dups_size":0,"ondisk_log_size":3336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:29:32.990012+0000","scrub_duration":0.013599927,"objects_trimmed":0,"snaptrim_duration":0.059113046000000002,"stat_sum":{"num_bytes":35,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1118,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"40'3527","reported_seq":3001,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.611673+0000","last_change":"2023-11-04T15:36:55.822917+0000","last_active":"2023-11-04T15:37:07.611673+0000","last_peered":"2023-11-04T15:37:07.611673+0000","last_clean":"2023-11-04T15:37:07.611673+0000","last_became_active":"2023-11-04T15:27:36.149748+0000","last_became_peered":"2023-11-04T15:27:36.149748+0000","last_unstale":"2023-11-04T15:37:07.611673+0000","last_undegraded":"2023-11-04T15:37:07.611673+0000","last_fullsized":"2023-11-04T15:37:07.611673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3527,"log_dups_size":0,"ondisk_log_size":3527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101592565,"stat_sum":{"num_bytes":8206,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":1149,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"40'3602","reported_seq":2996,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:13.718129+0000","last_change":"2023-11-04T15:38:13.718234+0000","last_active":"2023-11-04T15:38:13.718129+0000","last_peered":"2023-11-04T15:38:13.718129+0000","last_clean":"2023-11-04T15:38:13.718129+0000","last_became_active":"2023-11-04T15:27:36.139761+0000","last_became_peered":"2023-11-04T15:27:36.139761+0000","last_unstale":"2023-11-04T15:38:13.718129+0000","last_undegraded":"2023-11-04T15:38:13.718129+0000","last_fullsized":"2023-11-04T15:38:13.718129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3602","last_scrub_stamp":"2023-11-04T15:38:13.718107+0000","last_deep_scrub":"40'3602","last_deep_scrub_stamp":"2023-11-04T15:38:13.718107+0000","last_clean_scrub_stamp":"2023-11-04T15:38:13.718107+0000","objects_scrubbed":0,"log_size":3602,"log_dups_size":0,"ondisk_log_size":3602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:31.176388+0000","scrub_duration":0.0074235689999999997,"objects_trimmed":0,"snaptrim_duration":0.052924038,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1171,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"40'3725","reported_seq":3130,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:49.526048+0000","last_change":"2023-11-04T15:37:49.526154+0000","last_active":"2023-11-04T15:37:49.526048+0000","last_peered":"2023-11-04T15:37:49.526048+0000","last_clean":"2023-11-04T15:37:49.526048+0000","last_became_active":"2023-11-04T15:27:36.150017+0000","last_became_peered":"2023-11-04T15:27:36.150017+0000","last_unstale":"2023-11-04T15:37:49.526048+0000","last_undegraded":"2023-11-04T15:37:49.526048+0000","last_fullsized":"2023-11-04T15:37:49.526048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3725","last_scrub_stamp":"2023-11-04T15:37:49.526022+0000","last_deep_scrub":"40'3725","last_deep_scrub_stamp":"2023-11-04T15:37:49.526022+0000","last_clean_scrub_stamp":"2023-11-04T15:37:49.526022+0000","objects_scrubbed":0,"log_size":3725,"log_dups_size":0,"ondisk_log_size":3725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:46:35.934988+0000","scrub_duration":0.0051336519999999998,"objects_trimmed":0,"snaptrim_duration":0.073241305000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1192,"num_write_kb":641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"44'3328","reported_seq":2783,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:34.244312+0000","last_change":"2023-11-04T15:38:34.244401+0000","last_active":"2023-11-04T15:38:34.244312+0000","last_peered":"2023-11-04T15:38:34.244312+0000","last_clean":"2023-11-04T15:38:34.244312+0000","last_became_active":"2023-11-04T15:27:36.139036+0000","last_became_peered":"2023-11-04T15:27:36.139036+0000","last_unstale":"2023-11-04T15:38:34.244312+0000","last_undegraded":"2023-11-04T15:38:34.244312+0000","last_fullsized":"2023-11-04T15:38:34.244312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3328","last_scrub_stamp":"2023-11-04T15:38:34.244289+0000","last_deep_scrub":"44'3328","last_deep_scrub_stamp":"2023-11-04T15:38:34.244289+0000","last_clean_scrub_stamp":"2023-11-04T15:38:34.244289+0000","objects_scrubbed":1,"log_size":3328,"log_dups_size":0,"ondisk_log_size":3328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:39:09.364625+0000","scrub_duration":0.0082036850000000005,"objects_trimmed":0,"snaptrim_duration":0.102154117,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1074,"num_write_kb":603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"44'3356","reported_seq":2819,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:26.478185+0000","last_change":"2023-11-04T15:37:26.478185+0000","last_active":"2023-11-04T15:37:26.478185+0000","last_peered":"2023-11-04T15:37:26.478185+0000","last_clean":"2023-11-04T15:37:26.478185+0000","last_became_active":"2023-11-04T15:27:36.139121+0000","last_became_peered":"2023-11-04T15:27:36.139121+0000","last_unstale":"2023-11-04T15:37:26.478185+0000","last_undegraded":"2023-11-04T15:37:26.478185+0000","last_fullsized":"2023-11-04T15:37:26.478185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3356","last_scrub_stamp":"2023-11-04T15:37:26.478037+0000","last_deep_scrub":"44'3356","last_deep_scrub_stamp":"2023-11-04T15:37:26.478037+0000","last_clean_scrub_stamp":"2023-11-04T15:37:26.478037+0000","objects_scrubbed":5,"log_size":3356,"log_dups_size":0,"ondisk_log_size":3356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:38:01.386862+0000","scrub_duration":0.011615044999999999,"objects_trimmed":0,"snaptrim_duration":0.099827518000000004,"stat_sum":{"num_bytes":4117,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":2,"num_read_kb":1,"num_write":1086,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"40'3425","reported_seq":2844,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.611595+0000","last_change":"2023-11-04T15:36:55.816551+0000","last_active":"2023-11-04T15:37:07.611595+0000","last_peered":"2023-11-04T15:37:07.611595+0000","last_clean":"2023-11-04T15:37:07.611595+0000","last_became_active":"2023-11-04T15:27:36.147050+0000","last_became_peered":"2023-11-04T15:27:36.147050+0000","last_unstale":"2023-11-04T15:37:07.611595+0000","last_undegraded":"2023-11-04T15:37:07.611595+0000","last_fullsized":"2023-11-04T15:37:07.611595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3425,"log_dups_size":0,"ondisk_log_size":3425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.098810337999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"44'3562","reported_seq":2977,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:38.816297+0000","last_change":"2023-11-04T15:38:38.816421+0000","last_active":"2023-11-04T15:38:38.816297+0000","last_peered":"2023-11-04T15:38:38.816297+0000","last_clean":"2023-11-04T15:38:38.816297+0000","last_became_active":"2023-11-04T15:27:36.145825+0000","last_became_peered":"2023-11-04T15:27:36.145825+0000","last_unstale":"2023-11-04T15:38:38.816297+0000","last_undegraded":"2023-11-04T15:38:38.816297+0000","last_fullsized":"2023-11-04T15:38:38.816297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3562","last_scrub_stamp":"2023-11-04T15:38:38.816274+0000","last_deep_scrub":"44'3562","last_deep_scrub_stamp":"2023-11-04T15:38:38.816274+0000","last_clean_scrub_stamp":"2023-11-04T15:38:38.816274+0000","objects_scrubbed":1,"log_size":3562,"log_dups_size":0,"ondisk_log_size":3562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:39:40.398994+0000","scrub_duration":0.0076341400000000002,"objects_trimmed":0,"snaptrim_duration":0.072094483000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"44'3329","reported_seq":2857,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:55.514489+0000","last_change":"2023-11-04T15:37:55.514590+0000","last_active":"2023-11-04T15:37:55.514489+0000","last_peered":"2023-11-04T15:37:55.514489+0000","last_clean":"2023-11-04T15:37:55.514489+0000","last_became_active":"2023-11-04T15:27:36.150307+0000","last_became_peered":"2023-11-04T15:27:36.150307+0000","last_unstale":"2023-11-04T15:37:55.514489+0000","last_undegraded":"2023-11-04T15:37:55.514489+0000","last_fullsized":"2023-11-04T15:37:55.514489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3329","last_scrub_stamp":"2023-11-04T15:37:55.514464+0000","last_deep_scrub":"44'3329","last_deep_scrub_stamp":"2023-11-04T15:37:55.514464+0000","last_clean_scrub_stamp":"2023-11-04T15:37:55.514464+0000","objects_scrubbed":2,"log_size":3329,"log_dups_size":0,"ondisk_log_size":3329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:11:45.335660+0000","scrub_duration":0.011217928,"objects_trimmed":0,"snaptrim_duration":0.10012518099999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1064,"num_write_kb":572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"40'3202","reported_seq":2732,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:12.694264+0000","last_change":"2023-11-04T15:38:12.694422+0000","last_active":"2023-11-04T15:38:12.694264+0000","last_peered":"2023-11-04T15:38:12.694264+0000","last_clean":"2023-11-04T15:38:12.694264+0000","last_became_active":"2023-11-04T15:27:36.144988+0000","last_became_peered":"2023-11-04T15:27:36.144988+0000","last_unstale":"2023-11-04T15:38:12.694264+0000","last_undegraded":"2023-11-04T15:38:12.694264+0000","last_fullsized":"2023-11-04T15:38:12.694264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3202","last_scrub_stamp":"2023-11-04T15:38:12.694227+0000","last_deep_scrub":"40'3202","last_deep_scrub_stamp":"2023-11-04T15:38:12.694227+0000","last_clean_scrub_stamp":"2023-11-04T15:38:12.694227+0000","objects_scrubbed":0,"log_size":3202,"log_dups_size":0,"ondisk_log_size":3202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:44:10.147349+0000","scrub_duration":0.0048418030000000004,"objects_trimmed":0,"snaptrim_duration":0.052379294999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1028,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"44'3395","reported_seq":2835,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:21.176452+0000","last_change":"2023-11-04T15:38:21.176557+0000","last_active":"2023-11-04T15:38:21.176452+0000","last_peered":"2023-11-04T15:38:21.176452+0000","last_clean":"2023-11-04T15:38:21.176452+0000","last_became_active":"2023-11-04T15:27:36.149156+0000","last_became_peered":"2023-11-04T15:27:36.149156+0000","last_unstale":"2023-11-04T15:38:21.176452+0000","last_undegraded":"2023-11-04T15:38:21.176452+0000","last_fullsized":"2023-11-04T15:38:21.176452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3395","last_scrub_stamp":"2023-11-04T15:38:21.176427+0000","last_deep_scrub":"44'3395","last_deep_scrub_stamp":"2023-11-04T15:38:21.176427+0000","last_clean_scrub_stamp":"2023-11-04T15:38:21.176427+0000","objects_scrubbed":1,"log_size":3395,"log_dups_size":0,"ondisk_log_size":3395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:29:26.395550+0000","scrub_duration":0.011035761999999999,"objects_trimmed":0,"snaptrim_duration":0.064372897999999998,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1159,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"40'3255","reported_seq":2755,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:24.864365+0000","last_change":"2023-11-04T15:38:24.864474+0000","last_active":"2023-11-04T15:38:24.864365+0000","last_peered":"2023-11-04T15:38:24.864365+0000","last_clean":"2023-11-04T15:38:24.864365+0000","last_became_active":"2023-11-04T15:27:36.139824+0000","last_became_peered":"2023-11-04T15:27:36.139824+0000","last_unstale":"2023-11-04T15:38:24.864365+0000","last_undegraded":"2023-11-04T15:38:24.864365+0000","last_fullsized":"2023-11-04T15:38:24.864365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3255","last_scrub_stamp":"2023-11-04T15:38:24.864341+0000","last_deep_scrub":"40'3255","last_deep_scrub_stamp":"2023-11-04T15:38:24.864341+0000","last_clean_scrub_stamp":"2023-11-04T15:38:24.864341+0000","objects_scrubbed":0,"log_size":3255,"log_dups_size":0,"ondisk_log_size":3255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:32:57.678216+0000","scrub_duration":0.0057894940000000001,"objects_trimmed":0,"snaptrim_duration":0.070068697999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1062,"num_write_kb":575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"44'3539","reported_seq":2930,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:24.652046+0000","last_change":"2023-11-04T15:38:24.652151+0000","last_active":"2023-11-04T15:38:24.652046+0000","last_peered":"2023-11-04T15:38:24.652046+0000","last_clean":"2023-11-04T15:38:24.652046+0000","last_became_active":"2023-11-04T15:27:36.147273+0000","last_became_peered":"2023-11-04T15:27:36.147273+0000","last_unstale":"2023-11-04T15:38:24.652046+0000","last_undegraded":"2023-11-04T15:38:24.652046+0000","last_fullsized":"2023-11-04T15:38:24.652046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3539","last_scrub_stamp":"2023-11-04T15:38:24.652022+0000","last_deep_scrub":"44'3539","last_deep_scrub_stamp":"2023-11-04T15:38:24.652022+0000","last_clean_scrub_stamp":"2023-11-04T15:38:24.652022+0000","objects_scrubbed":1,"log_size":3539,"log_dups_size":0,"ondisk_log_size":3539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:16:59.050291+0000","scrub_duration":0.0093328639999999997,"objects_trimmed":0,"snaptrim_duration":0.055716603000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"40'3766","reported_seq":3170,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:15.722839+0000","last_change":"2023-11-04T15:38:15.722956+0000","last_active":"2023-11-04T15:38:15.722839+0000","last_peered":"2023-11-04T15:38:15.722839+0000","last_clean":"2023-11-04T15:38:15.722839+0000","last_became_active":"2023-11-04T15:27:36.148932+0000","last_became_peered":"2023-11-04T15:27:36.148932+0000","last_unstale":"2023-11-04T15:38:15.722839+0000","last_undegraded":"2023-11-04T15:38:15.722839+0000","last_fullsized":"2023-11-04T15:38:15.722839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3766","last_scrub_stamp":"2023-11-04T15:38:15.722815+0000","last_deep_scrub":"40'3766","last_deep_scrub_stamp":"2023-11-04T15:38:15.722815+0000","last_clean_scrub_stamp":"2023-11-04T15:38:15.722815+0000","objects_scrubbed":0,"log_size":3766,"log_dups_size":0,"ondisk_log_size":3766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:03:16.395834+0000","scrub_duration":0.0047167329999999999,"objects_trimmed":0,"snaptrim_duration":0.062648212999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1209,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"40'3538","reported_seq":2946,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.718524+0000","last_change":"2023-11-04T15:36:55.818096+0000","last_active":"2023-11-04T15:37:04.718524+0000","last_peered":"2023-11-04T15:37:04.718524+0000","last_clean":"2023-11-04T15:37:04.718524+0000","last_became_active":"2023-11-04T15:27:36.150856+0000","last_became_peered":"2023-11-04T15:27:36.150856+0000","last_unstale":"2023-11-04T15:37:04.718524+0000","last_undegraded":"2023-11-04T15:37:04.718524+0000","last_fullsized":"2023-11-04T15:37:04.718524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3538,"log_dups_size":0,"ondisk_log_size":3538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.099772735000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"40'3671","reported_seq":3011,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:33.881828+0000","last_change":"2023-11-04T15:38:33.881938+0000","last_active":"2023-11-04T15:38:33.881828+0000","last_peered":"2023-11-04T15:38:33.881828+0000","last_clean":"2023-11-04T15:38:33.881828+0000","last_became_active":"2023-11-04T15:27:36.144997+0000","last_became_peered":"2023-11-04T15:27:36.144997+0000","last_unstale":"2023-11-04T15:38:33.881828+0000","last_undegraded":"2023-11-04T15:38:33.881828+0000","last_fullsized":"2023-11-04T15:38:33.881828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3671","last_scrub_stamp":"2023-11-04T15:38:33.881801+0000","last_deep_scrub":"40'3671","last_deep_scrub_stamp":"2023-11-04T15:38:33.881801+0000","last_clean_scrub_stamp":"2023-11-04T15:38:33.881801+0000","objects_scrubbed":0,"log_size":3671,"log_dups_size":0,"ondisk_log_size":3671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:06:16.633743+0000","scrub_duration":0.0051090789999999999,"objects_trimmed":0,"snaptrim_duration":0.072563297999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1270,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"44'3139","reported_seq":2656,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:43.481415+0000","last_change":"2023-11-04T15:37:43.481511+0000","last_active":"2023-11-04T15:37:43.481415+0000","last_peered":"2023-11-04T15:37:43.481415+0000","last_clean":"2023-11-04T15:37:43.481415+0000","last_became_active":"2023-11-04T15:27:36.150555+0000","last_became_peered":"2023-11-04T15:27:36.150555+0000","last_unstale":"2023-11-04T15:37:43.481415+0000","last_undegraded":"2023-11-04T15:37:43.481415+0000","last_fullsized":"2023-11-04T15:37:43.481415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3139","last_scrub_stamp":"2023-11-04T15:37:43.481392+0000","last_deep_scrub":"44'3139","last_deep_scrub_stamp":"2023-11-04T15:37:43.481392+0000","last_clean_scrub_stamp":"2023-11-04T15:37:43.481392+0000","objects_scrubbed":2,"log_size":3139,"log_dups_size":0,"ondisk_log_size":3139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:46:29.890357+0000","scrub_duration":0.010710094,"objects_trimmed":0,"snaptrim_duration":0.101696772,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1042,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"44'3392","reported_seq":2826,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:20.801183+0000","last_change":"2023-11-04T15:38:20.801299+0000","last_active":"2023-11-04T15:38:20.801183+0000","last_peered":"2023-11-04T15:38:20.801183+0000","last_clean":"2023-11-04T15:38:20.801183+0000","last_became_active":"2023-11-04T15:27:36.147745+0000","last_became_peered":"2023-11-04T15:27:36.147745+0000","last_unstale":"2023-11-04T15:38:20.801183+0000","last_undegraded":"2023-11-04T15:38:20.801183+0000","last_fullsized":"2023-11-04T15:38:20.801183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3392","last_scrub_stamp":"2023-11-04T15:38:20.801150+0000","last_deep_scrub":"44'3392","last_deep_scrub_stamp":"2023-11-04T15:38:20.801150+0000","last_clean_scrub_stamp":"2023-11-04T15:38:20.801150+0000","objects_scrubbed":2,"log_size":3392,"log_dups_size":0,"ondisk_log_size":3392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:16:55.199419+0000","scrub_duration":0.0083994859999999994,"objects_trimmed":0,"snaptrim_duration":0.071588252000000005,"stat_sum":{"num_bytes":4128,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1173,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"44'3507","reported_seq":2929,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:47.451001+0000","last_change":"2023-11-04T15:37:47.451113+0000","last_active":"2023-11-04T15:37:47.451001+0000","last_peered":"2023-11-04T15:37:47.451001+0000","last_clean":"2023-11-04T15:37:47.451001+0000","last_became_active":"2023-11-04T15:27:36.150687+0000","last_became_peered":"2023-11-04T15:27:36.150687+0000","last_unstale":"2023-11-04T15:37:47.451001+0000","last_undegraded":"2023-11-04T15:37:47.451001+0000","last_fullsized":"2023-11-04T15:37:47.451001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3507","last_scrub_stamp":"2023-11-04T15:37:47.450975+0000","last_deep_scrub":"44'3507","last_deep_scrub_stamp":"2023-11-04T15:37:47.450975+0000","last_clean_scrub_stamp":"2023-11-04T15:37:47.450975+0000","objects_scrubbed":2,"log_size":3507,"log_dups_size":0,"ondisk_log_size":3507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:21:13.505376+0000","scrub_duration":0.0096580350000000006,"objects_trimmed":0,"snaptrim_duration":0.097896176000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1154,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"44'3547","reported_seq":2996,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:18.707502+0000","last_change":"2023-11-04T15:38:18.707619+0000","last_active":"2023-11-04T15:38:18.707502+0000","last_peered":"2023-11-04T15:38:18.707502+0000","last_clean":"2023-11-04T15:38:18.707502+0000","last_became_active":"2023-11-04T15:27:36.143551+0000","last_became_peered":"2023-11-04T15:27:36.143551+0000","last_unstale":"2023-11-04T15:38:18.707502+0000","last_undegraded":"2023-11-04T15:38:18.707502+0000","last_fullsized":"2023-11-04T15:38:18.707502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3547","last_scrub_stamp":"2023-11-04T15:38:18.707479+0000","last_deep_scrub":"44'3547","last_deep_scrub_stamp":"2023-11-04T15:38:18.707479+0000","last_clean_scrub_stamp":"2023-11-04T15:38:18.707479+0000","objects_scrubbed":3,"log_size":3547,"log_dups_size":0,"ondisk_log_size":3547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:16:47.482996+0000","scrub_duration":0.01049517,"objects_trimmed":0,"snaptrim_duration":0.056037475000000003,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1178,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"44'3730","reported_seq":3099,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:14.873759+0000","last_change":"2023-11-04T15:38:14.873894+0000","last_active":"2023-11-04T15:38:14.873759+0000","last_peered":"2023-11-04T15:38:14.873759+0000","last_clean":"2023-11-04T15:38:14.873759+0000","last_became_active":"2023-11-04T15:27:36.145943+0000","last_became_peered":"2023-11-04T15:27:36.145943+0000","last_unstale":"2023-11-04T15:38:14.873759+0000","last_undegraded":"2023-11-04T15:38:14.873759+0000","last_fullsized":"2023-11-04T15:38:14.873759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3730","last_scrub_stamp":"2023-11-04T15:38:14.873735+0000","last_deep_scrub":"44'3730","last_deep_scrub_stamp":"2023-11-04T15:38:14.873735+0000","last_clean_scrub_stamp":"2023-11-04T15:38:14.873735+0000","objects_scrubbed":2,"log_size":3730,"log_dups_size":0,"ondisk_log_size":3730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:16:43.649252+0000","scrub_duration":0.011526497,"objects_trimmed":0,"snaptrim_duration":0.071549077000000003,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1242,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"40'3454","reported_seq":2901,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:22.189149+0000","last_change":"2023-11-04T15:38:22.189283+0000","last_active":"2023-11-04T15:38:22.189149+0000","last_peered":"2023-11-04T15:38:22.189149+0000","last_clean":"2023-11-04T15:38:22.189149+0000","last_became_active":"2023-11-04T15:27:36.144083+0000","last_became_peered":"2023-11-04T15:27:36.144083+0000","last_unstale":"2023-11-04T15:38:22.189149+0000","last_undegraded":"2023-11-04T15:38:22.189149+0000","last_fullsized":"2023-11-04T15:38:22.189149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3454","last_scrub_stamp":"2023-11-04T15:38:22.189124+0000","last_deep_scrub":"40'3454","last_deep_scrub_stamp":"2023-11-04T15:38:22.189124+0000","last_clean_scrub_stamp":"2023-11-04T15:38:22.189124+0000","objects_scrubbed":0,"log_size":3454,"log_dups_size":0,"ondisk_log_size":3454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:32:55.002998+0000","scrub_duration":0.0043707939999999999,"objects_trimmed":0,"snaptrim_duration":0.060959410999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1127,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"40'3632","reported_seq":2993,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.611510+0000","last_change":"2023-11-04T15:36:55.821483+0000","last_active":"2023-11-04T15:37:07.611510+0000","last_peered":"2023-11-04T15:37:07.611510+0000","last_clean":"2023-11-04T15:37:07.611510+0000","last_became_active":"2023-11-04T15:27:36.146546+0000","last_became_peered":"2023-11-04T15:27:36.146546+0000","last_unstale":"2023-11-04T15:37:07.611510+0000","last_undegraded":"2023-11-04T15:37:07.611510+0000","last_fullsized":"2023-11-04T15:37:07.611510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3632,"log_dups_size":0,"ondisk_log_size":3632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.102597439,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1222,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"44'3167","reported_seq":2642,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:18.169777+0000","last_change":"2023-11-04T15:38:18.169777+0000","last_active":"2023-11-04T15:38:18.169777+0000","last_peered":"2023-11-04T15:38:18.169777+0000","last_clean":"2023-11-04T15:38:18.169777+0000","last_became_active":"2023-11-04T15:27:36.144047+0000","last_became_peered":"2023-11-04T15:27:36.144047+0000","last_unstale":"2023-11-04T15:38:18.169777+0000","last_undegraded":"2023-11-04T15:38:18.169777+0000","last_fullsized":"2023-11-04T15:38:18.169777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3167","last_scrub_stamp":"2023-11-04T15:38:18.169609+0000","last_deep_scrub":"44'3167","last_deep_scrub_stamp":"2023-11-04T15:38:18.169609+0000","last_clean_scrub_stamp":"2023-11-04T15:38:18.169609+0000","objects_scrubbed":1,"log_size":3167,"log_dups_size":0,"ondisk_log_size":3167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:16:52.567878+0000","scrub_duration":0.0076393160000000002,"objects_trimmed":0,"snaptrim_duration":0.064725415999999994,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1115,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"44'3494","reported_seq":2907,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:27.132214+0000","last_change":"2023-11-04T15:38:27.132214+0000","last_active":"2023-11-04T15:38:27.132214+0000","last_peered":"2023-11-04T15:38:27.132214+0000","last_clean":"2023-11-04T15:38:27.132214+0000","last_became_active":"2023-11-04T15:27:36.144458+0000","last_became_peered":"2023-11-04T15:27:36.144458+0000","last_unstale":"2023-11-04T15:38:27.132214+0000","last_undegraded":"2023-11-04T15:38:27.132214+0000","last_fullsized":"2023-11-04T15:38:27.132214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3494","last_scrub_stamp":"2023-11-04T15:38:27.132005+0000","last_deep_scrub":"44'3494","last_deep_scrub_stamp":"2023-11-04T15:38:27.132005+0000","last_clean_scrub_stamp":"2023-11-04T15:38:27.132005+0000","objects_scrubbed":1,"log_size":3494,"log_dups_size":0,"ondisk_log_size":3494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:54:38.317360+0000","scrub_duration":0.0090200420000000007,"objects_trimmed":0,"snaptrim_duration":0.066118209999999997,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"44'3387","reported_seq":2839,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:38.465038+0000","last_change":"2023-11-04T15:37:38.465038+0000","last_active":"2023-11-04T15:37:38.465038+0000","last_peered":"2023-11-04T15:37:38.465038+0000","last_clean":"2023-11-04T15:37:38.465038+0000","last_became_active":"2023-11-04T15:27:36.150270+0000","last_became_peered":"2023-11-04T15:27:36.150270+0000","last_unstale":"2023-11-04T15:37:38.465038+0000","last_undegraded":"2023-11-04T15:37:38.465038+0000","last_fullsized":"2023-11-04T15:37:38.465038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3387","last_scrub_stamp":"2023-11-04T15:37:38.464840+0000","last_deep_scrub":"44'3387","last_deep_scrub_stamp":"2023-11-04T15:37:38.464840+0000","last_clean_scrub_stamp":"2023-11-04T15:37:38.464840+0000","objects_scrubbed":1,"log_size":3387,"log_dups_size":0,"ondisk_log_size":3387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:40:18.070984+0000","scrub_duration":0.0081071519999999994,"objects_trimmed":0,"snaptrim_duration":0.104674168,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"44'3290","reported_seq":2733,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:40.874421+0000","last_change":"2023-11-04T15:38:40.874529+0000","last_active":"2023-11-04T15:38:40.874421+0000","last_peered":"2023-11-04T15:38:40.874421+0000","last_clean":"2023-11-04T15:38:40.874421+0000","last_became_active":"2023-11-04T15:28:20.871378+0000","last_became_peered":"2023-11-04T15:28:20.871378+0000","last_unstale":"2023-11-04T15:38:40.874421+0000","last_undegraded":"2023-11-04T15:38:40.874421+0000","last_fullsized":"2023-11-04T15:38:40.874421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3290","last_scrub_stamp":"2023-11-04T15:38:40.874398+0000","last_deep_scrub":"44'3290","last_deep_scrub_stamp":"2023-11-04T15:38:40.874398+0000","last_clean_scrub_stamp":"2023-11-04T15:38:40.874398+0000","objects_scrubbed":4,"log_size":3290,"log_dups_size":0,"ondisk_log_size":3290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:39:15.994733+0000","scrub_duration":0.011484166000000001,"objects_trimmed":0,"snaptrim_duration":0.074381663000000001,"stat_sum":{"num_bytes":9,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1152,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"44'3581","reported_seq":3023,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:43.871394+0000","last_change":"2023-11-04T15:38:43.871487+0000","last_active":"2023-11-04T15:38:43.871394+0000","last_peered":"2023-11-04T15:38:43.871394+0000","last_clean":"2023-11-04T15:38:43.871394+0000","last_became_active":"2023-11-04T15:27:36.145392+0000","last_became_peered":"2023-11-04T15:27:36.145392+0000","last_unstale":"2023-11-04T15:38:43.871394+0000","last_undegraded":"2023-11-04T15:38:43.871394+0000","last_fullsized":"2023-11-04T15:38:43.871394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3581","last_scrub_stamp":"2023-11-04T15:38:43.871369+0000","last_deep_scrub":"44'3581","last_deep_scrub_stamp":"2023-11-04T15:38:43.871369+0000","last_clean_scrub_stamp":"2023-11-04T15:38:43.871369+0000","objects_scrubbed":3,"log_size":3581,"log_dups_size":0,"ondisk_log_size":3581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T22:11:12.866904+0000","scrub_duration":0.012712273,"objects_trimmed":0,"snaptrim_duration":0.070714202000000004,"stat_sum":{"num_bytes":12288,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1167,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"40'3386","reported_seq":2874,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:10.551561+0000","last_change":"2023-11-04T15:37:10.551561+0000","last_active":"2023-11-04T15:37:10.551561+0000","last_peered":"2023-11-04T15:37:10.551561+0000","last_clean":"2023-11-04T15:37:10.551561+0000","last_became_active":"2023-11-04T15:27:36.145273+0000","last_became_peered":"2023-11-04T15:27:36.145273+0000","last_unstale":"2023-11-04T15:37:10.551561+0000","last_undegraded":"2023-11-04T15:37:10.551561+0000","last_fullsized":"2023-11-04T15:37:10.551561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3386","last_scrub_stamp":"2023-11-04T15:37:10.551443+0000","last_deep_scrub":"40'3386","last_deep_scrub_stamp":"2023-11-04T15:37:10.551443+0000","last_clean_scrub_stamp":"2023-11-04T15:37:10.551443+0000","objects_scrubbed":0,"log_size":3386,"log_dups_size":0,"ondisk_log_size":3386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:21:56.476755+0000","scrub_duration":0.005704687,"objects_trimmed":0,"snaptrim_duration":0.101784969,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1155,"num_write_kb":603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"40'3889","reported_seq":3226,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:09.188765+0000","last_change":"2023-11-04T15:38:09.188849+0000","last_active":"2023-11-04T15:38:09.188765+0000","last_peered":"2023-11-04T15:38:09.188765+0000","last_clean":"2023-11-04T15:38:09.188765+0000","last_became_active":"2023-11-04T15:27:36.144053+0000","last_became_peered":"2023-11-04T15:27:36.144053+0000","last_unstale":"2023-11-04T15:38:09.188765+0000","last_undegraded":"2023-11-04T15:38:09.188765+0000","last_fullsized":"2023-11-04T15:38:09.188765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3889","last_scrub_stamp":"2023-11-04T15:38:09.188744+0000","last_deep_scrub":"40'3889","last_deep_scrub_stamp":"2023-11-04T15:38:09.188744+0000","last_clean_scrub_stamp":"2023-11-04T15:38:09.188744+0000","objects_scrubbed":0,"log_size":3889,"log_dups_size":0,"ondisk_log_size":3889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:03:09.861762+0000","scrub_duration":0.0044858370000000003,"objects_trimmed":0,"snaptrim_duration":0.061944979999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1328,"num_write_kb":706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"40'3720","reported_seq":3117,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:06.685722+0000","last_change":"2023-11-04T15:38:06.685839+0000","last_active":"2023-11-04T15:38:06.685722+0000","last_peered":"2023-11-04T15:38:06.685722+0000","last_clean":"2023-11-04T15:38:06.685722+0000","last_became_active":"2023-11-04T15:27:36.148342+0000","last_became_peered":"2023-11-04T15:27:36.148342+0000","last_unstale":"2023-11-04T15:38:06.685722+0000","last_undegraded":"2023-11-04T15:38:06.685722+0000","last_fullsized":"2023-11-04T15:38:06.685722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3720","last_scrub_stamp":"2023-11-04T15:38:06.685700+0000","last_deep_scrub":"40'3720","last_deep_scrub_stamp":"2023-11-04T15:38:06.685700+0000","last_clean_scrub_stamp":"2023-11-04T15:38:06.685700+0000","objects_scrubbed":0,"log_size":3720,"log_dups_size":0,"ondisk_log_size":3720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:11:56.506896+0000","scrub_duration":0.0061541349999999998,"objects_trimmed":0,"snaptrim_duration":0.056486557999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"44'3426","reported_seq":2839,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:12.141768+0000","last_change":"2023-11-04T15:38:12.141869+0000","last_active":"2023-11-04T15:38:12.141768+0000","last_peered":"2023-11-04T15:38:12.141768+0000","last_clean":"2023-11-04T15:38:12.141768+0000","last_became_active":"2023-11-04T15:27:36.148951+0000","last_became_peered":"2023-11-04T15:27:36.148951+0000","last_unstale":"2023-11-04T15:38:12.141768+0000","last_undegraded":"2023-11-04T15:38:12.141768+0000","last_fullsized":"2023-11-04T15:38:12.141768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3426","last_scrub_stamp":"2023-11-04T15:38:12.141744+0000","last_deep_scrub":"44'3426","last_deep_scrub_stamp":"2023-11-04T15:38:12.141744+0000","last_clean_scrub_stamp":"2023-11-04T15:38:12.141744+0000","objects_scrubbed":2,"log_size":3426,"log_dups_size":0,"ondisk_log_size":3426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:16:40.917261+0000","scrub_duration":0.011982881000000001,"objects_trimmed":0,"snaptrim_duration":0.066218149000000004,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1176,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"44'2988","reported_seq":3040,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:52.513259+0000","last_change":"2023-11-04T15:37:52.513356+0000","last_active":"2023-11-04T15:37:52.513259+0000","last_peered":"2023-11-04T15:37:52.513259+0000","last_clean":"2023-11-04T15:37:52.513259+0000","last_became_active":"2023-11-04T15:27:35.775616+0000","last_became_peered":"2023-11-04T15:27:35.775616+0000","last_unstale":"2023-11-04T15:37:52.513259+0000","last_undegraded":"2023-11-04T15:37:52.513259+0000","last_fullsized":"2023-11-04T15:37:52.513259+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2988","last_scrub_stamp":"2023-11-04T15:37:52.513236+0000","last_deep_scrub":"44'2988","last_deep_scrub_stamp":"2023-11-04T15:37:52.513236+0000","last_clean_scrub_stamp":"2023-11-04T15:37:52.513236+0000","objects_scrubbed":4,"log_size":2988,"log_dups_size":0,"ondisk_log_size":2988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:52:02.610178+0000","scrub_duration":0.028368865,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2984,"num_write_kb":24202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"44'3309","reported_seq":2739,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:43.389469+0000","last_change":"2023-11-04T15:38:43.389597+0000","last_active":"2023-11-04T15:38:43.389469+0000","last_peered":"2023-11-04T15:38:43.389469+0000","last_clean":"2023-11-04T15:38:43.389469+0000","last_became_active":"2023-11-04T15:27:36.150276+0000","last_became_peered":"2023-11-04T15:27:36.150276+0000","last_unstale":"2023-11-04T15:38:43.389469+0000","last_undegraded":"2023-11-04T15:38:43.389469+0000","last_fullsized":"2023-11-04T15:38:43.389469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3309","last_scrub_stamp":"2023-11-04T15:38:43.389445+0000","last_deep_scrub":"44'3309","last_deep_scrub_stamp":"2023-11-04T15:38:43.389445+0000","last_clean_scrub_stamp":"2023-11-04T15:38:43.389445+0000","objects_scrubbed":1,"log_size":3309,"log_dups_size":0,"ondisk_log_size":3309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:57:45.575550+0000","scrub_duration":0.0084261809999999996,"objects_trimmed":0,"snaptrim_duration":0.101095329,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1177,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"44'464","reported_seq":516,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:01.615465+0000","last_change":"2023-11-04T15:38:01.615577+0000","last_active":"2023-11-04T15:38:01.615465+0000","last_peered":"2023-11-04T15:38:01.615465+0000","last_clean":"2023-11-04T15:38:01.615465+0000","last_became_active":"2023-11-04T15:27:35.776297+0000","last_became_peered":"2023-11-04T15:27:35.776297+0000","last_unstale":"2023-11-04T15:38:01.615465+0000","last_undegraded":"2023-11-04T15:38:01.615465+0000","last_fullsized":"2023-11-04T15:38:01.615465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'464","last_scrub_stamp":"2023-11-04T15:38:01.615441+0000","last_deep_scrub":"44'464","last_deep_scrub_stamp":"2023-11-04T15:38:01.615441+0000","last_clean_scrub_stamp":"2023-11-04T15:38:01.615441+0000","objects_scrubbed":2,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:11:51.436637+0000","scrub_duration":0.021155086,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":462,"num_write_kb":12396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"44'3489","reported_seq":2923,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:22.680227+0000","last_change":"2023-11-04T15:37:22.680321+0000","last_active":"2023-11-04T15:37:22.680227+0000","last_peered":"2023-11-04T15:37:22.680227+0000","last_clean":"2023-11-04T15:37:22.680227+0000","last_became_active":"2023-11-04T15:27:36.139580+0000","last_became_peered":"2023-11-04T15:27:36.139580+0000","last_unstale":"2023-11-04T15:37:22.680227+0000","last_undegraded":"2023-11-04T15:37:22.680227+0000","last_fullsized":"2023-11-04T15:37:22.680227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3489","last_scrub_stamp":"2023-11-04T15:37:22.680205+0000","last_deep_scrub":"44'3489","last_deep_scrub_stamp":"2023-11-04T15:37:22.680205+0000","last_clean_scrub_stamp":"2023-11-04T15:37:22.680205+0000","objects_scrubbed":4,"log_size":3489,"log_dups_size":0,"ondisk_log_size":3489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:18:28.360934+0000","scrub_duration":0.013912934,"objects_trimmed":0,"snaptrim_duration":0.074768939000000006,"stat_sum":{"num_bytes":8192,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1207,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"44'721","reported_seq":773,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:46.471555+0000","last_change":"2023-11-04T15:37:46.471682+0000","last_active":"2023-11-04T15:37:46.471555+0000","last_peered":"2023-11-04T15:37:46.471555+0000","last_clean":"2023-11-04T15:37:46.471555+0000","last_became_active":"2023-11-04T15:27:35.775486+0000","last_became_peered":"2023-11-04T15:27:35.775486+0000","last_unstale":"2023-11-04T15:37:46.471555+0000","last_undegraded":"2023-11-04T15:37:46.471555+0000","last_fullsized":"2023-11-04T15:37:46.471555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'721","last_scrub_stamp":"2023-11-04T15:37:46.471516+0000","last_deep_scrub":"44'721","last_deep_scrub_stamp":"2023-11-04T15:37:46.471516+0000","last_clean_scrub_stamp":"2023-11-04T15:37:46.471516+0000","objects_scrubbed":4,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:43.323066+0000","scrub_duration":0.043075086999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":707,"num_write_kb":16815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"44'3444","reported_seq":2888,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:23.861171+0000","last_change":"2023-11-04T15:38:23.861287+0000","last_active":"2023-11-04T15:38:23.861171+0000","last_peered":"2023-11-04T15:38:23.861171+0000","last_clean":"2023-11-04T15:38:23.861171+0000","last_became_active":"2023-11-04T15:27:36.139789+0000","last_became_peered":"2023-11-04T15:27:36.139789+0000","last_unstale":"2023-11-04T15:38:23.861171+0000","last_undegraded":"2023-11-04T15:38:23.861171+0000","last_fullsized":"2023-11-04T15:38:23.861171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3444","last_scrub_stamp":"2023-11-04T15:38:23.861140+0000","last_deep_scrub":"44'3444","last_deep_scrub_stamp":"2023-11-04T15:38:23.861140+0000","last_clean_scrub_stamp":"2023-11-04T15:38:23.861140+0000","objects_scrubbed":1,"log_size":3444,"log_dups_size":0,"ondisk_log_size":3444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:29:29.080263+0000","scrub_duration":0.0081163280000000008,"objects_trimmed":0,"snaptrim_duration":0.073936136,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"44'1621","reported_seq":1673,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:25.495184+0000","last_change":"2023-11-04T15:37:25.495295+0000","last_active":"2023-11-04T15:37:25.495184+0000","last_peered":"2023-11-04T15:37:25.495184+0000","last_clean":"2023-11-04T15:37:25.495184+0000","last_became_active":"2023-11-04T15:27:35.775895+0000","last_became_peered":"2023-11-04T15:27:35.775895+0000","last_unstale":"2023-11-04T15:37:25.495184+0000","last_undegraded":"2023-11-04T15:37:25.495184+0000","last_fullsized":"2023-11-04T15:37:25.495184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1621","last_scrub_stamp":"2023-11-04T15:37:25.495162+0000","last_deep_scrub":"44'1621","last_deep_scrub_stamp":"2023-11-04T15:37:25.495162+0000","last_clean_scrub_stamp":"2023-11-04T15:37:25.495162+0000","objects_scrubbed":7,"log_size":1621,"log_dups_size":0,"ondisk_log_size":1621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:31:16.990792+0000","scrub_duration":0.024403523,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":1625,"num_write_kb":22714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"44'1200","reported_seq":1252,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:53.730416+0000","last_change":"2023-11-04T15:37:53.730547+0000","last_active":"2023-11-04T15:37:53.730416+0000","last_peered":"2023-11-04T15:37:53.730416+0000","last_clean":"2023-11-04T15:37:53.730416+0000","last_became_active":"2023-11-04T15:27:35.767594+0000","last_became_peered":"2023-11-04T15:27:35.767594+0000","last_unstale":"2023-11-04T15:37:53.730416+0000","last_undegraded":"2023-11-04T15:37:53.730416+0000","last_fullsized":"2023-11-04T15:37:53.730416+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1200","last_scrub_stamp":"2023-11-04T15:37:53.730377+0000","last_deep_scrub":"44'1200","last_deep_scrub_stamp":"2023-11-04T15:37:53.730377+0000","last_clean_scrub_stamp":"2023-11-04T15:37:53.730377+0000","objects_scrubbed":2,"log_size":1200,"log_dups_size":0,"ondisk_log_size":1200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:46:40.139343+0000","scrub_duration":0.015421646000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1190,"num_write_kb":15478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"40'3688","reported_seq":3063,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:14.481041+0000","last_change":"2023-11-04T15:37:14.481041+0000","last_active":"2023-11-04T15:37:14.481041+0000","last_peered":"2023-11-04T15:37:14.481041+0000","last_clean":"2023-11-04T15:37:14.481041+0000","last_became_active":"2023-11-04T15:27:36.148282+0000","last_became_peered":"2023-11-04T15:27:36.148282+0000","last_unstale":"2023-11-04T15:37:14.481041+0000","last_undegraded":"2023-11-04T15:37:14.481041+0000","last_fullsized":"2023-11-04T15:37:14.481041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3688","last_scrub_stamp":"2023-11-04T15:37:14.480897+0000","last_deep_scrub":"40'3688","last_deep_scrub_stamp":"2023-11-04T15:37:14.480897+0000","last_clean_scrub_stamp":"2023-11-04T15:37:14.480897+0000","objects_scrubbed":0,"log_size":3688,"log_dups_size":0,"ondisk_log_size":3688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:24:49.251475+0000","scrub_duration":0.0044870750000000001,"objects_trimmed":0,"snaptrim_duration":0.102136719,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1244,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"44'2395","reported_seq":2447,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:45.652933+0000","last_change":"2023-11-04T15:37:45.653046+0000","last_active":"2023-11-04T15:37:45.652933+0000","last_peered":"2023-11-04T15:37:45.652933+0000","last_clean":"2023-11-04T15:37:45.652933+0000","last_became_active":"2023-11-04T15:27:35.771554+0000","last_became_peered":"2023-11-04T15:27:35.771554+0000","last_unstale":"2023-11-04T15:37:45.652933+0000","last_undegraded":"2023-11-04T15:37:45.652933+0000","last_fullsized":"2023-11-04T15:37:45.652933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2395","last_scrub_stamp":"2023-11-04T15:37:45.652911+0000","last_deep_scrub":"44'2395","last_deep_scrub_stamp":"2023-11-04T15:37:45.652911+0000","last_clean_scrub_stamp":"2023-11-04T15:37:45.652911+0000","objects_scrubbed":3,"log_size":2395,"log_dups_size":0,"ondisk_log_size":2395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:07:59.283572+0000","scrub_duration":0.025961439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2386,"num_write_kb":21701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"44'3603","reported_seq":3001,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:25.600392+0000","last_change":"2023-11-04T15:37:25.600392+0000","last_active":"2023-11-04T15:37:25.600392+0000","last_peered":"2023-11-04T15:37:25.600392+0000","last_clean":"2023-11-04T15:37:25.600392+0000","last_became_active":"2023-11-04T15:27:36.149146+0000","last_became_peered":"2023-11-04T15:27:36.149146+0000","last_unstale":"2023-11-04T15:37:25.600392+0000","last_undegraded":"2023-11-04T15:37:25.600392+0000","last_fullsized":"2023-11-04T15:37:25.600392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3603","last_scrub_stamp":"2023-11-04T15:37:25.600176+0000","last_deep_scrub":"44'3603","last_deep_scrub_stamp":"2023-11-04T15:37:25.600176+0000","last_clean_scrub_stamp":"2023-11-04T15:37:25.600176+0000","objects_scrubbed":3,"log_size":3603,"log_dups_size":0,"ondisk_log_size":3603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:18:31.280905+0000","scrub_duration":0.0137854,"objects_trimmed":0,"snaptrim_duration":0.055767874000000002,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"44'3591","reported_seq":3643,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:28.306883+0000","last_change":"2023-11-04T15:38:28.306981+0000","last_active":"2023-11-04T15:38:28.306883+0000","last_peered":"2023-11-04T15:38:28.306883+0000","last_clean":"2023-11-04T15:38:28.306883+0000","last_became_active":"2023-11-04T15:27:35.773689+0000","last_became_peered":"2023-11-04T15:27:35.773689+0000","last_unstale":"2023-11-04T15:38:28.306883+0000","last_undegraded":"2023-11-04T15:38:28.306883+0000","last_fullsized":"2023-11-04T15:38:28.306883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3591","last_scrub_stamp":"2023-11-04T15:38:28.306858+0000","last_deep_scrub":"44'3591","last_deep_scrub_stamp":"2023-11-04T15:38:28.306858+0000","last_clean_scrub_stamp":"2023-11-04T15:38:28.306858+0000","objects_scrubbed":4,"log_size":3591,"log_dups_size":0,"ondisk_log_size":3591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:06:11.058800+0000","scrub_duration":0.034148234999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582982,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3581,"num_write_kb":38716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"44'3514","reported_seq":2913,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:14.746264+0000","last_change":"2023-11-04T15:37:14.746264+0000","last_active":"2023-11-04T15:37:14.746264+0000","last_peered":"2023-11-04T15:37:14.746264+0000","last_clean":"2023-11-04T15:37:14.746264+0000","last_became_active":"2023-11-04T15:27:36.141695+0000","last_became_peered":"2023-11-04T15:27:36.141695+0000","last_unstale":"2023-11-04T15:37:14.746264+0000","last_undegraded":"2023-11-04T15:37:14.746264+0000","last_fullsized":"2023-11-04T15:37:14.746264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3514","last_scrub_stamp":"2023-11-04T15:37:14.746134+0000","last_deep_scrub":"44'3514","last_deep_scrub_stamp":"2023-11-04T15:37:14.746134+0000","last_clean_scrub_stamp":"2023-11-04T15:37:14.746134+0000","objects_scrubbed":3,"log_size":3514,"log_dups_size":0,"ondisk_log_size":3514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:36.355741+0000","scrub_duration":0.013556656,"objects_trimmed":0,"snaptrim_duration":0.057953993000000002,"stat_sum":{"num_bytes":4107,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1230,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"44'1581","reported_seq":1633,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:05.474243+0000","last_change":"2023-11-04T15:38:05.474337+0000","last_active":"2023-11-04T15:38:05.474243+0000","last_peered":"2023-11-04T15:38:05.474243+0000","last_clean":"2023-11-04T15:38:05.474243+0000","last_became_active":"2023-11-04T15:27:35.773818+0000","last_became_peered":"2023-11-04T15:27:35.773818+0000","last_unstale":"2023-11-04T15:38:05.474243+0000","last_undegraded":"2023-11-04T15:38:05.474243+0000","last_fullsized":"2023-11-04T15:38:05.474243+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1581","last_scrub_stamp":"2023-11-04T15:38:05.474220+0000","last_deep_scrub":"44'1581","last_deep_scrub_stamp":"2023-11-04T15:38:05.474220+0000","last_clean_scrub_stamp":"2023-11-04T15:38:05.474220+0000","objects_scrubbed":4,"log_size":1581,"log_dups_size":0,"ondisk_log_size":1581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:03:06.147239+0000","scrub_duration":0.038580360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1569,"num_write_kb":30603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"40'3300","reported_seq":2760,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:48.498605+0000","last_change":"2023-11-04T15:37:48.498756+0000","last_active":"2023-11-04T15:37:48.498605+0000","last_peered":"2023-11-04T15:37:48.498605+0000","last_clean":"2023-11-04T15:37:48.498605+0000","last_became_active":"2023-11-04T15:27:36.150653+0000","last_became_peered":"2023-11-04T15:27:36.150653+0000","last_unstale":"2023-11-04T15:37:48.498605+0000","last_undegraded":"2023-11-04T15:37:48.498605+0000","last_fullsized":"2023-11-04T15:37:48.498605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3300","last_scrub_stamp":"2023-11-04T15:37:48.498559+0000","last_deep_scrub":"40'3300","last_deep_scrub_stamp":"2023-11-04T15:37:48.498559+0000","last_clean_scrub_stamp":"2023-11-04T15:37:48.498559+0000","objects_scrubbed":0,"log_size":3300,"log_dups_size":0,"ondisk_log_size":3300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:55:19.632136+0000","scrub_duration":0.0039129610000000004,"objects_trimmed":0,"snaptrim_duration":0.070970674999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1129,"num_write_kb":600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"44'4025","reported_seq":4077,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:41.344060+0000","last_change":"2023-11-04T15:37:41.344248+0000","last_active":"2023-11-04T15:37:41.344060+0000","last_peered":"2023-11-04T15:37:41.344060+0000","last_clean":"2023-11-04T15:37:41.344060+0000","last_became_active":"2023-11-04T15:27:35.772815+0000","last_became_peered":"2023-11-04T15:27:35.772815+0000","last_unstale":"2023-11-04T15:37:41.344060+0000","last_undegraded":"2023-11-04T15:37:41.344060+0000","last_fullsized":"2023-11-04T15:37:41.344060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4025","last_scrub_stamp":"2023-11-04T15:37:41.344035+0000","last_deep_scrub":"44'4025","last_deep_scrub_stamp":"2023-11-04T15:37:41.344035+0000","last_clean_scrub_stamp":"2023-11-04T15:37:41.344035+0000","objects_scrubbed":4,"log_size":4025,"log_dups_size":0,"ondisk_log_size":4025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:07:54.974697+0000","scrub_duration":0.037607953,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4019,"num_write_kb":36923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1207,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"40'3784","reported_seq":3140,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:21.440173+0000","last_change":"2023-11-04T15:37:21.440272+0000","last_active":"2023-11-04T15:37:21.440173+0000","last_peered":"2023-11-04T15:37:21.440173+0000","last_clean":"2023-11-04T15:37:21.440173+0000","last_became_active":"2023-11-04T15:27:36.150667+0000","last_became_peered":"2023-11-04T15:27:36.150667+0000","last_unstale":"2023-11-04T15:37:21.440173+0000","last_undegraded":"2023-11-04T15:37:21.440173+0000","last_fullsized":"2023-11-04T15:37:21.440173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3784","last_scrub_stamp":"2023-11-04T15:37:21.440149+0000","last_deep_scrub":"40'3784","last_deep_scrub_stamp":"2023-11-04T15:37:21.440149+0000","last_clean_scrub_stamp":"2023-11-04T15:37:21.440149+0000","objects_scrubbed":0,"log_size":3784,"log_dups_size":0,"ondisk_log_size":3784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:35.107882+0000","scrub_duration":0.0057867910000000003,"objects_trimmed":0,"snaptrim_duration":0.098687114000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1287,"num_write_kb":684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"44'2127","reported_seq":2180,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:02.405082+0000","last_change":"2023-11-04T15:38:02.405082+0000","last_active":"2023-11-04T15:38:02.405082+0000","last_peered":"2023-11-04T15:38:02.405082+0000","last_clean":"2023-11-04T15:38:02.405082+0000","last_became_active":"2023-11-04T15:27:35.775063+0000","last_became_peered":"2023-11-04T15:27:35.775063+0000","last_unstale":"2023-11-04T15:38:02.405082+0000","last_undegraded":"2023-11-04T15:38:02.405082+0000","last_fullsized":"2023-11-04T15:38:02.405082+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2127","last_scrub_stamp":"2023-11-04T15:38:02.404947+0000","last_deep_scrub":"44'2127","last_deep_scrub_stamp":"2023-11-04T15:38:02.404947+0000","last_clean_scrub_stamp":"2023-11-04T15:38:02.404947+0000","objects_scrubbed":2,"log_size":2127,"log_dups_size":0,"ondisk_log_size":2127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:43:59.858069+0000","scrub_duration":0.024080308000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2118,"num_write_kb":30816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"40'3317","reported_seq":2788,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:04.719341+0000","last_change":"2023-11-04T15:36:55.826358+0000","last_active":"2023-11-04T15:37:04.719341+0000","last_peered":"2023-11-04T15:37:04.719341+0000","last_clean":"2023-11-04T15:37:04.719341+0000","last_became_active":"2023-11-04T15:27:36.139103+0000","last_became_peered":"2023-11-04T15:27:36.139103+0000","last_unstale":"2023-11-04T15:37:04.719341+0000","last_undegraded":"2023-11-04T15:37:04.719341+0000","last_fullsized":"2023-11-04T15:37:04.719341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3317,"log_dups_size":0,"ondisk_log_size":3317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10468400899999999,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1091,"num_write_kb":593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"44'1936","reported_seq":1989,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:32.267244+0000","last_change":"2023-11-04T15:38:32.267330+0000","last_active":"2023-11-04T15:38:32.267244+0000","last_peered":"2023-11-04T15:38:32.267244+0000","last_clean":"2023-11-04T15:38:32.267244+0000","last_became_active":"2023-11-04T15:27:35.773449+0000","last_became_peered":"2023-11-04T15:27:35.773449+0000","last_unstale":"2023-11-04T15:38:32.267244+0000","last_undegraded":"2023-11-04T15:38:32.267244+0000","last_fullsized":"2023-11-04T15:38:32.267244+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1936","last_scrub_stamp":"2023-11-04T15:38:32.267220+0000","last_deep_scrub":"44'1936","last_deep_scrub_stamp":"2023-11-04T15:38:32.267220+0000","last_clean_scrub_stamp":"2023-11-04T15:38:32.267220+0000","objects_scrubbed":2,"log_size":1936,"log_dups_size":0,"ondisk_log_size":1936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:39:33.849939+0000","scrub_duration":0.019926309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1929,"num_write_kb":17119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"40'3519","reported_seq":2953,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:23.652533+0000","last_change":"2023-11-04T15:37:23.652627+0000","last_active":"2023-11-04T15:37:23.652533+0000","last_peered":"2023-11-04T15:37:23.652533+0000","last_clean":"2023-11-04T15:37:23.652533+0000","last_became_active":"2023-11-04T15:27:36.141086+0000","last_became_peered":"2023-11-04T15:27:36.141086+0000","last_unstale":"2023-11-04T15:37:23.652533+0000","last_undegraded":"2023-11-04T15:37:23.652533+0000","last_fullsized":"2023-11-04T15:37:23.652533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3519","last_scrub_stamp":"2023-11-04T15:37:23.652509+0000","last_deep_scrub":"40'3519","last_deep_scrub_stamp":"2023-11-04T15:37:23.652509+0000","last_clean_scrub_stamp":"2023-11-04T15:37:23.652509+0000","objects_scrubbed":0,"log_size":3519,"log_dups_size":0,"ondisk_log_size":3519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:28.689310+0000","scrub_duration":0.0061970940000000002,"objects_trimmed":0,"snaptrim_duration":0.059170119,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1142,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"44'657","reported_seq":710,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:06.186834+0000","last_change":"2023-11-04T15:38:06.186834+0000","last_active":"2023-11-04T15:38:06.186834+0000","last_peered":"2023-11-04T15:38:06.186834+0000","last_clean":"2023-11-04T15:38:06.186834+0000","last_became_active":"2023-11-04T15:27:35.769001+0000","last_became_peered":"2023-11-04T15:27:35.769001+0000","last_unstale":"2023-11-04T15:38:06.186834+0000","last_undegraded":"2023-11-04T15:38:06.186834+0000","last_fullsized":"2023-11-04T15:38:06.186834+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'657","last_scrub_stamp":"2023-11-04T15:38:06.186659+0000","last_deep_scrub":"44'657","last_deep_scrub_stamp":"2023-11-04T15:38:06.186659+0000","last_clean_scrub_stamp":"2023-11-04T15:38:06.186659+0000","objects_scrubbed":2,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:44:03.639782+0000","scrub_duration":0.022387719,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":656,"num_write_kb":15166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"44'3666","reported_seq":3094,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:24.311230+0000","last_change":"2023-11-04T15:37:24.311349+0000","last_active":"2023-11-04T15:37:24.311230+0000","last_peered":"2023-11-04T15:37:24.311230+0000","last_clean":"2023-11-04T15:37:24.311230+0000","last_became_active":"2023-11-04T15:27:36.147034+0000","last_became_peered":"2023-11-04T15:27:36.147034+0000","last_unstale":"2023-11-04T15:37:24.311230+0000","last_undegraded":"2023-11-04T15:37:24.311230+0000","last_fullsized":"2023-11-04T15:37:24.311230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3666","last_scrub_stamp":"2023-11-04T15:37:24.311202+0000","last_deep_scrub":"44'3666","last_deep_scrub_stamp":"2023-11-04T15:37:24.311202+0000","last_clean_scrub_stamp":"2023-11-04T15:37:24.311202+0000","objects_scrubbed":3,"log_size":3666,"log_dups_size":0,"ondisk_log_size":3666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:56:38.113824+0000","scrub_duration":0.0088871530000000001,"objects_trimmed":0,"snaptrim_duration":0.064750725999999995,"stat_sum":{"num_bytes":4196,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1197,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"44'119","reported_seq":211,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:08.425104+0000","last_change":"2023-11-04T15:38:08.425208+0000","last_active":"2023-11-04T15:38:08.425104+0000","last_peered":"2023-11-04T15:38:08.425104+0000","last_clean":"2023-11-04T15:38:08.425104+0000","last_became_active":"2023-11-04T15:27:26.266242+0000","last_became_peered":"2023-11-04T15:27:26.266242+0000","last_unstale":"2023-11-04T15:38:08.425104+0000","last_undegraded":"2023-11-04T15:38:08.425104+0000","last_fullsized":"2023-11-04T15:38:08.425104+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'119","last_scrub_stamp":"2023-11-04T15:38:08.425081+0000","last_deep_scrub":"44'119","last_deep_scrub_stamp":"2023-11-04T15:38:08.425081+0000","last_clean_scrub_stamp":"2023-11-04T15:38:08.425081+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:16:37.200598+0000","scrub_duration":0.0054415069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:17.352034+0000","last_change":"2023-11-04T15:38:17.352138+0000","last_active":"2023-11-04T15:38:17.352034+0000","last_peered":"2023-11-04T15:38:17.352034+0000","last_clean":"2023-11-04T15:38:17.352034+0000","last_became_active":"2023-11-04T15:27:31.619798+0000","last_became_peered":"2023-11-04T15:27:31.619798+0000","last_unstale":"2023-11-04T15:38:17.352034+0000","last_undegraded":"2023-11-04T15:38:17.352034+0000","last_fullsized":"2023-11-04T15:38:17.352034+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:38:17.352004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:38:17.352004+0000","last_clean_scrub_stamp":"2023-11-04T15:38:17.352004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:29:22.571127+0000","scrub_duration":0.0014758830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"44'3636","reported_seq":3689,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:51.207512+0000","last_change":"2023-11-04T15:37:51.207512+0000","last_active":"2023-11-04T15:37:51.207512+0000","last_peered":"2023-11-04T15:37:51.207512+0000","last_clean":"2023-11-04T15:37:51.207512+0000","last_became_active":"2023-11-04T15:27:35.769150+0000","last_became_peered":"2023-11-04T15:27:35.769150+0000","last_unstale":"2023-11-04T15:37:51.207512+0000","last_undegraded":"2023-11-04T15:37:51.207512+0000","last_fullsized":"2023-11-04T15:37:51.207512+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3636","last_scrub_stamp":"2023-11-04T15:37:51.207371+0000","last_deep_scrub":"44'3636","last_deep_scrub_stamp":"2023-11-04T15:37:51.207371+0000","last_clean_scrub_stamp":"2023-11-04T15:37:51.207371+0000","objects_scrubbed":7,"log_size":3636,"log_dups_size":0,"ondisk_log_size":3636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:21:17.261772+0000","scrub_duration":0.064187266000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3620,"num_write_kb":52059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"44'3669","reported_seq":3088,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:03.410603+0000","last_change":"2023-11-04T15:38:03.410603+0000","last_active":"2023-11-04T15:38:03.410603+0000","last_peered":"2023-11-04T15:38:03.410603+0000","last_clean":"2023-11-04T15:38:03.410603+0000","last_became_active":"2023-11-04T15:27:36.140619+0000","last_became_peered":"2023-11-04T15:27:36.140619+0000","last_unstale":"2023-11-04T15:38:03.410603+0000","last_undegraded":"2023-11-04T15:38:03.410603+0000","last_fullsized":"2023-11-04T15:38:03.410603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3669","last_scrub_stamp":"2023-11-04T15:38:03.410431+0000","last_deep_scrub":"44'3669","last_deep_scrub_stamp":"2023-11-04T15:38:03.410431+0000","last_clean_scrub_stamp":"2023-11-04T15:38:03.410431+0000","objects_scrubbed":1,"log_size":3669,"log_dups_size":0,"ondisk_log_size":3669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:20.868712+0000","scrub_duration":0.009666315,"objects_trimmed":0,"snaptrim_duration":0.10532783499999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:10.460636+0000","last_change":"2023-11-04T15:38:10.460766+0000","last_active":"2023-11-04T15:38:10.460636+0000","last_peered":"2023-11-04T15:38:10.460636+0000","last_clean":"2023-11-04T15:38:10.460636+0000","last_became_active":"2023-11-04T15:27:31.621889+0000","last_became_peered":"2023-11-04T15:27:31.621889+0000","last_unstale":"2023-11-04T15:38:10.460636+0000","last_undegraded":"2023-11-04T15:38:10.460636+0000","last_fullsized":"2023-11-04T15:38:10.460636+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:38:10.460616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:38:10.460616+0000","last_clean_scrub_stamp":"2023-11-04T15:38:10.460616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:47:50.200142+0000","scrub_duration":0.002140351,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"44'3688","reported_seq":3907,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:52.624125+0000","last_change":"2023-11-04T15:37:52.624125+0000","last_active":"2023-11-04T15:37:52.624125+0000","last_peered":"2023-11-04T15:37:52.624125+0000","last_clean":"2023-11-04T15:37:52.624125+0000","last_became_active":"2023-11-04T15:27:35.770364+0000","last_became_peered":"2023-11-04T15:27:35.770364+0000","last_unstale":"2023-11-04T15:37:52.624125+0000","last_undegraded":"2023-11-04T15:37:52.624125+0000","last_fullsized":"2023-11-04T15:37:52.624125+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3688","last_scrub_stamp":"2023-11-04T15:37:52.623993+0000","last_deep_scrub":"44'3688","last_deep_scrub_stamp":"2023-11-04T15:37:52.623993+0000","last_clean_scrub_stamp":"2023-11-04T15:37:52.623993+0000","objects_scrubbed":4,"log_size":3688,"log_dups_size":0,"ondisk_log_size":3688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:49.475542+0000","scrub_duration":0.043049095000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15883313,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":166,"num_read_kb":3338,"num_write":3668,"num_write_kb":29714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"44'3553","reported_seq":2998,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:24.639702+0000","last_change":"2023-11-04T15:37:24.639702+0000","last_active":"2023-11-04T15:37:24.639702+0000","last_peered":"2023-11-04T15:37:24.639702+0000","last_clean":"2023-11-04T15:37:24.639702+0000","last_became_active":"2023-11-04T15:27:36.144459+0000","last_became_peered":"2023-11-04T15:27:36.144459+0000","last_unstale":"2023-11-04T15:37:24.639702+0000","last_undegraded":"2023-11-04T15:37:24.639702+0000","last_fullsized":"2023-11-04T15:37:24.639702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3553","last_scrub_stamp":"2023-11-04T15:37:24.639567+0000","last_deep_scrub":"44'3553","last_deep_scrub_stamp":"2023-11-04T15:37:24.639567+0000","last_clean_scrub_stamp":"2023-11-04T15:37:24.639567+0000","objects_scrubbed":2,"log_size":3553,"log_dups_size":0,"ondisk_log_size":3553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:38.307301+0000","scrub_duration":0.010629794999999999,"objects_trimmed":0,"snaptrim_duration":0.072685394,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:46.281358+0000","last_change":"2023-11-04T15:37:46.281358+0000","last_active":"2023-11-04T15:37:46.281358+0000","last_peered":"2023-11-04T15:37:46.281358+0000","last_clean":"2023-11-04T15:37:46.281358+0000","last_became_active":"2023-11-04T15:27:31.622378+0000","last_became_peered":"2023-11-04T15:27:31.622378+0000","last_unstale":"2023-11-04T15:37:46.281358+0000","last_undegraded":"2023-11-04T15:37:46.281358+0000","last_fullsized":"2023-11-04T15:37:46.281358+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:37:46.281232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:37:46.281232+0000","last_clean_scrub_stamp":"2023-11-04T15:37:46.281232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:55:17.414809+0000","scrub_duration":0.0016098729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"44'6085","reported_seq":6139,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:50.250495+0000","last_change":"2023-11-04T15:37:50.250593+0000","last_active":"2023-11-04T15:37:50.250495+0000","last_peered":"2023-11-04T15:37:50.250495+0000","last_clean":"2023-11-04T15:37:50.250495+0000","last_became_active":"2023-11-04T15:27:35.774339+0000","last_became_peered":"2023-11-04T15:27:35.774339+0000","last_unstale":"2023-11-04T15:37:50.250495+0000","last_undegraded":"2023-11-04T15:37:50.250495+0000","last_fullsized":"2023-11-04T15:37:50.250495+0000","mapping_epoch":16,"log_start":"26'400","ondisk_log_start":"26'400","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'6085","last_scrub_stamp":"2023-11-04T15:37:50.250469+0000","last_deep_scrub":"44'6085","last_deep_scrub_stamp":"2023-11-04T15:37:50.250469+0000","last_clean_scrub_stamp":"2023-11-04T15:37:50.250469+0000","objects_scrubbed":6,"log_size":5685,"log_dups_size":0,"ondisk_log_size":5685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:47.102018+0000","scrub_duration":0.070893610999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6078,"num_write_kb":43849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"44'3173","reported_seq":2651,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:10.305048+0000","last_change":"2023-11-04T15:37:10.305048+0000","last_active":"2023-11-04T15:37:10.305048+0000","last_peered":"2023-11-04T15:37:10.305048+0000","last_clean":"2023-11-04T15:37:10.305048+0000","last_became_active":"2023-11-04T15:27:36.146930+0000","last_became_peered":"2023-11-04T15:27:36.146930+0000","last_unstale":"2023-11-04T15:37:10.305048+0000","last_undegraded":"2023-11-04T15:37:10.305048+0000","last_fullsized":"2023-11-04T15:37:10.305048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3173","last_scrub_stamp":"2023-11-04T15:37:10.304861+0000","last_deep_scrub":"44'3173","last_deep_scrub_stamp":"2023-11-04T15:37:10.304861+0000","last_clean_scrub_stamp":"2023-11-04T15:37:10.304861+0000","objects_scrubbed":1,"log_size":3173,"log_dups_size":0,"ondisk_log_size":3173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:31.914468+0000","scrub_duration":0.0078700769999999996,"objects_trimmed":0,"snaptrim_duration":0.067233409999999993,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1111,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:14.382747+0000","last_change":"2023-11-04T15:38:14.382871+0000","last_active":"2023-11-04T15:38:14.382747+0000","last_peered":"2023-11-04T15:38:14.382747+0000","last_clean":"2023-11-04T15:38:14.382747+0000","last_became_active":"2023-11-04T15:27:31.621849+0000","last_became_peered":"2023-11-04T15:27:31.621849+0000","last_unstale":"2023-11-04T15:38:14.382747+0000","last_undegraded":"2023-11-04T15:38:14.382747+0000","last_fullsized":"2023-11-04T15:38:14.382747+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:38:14.382726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:38:14.382726+0000","last_clean_scrub_stamp":"2023-11-04T15:38:14.382726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:16:48.780994+0000","scrub_duration":0.0020309239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"44'3280","reported_seq":3333,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:27.660076+0000","last_change":"2023-11-04T15:37:27.660076+0000","last_active":"2023-11-04T15:37:27.660076+0000","last_peered":"2023-11-04T15:37:27.660076+0000","last_clean":"2023-11-04T15:37:27.660076+0000","last_became_active":"2023-11-04T15:27:35.769730+0000","last_became_peered":"2023-11-04T15:27:35.769730+0000","last_unstale":"2023-11-04T15:37:27.660076+0000","last_undegraded":"2023-11-04T15:37:27.660076+0000","last_fullsized":"2023-11-04T15:37:27.660076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3280","last_scrub_stamp":"2023-11-04T15:37:27.659954+0000","last_deep_scrub":"44'3280","last_deep_scrub_stamp":"2023-11-04T15:37:27.659954+0000","last_clean_scrub_stamp":"2023-11-04T15:37:27.659954+0000","objects_scrubbed":5,"log_size":3280,"log_dups_size":0,"ondisk_log_size":3280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:41.327688+0000","scrub_duration":0.054452754999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3258,"num_write_kb":30072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"44'3434","reported_seq":2864,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:18.421706+0000","last_change":"2023-11-04T15:37:18.421706+0000","last_active":"2023-11-04T15:37:18.421706+0000","last_peered":"2023-11-04T15:37:18.421706+0000","last_clean":"2023-11-04T15:37:18.421706+0000","last_became_active":"2023-11-04T15:27:36.144417+0000","last_became_peered":"2023-11-04T15:27:36.144417+0000","last_unstale":"2023-11-04T15:37:18.421706+0000","last_undegraded":"2023-11-04T15:37:18.421706+0000","last_fullsized":"2023-11-04T15:37:18.421706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3434","last_scrub_stamp":"2023-11-04T15:37:18.421580+0000","last_deep_scrub":"44'3434","last_deep_scrub_stamp":"2023-11-04T15:37:18.421580+0000","last_clean_scrub_stamp":"2023-11-04T15:37:18.421580+0000","objects_scrubbed":3,"log_size":3434,"log_dups_size":0,"ondisk_log_size":3434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:37:14.873581+0000","scrub_duration":0.011594345000000001,"objects_trimmed":0,"snaptrim_duration":0.067418286999999993,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"44'3108","reported_seq":3161,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:28.595288+0000","last_change":"2023-11-04T15:37:28.595288+0000","last_active":"2023-11-04T15:37:28.595288+0000","last_peered":"2023-11-04T15:37:28.595288+0000","last_clean":"2023-11-04T15:37:28.595288+0000","last_became_active":"2023-11-04T15:27:35.769772+0000","last_became_peered":"2023-11-04T15:27:35.769772+0000","last_unstale":"2023-11-04T15:37:28.595288+0000","last_undegraded":"2023-11-04T15:37:28.595288+0000","last_fullsized":"2023-11-04T15:37:28.595288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3108","last_scrub_stamp":"2023-11-04T15:37:28.595114+0000","last_deep_scrub":"44'3108","last_deep_scrub_stamp":"2023-11-04T15:37:28.595114+0000","last_clean_scrub_stamp":"2023-11-04T15:37:28.595114+0000","objects_scrubbed":3,"log_size":3108,"log_dups_size":0,"ondisk_log_size":3108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:56:42.397736+0000","scrub_duration":0.034473323,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3101,"num_write_kb":32806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:47.235098+0000","last_change":"2023-11-04T15:37:47.235098+0000","last_active":"2023-11-04T15:37:47.235098+0000","last_peered":"2023-11-04T15:37:47.235098+0000","last_clean":"2023-11-04T15:37:47.235098+0000","last_became_active":"2023-11-04T15:27:31.622350+0000","last_became_peered":"2023-11-04T15:27:31.622350+0000","last_unstale":"2023-11-04T15:37:47.235098+0000","last_undegraded":"2023-11-04T15:37:47.235098+0000","last_fullsized":"2023-11-04T15:37:47.235098+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:37:47.234970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:37:47.234970+0000","last_clean_scrub_stamp":"2023-11-04T15:37:47.234970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:46:33.643935+0000","scrub_duration":0.00154751,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"43'3419","reported_seq":2906,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:09.350908+0000","last_change":"2023-11-04T15:37:09.350908+0000","last_active":"2023-11-04T15:37:09.350908+0000","last_peered":"2023-11-04T15:37:09.350908+0000","last_clean":"2023-11-04T15:37:09.350908+0000","last_became_active":"2023-11-04T15:27:36.143991+0000","last_became_peered":"2023-11-04T15:27:36.143991+0000","last_unstale":"2023-11-04T15:37:09.350908+0000","last_undegraded":"2023-11-04T15:37:09.350908+0000","last_fullsized":"2023-11-04T15:37:09.350908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3419","last_scrub_stamp":"2023-11-04T15:37:09.350786+0000","last_deep_scrub":"43'3419","last_deep_scrub_stamp":"2023-11-04T15:37:09.350786+0000","last_clean_scrub_stamp":"2023-11-04T15:37:09.350786+0000","objects_scrubbed":2,"log_size":3419,"log_dups_size":0,"ondisk_log_size":3419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:20:35.227166+0000","scrub_duration":0.0074817540000000002,"objects_trimmed":0,"snaptrim_duration":0.062728023999999993,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":1116,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"44'4469","reported_seq":4522,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:56.224142+0000","last_change":"2023-11-04T15:37:56.224142+0000","last_active":"2023-11-04T15:37:56.224142+0000","last_peered":"2023-11-04T15:37:56.224142+0000","last_clean":"2023-11-04T15:37:56.224142+0000","last_became_active":"2023-11-04T15:27:35.769095+0000","last_became_peered":"2023-11-04T15:27:35.769095+0000","last_unstale":"2023-11-04T15:37:56.224142+0000","last_undegraded":"2023-11-04T15:37:56.224142+0000","last_fullsized":"2023-11-04T15:37:56.224142+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4469","last_scrub_stamp":"2023-11-04T15:37:56.224006+0000","last_deep_scrub":"44'4469","last_deep_scrub_stamp":"2023-11-04T15:37:56.224006+0000","last_clean_scrub_stamp":"2023-11-04T15:37:56.224006+0000","objects_scrubbed":5,"log_size":4469,"log_dups_size":0,"ondisk_log_size":4469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:52:06.320947+0000","scrub_duration":0.052842531999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4451,"num_write_kb":27035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:23.393957+0000","last_change":"2023-11-04T15:38:23.394103+0000","last_active":"2023-11-04T15:38:23.393957+0000","last_peered":"2023-11-04T15:38:23.393957+0000","last_clean":"2023-11-04T15:38:23.393957+0000","last_became_active":"2023-11-04T15:27:31.619702+0000","last_became_peered":"2023-11-04T15:27:31.619702+0000","last_unstale":"2023-11-04T15:38:23.393957+0000","last_undegraded":"2023-11-04T15:38:23.393957+0000","last_fullsized":"2023-11-04T15:38:23.393957+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:38:23.393926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:38:23.393926+0000","last_clean_scrub_stamp":"2023-11-04T15:38:23.393926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:54:34.579281+0000","scrub_duration":0.001751711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"40'3558","reported_seq":2956,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:19.665851+0000","last_change":"2023-11-04T15:37:19.665851+0000","last_active":"2023-11-04T15:37:19.665851+0000","last_peered":"2023-11-04T15:37:19.665851+0000","last_clean":"2023-11-04T15:37:19.665851+0000","last_became_active":"2023-11-04T15:27:36.139707+0000","last_became_peered":"2023-11-04T15:27:36.139707+0000","last_unstale":"2023-11-04T15:37:19.665851+0000","last_undegraded":"2023-11-04T15:37:19.665851+0000","last_fullsized":"2023-11-04T15:37:19.665851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3558","last_scrub_stamp":"2023-11-04T15:37:19.665726+0000","last_deep_scrub":"40'3558","last_deep_scrub_stamp":"2023-11-04T15:37:19.665726+0000","last_clean_scrub_stamp":"2023-11-04T15:37:19.665726+0000","objects_scrubbed":0,"log_size":3558,"log_dups_size":0,"ondisk_log_size":3558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:24:54.436304+0000","scrub_duration":0.0061987099999999996,"objects_trimmed":0,"snaptrim_duration":0.073815121999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"44'1219","reported_seq":1272,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:59.151132+0000","last_change":"2023-11-04T15:37:59.151132+0000","last_active":"2023-11-04T15:37:59.151132+0000","last_peered":"2023-11-04T15:37:59.151132+0000","last_clean":"2023-11-04T15:37:59.151132+0000","last_became_active":"2023-11-04T15:27:35.768320+0000","last_became_peered":"2023-11-04T15:27:35.768320+0000","last_unstale":"2023-11-04T15:37:59.151132+0000","last_undegraded":"2023-11-04T15:37:59.151132+0000","last_fullsized":"2023-11-04T15:37:59.151132+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1219","last_scrub_stamp":"2023-11-04T15:37:59.150991+0000","last_deep_scrub":"44'1219","last_deep_scrub_stamp":"2023-11-04T15:37:59.150991+0000","last_clean_scrub_stamp":"2023-11-04T15:37:59.150991+0000","objects_scrubbed":5,"log_size":1219,"log_dups_size":0,"ondisk_log_size":1219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:11:48.972187+0000","scrub_duration":0.031930034000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1211,"num_write_kb":18003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:42.307944+0000","last_change":"2023-11-04T15:37:42.307944+0000","last_active":"2023-11-04T15:37:42.307944+0000","last_peered":"2023-11-04T15:37:42.307944+0000","last_clean":"2023-11-04T15:37:42.307944+0000","last_became_active":"2023-11-04T15:27:31.624347+0000","last_became_peered":"2023-11-04T15:27:31.624347+0000","last_unstale":"2023-11-04T15:37:42.307944+0000","last_undegraded":"2023-11-04T15:37:42.307944+0000","last_fullsized":"2023-11-04T15:37:42.307944+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:37:42.307817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:37:42.307817+0000","last_clean_scrub_stamp":"2023-11-04T15:37:42.307817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:40:21.913960+0000","scrub_duration":0.002137136,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"44'3609","reported_seq":3026,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:29.793752+0000","last_change":"2023-11-04T15:38:29.793847+0000","last_active":"2023-11-04T15:38:29.793752+0000","last_peered":"2023-11-04T15:38:29.793752+0000","last_clean":"2023-11-04T15:38:29.793752+0000","last_became_active":"2023-11-04T15:27:36.137897+0000","last_became_peered":"2023-11-04T15:27:36.137897+0000","last_unstale":"2023-11-04T15:38:29.793752+0000","last_undegraded":"2023-11-04T15:38:29.793752+0000","last_fullsized":"2023-11-04T15:38:29.793752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3609","last_scrub_stamp":"2023-11-04T15:38:29.793727+0000","last_deep_scrub":"44'3609","last_deep_scrub_stamp":"2023-11-04T15:38:29.793727+0000","last_clean_scrub_stamp":"2023-11-04T15:38:29.793727+0000","objects_scrubbed":1,"log_size":3609,"log_dups_size":0,"ondisk_log_size":3609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:54:40.979082+0000","scrub_duration":0.0096043740000000006,"objects_trimmed":0,"snaptrim_duration":0.069534850999999995,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"44'835","reported_seq":888,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:58.635650+0000","last_change":"2023-11-04T15:37:58.635650+0000","last_active":"2023-11-04T15:37:58.635650+0000","last_peered":"2023-11-04T15:37:58.635650+0000","last_clean":"2023-11-04T15:37:58.635650+0000","last_became_active":"2023-11-04T15:27:35.772121+0000","last_became_peered":"2023-11-04T15:27:35.772121+0000","last_unstale":"2023-11-04T15:37:58.635650+0000","last_undegraded":"2023-11-04T15:37:58.635650+0000","last_fullsized":"2023-11-04T15:37:58.635650+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'835","last_scrub_stamp":"2023-11-04T15:37:58.635523+0000","last_deep_scrub":"44'835","last_deep_scrub_stamp":"2023-11-04T15:37:58.635523+0000","last_clean_scrub_stamp":"2023-11-04T15:37:58.635523+0000","objects_scrubbed":6,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:52:08.732465+0000","scrub_duration":0.064600797000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":960,"num_write_kb":25976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:18.360275+0000","last_change":"2023-11-04T15:38:18.360275+0000","last_active":"2023-11-04T15:38:18.360275+0000","last_peered":"2023-11-04T15:38:18.360275+0000","last_clean":"2023-11-04T15:38:18.360275+0000","last_became_active":"2023-11-04T15:27:31.619831+0000","last_became_peered":"2023-11-04T15:27:31.619831+0000","last_unstale":"2023-11-04T15:38:18.360275+0000","last_undegraded":"2023-11-04T15:38:18.360275+0000","last_fullsized":"2023-11-04T15:38:18.360275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:38:18.360157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:38:18.360157+0000","last_clean_scrub_stamp":"2023-11-04T15:38:18.360157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:32:51.174031+0000","scrub_duration":0.0014914360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"44'3481","reported_seq":2937,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:10.702911+0000","last_change":"2023-11-04T15:37:10.702911+0000","last_active":"2023-11-04T15:37:10.702911+0000","last_peered":"2023-11-04T15:37:10.702911+0000","last_clean":"2023-11-04T15:37:10.702911+0000","last_became_active":"2023-11-04T15:27:36.140871+0000","last_became_peered":"2023-11-04T15:27:36.140871+0000","last_unstale":"2023-11-04T15:37:10.702911+0000","last_undegraded":"2023-11-04T15:37:10.702911+0000","last_fullsized":"2023-11-04T15:37:10.702911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3481","last_scrub_stamp":"2023-11-04T15:37:10.702789+0000","last_deep_scrub":"44'3481","last_deep_scrub_stamp":"2023-11-04T15:37:10.702789+0000","last_clean_scrub_stamp":"2023-11-04T15:37:10.702789+0000","objects_scrubbed":1,"log_size":3481,"log_dups_size":0,"ondisk_log_size":3481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:23:02.723895+0000","scrub_duration":0.008399541,"objects_trimmed":0,"snaptrim_duration":0.058381362999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"40'3644","reported_seq":3059,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:22.638939+0000","last_change":"2023-11-04T15:37:22.639061+0000","last_active":"2023-11-04T15:37:22.638939+0000","last_peered":"2023-11-04T15:37:22.638939+0000","last_clean":"2023-11-04T15:37:22.638939+0000","last_became_active":"2023-11-04T15:27:36.139487+0000","last_became_peered":"2023-11-04T15:27:36.139487+0000","last_unstale":"2023-11-04T15:37:22.638939+0000","last_undegraded":"2023-11-04T15:37:22.638939+0000","last_fullsized":"2023-11-04T15:37:22.638939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3644","last_scrub_stamp":"2023-11-04T15:37:22.638916+0000","last_deep_scrub":"40'3644","last_deep_scrub_stamp":"2023-11-04T15:37:22.638916+0000","last_clean_scrub_stamp":"2023-11-04T15:37:22.638916+0000","objects_scrubbed":0,"log_size":3644,"log_dups_size":0,"ondisk_log_size":3644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:37:19.090917+0000","scrub_duration":0.0049130600000000003,"objects_trimmed":0,"snaptrim_duration":0.056621590999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"44'2776","reported_seq":2828,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:42.474185+0000","last_change":"2023-11-04T15:37:42.474282+0000","last_active":"2023-11-04T15:37:42.474185+0000","last_peered":"2023-11-04T15:37:42.474185+0000","last_clean":"2023-11-04T15:37:42.474185+0000","last_became_active":"2023-11-04T15:27:35.775356+0000","last_became_peered":"2023-11-04T15:27:35.775356+0000","last_unstale":"2023-11-04T15:37:42.474185+0000","last_undegraded":"2023-11-04T15:37:42.474185+0000","last_fullsized":"2023-11-04T15:37:42.474185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2776","last_scrub_stamp":"2023-11-04T15:37:42.474162+0000","last_deep_scrub":"44'2776","last_deep_scrub_stamp":"2023-11-04T15:37:42.474162+0000","last_clean_scrub_stamp":"2023-11-04T15:37:42.474162+0000","objects_scrubbed":5,"log_size":2776,"log_dups_size":0,"ondisk_log_size":2776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:55:13.607739+0000","scrub_duration":0.030546663000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2770,"num_write_kb":31342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"44'3526","reported_seq":2945,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:07.150693+0000","last_change":"2023-11-04T15:38:07.150810+0000","last_active":"2023-11-04T15:38:07.150693+0000","last_peered":"2023-11-04T15:38:07.150693+0000","last_clean":"2023-11-04T15:38:07.150693+0000","last_became_active":"2023-11-04T15:27:36.146464+0000","last_became_peered":"2023-11-04T15:27:36.146464+0000","last_unstale":"2023-11-04T15:38:07.150693+0000","last_undegraded":"2023-11-04T15:38:07.150693+0000","last_fullsized":"2023-11-04T15:38:07.150693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3526","last_scrub_stamp":"2023-11-04T15:38:07.150668+0000","last_deep_scrub":"44'3526","last_deep_scrub_stamp":"2023-11-04T15:38:07.150668+0000","last_clean_scrub_stamp":"2023-11-04T15:38:07.150668+0000","objects_scrubbed":1,"log_size":3526,"log_dups_size":0,"ondisk_log_size":3526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:24.608949+0000","scrub_duration":0.0086108179999999993,"objects_trimmed":0,"snaptrim_duration":0.064516859999999995,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"44'3745","reported_seq":3797,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:57.703309+0000","last_change":"2023-11-04T15:37:57.703411+0000","last_active":"2023-11-04T15:37:57.703309+0000","last_peered":"2023-11-04T15:37:57.703309+0000","last_clean":"2023-11-04T15:37:57.703309+0000","last_became_active":"2023-11-04T15:27:35.769904+0000","last_became_peered":"2023-11-04T15:27:35.769904+0000","last_unstale":"2023-11-04T15:37:57.703309+0000","last_undegraded":"2023-11-04T15:37:57.703309+0000","last_fullsized":"2023-11-04T15:37:57.703309+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3745","last_scrub_stamp":"2023-11-04T15:37:57.703286+0000","last_deep_scrub":"44'3745","last_deep_scrub_stamp":"2023-11-04T15:37:57.703286+0000","last_clean_scrub_stamp":"2023-11-04T15:37:57.703286+0000","objects_scrubbed":3,"log_size":3745,"log_dups_size":0,"ondisk_log_size":3745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:21:23.757688+0000","scrub_duration":0.020686982,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3740,"num_write_kb":21755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"44'3556","reported_seq":3608,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:02.674712+0000","last_change":"2023-11-04T15:38:02.674801+0000","last_active":"2023-11-04T15:38:02.674712+0000","last_peered":"2023-11-04T15:38:02.674712+0000","last_clean":"2023-11-04T15:38:02.674712+0000","last_became_active":"2023-11-04T15:27:35.768413+0000","last_became_peered":"2023-11-04T15:27:35.768413+0000","last_unstale":"2023-11-04T15:38:02.674712+0000","last_undegraded":"2023-11-04T15:38:02.674712+0000","last_fullsized":"2023-11-04T15:38:02.674712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3556","last_scrub_stamp":"2023-11-04T15:38:02.674689+0000","last_deep_scrub":"44'3556","last_deep_scrub_stamp":"2023-11-04T15:38:02.674689+0000","last_clean_scrub_stamp":"2023-11-04T15:38:02.674689+0000","objects_scrubbed":2,"log_size":3556,"log_dups_size":0,"ondisk_log_size":3556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:52:12.771630+0000","scrub_duration":0.025634852,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3537,"num_write_kb":29647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"40'3937","reported_seq":3332,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:42.530756+0000","last_change":"2023-11-04T15:37:42.530849+0000","last_active":"2023-11-04T15:37:42.530756+0000","last_peered":"2023-11-04T15:37:42.530756+0000","last_clean":"2023-11-04T15:37:42.530756+0000","last_became_active":"2023-11-04T15:27:36.139524+0000","last_became_peered":"2023-11-04T15:27:36.139524+0000","last_unstale":"2023-11-04T15:37:42.530756+0000","last_undegraded":"2023-11-04T15:37:42.530756+0000","last_fullsized":"2023-11-04T15:37:42.530756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3937","last_scrub_stamp":"2023-11-04T15:37:42.530734+0000","last_deep_scrub":"40'3937","last_deep_scrub_stamp":"2023-11-04T15:37:42.530734+0000","last_clean_scrub_stamp":"2023-11-04T15:37:42.530734+0000","objects_scrubbed":0,"log_size":3937,"log_dups_size":0,"ondisk_log_size":3937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:07:56.161396+0000","scrub_duration":0.0048541679999999999,"objects_trimmed":0,"snaptrim_duration":0.068494678000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1248,"num_write_kb":670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"44'1642","reported_seq":1694,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:08.820848+0000","last_change":"2023-11-04T15:38:08.820939+0000","last_active":"2023-11-04T15:38:08.820848+0000","last_peered":"2023-11-04T15:38:08.820848+0000","last_clean":"2023-11-04T15:38:08.820848+0000","last_became_active":"2023-11-04T15:27:35.775917+0000","last_became_peered":"2023-11-04T15:27:35.775917+0000","last_unstale":"2023-11-04T15:38:08.820848+0000","last_undegraded":"2023-11-04T15:38:08.820848+0000","last_fullsized":"2023-11-04T15:38:08.820848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1642","last_scrub_stamp":"2023-11-04T15:38:08.820827+0000","last_deep_scrub":"44'1642","last_deep_scrub_stamp":"2023-11-04T15:38:08.820827+0000","last_clean_scrub_stamp":"2023-11-04T15:38:08.820827+0000","objects_scrubbed":5,"log_size":1642,"log_dups_size":0,"ondisk_log_size":1642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:44:06.273949+0000","scrub_duration":0.0476023,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1634,"num_write_kb":25426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"44'3473","reported_seq":2906,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:21.407271+0000","last_change":"2023-11-04T15:37:21.407382+0000","last_active":"2023-11-04T15:37:21.407271+0000","last_peered":"2023-11-04T15:37:21.407271+0000","last_clean":"2023-11-04T15:37:21.407271+0000","last_became_active":"2023-11-04T15:27:36.150557+0000","last_became_peered":"2023-11-04T15:27:36.150557+0000","last_unstale":"2023-11-04T15:37:21.407271+0000","last_undegraded":"2023-11-04T15:37:21.407271+0000","last_fullsized":"2023-11-04T15:37:21.407271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3473","last_scrub_stamp":"2023-11-04T15:37:21.407243+0000","last_deep_scrub":"44'3473","last_deep_scrub_stamp":"2023-11-04T15:37:21.407243+0000","last_clean_scrub_stamp":"2023-11-04T15:37:21.407243+0000","objects_scrubbed":1,"log_size":3473,"log_dups_size":0,"ondisk_log_size":3473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:18:27.087972+0000","scrub_duration":0.0082048629999999997,"objects_trimmed":0,"snaptrim_duration":0.062631718000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"44'3230","reported_seq":2725,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:37.265461+0000","last_change":"2023-11-04T15:38:37.265547+0000","last_active":"2023-11-04T15:38:37.265461+0000","last_peered":"2023-11-04T15:38:37.265461+0000","last_clean":"2023-11-04T15:38:37.265461+0000","last_became_active":"2023-11-04T15:27:36.149831+0000","last_became_peered":"2023-11-04T15:27:36.149831+0000","last_unstale":"2023-11-04T15:38:37.265461+0000","last_undegraded":"2023-11-04T15:38:37.265461+0000","last_fullsized":"2023-11-04T15:38:37.265461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3230","last_scrub_stamp":"2023-11-04T15:38:37.265437+0000","last_deep_scrub":"44'3230","last_deep_scrub_stamp":"2023-11-04T15:38:37.265437+0000","last_clean_scrub_stamp":"2023-11-04T15:38:37.265437+0000","objects_scrubbed":2,"log_size":3230,"log_dups_size":0,"ondisk_log_size":3230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T22:11:06.260972+0000","scrub_duration":0.0083613030000000005,"objects_trimmed":0,"snaptrim_duration":0.103639325,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1060,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"44'4779","reported_seq":4831,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:19.478819+0000","last_change":"2023-11-04T15:37:19.478909+0000","last_active":"2023-11-04T15:37:19.478819+0000","last_peered":"2023-11-04T15:37:19.478819+0000","last_clean":"2023-11-04T15:37:19.478819+0000","last_became_active":"2023-11-04T15:27:35.770022+0000","last_became_peered":"2023-11-04T15:27:35.770022+0000","last_unstale":"2023-11-04T15:37:19.478819+0000","last_undegraded":"2023-11-04T15:37:19.478819+0000","last_fullsized":"2023-11-04T15:37:19.478819+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4779","last_scrub_stamp":"2023-11-04T15:37:19.478796+0000","last_deep_scrub":"44'4779","last_deep_scrub_stamp":"2023-11-04T15:37:19.478796+0000","last_clean_scrub_stamp":"2023-11-04T15:37:19.478796+0000","objects_scrubbed":7,"log_size":4779,"log_dups_size":0,"ondisk_log_size":4779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:24.515597+0000","scrub_duration":0.083030119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28974830,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4772,"num_write_kb":50744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"44'3335","reported_seq":2791,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:16.935545+0000","last_change":"2023-11-04T15:38:16.935650+0000","last_active":"2023-11-04T15:38:16.935545+0000","last_peered":"2023-11-04T15:38:16.935545+0000","last_clean":"2023-11-04T15:38:16.935545+0000","last_became_active":"2023-11-04T15:27:36.138908+0000","last_became_peered":"2023-11-04T15:27:36.138908+0000","last_unstale":"2023-11-04T15:38:16.935545+0000","last_undegraded":"2023-11-04T15:38:16.935545+0000","last_fullsized":"2023-11-04T15:38:16.935545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3335","last_scrub_stamp":"2023-11-04T15:38:16.935521+0000","last_deep_scrub":"44'3335","last_deep_scrub_stamp":"2023-11-04T15:38:16.935521+0000","last_clean_scrub_stamp":"2023-11-04T15:38:16.935521+0000","objects_scrubbed":2,"log_size":3335,"log_dups_size":0,"ondisk_log_size":3335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:47:56.675047+0000","scrub_duration":0.010785885,"objects_trimmed":0,"snaptrim_duration":0.073000567000000002,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":1157,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"44'784","reported_seq":836,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:23.362195+0000","last_change":"2023-11-04T15:37:23.362327+0000","last_active":"2023-11-04T15:37:23.362195+0000","last_peered":"2023-11-04T15:37:23.362195+0000","last_clean":"2023-11-04T15:37:23.362195+0000","last_became_active":"2023-11-04T15:27:35.767858+0000","last_became_peered":"2023-11-04T15:27:35.767858+0000","last_unstale":"2023-11-04T15:37:23.362195+0000","last_undegraded":"2023-11-04T15:37:23.362195+0000","last_fullsized":"2023-11-04T15:37:23.362195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'784","last_scrub_stamp":"2023-11-04T15:37:23.362171+0000","last_deep_scrub":"44'784","last_deep_scrub_stamp":"2023-11-04T15:37:23.362171+0000","last_clean_scrub_stamp":"2023-11-04T15:37:23.362171+0000","objects_scrubbed":4,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:37.029904+0000","scrub_duration":0.042357839000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":779,"num_write_kb":20966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"40'3359","reported_seq":2795,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:25.666192+0000","last_change":"2023-11-04T15:37:25.666192+0000","last_active":"2023-11-04T15:37:25.666192+0000","last_peered":"2023-11-04T15:37:25.666192+0000","last_clean":"2023-11-04T15:37:25.666192+0000","last_became_active":"2023-11-04T15:27:36.143442+0000","last_became_peered":"2023-11-04T15:27:36.143442+0000","last_unstale":"2023-11-04T15:37:25.666192+0000","last_undegraded":"2023-11-04T15:37:25.666192+0000","last_fullsized":"2023-11-04T15:37:25.666192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3359","last_scrub_stamp":"2023-11-04T15:37:25.666058+0000","last_deep_scrub":"40'3359","last_deep_scrub_stamp":"2023-11-04T15:37:25.666058+0000","last_clean_scrub_stamp":"2023-11-04T15:37:25.666058+0000","objects_scrubbed":0,"log_size":3359,"log_dups_size":0,"ondisk_log_size":3359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:56:39.468680+0000","scrub_duration":0.003764154,"objects_trimmed":0,"snaptrim_duration":0.072078296,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1167,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"44'3780","reported_seq":3832,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:56.657179+0000","last_change":"2023-11-04T15:37:56.657328+0000","last_active":"2023-11-04T15:37:56.657179+0000","last_peered":"2023-11-04T15:37:56.657179+0000","last_clean":"2023-11-04T15:37:56.657179+0000","last_became_active":"2023-11-04T15:27:35.770539+0000","last_became_peered":"2023-11-04T15:27:35.770539+0000","last_unstale":"2023-11-04T15:37:56.657179+0000","last_undegraded":"2023-11-04T15:37:56.657179+0000","last_fullsized":"2023-11-04T15:37:56.657179+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3780","last_scrub_stamp":"2023-11-04T15:37:56.657156+0000","last_deep_scrub":"44'3780","last_deep_scrub_stamp":"2023-11-04T15:37:56.657156+0000","last_clean_scrub_stamp":"2023-11-04T15:37:56.657156+0000","objects_scrubbed":2,"log_size":3780,"log_dups_size":0,"ondisk_log_size":3780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:53.508705+0000","scrub_duration":0.023445829000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3770,"num_write_kb":38321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"44'3794","reported_seq":3161,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:14.135362+0000","last_change":"2023-11-04T15:38:14.135463+0000","last_active":"2023-11-04T15:38:14.135362+0000","last_peered":"2023-11-04T15:38:14.135362+0000","last_clean":"2023-11-04T15:38:14.135362+0000","last_became_active":"2023-11-04T15:27:36.146477+0000","last_became_peered":"2023-11-04T15:27:36.146477+0000","last_unstale":"2023-11-04T15:38:14.135362+0000","last_undegraded":"2023-11-04T15:38:14.135362+0000","last_fullsized":"2023-11-04T15:38:14.135362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3794","last_scrub_stamp":"2023-11-04T15:38:14.135338+0000","last_deep_scrub":"44'3794","last_deep_scrub_stamp":"2023-11-04T15:38:14.135338+0000","last_clean_scrub_stamp":"2023-11-04T15:38:14.135338+0000","objects_scrubbed":3,"log_size":3794,"log_dups_size":0,"ondisk_log_size":3794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:47:53.874864+0000","scrub_duration":0.014159603999999999,"objects_trimmed":0,"snaptrim_duration":0.063144525000000007,"stat_sum":{"num_bytes":8192,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1270,"num_write_kb":694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"44'2947","reported_seq":2999,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:53.659127+0000","last_change":"2023-11-04T15:37:53.659229+0000","last_active":"2023-11-04T15:37:53.659127+0000","last_peered":"2023-11-04T15:37:53.659127+0000","last_clean":"2023-11-04T15:37:53.659127+0000","last_became_active":"2023-11-04T15:27:35.771316+0000","last_became_peered":"2023-11-04T15:27:35.771316+0000","last_unstale":"2023-11-04T15:37:53.659127+0000","last_undegraded":"2023-11-04T15:37:53.659127+0000","last_fullsized":"2023-11-04T15:37:53.659127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2947","last_scrub_stamp":"2023-11-04T15:37:53.659103+0000","last_deep_scrub":"44'2947","last_deep_scrub_stamp":"2023-11-04T15:37:53.659103+0000","last_clean_scrub_stamp":"2023-11-04T15:37:53.659103+0000","objects_scrubbed":4,"log_size":2947,"log_dups_size":0,"ondisk_log_size":2947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:21:19.713505+0000","scrub_duration":0.039096767999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2943,"num_write_kb":28401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"44'3597","reported_seq":3019,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:09.671026+0000","last_change":"2023-11-04T15:37:09.671026+0000","last_active":"2023-11-04T15:37:09.671026+0000","last_peered":"2023-11-04T15:37:09.671026+0000","last_clean":"2023-11-04T15:37:09.671026+0000","last_became_active":"2023-11-04T15:27:36.144066+0000","last_became_peered":"2023-11-04T15:27:36.144066+0000","last_unstale":"2023-11-04T15:37:09.671026+0000","last_undegraded":"2023-11-04T15:37:09.671026+0000","last_fullsized":"2023-11-04T15:37:09.671026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3597","last_scrub_stamp":"2023-11-04T15:37:09.670901+0000","last_deep_scrub":"44'3597","last_deep_scrub_stamp":"2023-11-04T15:37:09.670901+0000","last_clean_scrub_stamp":"2023-11-04T15:37:09.670901+0000","objects_scrubbed":2,"log_size":3597,"log_dups_size":0,"ondisk_log_size":3597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T22:52:59.961460+0000","scrub_duration":0.010082327,"objects_trimmed":0,"snaptrim_duration":0.057889772999999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1118,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"44'931","reported_seq":983,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:46.627662+0000","last_change":"2023-11-04T15:37:46.627792+0000","last_active":"2023-11-04T15:37:46.627662+0000","last_peered":"2023-11-04T15:37:46.627662+0000","last_clean":"2023-11-04T15:37:46.627662+0000","last_became_active":"2023-11-04T15:27:35.767852+0000","last_became_peered":"2023-11-04T15:27:35.767852+0000","last_unstale":"2023-11-04T15:37:46.627662+0000","last_undegraded":"2023-11-04T15:37:46.627662+0000","last_fullsized":"2023-11-04T15:37:46.627662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'931","last_scrub_stamp":"2023-11-04T15:37:46.627638+0000","last_deep_scrub":"44'931","last_deep_scrub_stamp":"2023-11-04T15:37:46.627638+0000","last_clean_scrub_stamp":"2023-11-04T15:37:46.627638+0000","objects_scrubbed":5,"log_size":931,"log_dups_size":0,"ondisk_log_size":931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:40:26.233782+0000","scrub_duration":0.040590909000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":923,"num_write_kb":21087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"44'3553","reported_seq":2986,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:20.652542+0000","last_change":"2023-11-04T15:38:20.652681+0000","last_active":"2023-11-04T15:38:20.652542+0000","last_peered":"2023-11-04T15:38:20.652542+0000","last_clean":"2023-11-04T15:38:20.652542+0000","last_became_active":"2023-11-04T15:27:36.141167+0000","last_became_peered":"2023-11-04T15:27:36.141167+0000","last_unstale":"2023-11-04T15:38:20.652542+0000","last_undegraded":"2023-11-04T15:38:20.652542+0000","last_fullsized":"2023-11-04T15:38:20.652542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3553","last_scrub_stamp":"2023-11-04T15:38:20.652503+0000","last_deep_scrub":"44'3553","last_deep_scrub_stamp":"2023-11-04T15:38:20.652503+0000","last_clean_scrub_stamp":"2023-11-04T15:38:20.652503+0000","objects_scrubbed":1,"log_size":3553,"log_dups_size":0,"ondisk_log_size":3553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:48:00.392030+0000","scrub_duration":0.0095782799999999998,"objects_trimmed":0,"snaptrim_duration":0.057363947999999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1127,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"44'3229","reported_seq":3281,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:37.512770+0000","last_change":"2023-11-04T15:37:37.512913+0000","last_active":"2023-11-04T15:37:37.512770+0000","last_peered":"2023-11-04T15:37:37.512770+0000","last_clean":"2023-11-04T15:37:37.512770+0000","last_became_active":"2023-11-04T15:27:35.775171+0000","last_became_peered":"2023-11-04T15:27:35.775171+0000","last_unstale":"2023-11-04T15:37:37.512770+0000","last_undegraded":"2023-11-04T15:37:37.512770+0000","last_fullsized":"2023-11-04T15:37:37.512770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3229","last_scrub_stamp":"2023-11-04T15:37:37.512732+0000","last_deep_scrub":"44'3229","last_deep_scrub_stamp":"2023-11-04T15:37:37.512732+0000","last_clean_scrub_stamp":"2023-11-04T15:37:37.512732+0000","objects_scrubbed":4,"log_size":3229,"log_dups_size":0,"ondisk_log_size":3229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:07:51.143393+0000","scrub_duration":0.039893972,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3214,"num_write_kb":42509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"44'3490","reported_seq":2947,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:09.749095+0000","last_change":"2023-11-04T15:37:09.749095+0000","last_active":"2023-11-04T15:37:09.749095+0000","last_peered":"2023-11-04T15:37:09.749095+0000","last_clean":"2023-11-04T15:37:09.749095+0000","last_became_active":"2023-11-04T15:27:36.145560+0000","last_became_peered":"2023-11-04T15:27:36.145560+0000","last_unstale":"2023-11-04T15:37:09.749095+0000","last_undegraded":"2023-11-04T15:37:09.749095+0000","last_fullsized":"2023-11-04T15:37:09.749095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3490","last_scrub_stamp":"2023-11-04T15:37:09.748973+0000","last_deep_scrub":"44'3490","last_deep_scrub_stamp":"2023-11-04T15:37:09.748973+0000","last_clean_scrub_stamp":"2023-11-04T15:37:09.748973+0000","objects_scrubbed":5,"log_size":3490,"log_dups_size":0,"ondisk_log_size":3490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:31.358580+0000","scrub_duration":0.011863093,"objects_trimmed":0,"snaptrim_duration":0.07011676,"stat_sum":{"num_bytes":4151,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":1159,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"44'4215","reported_seq":4268,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:09.815711+0000","last_change":"2023-11-04T15:38:09.815860+0000","last_active":"2023-11-04T15:38:09.815711+0000","last_peered":"2023-11-04T15:38:09.815711+0000","last_clean":"2023-11-04T15:38:09.815711+0000","last_became_active":"2023-11-04T15:27:35.770873+0000","last_became_peered":"2023-11-04T15:27:35.770873+0000","last_unstale":"2023-11-04T15:38:09.815711+0000","last_undegraded":"2023-11-04T15:38:09.815711+0000","last_fullsized":"2023-11-04T15:38:09.815711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4215","last_scrub_stamp":"2023-11-04T15:38:09.815689+0000","last_deep_scrub":"44'4215","last_deep_scrub_stamp":"2023-11-04T15:38:09.815689+0000","last_clean_scrub_stamp":"2023-11-04T15:38:09.815689+0000","objects_scrubbed":1,"log_size":4215,"log_dups_size":0,"ondisk_log_size":4215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:27.273970+0000","scrub_duration":0.014824155,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4214,"num_write_kb":32525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"44'4092","reported_seq":3407,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:13.735284+0000","last_change":"2023-11-04T15:37:13.735284+0000","last_active":"2023-11-04T15:37:13.735284+0000","last_peered":"2023-11-04T15:37:13.735284+0000","last_clean":"2023-11-04T15:37:13.735284+0000","last_became_active":"2023-11-04T15:27:36.147535+0000","last_became_peered":"2023-11-04T15:27:36.147535+0000","last_unstale":"2023-11-04T15:37:13.735284+0000","last_undegraded":"2023-11-04T15:37:13.735284+0000","last_fullsized":"2023-11-04T15:37:13.735284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4092","last_scrub_stamp":"2023-11-04T15:37:13.735159+0000","last_deep_scrub":"44'4092","last_deep_scrub_stamp":"2023-11-04T15:37:13.735159+0000","last_clean_scrub_stamp":"2023-11-04T15:37:13.735159+0000","objects_scrubbed":2,"log_size":4092,"log_dups_size":0,"ondisk_log_size":4092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:20:39.611539+0000","scrub_duration":0.012119325,"objects_trimmed":0,"snaptrim_duration":0.055801837,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1294,"num_write_kb":719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"44'1592","reported_seq":1645,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:11.894655+0000","last_change":"2023-11-04T15:38:11.894759+0000","last_active":"2023-11-04T15:38:11.894655+0000","last_peered":"2023-11-04T15:38:11.894655+0000","last_clean":"2023-11-04T15:38:11.894655+0000","last_became_active":"2023-11-04T15:27:35.775918+0000","last_became_peered":"2023-11-04T15:27:35.775918+0000","last_unstale":"2023-11-04T15:38:11.894655+0000","last_undegraded":"2023-11-04T15:38:11.894655+0000","last_fullsized":"2023-11-04T15:38:11.894655+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1592","last_scrub_stamp":"2023-11-04T15:38:11.894631+0000","last_deep_scrub":"44'1592","last_deep_scrub_stamp":"2023-11-04T15:38:11.894631+0000","last_clean_scrub_stamp":"2023-11-04T15:38:11.894631+0000","objects_scrubbed":3,"log_size":1592,"log_dups_size":0,"ondisk_log_size":1592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:03:12.567650+0000","scrub_duration":0.018695843,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1587,"num_write_kb":12658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1143,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":127433,"num_objects":92,"num_object_clones":25,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":8,"num_read":46,"num_read_kb":30,"num_write":74822,"num_write_kb":40603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":254672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224370,"ondisk_log_size":224370,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":430735581,"num_objects":126,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":126,"num_whiteouts":0,"num_read":190,"num_read_kb":3338,"num_write":83456,"num_write_kb":897544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7850,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":861528064,"data_stored":861471162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83202,"ondisk_log_size":83202,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705804,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":663648,"kb_used_data":173208,"kb_used_omap":0,"kb_used_meta":490432,"kb_avail":93708192,"statfs":{"total":96636764160,"available":95957188608,"internally_reserved":0,"allocated":177364992,"data_stored":176999461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":502202368},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 15:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47899999999999998,"15min":0.40400000000000003},"min":{"1min":0.28899999999999998,"5min":0.182,"15min":0.156},"max":{"1min":0.67900000000000005,"5min":10.488,"15min":10.488},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.628,"15min":0.45800000000000002},"min":{"1min":0.218,"5min":0.20200000000000001,"15min":0.186},"max":{"1min":0.61599999999999999,"5min":13.055,"15min":13.055},"last":0.41799999999999998}]},{"osd":1,"last update":"Sat Nov 4 15:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.54000000000000004,"15min":0.435},"min":{"1min":0.23499999999999999,"5min":0.20200000000000001,"15min":0.188},"max":{"1min":0.71199999999999997,"5min":12.347,"15min":12.347},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.53000000000000003,"15min":0.439},"min":{"1min":0.26600000000000001,"5min":0.23100000000000001,"15min":0.186},"max":{"1min":0.65300000000000002,"5min":12.853999999999999,"15min":12.853999999999999},"last":0.44500000000000001}]},{"osd":2,"last update":"Sat Nov 4 15:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.441,"15min":0.34499999999999997},"min":{"1min":0.17199999999999999,"5min":0.153,"15min":0.153},"max":{"1min":0.46100000000000002,"5min":11.709,"15min":11.709},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.42899999999999999,"15min":0.35499999999999998},"min":{"1min":0.22600000000000001,"5min":0.161,"15min":0.14899999999999999},"max":{"1min":0.47899999999999998,"5min":9.2629999999999999,"15min":9.2629999999999999},"last":0.34699999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705803,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":952424,"kb_used_data":245472,"kb_used_omap":0,"kb_used_meta":706944,"kb_avail":93419416,"statfs":{"total":96636764160,"available":95661481984,"internally_reserved":0,"allocated":251363328,"data_stored":250991590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":723910656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 15:37:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":0.64800000000000002,"15min":0.46600000000000003},"min":{"1min":0.20599999999999999,"5min":0.153,"15min":0.151},"max":{"1min":21.297999999999998,"5min":21.297999999999998,"15min":21.297999999999998},"last":0.47899999999999998},{"interface":"front","average":{"1min":1.252,"5min":0.55900000000000005,"15min":0.432},"min":{"1min":0.26000000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":17.809000000000001,"5min":17.809000000000001,"15min":17.809000000000001},"last":0.503}]},{"osd":1,"last update":"Sat Nov 4 15:37:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":0.53800000000000003,"15min":0.44700000000000001},"min":{"1min":0.379,"5min":0.192,"15min":0.17100000000000001},"max":{"1min":10.851000000000001,"5min":10.851000000000001,"15min":10.851000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":1.2509999999999999,"5min":0.54200000000000004,"15min":0.46100000000000002},"min":{"1min":0.37,"5min":0.20899999999999999,"15min":0.20399999999999999},"max":{"1min":8.9740000000000002,"5min":8.9740000000000002,"15min":8.9740000000000002},"last":0.52200000000000002}]},{"osd":3,"last update":"Sat Nov 4 15:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.33700000000000002,"15min":0.32400000000000001},"min":{"1min":0.19700000000000001,"5min":0.152,"15min":0.14699999999999999},"max":{"1min":3.3929999999999998,"5min":3.3929999999999998,"15min":3.3929999999999998},"last":0.371},{"interface":"front","average":{"1min":0.874,"5min":0.43099999999999999,"15min":0.373},"min":{"1min":0.248,"5min":0.159,"15min":0.14899999999999999},"max":{"1min":10.887,"5min":10.887,"15min":10.887},"last":0.29399999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705802,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":719272,"kb_used_data":188640,"kb_used_omap":0,"kb_used_meta":530624,"kb_avail":93652568,"statfs":{"total":96636764160,"available":95900229632,"internally_reserved":0,"allocated":193167360,"data_stored":192807863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":543358976},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 15:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.28699999999999998,"5min":0.42899999999999999,"15min":0.318},"min":{"1min":0.20499999999999999,"5min":0.152,"15min":0.14399999999999999},"max":{"1min":0.377,"5min":12.768000000000001,"15min":12.768000000000001},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.33800000000000002,"15min":0.29999999999999999},"min":{"1min":0.22500000000000001,"5min":0.14399999999999999,"15min":0.14399999999999999},"max":{"1min":1.847,"5min":8.609,"15min":8.609},"last":0.30299999999999999}]},{"osd":2,"last update":"Sat Nov 4 15:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.44400000000000001,"15min":0.438},"min":{"1min":0.215,"5min":0.19600000000000001,"15min":0.189},"max":{"1min":0.624,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.495},{"interface":"front","average":{"1min":0.434,"5min":0.42199999999999999,"15min":0.41999999999999998},"min":{"1min":0.27400000000000002,"5min":0.21299999999999999,"15min":0.192},"max":{"1min":0.56799999999999995,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.42599999999999999}]},{"osd":3,"last update":"Sat Nov 4 15:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.45100000000000001,"15min":0.435},"min":{"1min":0.26200000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.621,"5min":6.7679999999999998,"15min":6.7679999999999998},"last":0.437},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.45200000000000001,"15min":0.44700000000000001},"min":{"1min":0.26600000000000001,"5min":0.25600000000000001,"15min":0.24299999999999999},"max":{"1min":0.58399999999999996,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.45000000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705803,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":918208,"kb_used_data":237496,"kb_used_omap":0,"kb_used_meta":680704,"kb_avail":93453632,"statfs":{"total":96636764160,"available":95696519168,"internally_reserved":0,"allocated":243195904,"data_stored":242832608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":697040896},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 15:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.46200000000000002,"15min":0.32400000000000001},"min":{"1min":0.22700000000000001,"5min":0.14499999999999999,"15min":0.13500000000000001},"max":{"1min":0.44,"5min":12.731,"15min":12.731},"last":0.251},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.30399999999999999,"15min":0.27900000000000003},"min":{"1min":0.253,"5min":0.16400000000000001,"15min":0.155},"max":{"1min":0.45900000000000002,"5min":4.1200000000000001,"15min":4.1200000000000001},"last":0.27800000000000002}]},{"osd":2,"last update":"Sat Nov 4 15:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.49099999999999999,"15min":0.434},"min":{"1min":0.38400000000000001,"5min":0.219,"15min":0.17599999999999999},"max":{"1min":0.70399999999999996,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.46500000000000002,"15min":0.433},"min":{"1min":0.36499999999999999,"5min":0.21099999999999999,"15min":0.187},"max":{"1min":0.72999999999999998,"5min":3.6749999999999998,"15min":3.6749999999999998},"last":0.52100000000000002}]},{"osd":3,"last update":"Sat Nov 4 15:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.5,"15min":0.44600000000000001},"min":{"1min":0.35899999999999999,"5min":0.20899999999999999,"15min":0.20300000000000001},"max":{"1min":0.71899999999999997,"5min":6.4660000000000002,"15min":6.4660000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.50600000000000001,"15min":0.45300000000000001},"min":{"1min":0.40600000000000003,"5min":0.23899999999999999,"15min":0.23000000000000001},"max":{"1min":0.70899999999999996,"5min":6.3540000000000001,"15min":6.3540000000000001},"last":0.58399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":242003968,"data_stored":241991173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":192552960,"data_stored":192552686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":250785792,"data_stored":250765155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":176185344,"data_stored":176162148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":69829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":73939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":45197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":65707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T15:38:49.733 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:49.733 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:49.734 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:49.734 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:49.735 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:38:49.736 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-04T15:39:04.220 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:39:04.223 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:39:04.226 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:39:09.736 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T15:39:09.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.853+0000 7fa0db35c640 1 Processor -- start 2023-11-04T15:39:09.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.853+0000 7fa0db35c640 1 -- start start 2023-11-04T15:39:09.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.854+0000 7fa0db35c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa0d41372b0 0x7fa0d4137690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:09.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.854+0000 7fa0db35c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d40a2220 con 0x7fa0d409fb10 2023-11-04T15:39:09.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.854+0000 7fa0db35c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d406e100 con 0x7fa0d40a0bf0 2023-11-04T15:39:09.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.854+0000 7fa0db35c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d4136ca0 con 0x7fa0d41372b0 2023-11-04T15:39:09.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.854+0000 7fa0d98f9640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa0d409fb10 0x7fa0d413efe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56484/0 (socket says 172.21.15.19:56484) 2023-11-04T15:39:09.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.854+0000 7fa0d98f9640 1 -- 172.21.15.19:0/4241332264 learned_addr learned my addr 172.21.15.19:0/4241332264 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:39:09.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.854+0000 7fa0d90f8640 1 --2- 172.21.15.19:0/4241332264 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa0d41372b0 0x7fa0d4137690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:09.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.854+0000 7fa0d3fff640 1 -- 172.21.15.19:0/4241332264 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1345637133 0 0) 0x7fa0d40a2220 con 0x7fa0d409fb10 2023-11-04T15:39:09.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.854+0000 7fa0d3fff640 1 -- 172.21.15.19:0/4241332264 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0bc003520 con 0x7fa0d409fb10 2023-11-04T15:39:09.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.854+0000 7fa0d3fff640 1 -- 172.21.15.19:0/4241332264 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 100875707 0 0) 0x7fa0d406e100 con 0x7fa0d40a0bf0 2023-11-04T15:39:09.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.854+0000 7fa0d3fff640 1 -- 172.21.15.19:0/4241332264 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0d40a2220 con 0x7fa0d40a0bf0 2023-11-04T15:39:09.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.855+0000 7fa0d3fff640 1 -- 172.21.15.19:0/4241332264 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1431751531 0 0) 0x7fa0bc003520 con 0x7fa0d409fb10 2023-11-04T15:39:09.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.855+0000 7fa0d90f8640 1 -- 172.21.15.19:0/4241332264 >> v1:172.21.15.96:6789/0 conn(0x7fa0d40a0bf0 legacy=0x7fa0d409f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:09.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.855+0000 7fa0d90f8640 1 -- 172.21.15.19:0/4241332264 >> v1:172.21.15.19:6789/0 conn(0x7fa0d409fb10 legacy=0x7fa0d413efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:09.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.855+0000 7fa0d90f8640 1 -- 172.21.15.19:0/4241332264 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d4137bd0 con 0x7fa0d41372b0 2023-11-04T15:39:09.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.855+0000 7fa0d90f8640 1 --2- 172.21.15.19:0/4241332264 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa0d41372b0 0x7fa0d4137690 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4009dc0 tx=0x7fa0c402bcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40f123f82b1d96e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:39:09.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.856+0000 7fa0d3fff640 1 -- 172.21.15.19:0/4241332264 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc001670 con 0x7fa0d41372b0 2023-11-04T15:39:09.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.856+0000 7fa0d3fff640 1 -- 172.21.15.19:0/4241332264 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c402c7f0 con 0x7fa0d41372b0 2023-11-04T15:39:09.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.856+0000 7fa0d3fff640 1 -- 172.21.15.19:0/4241332264 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c402cb60 con 0x7fa0d41372b0 2023-11-04T15:39:09.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.856+0000 7fa0db35c640 1 -- 172.21.15.19:0/4241332264 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa0d41372b0 msgr2=0x7fa0d4137690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:09.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.856+0000 7fa0db35c640 1 --2- 172.21.15.19:0/4241332264 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa0d41372b0 0x7fa0d4137690 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4009dc0 tx=0x7fa0c402bcc0 comp rx=0 tx=0).stop 2023-11-04T15:39:09.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.856+0000 7fa0db35c640 1 -- 172.21.15.19:0/4241332264 shutdown_connections 2023-11-04T15:39:09.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.856+0000 7fa0db35c640 1 --2- 172.21.15.19:0/4241332264 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa0d41372b0 0x7fa0d4137690 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:09.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.856+0000 7fa0db35c640 1 -- 172.21.15.19:0/4241332264 >> 172.21.15.19:0/4241332264 conn(0x7fa0d40a8280 msgr2=0x7fa0d40a8690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:39:09.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.856+0000 7fa0db35c640 1 -- 172.21.15.19:0/4241332264 shutdown_connections 2023-11-04T15:39:09.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.856+0000 7fa0db35c640 1 -- 172.21.15.19:0/4241332264 wait complete. 2023-11-04T15:39:09.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.857+0000 7fa0db35c640 1 Processor -- start 2023-11-04T15:39:09.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.857+0000 7fa0db35c640 1 -- start start 2023-11-04T15:39:09.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.858+0000 7fa0db35c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0d409fb10 0x7fa0d4097a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:09.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.858+0000 7fa0db35c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa0d40a0bf0 0x7fa0d4097f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:09.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.858+0000 7fa0db35c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0d41372b0 0x7fa0d4098480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:09.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.858+0000 7fa0db35c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d4098f70 con 0x7fa0d409fb10 2023-11-04T15:39:09.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.858+0000 7fa0db35c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d409a4c0 con 0x7fa0d41372b0 2023-11-04T15:39:09.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.858+0000 7fa0db35c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d41365b0 con 0x7fa0d40a0bf0 2023-11-04T15:39:09.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.858+0000 7fa0d90f8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0d409fb10 0x7fa0d4097a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:09.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.858+0000 7fa0d90f8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0d409fb10 0x7fa0d4097a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60866/0 (socket says 172.21.15.19:60866) 2023-11-04T15:39:09.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.858+0000 7fa0d90f8640 1 -- 172.21.15.19:0/1093091781 learned_addr learned my addr 172.21.15.19:0/1093091781 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:39:09.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.858+0000 7fa0d88f7640 1 --2- 172.21.15.19:0/1093091781 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa0d40a0bf0 0x7fa0d4097f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:09.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.858+0000 7fa0d98f9640 1 --2- 172.21.15.19:0/1093091781 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0d41372b0 0x7fa0d4098480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:09.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.858+0000 7fa0d90f8640 1 -- 172.21.15.19:0/1093091781 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa0d40a0bf0 msgr2=0x7fa0d4097f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:09.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.858+0000 7fa0d90f8640 1 --2- 172.21.15.19:0/1093091781 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa0d40a0bf0 0x7fa0d4097f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:09.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.858+0000 7fa0d90f8640 1 -- 172.21.15.19:0/1093091781 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0d41372b0 msgr2=0x7fa0d4098480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:09.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.858+0000 7fa0d90f8640 1 --2- 172.21.15.19:0/1093091781 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0d41372b0 0x7fa0d4098480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:09.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.858+0000 7fa0d90f8640 1 -- 172.21.15.19:0/1093091781 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c4009a70 con 0x7fa0d409fb10 2023-11-04T15:39:09.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.858+0000 7fa0d90f8640 1 --2- 172.21.15.19:0/1093091781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0d409fb10 0x7fa0d4097a00 secure :-1 s=READY pgs=3784 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4009ee0 tx=0x7fa0c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:39:09.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.859+0000 7fa0d1ffb640 1 -- 172.21.15.19:0/1093091781 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c4035c70 con 0x7fa0d409fb10 2023-11-04T15:39:09.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.859+0000 7fa0d1ffb640 1 -- 172.21.15.19:0/1093091781 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c4035dd0 con 0x7fa0d409fb10 2023-11-04T15:39:09.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.859+0000 7fa0db35c640 1 -- 172.21.15.19:0/1093091781 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d41367f0 con 0x7fa0d409fb10 2023-11-04T15:39:09.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.859+0000 7fa0d1ffb640 1 -- 172.21.15.19:0/1093091781 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c403e630 con 0x7fa0d409fb10 2023-11-04T15:39:09.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.859+0000 7fa0db35c640 1 -- 172.21.15.19:0/1093091781 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d4099930 con 0x7fa0d409fb10 2023-11-04T15:39:09.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.860+0000 7fa0db35c640 1 -- 172.21.15.19:0/1093091781 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0d4067d60 con 0x7fa0d409fb10 2023-11-04T15:39:09.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.860+0000 7fa0d1ffb640 1 -- 172.21.15.19:0/1093091781 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa0c403b050 con 0x7fa0d409fb10 2023-11-04T15:39:09.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.861+0000 7fa0d1ffb640 1 --2- 172.21.15.19:0/1093091781 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa0c006a430 0x7fa0c006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:09.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.861+0000 7fa0d1ffb640 1 -- 172.21.15.19:0/1093091781 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4434+0+0 (secure 0 0 0) 0x7fa0c40aa400 con 0x7fa0d409fb10 2023-11-04T15:39:09.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.861+0000 7fa0d88f7640 1 --2- 172.21.15.19:0/1093091781 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa0c006a430 0x7fa0c006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:09.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.861+0000 7fa0d88f7640 1 --2- 172.21.15.19:0/1093091781 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa0c006a430 0x7fa0c006c8f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa0d40a7d90 tx=0x7fa0c8009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:39:09.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:09.865+0000 7fa0d1ffb640 1 -- 172.21.15.19:0/1093091781 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa0c40760a0 con 0x7fa0d409fb10 2023-11-04T15:39:10.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:10.040+0000 7fa0db35c640 1 -- 172.21.15.19:0/1093091781 --> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa0d40a1f60 con 0x7fa0c006a430 2023-11-04T15:39:10.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:10.047+0000 7fa0d1ffb640 1 -- 172.21.15.19:0/1093091781 <== mgr.4114 v2:172.21.15.96:6816/83123 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282036 (secure 0 0 0) 0x7fa0c80014d0 con 0x7fa0c006a430 2023-11-04T15:39:10.052 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:39:10.054 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-11-04T15:39:10.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:10.050+0000 7fa0db35c640 1 -- 172.21.15.19:0/1093091781 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa0c006a430 msgr2=0x7fa0c006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:10.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:10.050+0000 7fa0db35c640 1 --2- 172.21.15.19:0/1093091781 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa0c006a430 0x7fa0c006c8f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa0d40a7d90 tx=0x7fa0c8009040 comp rx=0 tx=0).stop 2023-11-04T15:39:10.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:10.050+0000 7fa0db35c640 1 -- 172.21.15.19:0/1093091781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0d409fb10 msgr2=0x7fa0d4097a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:10.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:10.050+0000 7fa0db35c640 1 --2- 172.21.15.19:0/1093091781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0d409fb10 0x7fa0d4097a00 secure :-1 s=READY pgs=3784 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4009ee0 tx=0x7fa0c4004a40 comp rx=0 tx=0).stop 2023-11-04T15:39:10.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:10.050+0000 7fa0db35c640 1 -- 172.21.15.19:0/1093091781 shutdown_connections 2023-11-04T15:39:10.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:10.050+0000 7fa0db35c640 1 --2- 172.21.15.19:0/1093091781 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa0c006a430 0x7fa0c006c8f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:10.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:10.050+0000 7fa0db35c640 1 --2- 172.21.15.19:0/1093091781 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0d41372b0 0x7fa0d4098480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:10.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:10.050+0000 7fa0db35c640 1 --2- 172.21.15.19:0/1093091781 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa0d40a0bf0 0x7fa0d4097f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:10.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:10.050+0000 7fa0db35c640 1 --2- 172.21.15.19:0/1093091781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0d409fb10 0x7fa0d4097a00 unknown :-1 s=CLOSED pgs=3784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:10.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:10.050+0000 7fa0db35c640 1 -- 172.21.15.19:0/1093091781 >> 172.21.15.19:0/1093091781 conn(0x7fa0d40a8280 msgr2=0x7fa0d4131710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:39:10.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:10.050+0000 7fa0db35c640 1 -- 172.21.15.19:0/1093091781 shutdown_connections 2023-11-04T15:39:10.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:10.050+0000 7fa0db35c640 1 -- 172.21.15.19:0/1093091781 wait complete. 2023-11-04T15:39:10.063 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":393,"stamp":"2023-11-04T15:39:09.087247+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":431453382,"num_objects":220,"num_object_clones":25,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":8,"num_read":352,"num_read_kb":3468,"num_write":158437,"num_write_kb":940563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7850,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":307700,"ondisk_log_size":307700,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":3253552,"kb_used_data":844816,"kb_used_omap":0,"kb_used_meta":2408704,"kb_avail":374233808,"statfs":{"total":386547056640,"available":383215419392,"internally_reserved":0,"allocated":865091584,"data_stored":863631522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2466512896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003561"},"pg_stats":[{"pgid":"4.3f","version":"40'3514","reported_seq":2963,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:08.783192+0000","last_change":"2023-11-04T15:37:08.783192+0000","last_active":"2023-11-04T15:37:08.783192+0000","last_peered":"2023-11-04T15:37:08.783192+0000","last_clean":"2023-11-04T15:37:08.783192+0000","last_became_active":"2023-11-04T15:27:36.150296+0000","last_became_peered":"2023-11-04T15:27:36.150296+0000","last_unstale":"2023-11-04T15:37:08.783192+0000","last_undegraded":"2023-11-04T15:37:08.783192+0000","last_fullsized":"2023-11-04T15:37:08.783192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3514","last_scrub_stamp":"2023-11-04T15:37:08.783013+0000","last_deep_scrub":"40'3514","last_deep_scrub_stamp":"2023-11-04T15:37:08.783013+0000","last_clean_scrub_stamp":"2023-11-04T15:37:08.783013+0000","objects_scrubbed":0,"log_size":3514,"log_dups_size":0,"ondisk_log_size":3514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:20:34.659393+0000","scrub_duration":0.0030156520000000002,"objects_trimmed":0,"snaptrim_duration":0.074678280999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1112,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"44'3336","reported_seq":2800,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:27.770913+0000","last_change":"2023-11-04T15:38:27.771063+0000","last_active":"2023-11-04T15:38:27.770913+0000","last_peered":"2023-11-04T15:38:27.770913+0000","last_clean":"2023-11-04T15:38:27.770913+0000","last_became_active":"2023-11-04T15:27:36.148939+0000","last_became_peered":"2023-11-04T15:27:36.148939+0000","last_unstale":"2023-11-04T15:38:27.770913+0000","last_undegraded":"2023-11-04T15:38:27.770913+0000","last_fullsized":"2023-11-04T15:38:27.770913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3336","last_scrub_stamp":"2023-11-04T15:38:27.770889+0000","last_deep_scrub":"44'3336","last_deep_scrub_stamp":"2023-11-04T15:38:27.770889+0000","last_clean_scrub_stamp":"2023-11-04T15:38:27.770889+0000","objects_scrubbed":4,"log_size":3336,"log_dups_size":0,"ondisk_log_size":3336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:29:32.990012+0000","scrub_duration":0.013599927,"objects_trimmed":0,"snaptrim_duration":0.059113046000000002,"stat_sum":{"num_bytes":35,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1118,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"44'3530","reported_seq":3015,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:39:03.167592+0000","last_change":"2023-11-04T15:39:03.167694+0000","last_active":"2023-11-04T15:39:03.167592+0000","last_peered":"2023-11-04T15:39:03.167592+0000","last_clean":"2023-11-04T15:39:03.167592+0000","last_became_active":"2023-11-04T15:27:36.149748+0000","last_became_peered":"2023-11-04T15:27:36.149748+0000","last_unstale":"2023-11-04T15:39:03.167592+0000","last_undegraded":"2023-11-04T15:39:03.167592+0000","last_fullsized":"2023-11-04T15:39:03.167592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3530","last_scrub_stamp":"2023-11-04T15:39:03.167569+0000","last_deep_scrub":"44'3530","last_deep_scrub_stamp":"2023-11-04T15:39:03.167569+0000","last_clean_scrub_stamp":"2023-11-04T15:39:03.167569+0000","objects_scrubbed":3,"log_size":3530,"log_dups_size":0,"ondisk_log_size":3530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:43:20.156908+0000","scrub_duration":0.013353248,"objects_trimmed":0,"snaptrim_duration":0.101592565,"stat_sum":{"num_bytes":8206,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":1149,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"40'3602","reported_seq":2996,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:13.718129+0000","last_change":"2023-11-04T15:38:13.718234+0000","last_active":"2023-11-04T15:38:13.718129+0000","last_peered":"2023-11-04T15:38:13.718129+0000","last_clean":"2023-11-04T15:38:13.718129+0000","last_became_active":"2023-11-04T15:27:36.139761+0000","last_became_peered":"2023-11-04T15:27:36.139761+0000","last_unstale":"2023-11-04T15:38:13.718129+0000","last_undegraded":"2023-11-04T15:38:13.718129+0000","last_fullsized":"2023-11-04T15:38:13.718129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3602","last_scrub_stamp":"2023-11-04T15:38:13.718107+0000","last_deep_scrub":"40'3602","last_deep_scrub_stamp":"2023-11-04T15:38:13.718107+0000","last_clean_scrub_stamp":"2023-11-04T15:38:13.718107+0000","objects_scrubbed":0,"log_size":3602,"log_dups_size":0,"ondisk_log_size":3602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:31.176388+0000","scrub_duration":0.0074235689999999997,"objects_trimmed":0,"snaptrim_duration":0.052924038,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1171,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"40'3725","reported_seq":3130,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:49.526048+0000","last_change":"2023-11-04T15:37:49.526154+0000","last_active":"2023-11-04T15:37:49.526048+0000","last_peered":"2023-11-04T15:37:49.526048+0000","last_clean":"2023-11-04T15:37:49.526048+0000","last_became_active":"2023-11-04T15:27:36.150017+0000","last_became_peered":"2023-11-04T15:27:36.150017+0000","last_unstale":"2023-11-04T15:37:49.526048+0000","last_undegraded":"2023-11-04T15:37:49.526048+0000","last_fullsized":"2023-11-04T15:37:49.526048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3725","last_scrub_stamp":"2023-11-04T15:37:49.526022+0000","last_deep_scrub":"40'3725","last_deep_scrub_stamp":"2023-11-04T15:37:49.526022+0000","last_clean_scrub_stamp":"2023-11-04T15:37:49.526022+0000","objects_scrubbed":0,"log_size":3725,"log_dups_size":0,"ondisk_log_size":3725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:46:35.934988+0000","scrub_duration":0.0051336519999999998,"objects_trimmed":0,"snaptrim_duration":0.073241305000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1192,"num_write_kb":641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"44'3328","reported_seq":2783,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:34.244312+0000","last_change":"2023-11-04T15:38:34.244401+0000","last_active":"2023-11-04T15:38:34.244312+0000","last_peered":"2023-11-04T15:38:34.244312+0000","last_clean":"2023-11-04T15:38:34.244312+0000","last_became_active":"2023-11-04T15:27:36.139036+0000","last_became_peered":"2023-11-04T15:27:36.139036+0000","last_unstale":"2023-11-04T15:38:34.244312+0000","last_undegraded":"2023-11-04T15:38:34.244312+0000","last_fullsized":"2023-11-04T15:38:34.244312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3328","last_scrub_stamp":"2023-11-04T15:38:34.244289+0000","last_deep_scrub":"44'3328","last_deep_scrub_stamp":"2023-11-04T15:38:34.244289+0000","last_clean_scrub_stamp":"2023-11-04T15:38:34.244289+0000","objects_scrubbed":1,"log_size":3328,"log_dups_size":0,"ondisk_log_size":3328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:39:09.364625+0000","scrub_duration":0.0082036850000000005,"objects_trimmed":0,"snaptrim_duration":0.102154117,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1074,"num_write_kb":603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"44'3356","reported_seq":2819,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:26.478185+0000","last_change":"2023-11-04T15:37:26.478185+0000","last_active":"2023-11-04T15:37:26.478185+0000","last_peered":"2023-11-04T15:37:26.478185+0000","last_clean":"2023-11-04T15:37:26.478185+0000","last_became_active":"2023-11-04T15:27:36.139121+0000","last_became_peered":"2023-11-04T15:27:36.139121+0000","last_unstale":"2023-11-04T15:37:26.478185+0000","last_undegraded":"2023-11-04T15:37:26.478185+0000","last_fullsized":"2023-11-04T15:37:26.478185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3356","last_scrub_stamp":"2023-11-04T15:37:26.478037+0000","last_deep_scrub":"44'3356","last_deep_scrub_stamp":"2023-11-04T15:37:26.478037+0000","last_clean_scrub_stamp":"2023-11-04T15:37:26.478037+0000","objects_scrubbed":5,"log_size":3356,"log_dups_size":0,"ondisk_log_size":3356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:38:01.386862+0000","scrub_duration":0.011615044999999999,"objects_trimmed":0,"snaptrim_duration":0.099827518000000004,"stat_sum":{"num_bytes":4117,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":2,"num_read_kb":1,"num_write":1086,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"40'3425","reported_seq":2844,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:07.611595+0000","last_change":"2023-11-04T15:36:55.816551+0000","last_active":"2023-11-04T15:37:07.611595+0000","last_peered":"2023-11-04T15:37:07.611595+0000","last_clean":"2023-11-04T15:37:07.611595+0000","last_became_active":"2023-11-04T15:27:36.147050+0000","last_became_peered":"2023-11-04T15:27:36.147050+0000","last_unstale":"2023-11-04T15:37:07.611595+0000","last_undegraded":"2023-11-04T15:37:07.611595+0000","last_fullsized":"2023-11-04T15:37:07.611595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:27:35.748092+0000","last_clean_scrub_stamp":"2023-11-04T15:27:35.748092+0000","objects_scrubbed":0,"log_size":3425,"log_dups_size":0,"ondisk_log_size":3425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.098810337999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"44'3562","reported_seq":2977,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:38.816297+0000","last_change":"2023-11-04T15:38:38.816421+0000","last_active":"2023-11-04T15:38:38.816297+0000","last_peered":"2023-11-04T15:38:38.816297+0000","last_clean":"2023-11-04T15:38:38.816297+0000","last_became_active":"2023-11-04T15:27:36.145825+0000","last_became_peered":"2023-11-04T15:27:36.145825+0000","last_unstale":"2023-11-04T15:38:38.816297+0000","last_undegraded":"2023-11-04T15:38:38.816297+0000","last_fullsized":"2023-11-04T15:38:38.816297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3562","last_scrub_stamp":"2023-11-04T15:38:38.816274+0000","last_deep_scrub":"44'3562","last_deep_scrub_stamp":"2023-11-04T15:38:38.816274+0000","last_clean_scrub_stamp":"2023-11-04T15:38:38.816274+0000","objects_scrubbed":1,"log_size":3562,"log_dups_size":0,"ondisk_log_size":3562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:39:40.398994+0000","scrub_duration":0.0076341400000000002,"objects_trimmed":0,"snaptrim_duration":0.072094483000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"44'3329","reported_seq":2857,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:55.514489+0000","last_change":"2023-11-04T15:37:55.514590+0000","last_active":"2023-11-04T15:37:55.514489+0000","last_peered":"2023-11-04T15:37:55.514489+0000","last_clean":"2023-11-04T15:37:55.514489+0000","last_became_active":"2023-11-04T15:27:36.150307+0000","last_became_peered":"2023-11-04T15:27:36.150307+0000","last_unstale":"2023-11-04T15:37:55.514489+0000","last_undegraded":"2023-11-04T15:37:55.514489+0000","last_fullsized":"2023-11-04T15:37:55.514489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3329","last_scrub_stamp":"2023-11-04T15:37:55.514464+0000","last_deep_scrub":"44'3329","last_deep_scrub_stamp":"2023-11-04T15:37:55.514464+0000","last_clean_scrub_stamp":"2023-11-04T15:37:55.514464+0000","objects_scrubbed":2,"log_size":3329,"log_dups_size":0,"ondisk_log_size":3329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:11:45.335660+0000","scrub_duration":0.011217928,"objects_trimmed":0,"snaptrim_duration":0.10012518099999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1064,"num_write_kb":572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"40'3202","reported_seq":2732,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:12.694264+0000","last_change":"2023-11-04T15:38:12.694422+0000","last_active":"2023-11-04T15:38:12.694264+0000","last_peered":"2023-11-04T15:38:12.694264+0000","last_clean":"2023-11-04T15:38:12.694264+0000","last_became_active":"2023-11-04T15:27:36.144988+0000","last_became_peered":"2023-11-04T15:27:36.144988+0000","last_unstale":"2023-11-04T15:38:12.694264+0000","last_undegraded":"2023-11-04T15:38:12.694264+0000","last_fullsized":"2023-11-04T15:38:12.694264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3202","last_scrub_stamp":"2023-11-04T15:38:12.694227+0000","last_deep_scrub":"40'3202","last_deep_scrub_stamp":"2023-11-04T15:38:12.694227+0000","last_clean_scrub_stamp":"2023-11-04T15:38:12.694227+0000","objects_scrubbed":0,"log_size":3202,"log_dups_size":0,"ondisk_log_size":3202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:44:10.147349+0000","scrub_duration":0.0048418030000000004,"objects_trimmed":0,"snaptrim_duration":0.052379294999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1028,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"44'3395","reported_seq":2835,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:21.176452+0000","last_change":"2023-11-04T15:38:21.176557+0000","last_active":"2023-11-04T15:38:21.176452+0000","last_peered":"2023-11-04T15:38:21.176452+0000","last_clean":"2023-11-04T15:38:21.176452+0000","last_became_active":"2023-11-04T15:27:36.149156+0000","last_became_peered":"2023-11-04T15:27:36.149156+0000","last_unstale":"2023-11-04T15:38:21.176452+0000","last_undegraded":"2023-11-04T15:38:21.176452+0000","last_fullsized":"2023-11-04T15:38:21.176452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3395","last_scrub_stamp":"2023-11-04T15:38:21.176427+0000","last_deep_scrub":"44'3395","last_deep_scrub_stamp":"2023-11-04T15:38:21.176427+0000","last_clean_scrub_stamp":"2023-11-04T15:38:21.176427+0000","objects_scrubbed":1,"log_size":3395,"log_dups_size":0,"ondisk_log_size":3395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:29:26.395550+0000","scrub_duration":0.011035761999999999,"objects_trimmed":0,"snaptrim_duration":0.064372897999999998,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1159,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"40'3255","reported_seq":2755,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:24.864365+0000","last_change":"2023-11-04T15:38:24.864474+0000","last_active":"2023-11-04T15:38:24.864365+0000","last_peered":"2023-11-04T15:38:24.864365+0000","last_clean":"2023-11-04T15:38:24.864365+0000","last_became_active":"2023-11-04T15:27:36.139824+0000","last_became_peered":"2023-11-04T15:27:36.139824+0000","last_unstale":"2023-11-04T15:38:24.864365+0000","last_undegraded":"2023-11-04T15:38:24.864365+0000","last_fullsized":"2023-11-04T15:38:24.864365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3255","last_scrub_stamp":"2023-11-04T15:38:24.864341+0000","last_deep_scrub":"40'3255","last_deep_scrub_stamp":"2023-11-04T15:38:24.864341+0000","last_clean_scrub_stamp":"2023-11-04T15:38:24.864341+0000","objects_scrubbed":0,"log_size":3255,"log_dups_size":0,"ondisk_log_size":3255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:32:57.678216+0000","scrub_duration":0.0057894940000000001,"objects_trimmed":0,"snaptrim_duration":0.070068697999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1062,"num_write_kb":575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"44'3539","reported_seq":2930,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:24.652046+0000","last_change":"2023-11-04T15:38:24.652151+0000","last_active":"2023-11-04T15:38:24.652046+0000","last_peered":"2023-11-04T15:38:24.652046+0000","last_clean":"2023-11-04T15:38:24.652046+0000","last_became_active":"2023-11-04T15:27:36.147273+0000","last_became_peered":"2023-11-04T15:27:36.147273+0000","last_unstale":"2023-11-04T15:38:24.652046+0000","last_undegraded":"2023-11-04T15:38:24.652046+0000","last_fullsized":"2023-11-04T15:38:24.652046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3539","last_scrub_stamp":"2023-11-04T15:38:24.652022+0000","last_deep_scrub":"44'3539","last_deep_scrub_stamp":"2023-11-04T15:38:24.652022+0000","last_clean_scrub_stamp":"2023-11-04T15:38:24.652022+0000","objects_scrubbed":1,"log_size":3539,"log_dups_size":0,"ondisk_log_size":3539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:16:59.050291+0000","scrub_duration":0.0093328639999999997,"objects_trimmed":0,"snaptrim_duration":0.055716603000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"40'3766","reported_seq":3170,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:15.722839+0000","last_change":"2023-11-04T15:38:15.722956+0000","last_active":"2023-11-04T15:38:15.722839+0000","last_peered":"2023-11-04T15:38:15.722839+0000","last_clean":"2023-11-04T15:38:15.722839+0000","last_became_active":"2023-11-04T15:27:36.148932+0000","last_became_peered":"2023-11-04T15:27:36.148932+0000","last_unstale":"2023-11-04T15:38:15.722839+0000","last_undegraded":"2023-11-04T15:38:15.722839+0000","last_fullsized":"2023-11-04T15:38:15.722839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3766","last_scrub_stamp":"2023-11-04T15:38:15.722815+0000","last_deep_scrub":"40'3766","last_deep_scrub_stamp":"2023-11-04T15:38:15.722815+0000","last_clean_scrub_stamp":"2023-11-04T15:38:15.722815+0000","objects_scrubbed":0,"log_size":3766,"log_dups_size":0,"ondisk_log_size":3766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:03:16.395834+0000","scrub_duration":0.0047167329999999999,"objects_trimmed":0,"snaptrim_duration":0.062648212999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1209,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"44'3539","reported_seq":2958,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:39:05.203425+0000","last_change":"2023-11-04T15:39:05.203578+0000","last_active":"2023-11-04T15:39:05.203425+0000","last_peered":"2023-11-04T15:39:05.203425+0000","last_clean":"2023-11-04T15:39:05.203425+0000","last_became_active":"2023-11-04T15:27:36.150856+0000","last_became_peered":"2023-11-04T15:27:36.150856+0000","last_unstale":"2023-11-04T15:39:05.203425+0000","last_undegraded":"2023-11-04T15:39:05.203425+0000","last_fullsized":"2023-11-04T15:39:05.203425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3539","last_scrub_stamp":"2023-11-04T15:39:05.203385+0000","last_deep_scrub":"44'3539","last_deep_scrub_stamp":"2023-11-04T15:39:05.203385+0000","last_clean_scrub_stamp":"2023-11-04T15:39:05.203385+0000","objects_scrubbed":1,"log_size":3539,"log_dups_size":0,"ondisk_log_size":3539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:27:48.900527+0000","scrub_duration":0.0087229419999999992,"objects_trimmed":0,"snaptrim_duration":0.099772735000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"40'3671","reported_seq":3011,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:33.881828+0000","last_change":"2023-11-04T15:38:33.881938+0000","last_active":"2023-11-04T15:38:33.881828+0000","last_peered":"2023-11-04T15:38:33.881828+0000","last_clean":"2023-11-04T15:38:33.881828+0000","last_became_active":"2023-11-04T15:27:36.144997+0000","last_became_peered":"2023-11-04T15:27:36.144997+0000","last_unstale":"2023-11-04T15:38:33.881828+0000","last_undegraded":"2023-11-04T15:38:33.881828+0000","last_fullsized":"2023-11-04T15:38:33.881828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3671","last_scrub_stamp":"2023-11-04T15:38:33.881801+0000","last_deep_scrub":"40'3671","last_deep_scrub_stamp":"2023-11-04T15:38:33.881801+0000","last_clean_scrub_stamp":"2023-11-04T15:38:33.881801+0000","objects_scrubbed":0,"log_size":3671,"log_dups_size":0,"ondisk_log_size":3671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:06:16.633743+0000","scrub_duration":0.0051090789999999999,"objects_trimmed":0,"snaptrim_duration":0.072563297999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1270,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"44'3139","reported_seq":2656,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:43.481415+0000","last_change":"2023-11-04T15:37:43.481511+0000","last_active":"2023-11-04T15:37:43.481415+0000","last_peered":"2023-11-04T15:37:43.481415+0000","last_clean":"2023-11-04T15:37:43.481415+0000","last_became_active":"2023-11-04T15:27:36.150555+0000","last_became_peered":"2023-11-04T15:27:36.150555+0000","last_unstale":"2023-11-04T15:37:43.481415+0000","last_undegraded":"2023-11-04T15:37:43.481415+0000","last_fullsized":"2023-11-04T15:37:43.481415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3139","last_scrub_stamp":"2023-11-04T15:37:43.481392+0000","last_deep_scrub":"44'3139","last_deep_scrub_stamp":"2023-11-04T15:37:43.481392+0000","last_clean_scrub_stamp":"2023-11-04T15:37:43.481392+0000","objects_scrubbed":2,"log_size":3139,"log_dups_size":0,"ondisk_log_size":3139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:46:29.890357+0000","scrub_duration":0.010710094,"objects_trimmed":0,"snaptrim_duration":0.101696772,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1042,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"44'3392","reported_seq":2827,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:20.801299+0000","last_change":"2023-11-04T15:38:20.801299+0000","last_active":"2023-11-04T15:38:20.801299+0000","last_peered":"2023-11-04T15:38:20.801299+0000","last_clean":"2023-11-04T15:38:20.801299+0000","last_became_active":"2023-11-04T15:27:36.147745+0000","last_became_peered":"2023-11-04T15:27:36.147745+0000","last_unstale":"2023-11-04T15:38:20.801299+0000","last_undegraded":"2023-11-04T15:38:20.801299+0000","last_fullsized":"2023-11-04T15:38:20.801299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3392","last_scrub_stamp":"2023-11-04T15:38:20.801150+0000","last_deep_scrub":"44'3392","last_deep_scrub_stamp":"2023-11-04T15:38:20.801150+0000","last_clean_scrub_stamp":"2023-11-04T15:38:20.801150+0000","objects_scrubbed":2,"log_size":3392,"log_dups_size":0,"ondisk_log_size":3392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:16:55.199419+0000","scrub_duration":0.0083994859999999994,"objects_trimmed":0,"snaptrim_duration":0.071588252000000005,"stat_sum":{"num_bytes":4128,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1173,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"44'3507","reported_seq":2930,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:47.451113+0000","last_change":"2023-11-04T15:37:47.451113+0000","last_active":"2023-11-04T15:37:47.451113+0000","last_peered":"2023-11-04T15:37:47.451113+0000","last_clean":"2023-11-04T15:37:47.451113+0000","last_became_active":"2023-11-04T15:27:36.150687+0000","last_became_peered":"2023-11-04T15:27:36.150687+0000","last_unstale":"2023-11-04T15:37:47.451113+0000","last_undegraded":"2023-11-04T15:37:47.451113+0000","last_fullsized":"2023-11-04T15:37:47.451113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3507","last_scrub_stamp":"2023-11-04T15:37:47.450975+0000","last_deep_scrub":"44'3507","last_deep_scrub_stamp":"2023-11-04T15:37:47.450975+0000","last_clean_scrub_stamp":"2023-11-04T15:37:47.450975+0000","objects_scrubbed":2,"log_size":3507,"log_dups_size":0,"ondisk_log_size":3507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:21:13.505376+0000","scrub_duration":0.0096580350000000006,"objects_trimmed":0,"snaptrim_duration":0.097896176000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1154,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"44'3547","reported_seq":2997,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:18.707619+0000","last_change":"2023-11-04T15:38:18.707619+0000","last_active":"2023-11-04T15:38:18.707619+0000","last_peered":"2023-11-04T15:38:18.707619+0000","last_clean":"2023-11-04T15:38:18.707619+0000","last_became_active":"2023-11-04T15:27:36.143551+0000","last_became_peered":"2023-11-04T15:27:36.143551+0000","last_unstale":"2023-11-04T15:38:18.707619+0000","last_undegraded":"2023-11-04T15:38:18.707619+0000","last_fullsized":"2023-11-04T15:38:18.707619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3547","last_scrub_stamp":"2023-11-04T15:38:18.707479+0000","last_deep_scrub":"44'3547","last_deep_scrub_stamp":"2023-11-04T15:38:18.707479+0000","last_clean_scrub_stamp":"2023-11-04T15:38:18.707479+0000","objects_scrubbed":3,"log_size":3547,"log_dups_size":0,"ondisk_log_size":3547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:16:47.482996+0000","scrub_duration":0.01049517,"objects_trimmed":0,"snaptrim_duration":0.056037475000000003,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1178,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"44'3730","reported_seq":3100,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:14.873894+0000","last_change":"2023-11-04T15:38:14.873894+0000","last_active":"2023-11-04T15:38:14.873894+0000","last_peered":"2023-11-04T15:38:14.873894+0000","last_clean":"2023-11-04T15:38:14.873894+0000","last_became_active":"2023-11-04T15:27:36.145943+0000","last_became_peered":"2023-11-04T15:27:36.145943+0000","last_unstale":"2023-11-04T15:38:14.873894+0000","last_undegraded":"2023-11-04T15:38:14.873894+0000","last_fullsized":"2023-11-04T15:38:14.873894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3730","last_scrub_stamp":"2023-11-04T15:38:14.873735+0000","last_deep_scrub":"44'3730","last_deep_scrub_stamp":"2023-11-04T15:38:14.873735+0000","last_clean_scrub_stamp":"2023-11-04T15:38:14.873735+0000","objects_scrubbed":2,"log_size":3730,"log_dups_size":0,"ondisk_log_size":3730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:16:43.649252+0000","scrub_duration":0.011526497,"objects_trimmed":0,"snaptrim_duration":0.071549077000000003,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1242,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"40'3454","reported_seq":2902,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:22.189283+0000","last_change":"2023-11-04T15:38:22.189283+0000","last_active":"2023-11-04T15:38:22.189283+0000","last_peered":"2023-11-04T15:38:22.189283+0000","last_clean":"2023-11-04T15:38:22.189283+0000","last_became_active":"2023-11-04T15:27:36.144083+0000","last_became_peered":"2023-11-04T15:27:36.144083+0000","last_unstale":"2023-11-04T15:38:22.189283+0000","last_undegraded":"2023-11-04T15:38:22.189283+0000","last_fullsized":"2023-11-04T15:38:22.189283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3454","last_scrub_stamp":"2023-11-04T15:38:22.189124+0000","last_deep_scrub":"40'3454","last_deep_scrub_stamp":"2023-11-04T15:38:22.189124+0000","last_clean_scrub_stamp":"2023-11-04T15:38:22.189124+0000","objects_scrubbed":0,"log_size":3454,"log_dups_size":0,"ondisk_log_size":3454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:32:55.002998+0000","scrub_duration":0.0043707939999999999,"objects_trimmed":0,"snaptrim_duration":0.060959410999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1127,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"44'3635","reported_seq":3007,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:49.308455+0000","last_change":"2023-11-04T15:38:49.308586+0000","last_active":"2023-11-04T15:38:49.308455+0000","last_peered":"2023-11-04T15:38:49.308455+0000","last_clean":"2023-11-04T15:38:49.308455+0000","last_became_active":"2023-11-04T15:27:36.146546+0000","last_became_peered":"2023-11-04T15:27:36.146546+0000","last_unstale":"2023-11-04T15:38:49.308455+0000","last_undegraded":"2023-11-04T15:38:49.308455+0000","last_fullsized":"2023-11-04T15:38:49.308455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3635","last_scrub_stamp":"2023-11-04T15:38:49.308433+0000","last_deep_scrub":"44'3635","last_deep_scrub_stamp":"2023-11-04T15:38:49.308433+0000","last_clean_scrub_stamp":"2023-11-04T15:38:49.308433+0000","objects_scrubbed":3,"log_size":3635,"log_dups_size":0,"ondisk_log_size":3635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:57:34.938072+0000","scrub_duration":0.013378011,"objects_trimmed":0,"snaptrim_duration":0.102597439,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1222,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"44'3167","reported_seq":2642,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:18.169777+0000","last_change":"2023-11-04T15:38:18.169777+0000","last_active":"2023-11-04T15:38:18.169777+0000","last_peered":"2023-11-04T15:38:18.169777+0000","last_clean":"2023-11-04T15:38:18.169777+0000","last_became_active":"2023-11-04T15:27:36.144047+0000","last_became_peered":"2023-11-04T15:27:36.144047+0000","last_unstale":"2023-11-04T15:38:18.169777+0000","last_undegraded":"2023-11-04T15:38:18.169777+0000","last_fullsized":"2023-11-04T15:38:18.169777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3167","last_scrub_stamp":"2023-11-04T15:38:18.169609+0000","last_deep_scrub":"44'3167","last_deep_scrub_stamp":"2023-11-04T15:38:18.169609+0000","last_clean_scrub_stamp":"2023-11-04T15:38:18.169609+0000","objects_scrubbed":1,"log_size":3167,"log_dups_size":0,"ondisk_log_size":3167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:16:52.567878+0000","scrub_duration":0.0076393160000000002,"objects_trimmed":0,"snaptrim_duration":0.064725415999999994,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1115,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"44'3494","reported_seq":2907,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:27.132214+0000","last_change":"2023-11-04T15:38:27.132214+0000","last_active":"2023-11-04T15:38:27.132214+0000","last_peered":"2023-11-04T15:38:27.132214+0000","last_clean":"2023-11-04T15:38:27.132214+0000","last_became_active":"2023-11-04T15:27:36.144458+0000","last_became_peered":"2023-11-04T15:27:36.144458+0000","last_unstale":"2023-11-04T15:38:27.132214+0000","last_undegraded":"2023-11-04T15:38:27.132214+0000","last_fullsized":"2023-11-04T15:38:27.132214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3494","last_scrub_stamp":"2023-11-04T15:38:27.132005+0000","last_deep_scrub":"44'3494","last_deep_scrub_stamp":"2023-11-04T15:38:27.132005+0000","last_clean_scrub_stamp":"2023-11-04T15:38:27.132005+0000","objects_scrubbed":1,"log_size":3494,"log_dups_size":0,"ondisk_log_size":3494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:54:38.317360+0000","scrub_duration":0.0090200420000000007,"objects_trimmed":0,"snaptrim_duration":0.066118209999999997,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"44'3387","reported_seq":2839,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:38.465038+0000","last_change":"2023-11-04T15:37:38.465038+0000","last_active":"2023-11-04T15:37:38.465038+0000","last_peered":"2023-11-04T15:37:38.465038+0000","last_clean":"2023-11-04T15:37:38.465038+0000","last_became_active":"2023-11-04T15:27:36.150270+0000","last_became_peered":"2023-11-04T15:27:36.150270+0000","last_unstale":"2023-11-04T15:37:38.465038+0000","last_undegraded":"2023-11-04T15:37:38.465038+0000","last_fullsized":"2023-11-04T15:37:38.465038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3387","last_scrub_stamp":"2023-11-04T15:37:38.464840+0000","last_deep_scrub":"44'3387","last_deep_scrub_stamp":"2023-11-04T15:37:38.464840+0000","last_clean_scrub_stamp":"2023-11-04T15:37:38.464840+0000","objects_scrubbed":1,"log_size":3387,"log_dups_size":0,"ondisk_log_size":3387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:40:18.070984+0000","scrub_duration":0.0081071519999999994,"objects_trimmed":0,"snaptrim_duration":0.104674168,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"44'3290","reported_seq":2733,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:40.874421+0000","last_change":"2023-11-04T15:38:40.874529+0000","last_active":"2023-11-04T15:38:40.874421+0000","last_peered":"2023-11-04T15:38:40.874421+0000","last_clean":"2023-11-04T15:38:40.874421+0000","last_became_active":"2023-11-04T15:28:20.871378+0000","last_became_peered":"2023-11-04T15:28:20.871378+0000","last_unstale":"2023-11-04T15:38:40.874421+0000","last_undegraded":"2023-11-04T15:38:40.874421+0000","last_fullsized":"2023-11-04T15:38:40.874421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3290","last_scrub_stamp":"2023-11-04T15:38:40.874398+0000","last_deep_scrub":"44'3290","last_deep_scrub_stamp":"2023-11-04T15:38:40.874398+0000","last_clean_scrub_stamp":"2023-11-04T15:38:40.874398+0000","objects_scrubbed":4,"log_size":3290,"log_dups_size":0,"ondisk_log_size":3290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:39:15.994733+0000","scrub_duration":0.011484166000000001,"objects_trimmed":0,"snaptrim_duration":0.074381663000000001,"stat_sum":{"num_bytes":9,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1152,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"44'3581","reported_seq":3023,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:43.871394+0000","last_change":"2023-11-04T15:38:43.871487+0000","last_active":"2023-11-04T15:38:43.871394+0000","last_peered":"2023-11-04T15:38:43.871394+0000","last_clean":"2023-11-04T15:38:43.871394+0000","last_became_active":"2023-11-04T15:27:36.145392+0000","last_became_peered":"2023-11-04T15:27:36.145392+0000","last_unstale":"2023-11-04T15:38:43.871394+0000","last_undegraded":"2023-11-04T15:38:43.871394+0000","last_fullsized":"2023-11-04T15:38:43.871394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3581","last_scrub_stamp":"2023-11-04T15:38:43.871369+0000","last_deep_scrub":"44'3581","last_deep_scrub_stamp":"2023-11-04T15:38:43.871369+0000","last_clean_scrub_stamp":"2023-11-04T15:38:43.871369+0000","objects_scrubbed":3,"log_size":3581,"log_dups_size":0,"ondisk_log_size":3581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T22:11:12.866904+0000","scrub_duration":0.012712273,"objects_trimmed":0,"snaptrim_duration":0.070714202000000004,"stat_sum":{"num_bytes":12288,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1167,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"40'3386","reported_seq":2874,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:10.551561+0000","last_change":"2023-11-04T15:37:10.551561+0000","last_active":"2023-11-04T15:37:10.551561+0000","last_peered":"2023-11-04T15:37:10.551561+0000","last_clean":"2023-11-04T15:37:10.551561+0000","last_became_active":"2023-11-04T15:27:36.145273+0000","last_became_peered":"2023-11-04T15:27:36.145273+0000","last_unstale":"2023-11-04T15:37:10.551561+0000","last_undegraded":"2023-11-04T15:37:10.551561+0000","last_fullsized":"2023-11-04T15:37:10.551561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3386","last_scrub_stamp":"2023-11-04T15:37:10.551443+0000","last_deep_scrub":"40'3386","last_deep_scrub_stamp":"2023-11-04T15:37:10.551443+0000","last_clean_scrub_stamp":"2023-11-04T15:37:10.551443+0000","objects_scrubbed":0,"log_size":3386,"log_dups_size":0,"ondisk_log_size":3386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:21:56.476755+0000","scrub_duration":0.005704687,"objects_trimmed":0,"snaptrim_duration":0.101784969,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1155,"num_write_kb":603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"40'3889","reported_seq":3226,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:09.188765+0000","last_change":"2023-11-04T15:38:09.188849+0000","last_active":"2023-11-04T15:38:09.188765+0000","last_peered":"2023-11-04T15:38:09.188765+0000","last_clean":"2023-11-04T15:38:09.188765+0000","last_became_active":"2023-11-04T15:27:36.144053+0000","last_became_peered":"2023-11-04T15:27:36.144053+0000","last_unstale":"2023-11-04T15:38:09.188765+0000","last_undegraded":"2023-11-04T15:38:09.188765+0000","last_fullsized":"2023-11-04T15:38:09.188765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3889","last_scrub_stamp":"2023-11-04T15:38:09.188744+0000","last_deep_scrub":"40'3889","last_deep_scrub_stamp":"2023-11-04T15:38:09.188744+0000","last_clean_scrub_stamp":"2023-11-04T15:38:09.188744+0000","objects_scrubbed":0,"log_size":3889,"log_dups_size":0,"ondisk_log_size":3889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:03:09.861762+0000","scrub_duration":0.0044858370000000003,"objects_trimmed":0,"snaptrim_duration":0.061944979999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1328,"num_write_kb":706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"40'3720","reported_seq":3117,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:06.685722+0000","last_change":"2023-11-04T15:38:06.685839+0000","last_active":"2023-11-04T15:38:06.685722+0000","last_peered":"2023-11-04T15:38:06.685722+0000","last_clean":"2023-11-04T15:38:06.685722+0000","last_became_active":"2023-11-04T15:27:36.148342+0000","last_became_peered":"2023-11-04T15:27:36.148342+0000","last_unstale":"2023-11-04T15:38:06.685722+0000","last_undegraded":"2023-11-04T15:38:06.685722+0000","last_fullsized":"2023-11-04T15:38:06.685722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3720","last_scrub_stamp":"2023-11-04T15:38:06.685700+0000","last_deep_scrub":"40'3720","last_deep_scrub_stamp":"2023-11-04T15:38:06.685700+0000","last_clean_scrub_stamp":"2023-11-04T15:38:06.685700+0000","objects_scrubbed":0,"log_size":3720,"log_dups_size":0,"ondisk_log_size":3720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:11:56.506896+0000","scrub_duration":0.0061541349999999998,"objects_trimmed":0,"snaptrim_duration":0.056486557999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"44'3426","reported_seq":2839,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:12.141768+0000","last_change":"2023-11-04T15:38:12.141869+0000","last_active":"2023-11-04T15:38:12.141768+0000","last_peered":"2023-11-04T15:38:12.141768+0000","last_clean":"2023-11-04T15:38:12.141768+0000","last_became_active":"2023-11-04T15:27:36.148951+0000","last_became_peered":"2023-11-04T15:27:36.148951+0000","last_unstale":"2023-11-04T15:38:12.141768+0000","last_undegraded":"2023-11-04T15:38:12.141768+0000","last_fullsized":"2023-11-04T15:38:12.141768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3426","last_scrub_stamp":"2023-11-04T15:38:12.141744+0000","last_deep_scrub":"44'3426","last_deep_scrub_stamp":"2023-11-04T15:38:12.141744+0000","last_clean_scrub_stamp":"2023-11-04T15:38:12.141744+0000","objects_scrubbed":2,"log_size":3426,"log_dups_size":0,"ondisk_log_size":3426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:16:40.917261+0000","scrub_duration":0.011982881000000001,"objects_trimmed":0,"snaptrim_duration":0.066218149000000004,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1176,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"44'2988","reported_seq":3040,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:52.513259+0000","last_change":"2023-11-04T15:37:52.513356+0000","last_active":"2023-11-04T15:37:52.513259+0000","last_peered":"2023-11-04T15:37:52.513259+0000","last_clean":"2023-11-04T15:37:52.513259+0000","last_became_active":"2023-11-04T15:27:35.775616+0000","last_became_peered":"2023-11-04T15:27:35.775616+0000","last_unstale":"2023-11-04T15:37:52.513259+0000","last_undegraded":"2023-11-04T15:37:52.513259+0000","last_fullsized":"2023-11-04T15:37:52.513259+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2988","last_scrub_stamp":"2023-11-04T15:37:52.513236+0000","last_deep_scrub":"44'2988","last_deep_scrub_stamp":"2023-11-04T15:37:52.513236+0000","last_clean_scrub_stamp":"2023-11-04T15:37:52.513236+0000","objects_scrubbed":4,"log_size":2988,"log_dups_size":0,"ondisk_log_size":2988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:52:02.610178+0000","scrub_duration":0.028368865,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2984,"num_write_kb":24202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"44'3309","reported_seq":2739,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:43.389469+0000","last_change":"2023-11-04T15:38:43.389597+0000","last_active":"2023-11-04T15:38:43.389469+0000","last_peered":"2023-11-04T15:38:43.389469+0000","last_clean":"2023-11-04T15:38:43.389469+0000","last_became_active":"2023-11-04T15:27:36.150276+0000","last_became_peered":"2023-11-04T15:27:36.150276+0000","last_unstale":"2023-11-04T15:38:43.389469+0000","last_undegraded":"2023-11-04T15:38:43.389469+0000","last_fullsized":"2023-11-04T15:38:43.389469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3309","last_scrub_stamp":"2023-11-04T15:38:43.389445+0000","last_deep_scrub":"44'3309","last_deep_scrub_stamp":"2023-11-04T15:38:43.389445+0000","last_clean_scrub_stamp":"2023-11-04T15:38:43.389445+0000","objects_scrubbed":1,"log_size":3309,"log_dups_size":0,"ondisk_log_size":3309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:57:45.575550+0000","scrub_duration":0.0084261809999999996,"objects_trimmed":0,"snaptrim_duration":0.101095329,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1177,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"44'464","reported_seq":516,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:01.615465+0000","last_change":"2023-11-04T15:38:01.615577+0000","last_active":"2023-11-04T15:38:01.615465+0000","last_peered":"2023-11-04T15:38:01.615465+0000","last_clean":"2023-11-04T15:38:01.615465+0000","last_became_active":"2023-11-04T15:27:35.776297+0000","last_became_peered":"2023-11-04T15:27:35.776297+0000","last_unstale":"2023-11-04T15:38:01.615465+0000","last_undegraded":"2023-11-04T15:38:01.615465+0000","last_fullsized":"2023-11-04T15:38:01.615465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'464","last_scrub_stamp":"2023-11-04T15:38:01.615441+0000","last_deep_scrub":"44'464","last_deep_scrub_stamp":"2023-11-04T15:38:01.615441+0000","last_clean_scrub_stamp":"2023-11-04T15:38:01.615441+0000","objects_scrubbed":2,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:11:51.436637+0000","scrub_duration":0.021155086,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":462,"num_write_kb":12396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"44'3489","reported_seq":2923,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:22.680227+0000","last_change":"2023-11-04T15:37:22.680321+0000","last_active":"2023-11-04T15:37:22.680227+0000","last_peered":"2023-11-04T15:37:22.680227+0000","last_clean":"2023-11-04T15:37:22.680227+0000","last_became_active":"2023-11-04T15:27:36.139580+0000","last_became_peered":"2023-11-04T15:27:36.139580+0000","last_unstale":"2023-11-04T15:37:22.680227+0000","last_undegraded":"2023-11-04T15:37:22.680227+0000","last_fullsized":"2023-11-04T15:37:22.680227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3489","last_scrub_stamp":"2023-11-04T15:37:22.680205+0000","last_deep_scrub":"44'3489","last_deep_scrub_stamp":"2023-11-04T15:37:22.680205+0000","last_clean_scrub_stamp":"2023-11-04T15:37:22.680205+0000","objects_scrubbed":4,"log_size":3489,"log_dups_size":0,"ondisk_log_size":3489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:18:28.360934+0000","scrub_duration":0.013912934,"objects_trimmed":0,"snaptrim_duration":0.074768939000000006,"stat_sum":{"num_bytes":8192,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1207,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"44'721","reported_seq":773,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:46.471555+0000","last_change":"2023-11-04T15:37:46.471682+0000","last_active":"2023-11-04T15:37:46.471555+0000","last_peered":"2023-11-04T15:37:46.471555+0000","last_clean":"2023-11-04T15:37:46.471555+0000","last_became_active":"2023-11-04T15:27:35.775486+0000","last_became_peered":"2023-11-04T15:27:35.775486+0000","last_unstale":"2023-11-04T15:37:46.471555+0000","last_undegraded":"2023-11-04T15:37:46.471555+0000","last_fullsized":"2023-11-04T15:37:46.471555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'721","last_scrub_stamp":"2023-11-04T15:37:46.471516+0000","last_deep_scrub":"44'721","last_deep_scrub_stamp":"2023-11-04T15:37:46.471516+0000","last_clean_scrub_stamp":"2023-11-04T15:37:46.471516+0000","objects_scrubbed":4,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:43.323066+0000","scrub_duration":0.043075086999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":707,"num_write_kb":16815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"44'3444","reported_seq":2888,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:23.861171+0000","last_change":"2023-11-04T15:38:23.861287+0000","last_active":"2023-11-04T15:38:23.861171+0000","last_peered":"2023-11-04T15:38:23.861171+0000","last_clean":"2023-11-04T15:38:23.861171+0000","last_became_active":"2023-11-04T15:27:36.139789+0000","last_became_peered":"2023-11-04T15:27:36.139789+0000","last_unstale":"2023-11-04T15:38:23.861171+0000","last_undegraded":"2023-11-04T15:38:23.861171+0000","last_fullsized":"2023-11-04T15:38:23.861171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3444","last_scrub_stamp":"2023-11-04T15:38:23.861140+0000","last_deep_scrub":"44'3444","last_deep_scrub_stamp":"2023-11-04T15:38:23.861140+0000","last_clean_scrub_stamp":"2023-11-04T15:38:23.861140+0000","objects_scrubbed":1,"log_size":3444,"log_dups_size":0,"ondisk_log_size":3444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:29:29.080263+0000","scrub_duration":0.0081163280000000008,"objects_trimmed":0,"snaptrim_duration":0.073936136,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"44'1621","reported_seq":1673,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:25.495184+0000","last_change":"2023-11-04T15:37:25.495295+0000","last_active":"2023-11-04T15:37:25.495184+0000","last_peered":"2023-11-04T15:37:25.495184+0000","last_clean":"2023-11-04T15:37:25.495184+0000","last_became_active":"2023-11-04T15:27:35.775895+0000","last_became_peered":"2023-11-04T15:27:35.775895+0000","last_unstale":"2023-11-04T15:37:25.495184+0000","last_undegraded":"2023-11-04T15:37:25.495184+0000","last_fullsized":"2023-11-04T15:37:25.495184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1621","last_scrub_stamp":"2023-11-04T15:37:25.495162+0000","last_deep_scrub":"44'1621","last_deep_scrub_stamp":"2023-11-04T15:37:25.495162+0000","last_clean_scrub_stamp":"2023-11-04T15:37:25.495162+0000","objects_scrubbed":7,"log_size":1621,"log_dups_size":0,"ondisk_log_size":1621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:31:16.990792+0000","scrub_duration":0.024403523,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":1625,"num_write_kb":22714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"44'1200","reported_seq":1253,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:53.730547+0000","last_change":"2023-11-04T15:37:53.730547+0000","last_active":"2023-11-04T15:37:53.730547+0000","last_peered":"2023-11-04T15:37:53.730547+0000","last_clean":"2023-11-04T15:37:53.730547+0000","last_became_active":"2023-11-04T15:27:35.767594+0000","last_became_peered":"2023-11-04T15:27:35.767594+0000","last_unstale":"2023-11-04T15:37:53.730547+0000","last_undegraded":"2023-11-04T15:37:53.730547+0000","last_fullsized":"2023-11-04T15:37:53.730547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1200","last_scrub_stamp":"2023-11-04T15:37:53.730377+0000","last_deep_scrub":"44'1200","last_deep_scrub_stamp":"2023-11-04T15:37:53.730377+0000","last_clean_scrub_stamp":"2023-11-04T15:37:53.730377+0000","objects_scrubbed":2,"log_size":1200,"log_dups_size":0,"ondisk_log_size":1200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:46:40.139343+0000","scrub_duration":0.015421646000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1190,"num_write_kb":15478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"40'3688","reported_seq":3063,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:14.481041+0000","last_change":"2023-11-04T15:37:14.481041+0000","last_active":"2023-11-04T15:37:14.481041+0000","last_peered":"2023-11-04T15:37:14.481041+0000","last_clean":"2023-11-04T15:37:14.481041+0000","last_became_active":"2023-11-04T15:27:36.148282+0000","last_became_peered":"2023-11-04T15:27:36.148282+0000","last_unstale":"2023-11-04T15:37:14.481041+0000","last_undegraded":"2023-11-04T15:37:14.481041+0000","last_fullsized":"2023-11-04T15:37:14.481041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3688","last_scrub_stamp":"2023-11-04T15:37:14.480897+0000","last_deep_scrub":"40'3688","last_deep_scrub_stamp":"2023-11-04T15:37:14.480897+0000","last_clean_scrub_stamp":"2023-11-04T15:37:14.480897+0000","objects_scrubbed":0,"log_size":3688,"log_dups_size":0,"ondisk_log_size":3688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:24:49.251475+0000","scrub_duration":0.0044870750000000001,"objects_trimmed":0,"snaptrim_duration":0.102136719,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1244,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"44'2395","reported_seq":2448,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:45.653046+0000","last_change":"2023-11-04T15:37:45.653046+0000","last_active":"2023-11-04T15:37:45.653046+0000","last_peered":"2023-11-04T15:37:45.653046+0000","last_clean":"2023-11-04T15:37:45.653046+0000","last_became_active":"2023-11-04T15:27:35.771554+0000","last_became_peered":"2023-11-04T15:27:35.771554+0000","last_unstale":"2023-11-04T15:37:45.653046+0000","last_undegraded":"2023-11-04T15:37:45.653046+0000","last_fullsized":"2023-11-04T15:37:45.653046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2395","last_scrub_stamp":"2023-11-04T15:37:45.652911+0000","last_deep_scrub":"44'2395","last_deep_scrub_stamp":"2023-11-04T15:37:45.652911+0000","last_clean_scrub_stamp":"2023-11-04T15:37:45.652911+0000","objects_scrubbed":3,"log_size":2395,"log_dups_size":0,"ondisk_log_size":2395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:07:59.283572+0000","scrub_duration":0.025961439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2386,"num_write_kb":21701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"44'3603","reported_seq":3001,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:25.600392+0000","last_change":"2023-11-04T15:37:25.600392+0000","last_active":"2023-11-04T15:37:25.600392+0000","last_peered":"2023-11-04T15:37:25.600392+0000","last_clean":"2023-11-04T15:37:25.600392+0000","last_became_active":"2023-11-04T15:27:36.149146+0000","last_became_peered":"2023-11-04T15:27:36.149146+0000","last_unstale":"2023-11-04T15:37:25.600392+0000","last_undegraded":"2023-11-04T15:37:25.600392+0000","last_fullsized":"2023-11-04T15:37:25.600392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3603","last_scrub_stamp":"2023-11-04T15:37:25.600176+0000","last_deep_scrub":"44'3603","last_deep_scrub_stamp":"2023-11-04T15:37:25.600176+0000","last_clean_scrub_stamp":"2023-11-04T15:37:25.600176+0000","objects_scrubbed":3,"log_size":3603,"log_dups_size":0,"ondisk_log_size":3603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:18:31.280905+0000","scrub_duration":0.0137854,"objects_trimmed":0,"snaptrim_duration":0.055767874000000002,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"44'3591","reported_seq":3644,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:28.306981+0000","last_change":"2023-11-04T15:38:28.306981+0000","last_active":"2023-11-04T15:38:28.306981+0000","last_peered":"2023-11-04T15:38:28.306981+0000","last_clean":"2023-11-04T15:38:28.306981+0000","last_became_active":"2023-11-04T15:27:35.773689+0000","last_became_peered":"2023-11-04T15:27:35.773689+0000","last_unstale":"2023-11-04T15:38:28.306981+0000","last_undegraded":"2023-11-04T15:38:28.306981+0000","last_fullsized":"2023-11-04T15:38:28.306981+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3591","last_scrub_stamp":"2023-11-04T15:38:28.306858+0000","last_deep_scrub":"44'3591","last_deep_scrub_stamp":"2023-11-04T15:38:28.306858+0000","last_clean_scrub_stamp":"2023-11-04T15:38:28.306858+0000","objects_scrubbed":4,"log_size":3591,"log_dups_size":0,"ondisk_log_size":3591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:06:11.058800+0000","scrub_duration":0.034148234999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582982,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3581,"num_write_kb":38716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"44'3514","reported_seq":2913,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:14.746264+0000","last_change":"2023-11-04T15:37:14.746264+0000","last_active":"2023-11-04T15:37:14.746264+0000","last_peered":"2023-11-04T15:37:14.746264+0000","last_clean":"2023-11-04T15:37:14.746264+0000","last_became_active":"2023-11-04T15:27:36.141695+0000","last_became_peered":"2023-11-04T15:27:36.141695+0000","last_unstale":"2023-11-04T15:37:14.746264+0000","last_undegraded":"2023-11-04T15:37:14.746264+0000","last_fullsized":"2023-11-04T15:37:14.746264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3514","last_scrub_stamp":"2023-11-04T15:37:14.746134+0000","last_deep_scrub":"44'3514","last_deep_scrub_stamp":"2023-11-04T15:37:14.746134+0000","last_clean_scrub_stamp":"2023-11-04T15:37:14.746134+0000","objects_scrubbed":3,"log_size":3514,"log_dups_size":0,"ondisk_log_size":3514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:36.355741+0000","scrub_duration":0.013556656,"objects_trimmed":0,"snaptrim_duration":0.057953993000000002,"stat_sum":{"num_bytes":4107,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1230,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"44'1581","reported_seq":1634,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:05.474337+0000","last_change":"2023-11-04T15:38:05.474337+0000","last_active":"2023-11-04T15:38:05.474337+0000","last_peered":"2023-11-04T15:38:05.474337+0000","last_clean":"2023-11-04T15:38:05.474337+0000","last_became_active":"2023-11-04T15:27:35.773818+0000","last_became_peered":"2023-11-04T15:27:35.773818+0000","last_unstale":"2023-11-04T15:38:05.474337+0000","last_undegraded":"2023-11-04T15:38:05.474337+0000","last_fullsized":"2023-11-04T15:38:05.474337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1581","last_scrub_stamp":"2023-11-04T15:38:05.474220+0000","last_deep_scrub":"44'1581","last_deep_scrub_stamp":"2023-11-04T15:38:05.474220+0000","last_clean_scrub_stamp":"2023-11-04T15:38:05.474220+0000","objects_scrubbed":4,"log_size":1581,"log_dups_size":0,"ondisk_log_size":1581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:03:06.147239+0000","scrub_duration":0.038580360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1569,"num_write_kb":30603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"40'3300","reported_seq":2761,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:48.498756+0000","last_change":"2023-11-04T15:37:48.498756+0000","last_active":"2023-11-04T15:37:48.498756+0000","last_peered":"2023-11-04T15:37:48.498756+0000","last_clean":"2023-11-04T15:37:48.498756+0000","last_became_active":"2023-11-04T15:27:36.150653+0000","last_became_peered":"2023-11-04T15:27:36.150653+0000","last_unstale":"2023-11-04T15:37:48.498756+0000","last_undegraded":"2023-11-04T15:37:48.498756+0000","last_fullsized":"2023-11-04T15:37:48.498756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3300","last_scrub_stamp":"2023-11-04T15:37:48.498559+0000","last_deep_scrub":"40'3300","last_deep_scrub_stamp":"2023-11-04T15:37:48.498559+0000","last_clean_scrub_stamp":"2023-11-04T15:37:48.498559+0000","objects_scrubbed":0,"log_size":3300,"log_dups_size":0,"ondisk_log_size":3300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:55:19.632136+0000","scrub_duration":0.0039129610000000004,"objects_trimmed":0,"snaptrim_duration":0.070970674999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1129,"num_write_kb":600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"44'4025","reported_seq":4078,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:41.344248+0000","last_change":"2023-11-04T15:37:41.344248+0000","last_active":"2023-11-04T15:37:41.344248+0000","last_peered":"2023-11-04T15:37:41.344248+0000","last_clean":"2023-11-04T15:37:41.344248+0000","last_became_active":"2023-11-04T15:27:35.772815+0000","last_became_peered":"2023-11-04T15:27:35.772815+0000","last_unstale":"2023-11-04T15:37:41.344248+0000","last_undegraded":"2023-11-04T15:37:41.344248+0000","last_fullsized":"2023-11-04T15:37:41.344248+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4025","last_scrub_stamp":"2023-11-04T15:37:41.344035+0000","last_deep_scrub":"44'4025","last_deep_scrub_stamp":"2023-11-04T15:37:41.344035+0000","last_clean_scrub_stamp":"2023-11-04T15:37:41.344035+0000","objects_scrubbed":4,"log_size":4025,"log_dups_size":0,"ondisk_log_size":4025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:07:54.974697+0000","scrub_duration":0.037607953,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4019,"num_write_kb":36923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1207,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"40'3784","reported_seq":3141,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:21.440272+0000","last_change":"2023-11-04T15:37:21.440272+0000","last_active":"2023-11-04T15:37:21.440272+0000","last_peered":"2023-11-04T15:37:21.440272+0000","last_clean":"2023-11-04T15:37:21.440272+0000","last_became_active":"2023-11-04T15:27:36.150667+0000","last_became_peered":"2023-11-04T15:27:36.150667+0000","last_unstale":"2023-11-04T15:37:21.440272+0000","last_undegraded":"2023-11-04T15:37:21.440272+0000","last_fullsized":"2023-11-04T15:37:21.440272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3784","last_scrub_stamp":"2023-11-04T15:37:21.440149+0000","last_deep_scrub":"40'3784","last_deep_scrub_stamp":"2023-11-04T15:37:21.440149+0000","last_clean_scrub_stamp":"2023-11-04T15:37:21.440149+0000","objects_scrubbed":0,"log_size":3784,"log_dups_size":0,"ondisk_log_size":3784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:35.107882+0000","scrub_duration":0.0057867910000000003,"objects_trimmed":0,"snaptrim_duration":0.098687114000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1287,"num_write_kb":684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"44'2127","reported_seq":2180,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:02.405082+0000","last_change":"2023-11-04T15:38:02.405082+0000","last_active":"2023-11-04T15:38:02.405082+0000","last_peered":"2023-11-04T15:38:02.405082+0000","last_clean":"2023-11-04T15:38:02.405082+0000","last_became_active":"2023-11-04T15:27:35.775063+0000","last_became_peered":"2023-11-04T15:27:35.775063+0000","last_unstale":"2023-11-04T15:38:02.405082+0000","last_undegraded":"2023-11-04T15:38:02.405082+0000","last_fullsized":"2023-11-04T15:38:02.405082+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2127","last_scrub_stamp":"2023-11-04T15:38:02.404947+0000","last_deep_scrub":"44'2127","last_deep_scrub_stamp":"2023-11-04T15:38:02.404947+0000","last_clean_scrub_stamp":"2023-11-04T15:38:02.404947+0000","objects_scrubbed":2,"log_size":2127,"log_dups_size":0,"ondisk_log_size":2127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:43:59.858069+0000","scrub_duration":0.024080308000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2118,"num_write_kb":30816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"44'3319","reported_seq":2802,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:46.325522+0000","last_change":"2023-11-04T15:38:46.325522+0000","last_active":"2023-11-04T15:38:46.325522+0000","last_peered":"2023-11-04T15:38:46.325522+0000","last_clean":"2023-11-04T15:38:46.325522+0000","last_became_active":"2023-11-04T15:27:36.139103+0000","last_became_peered":"2023-11-04T15:27:36.139103+0000","last_unstale":"2023-11-04T15:38:46.325522+0000","last_undegraded":"2023-11-04T15:38:46.325522+0000","last_fullsized":"2023-11-04T15:38:46.325522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3319","last_scrub_stamp":"2023-11-04T15:38:46.325396+0000","last_deep_scrub":"44'3319","last_deep_scrub_stamp":"2023-11-04T15:38:46.325396+0000","last_clean_scrub_stamp":"2023-11-04T15:38:46.325396+0000","objects_scrubbed":2,"log_size":3319,"log_dups_size":0,"ondisk_log_size":3319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:10:49.251976+0000","scrub_duration":0.0094029769999999999,"objects_trimmed":0,"snaptrim_duration":0.10468400899999999,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1091,"num_write_kb":593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"44'1936","reported_seq":1989,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:32.267244+0000","last_change":"2023-11-04T15:38:32.267330+0000","last_active":"2023-11-04T15:38:32.267244+0000","last_peered":"2023-11-04T15:38:32.267244+0000","last_clean":"2023-11-04T15:38:32.267244+0000","last_became_active":"2023-11-04T15:27:35.773449+0000","last_became_peered":"2023-11-04T15:27:35.773449+0000","last_unstale":"2023-11-04T15:38:32.267244+0000","last_undegraded":"2023-11-04T15:38:32.267244+0000","last_fullsized":"2023-11-04T15:38:32.267244+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1936","last_scrub_stamp":"2023-11-04T15:38:32.267220+0000","last_deep_scrub":"44'1936","last_deep_scrub_stamp":"2023-11-04T15:38:32.267220+0000","last_clean_scrub_stamp":"2023-11-04T15:38:32.267220+0000","objects_scrubbed":2,"log_size":1936,"log_dups_size":0,"ondisk_log_size":1936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:39:33.849939+0000","scrub_duration":0.019926309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1929,"num_write_kb":17119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"40'3519","reported_seq":2954,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:23.652627+0000","last_change":"2023-11-04T15:37:23.652627+0000","last_active":"2023-11-04T15:37:23.652627+0000","last_peered":"2023-11-04T15:37:23.652627+0000","last_clean":"2023-11-04T15:37:23.652627+0000","last_became_active":"2023-11-04T15:27:36.141086+0000","last_became_peered":"2023-11-04T15:27:36.141086+0000","last_unstale":"2023-11-04T15:37:23.652627+0000","last_undegraded":"2023-11-04T15:37:23.652627+0000","last_fullsized":"2023-11-04T15:37:23.652627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3519","last_scrub_stamp":"2023-11-04T15:37:23.652509+0000","last_deep_scrub":"40'3519","last_deep_scrub_stamp":"2023-11-04T15:37:23.652509+0000","last_clean_scrub_stamp":"2023-11-04T15:37:23.652509+0000","objects_scrubbed":0,"log_size":3519,"log_dups_size":0,"ondisk_log_size":3519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:28.689310+0000","scrub_duration":0.0061970940000000002,"objects_trimmed":0,"snaptrim_duration":0.059170119,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1142,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"44'657","reported_seq":710,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:06.186834+0000","last_change":"2023-11-04T15:38:06.186834+0000","last_active":"2023-11-04T15:38:06.186834+0000","last_peered":"2023-11-04T15:38:06.186834+0000","last_clean":"2023-11-04T15:38:06.186834+0000","last_became_active":"2023-11-04T15:27:35.769001+0000","last_became_peered":"2023-11-04T15:27:35.769001+0000","last_unstale":"2023-11-04T15:38:06.186834+0000","last_undegraded":"2023-11-04T15:38:06.186834+0000","last_fullsized":"2023-11-04T15:38:06.186834+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'657","last_scrub_stamp":"2023-11-04T15:38:06.186659+0000","last_deep_scrub":"44'657","last_deep_scrub_stamp":"2023-11-04T15:38:06.186659+0000","last_clean_scrub_stamp":"2023-11-04T15:38:06.186659+0000","objects_scrubbed":2,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:44:03.639782+0000","scrub_duration":0.022387719,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":656,"num_write_kb":15166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"44'3666","reported_seq":3095,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:24.311349+0000","last_change":"2023-11-04T15:37:24.311349+0000","last_active":"2023-11-04T15:37:24.311349+0000","last_peered":"2023-11-04T15:37:24.311349+0000","last_clean":"2023-11-04T15:37:24.311349+0000","last_became_active":"2023-11-04T15:27:36.147034+0000","last_became_peered":"2023-11-04T15:27:36.147034+0000","last_unstale":"2023-11-04T15:37:24.311349+0000","last_undegraded":"2023-11-04T15:37:24.311349+0000","last_fullsized":"2023-11-04T15:37:24.311349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3666","last_scrub_stamp":"2023-11-04T15:37:24.311202+0000","last_deep_scrub":"44'3666","last_deep_scrub_stamp":"2023-11-04T15:37:24.311202+0000","last_clean_scrub_stamp":"2023-11-04T15:37:24.311202+0000","objects_scrubbed":3,"log_size":3666,"log_dups_size":0,"ondisk_log_size":3666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:56:38.113824+0000","scrub_duration":0.0088871530000000001,"objects_trimmed":0,"snaptrim_duration":0.064750725999999995,"stat_sum":{"num_bytes":4196,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1197,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"44'119","reported_seq":211,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:08.425104+0000","last_change":"2023-11-04T15:38:08.425208+0000","last_active":"2023-11-04T15:38:08.425104+0000","last_peered":"2023-11-04T15:38:08.425104+0000","last_clean":"2023-11-04T15:38:08.425104+0000","last_became_active":"2023-11-04T15:27:26.266242+0000","last_became_peered":"2023-11-04T15:27:26.266242+0000","last_unstale":"2023-11-04T15:38:08.425104+0000","last_undegraded":"2023-11-04T15:38:08.425104+0000","last_fullsized":"2023-11-04T15:38:08.425104+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'119","last_scrub_stamp":"2023-11-04T15:38:08.425081+0000","last_deep_scrub":"44'119","last_deep_scrub_stamp":"2023-11-04T15:38:08.425081+0000","last_clean_scrub_stamp":"2023-11-04T15:38:08.425081+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:16:37.200598+0000","scrub_duration":0.0054415069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:17.352034+0000","last_change":"2023-11-04T15:38:17.352138+0000","last_active":"2023-11-04T15:38:17.352034+0000","last_peered":"2023-11-04T15:38:17.352034+0000","last_clean":"2023-11-04T15:38:17.352034+0000","last_became_active":"2023-11-04T15:27:31.619798+0000","last_became_peered":"2023-11-04T15:27:31.619798+0000","last_unstale":"2023-11-04T15:38:17.352034+0000","last_undegraded":"2023-11-04T15:38:17.352034+0000","last_fullsized":"2023-11-04T15:38:17.352034+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:38:17.352004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:38:17.352004+0000","last_clean_scrub_stamp":"2023-11-04T15:38:17.352004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:29:22.571127+0000","scrub_duration":0.0014758830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"44'3636","reported_seq":3689,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:51.207512+0000","last_change":"2023-11-04T15:37:51.207512+0000","last_active":"2023-11-04T15:37:51.207512+0000","last_peered":"2023-11-04T15:37:51.207512+0000","last_clean":"2023-11-04T15:37:51.207512+0000","last_became_active":"2023-11-04T15:27:35.769150+0000","last_became_peered":"2023-11-04T15:27:35.769150+0000","last_unstale":"2023-11-04T15:37:51.207512+0000","last_undegraded":"2023-11-04T15:37:51.207512+0000","last_fullsized":"2023-11-04T15:37:51.207512+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3636","last_scrub_stamp":"2023-11-04T15:37:51.207371+0000","last_deep_scrub":"44'3636","last_deep_scrub_stamp":"2023-11-04T15:37:51.207371+0000","last_clean_scrub_stamp":"2023-11-04T15:37:51.207371+0000","objects_scrubbed":7,"log_size":3636,"log_dups_size":0,"ondisk_log_size":3636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:21:17.261772+0000","scrub_duration":0.064187266000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3620,"num_write_kb":52059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"44'3669","reported_seq":3088,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:03.410603+0000","last_change":"2023-11-04T15:38:03.410603+0000","last_active":"2023-11-04T15:38:03.410603+0000","last_peered":"2023-11-04T15:38:03.410603+0000","last_clean":"2023-11-04T15:38:03.410603+0000","last_became_active":"2023-11-04T15:27:36.140619+0000","last_became_peered":"2023-11-04T15:27:36.140619+0000","last_unstale":"2023-11-04T15:38:03.410603+0000","last_undegraded":"2023-11-04T15:38:03.410603+0000","last_fullsized":"2023-11-04T15:38:03.410603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3669","last_scrub_stamp":"2023-11-04T15:38:03.410431+0000","last_deep_scrub":"44'3669","last_deep_scrub_stamp":"2023-11-04T15:38:03.410431+0000","last_clean_scrub_stamp":"2023-11-04T15:38:03.410431+0000","objects_scrubbed":1,"log_size":3669,"log_dups_size":0,"ondisk_log_size":3669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:20.868712+0000","scrub_duration":0.009666315,"objects_trimmed":0,"snaptrim_duration":0.10532783499999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:10.460636+0000","last_change":"2023-11-04T15:38:10.460766+0000","last_active":"2023-11-04T15:38:10.460636+0000","last_peered":"2023-11-04T15:38:10.460636+0000","last_clean":"2023-11-04T15:38:10.460636+0000","last_became_active":"2023-11-04T15:27:31.621889+0000","last_became_peered":"2023-11-04T15:27:31.621889+0000","last_unstale":"2023-11-04T15:38:10.460636+0000","last_undegraded":"2023-11-04T15:38:10.460636+0000","last_fullsized":"2023-11-04T15:38:10.460636+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:38:10.460616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:38:10.460616+0000","last_clean_scrub_stamp":"2023-11-04T15:38:10.460616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:47:50.200142+0000","scrub_duration":0.002140351,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"44'3688","reported_seq":3907,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:52.624125+0000","last_change":"2023-11-04T15:37:52.624125+0000","last_active":"2023-11-04T15:37:52.624125+0000","last_peered":"2023-11-04T15:37:52.624125+0000","last_clean":"2023-11-04T15:37:52.624125+0000","last_became_active":"2023-11-04T15:27:35.770364+0000","last_became_peered":"2023-11-04T15:27:35.770364+0000","last_unstale":"2023-11-04T15:37:52.624125+0000","last_undegraded":"2023-11-04T15:37:52.624125+0000","last_fullsized":"2023-11-04T15:37:52.624125+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3688","last_scrub_stamp":"2023-11-04T15:37:52.623993+0000","last_deep_scrub":"44'3688","last_deep_scrub_stamp":"2023-11-04T15:37:52.623993+0000","last_clean_scrub_stamp":"2023-11-04T15:37:52.623993+0000","objects_scrubbed":4,"log_size":3688,"log_dups_size":0,"ondisk_log_size":3688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:49.475542+0000","scrub_duration":0.043049095000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15883313,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":166,"num_read_kb":3338,"num_write":3668,"num_write_kb":29714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"44'3553","reported_seq":2998,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:24.639702+0000","last_change":"2023-11-04T15:37:24.639702+0000","last_active":"2023-11-04T15:37:24.639702+0000","last_peered":"2023-11-04T15:37:24.639702+0000","last_clean":"2023-11-04T15:37:24.639702+0000","last_became_active":"2023-11-04T15:27:36.144459+0000","last_became_peered":"2023-11-04T15:27:36.144459+0000","last_unstale":"2023-11-04T15:37:24.639702+0000","last_undegraded":"2023-11-04T15:37:24.639702+0000","last_fullsized":"2023-11-04T15:37:24.639702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3553","last_scrub_stamp":"2023-11-04T15:37:24.639567+0000","last_deep_scrub":"44'3553","last_deep_scrub_stamp":"2023-11-04T15:37:24.639567+0000","last_clean_scrub_stamp":"2023-11-04T15:37:24.639567+0000","objects_scrubbed":2,"log_size":3553,"log_dups_size":0,"ondisk_log_size":3553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:38.307301+0000","scrub_duration":0.010629794999999999,"objects_trimmed":0,"snaptrim_duration":0.072685394,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:46.281358+0000","last_change":"2023-11-04T15:37:46.281358+0000","last_active":"2023-11-04T15:37:46.281358+0000","last_peered":"2023-11-04T15:37:46.281358+0000","last_clean":"2023-11-04T15:37:46.281358+0000","last_became_active":"2023-11-04T15:27:31.622378+0000","last_became_peered":"2023-11-04T15:27:31.622378+0000","last_unstale":"2023-11-04T15:37:46.281358+0000","last_undegraded":"2023-11-04T15:37:46.281358+0000","last_fullsized":"2023-11-04T15:37:46.281358+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:37:46.281232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:37:46.281232+0000","last_clean_scrub_stamp":"2023-11-04T15:37:46.281232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:55:17.414809+0000","scrub_duration":0.0016098729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"44'6085","reported_seq":6139,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:50.250495+0000","last_change":"2023-11-04T15:37:50.250593+0000","last_active":"2023-11-04T15:37:50.250495+0000","last_peered":"2023-11-04T15:37:50.250495+0000","last_clean":"2023-11-04T15:37:50.250495+0000","last_became_active":"2023-11-04T15:27:35.774339+0000","last_became_peered":"2023-11-04T15:27:35.774339+0000","last_unstale":"2023-11-04T15:37:50.250495+0000","last_undegraded":"2023-11-04T15:37:50.250495+0000","last_fullsized":"2023-11-04T15:37:50.250495+0000","mapping_epoch":16,"log_start":"26'400","ondisk_log_start":"26'400","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'6085","last_scrub_stamp":"2023-11-04T15:37:50.250469+0000","last_deep_scrub":"44'6085","last_deep_scrub_stamp":"2023-11-04T15:37:50.250469+0000","last_clean_scrub_stamp":"2023-11-04T15:37:50.250469+0000","objects_scrubbed":6,"log_size":5685,"log_dups_size":0,"ondisk_log_size":5685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:47.102018+0000","scrub_duration":0.070893610999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6078,"num_write_kb":43849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"44'3173","reported_seq":2651,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:10.305048+0000","last_change":"2023-11-04T15:37:10.305048+0000","last_active":"2023-11-04T15:37:10.305048+0000","last_peered":"2023-11-04T15:37:10.305048+0000","last_clean":"2023-11-04T15:37:10.305048+0000","last_became_active":"2023-11-04T15:27:36.146930+0000","last_became_peered":"2023-11-04T15:27:36.146930+0000","last_unstale":"2023-11-04T15:37:10.305048+0000","last_undegraded":"2023-11-04T15:37:10.305048+0000","last_fullsized":"2023-11-04T15:37:10.305048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3173","last_scrub_stamp":"2023-11-04T15:37:10.304861+0000","last_deep_scrub":"44'3173","last_deep_scrub_stamp":"2023-11-04T15:37:10.304861+0000","last_clean_scrub_stamp":"2023-11-04T15:37:10.304861+0000","objects_scrubbed":1,"log_size":3173,"log_dups_size":0,"ondisk_log_size":3173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:31.914468+0000","scrub_duration":0.0078700769999999996,"objects_trimmed":0,"snaptrim_duration":0.067233409999999993,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1111,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:14.382747+0000","last_change":"2023-11-04T15:38:14.382871+0000","last_active":"2023-11-04T15:38:14.382747+0000","last_peered":"2023-11-04T15:38:14.382747+0000","last_clean":"2023-11-04T15:38:14.382747+0000","last_became_active":"2023-11-04T15:27:31.621849+0000","last_became_peered":"2023-11-04T15:27:31.621849+0000","last_unstale":"2023-11-04T15:38:14.382747+0000","last_undegraded":"2023-11-04T15:38:14.382747+0000","last_fullsized":"2023-11-04T15:38:14.382747+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:38:14.382726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:38:14.382726+0000","last_clean_scrub_stamp":"2023-11-04T15:38:14.382726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:16:48.780994+0000","scrub_duration":0.0020309239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"44'3280","reported_seq":3333,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:27.660076+0000","last_change":"2023-11-04T15:37:27.660076+0000","last_active":"2023-11-04T15:37:27.660076+0000","last_peered":"2023-11-04T15:37:27.660076+0000","last_clean":"2023-11-04T15:37:27.660076+0000","last_became_active":"2023-11-04T15:27:35.769730+0000","last_became_peered":"2023-11-04T15:27:35.769730+0000","last_unstale":"2023-11-04T15:37:27.660076+0000","last_undegraded":"2023-11-04T15:37:27.660076+0000","last_fullsized":"2023-11-04T15:37:27.660076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3280","last_scrub_stamp":"2023-11-04T15:37:27.659954+0000","last_deep_scrub":"44'3280","last_deep_scrub_stamp":"2023-11-04T15:37:27.659954+0000","last_clean_scrub_stamp":"2023-11-04T15:37:27.659954+0000","objects_scrubbed":5,"log_size":3280,"log_dups_size":0,"ondisk_log_size":3280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:41.327688+0000","scrub_duration":0.054452754999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3258,"num_write_kb":30072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"44'3434","reported_seq":2864,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:18.421706+0000","last_change":"2023-11-04T15:37:18.421706+0000","last_active":"2023-11-04T15:37:18.421706+0000","last_peered":"2023-11-04T15:37:18.421706+0000","last_clean":"2023-11-04T15:37:18.421706+0000","last_became_active":"2023-11-04T15:27:36.144417+0000","last_became_peered":"2023-11-04T15:27:36.144417+0000","last_unstale":"2023-11-04T15:37:18.421706+0000","last_undegraded":"2023-11-04T15:37:18.421706+0000","last_fullsized":"2023-11-04T15:37:18.421706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3434","last_scrub_stamp":"2023-11-04T15:37:18.421580+0000","last_deep_scrub":"44'3434","last_deep_scrub_stamp":"2023-11-04T15:37:18.421580+0000","last_clean_scrub_stamp":"2023-11-04T15:37:18.421580+0000","objects_scrubbed":3,"log_size":3434,"log_dups_size":0,"ondisk_log_size":3434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:37:14.873581+0000","scrub_duration":0.011594345000000001,"objects_trimmed":0,"snaptrim_duration":0.067418286999999993,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"44'3108","reported_seq":3161,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:28.595288+0000","last_change":"2023-11-04T15:37:28.595288+0000","last_active":"2023-11-04T15:37:28.595288+0000","last_peered":"2023-11-04T15:37:28.595288+0000","last_clean":"2023-11-04T15:37:28.595288+0000","last_became_active":"2023-11-04T15:27:35.769772+0000","last_became_peered":"2023-11-04T15:27:35.769772+0000","last_unstale":"2023-11-04T15:37:28.595288+0000","last_undegraded":"2023-11-04T15:37:28.595288+0000","last_fullsized":"2023-11-04T15:37:28.595288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3108","last_scrub_stamp":"2023-11-04T15:37:28.595114+0000","last_deep_scrub":"44'3108","last_deep_scrub_stamp":"2023-11-04T15:37:28.595114+0000","last_clean_scrub_stamp":"2023-11-04T15:37:28.595114+0000","objects_scrubbed":3,"log_size":3108,"log_dups_size":0,"ondisk_log_size":3108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:56:42.397736+0000","scrub_duration":0.034473323,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3101,"num_write_kb":32806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:47.235098+0000","last_change":"2023-11-04T15:37:47.235098+0000","last_active":"2023-11-04T15:37:47.235098+0000","last_peered":"2023-11-04T15:37:47.235098+0000","last_clean":"2023-11-04T15:37:47.235098+0000","last_became_active":"2023-11-04T15:27:31.622350+0000","last_became_peered":"2023-11-04T15:27:31.622350+0000","last_unstale":"2023-11-04T15:37:47.235098+0000","last_undegraded":"2023-11-04T15:37:47.235098+0000","last_fullsized":"2023-11-04T15:37:47.235098+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:37:47.234970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:37:47.234970+0000","last_clean_scrub_stamp":"2023-11-04T15:37:47.234970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:46:33.643935+0000","scrub_duration":0.00154751,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"43'3419","reported_seq":2906,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:09.350908+0000","last_change":"2023-11-04T15:37:09.350908+0000","last_active":"2023-11-04T15:37:09.350908+0000","last_peered":"2023-11-04T15:37:09.350908+0000","last_clean":"2023-11-04T15:37:09.350908+0000","last_became_active":"2023-11-04T15:27:36.143991+0000","last_became_peered":"2023-11-04T15:27:36.143991+0000","last_unstale":"2023-11-04T15:37:09.350908+0000","last_undegraded":"2023-11-04T15:37:09.350908+0000","last_fullsized":"2023-11-04T15:37:09.350908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3419","last_scrub_stamp":"2023-11-04T15:37:09.350786+0000","last_deep_scrub":"43'3419","last_deep_scrub_stamp":"2023-11-04T15:37:09.350786+0000","last_clean_scrub_stamp":"2023-11-04T15:37:09.350786+0000","objects_scrubbed":2,"log_size":3419,"log_dups_size":0,"ondisk_log_size":3419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:20:35.227166+0000","scrub_duration":0.0074817540000000002,"objects_trimmed":0,"snaptrim_duration":0.062728023999999993,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":1116,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"44'4469","reported_seq":4522,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:56.224142+0000","last_change":"2023-11-04T15:37:56.224142+0000","last_active":"2023-11-04T15:37:56.224142+0000","last_peered":"2023-11-04T15:37:56.224142+0000","last_clean":"2023-11-04T15:37:56.224142+0000","last_became_active":"2023-11-04T15:27:35.769095+0000","last_became_peered":"2023-11-04T15:27:35.769095+0000","last_unstale":"2023-11-04T15:37:56.224142+0000","last_undegraded":"2023-11-04T15:37:56.224142+0000","last_fullsized":"2023-11-04T15:37:56.224142+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4469","last_scrub_stamp":"2023-11-04T15:37:56.224006+0000","last_deep_scrub":"44'4469","last_deep_scrub_stamp":"2023-11-04T15:37:56.224006+0000","last_clean_scrub_stamp":"2023-11-04T15:37:56.224006+0000","objects_scrubbed":5,"log_size":4469,"log_dups_size":0,"ondisk_log_size":4469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:52:06.320947+0000","scrub_duration":0.052842531999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4451,"num_write_kb":27035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:23.393957+0000","last_change":"2023-11-04T15:38:23.394103+0000","last_active":"2023-11-04T15:38:23.393957+0000","last_peered":"2023-11-04T15:38:23.393957+0000","last_clean":"2023-11-04T15:38:23.393957+0000","last_became_active":"2023-11-04T15:27:31.619702+0000","last_became_peered":"2023-11-04T15:27:31.619702+0000","last_unstale":"2023-11-04T15:38:23.393957+0000","last_undegraded":"2023-11-04T15:38:23.393957+0000","last_fullsized":"2023-11-04T15:38:23.393957+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:38:23.393926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:38:23.393926+0000","last_clean_scrub_stamp":"2023-11-04T15:38:23.393926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:54:34.579281+0000","scrub_duration":0.001751711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"40'3558","reported_seq":2956,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:19.665851+0000","last_change":"2023-11-04T15:37:19.665851+0000","last_active":"2023-11-04T15:37:19.665851+0000","last_peered":"2023-11-04T15:37:19.665851+0000","last_clean":"2023-11-04T15:37:19.665851+0000","last_became_active":"2023-11-04T15:27:36.139707+0000","last_became_peered":"2023-11-04T15:27:36.139707+0000","last_unstale":"2023-11-04T15:37:19.665851+0000","last_undegraded":"2023-11-04T15:37:19.665851+0000","last_fullsized":"2023-11-04T15:37:19.665851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3558","last_scrub_stamp":"2023-11-04T15:37:19.665726+0000","last_deep_scrub":"40'3558","last_deep_scrub_stamp":"2023-11-04T15:37:19.665726+0000","last_clean_scrub_stamp":"2023-11-04T15:37:19.665726+0000","objects_scrubbed":0,"log_size":3558,"log_dups_size":0,"ondisk_log_size":3558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:24:54.436304+0000","scrub_duration":0.0061987099999999996,"objects_trimmed":0,"snaptrim_duration":0.073815121999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"44'1219","reported_seq":1272,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:59.151132+0000","last_change":"2023-11-04T15:37:59.151132+0000","last_active":"2023-11-04T15:37:59.151132+0000","last_peered":"2023-11-04T15:37:59.151132+0000","last_clean":"2023-11-04T15:37:59.151132+0000","last_became_active":"2023-11-04T15:27:35.768320+0000","last_became_peered":"2023-11-04T15:27:35.768320+0000","last_unstale":"2023-11-04T15:37:59.151132+0000","last_undegraded":"2023-11-04T15:37:59.151132+0000","last_fullsized":"2023-11-04T15:37:59.151132+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1219","last_scrub_stamp":"2023-11-04T15:37:59.150991+0000","last_deep_scrub":"44'1219","last_deep_scrub_stamp":"2023-11-04T15:37:59.150991+0000","last_clean_scrub_stamp":"2023-11-04T15:37:59.150991+0000","objects_scrubbed":5,"log_size":1219,"log_dups_size":0,"ondisk_log_size":1219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:11:48.972187+0000","scrub_duration":0.031930034000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1211,"num_write_kb":18003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:42.307944+0000","last_change":"2023-11-04T15:37:42.307944+0000","last_active":"2023-11-04T15:37:42.307944+0000","last_peered":"2023-11-04T15:37:42.307944+0000","last_clean":"2023-11-04T15:37:42.307944+0000","last_became_active":"2023-11-04T15:27:31.624347+0000","last_became_peered":"2023-11-04T15:27:31.624347+0000","last_unstale":"2023-11-04T15:37:42.307944+0000","last_undegraded":"2023-11-04T15:37:42.307944+0000","last_fullsized":"2023-11-04T15:37:42.307944+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:37:42.307817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:37:42.307817+0000","last_clean_scrub_stamp":"2023-11-04T15:37:42.307817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:40:21.913960+0000","scrub_duration":0.002137136,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"44'3609","reported_seq":3026,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:29.793752+0000","last_change":"2023-11-04T15:38:29.793847+0000","last_active":"2023-11-04T15:38:29.793752+0000","last_peered":"2023-11-04T15:38:29.793752+0000","last_clean":"2023-11-04T15:38:29.793752+0000","last_became_active":"2023-11-04T15:27:36.137897+0000","last_became_peered":"2023-11-04T15:27:36.137897+0000","last_unstale":"2023-11-04T15:38:29.793752+0000","last_undegraded":"2023-11-04T15:38:29.793752+0000","last_fullsized":"2023-11-04T15:38:29.793752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3609","last_scrub_stamp":"2023-11-04T15:38:29.793727+0000","last_deep_scrub":"44'3609","last_deep_scrub_stamp":"2023-11-04T15:38:29.793727+0000","last_clean_scrub_stamp":"2023-11-04T15:38:29.793727+0000","objects_scrubbed":1,"log_size":3609,"log_dups_size":0,"ondisk_log_size":3609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:54:40.979082+0000","scrub_duration":0.0096043740000000006,"objects_trimmed":0,"snaptrim_duration":0.069534850999999995,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"44'835","reported_seq":888,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:58.635650+0000","last_change":"2023-11-04T15:37:58.635650+0000","last_active":"2023-11-04T15:37:58.635650+0000","last_peered":"2023-11-04T15:37:58.635650+0000","last_clean":"2023-11-04T15:37:58.635650+0000","last_became_active":"2023-11-04T15:27:35.772121+0000","last_became_peered":"2023-11-04T15:27:35.772121+0000","last_unstale":"2023-11-04T15:37:58.635650+0000","last_undegraded":"2023-11-04T15:37:58.635650+0000","last_fullsized":"2023-11-04T15:37:58.635650+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'835","last_scrub_stamp":"2023-11-04T15:37:58.635523+0000","last_deep_scrub":"44'835","last_deep_scrub_stamp":"2023-11-04T15:37:58.635523+0000","last_clean_scrub_stamp":"2023-11-04T15:37:58.635523+0000","objects_scrubbed":6,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:52:08.732465+0000","scrub_duration":0.064600797000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":960,"num_write_kb":25976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:18.360275+0000","last_change":"2023-11-04T15:38:18.360275+0000","last_active":"2023-11-04T15:38:18.360275+0000","last_peered":"2023-11-04T15:38:18.360275+0000","last_clean":"2023-11-04T15:38:18.360275+0000","last_became_active":"2023-11-04T15:27:31.619831+0000","last_became_peered":"2023-11-04T15:27:31.619831+0000","last_unstale":"2023-11-04T15:38:18.360275+0000","last_undegraded":"2023-11-04T15:38:18.360275+0000","last_fullsized":"2023-11-04T15:38:18.360275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:38:18.360157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:38:18.360157+0000","last_clean_scrub_stamp":"2023-11-04T15:38:18.360157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:32:51.174031+0000","scrub_duration":0.0014914360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"44'3481","reported_seq":2937,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:10.702911+0000","last_change":"2023-11-04T15:37:10.702911+0000","last_active":"2023-11-04T15:37:10.702911+0000","last_peered":"2023-11-04T15:37:10.702911+0000","last_clean":"2023-11-04T15:37:10.702911+0000","last_became_active":"2023-11-04T15:27:36.140871+0000","last_became_peered":"2023-11-04T15:27:36.140871+0000","last_unstale":"2023-11-04T15:37:10.702911+0000","last_undegraded":"2023-11-04T15:37:10.702911+0000","last_fullsized":"2023-11-04T15:37:10.702911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3481","last_scrub_stamp":"2023-11-04T15:37:10.702789+0000","last_deep_scrub":"44'3481","last_deep_scrub_stamp":"2023-11-04T15:37:10.702789+0000","last_clean_scrub_stamp":"2023-11-04T15:37:10.702789+0000","objects_scrubbed":1,"log_size":3481,"log_dups_size":0,"ondisk_log_size":3481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:23:02.723895+0000","scrub_duration":0.008399541,"objects_trimmed":0,"snaptrim_duration":0.058381362999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"40'3644","reported_seq":3059,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:22.638939+0000","last_change":"2023-11-04T15:37:22.639061+0000","last_active":"2023-11-04T15:37:22.638939+0000","last_peered":"2023-11-04T15:37:22.638939+0000","last_clean":"2023-11-04T15:37:22.638939+0000","last_became_active":"2023-11-04T15:27:36.139487+0000","last_became_peered":"2023-11-04T15:27:36.139487+0000","last_unstale":"2023-11-04T15:37:22.638939+0000","last_undegraded":"2023-11-04T15:37:22.638939+0000","last_fullsized":"2023-11-04T15:37:22.638939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3644","last_scrub_stamp":"2023-11-04T15:37:22.638916+0000","last_deep_scrub":"40'3644","last_deep_scrub_stamp":"2023-11-04T15:37:22.638916+0000","last_clean_scrub_stamp":"2023-11-04T15:37:22.638916+0000","objects_scrubbed":0,"log_size":3644,"log_dups_size":0,"ondisk_log_size":3644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:37:19.090917+0000","scrub_duration":0.0049130600000000003,"objects_trimmed":0,"snaptrim_duration":0.056621590999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"44'2776","reported_seq":2828,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:42.474185+0000","last_change":"2023-11-04T15:37:42.474282+0000","last_active":"2023-11-04T15:37:42.474185+0000","last_peered":"2023-11-04T15:37:42.474185+0000","last_clean":"2023-11-04T15:37:42.474185+0000","last_became_active":"2023-11-04T15:27:35.775356+0000","last_became_peered":"2023-11-04T15:27:35.775356+0000","last_unstale":"2023-11-04T15:37:42.474185+0000","last_undegraded":"2023-11-04T15:37:42.474185+0000","last_fullsized":"2023-11-04T15:37:42.474185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2776","last_scrub_stamp":"2023-11-04T15:37:42.474162+0000","last_deep_scrub":"44'2776","last_deep_scrub_stamp":"2023-11-04T15:37:42.474162+0000","last_clean_scrub_stamp":"2023-11-04T15:37:42.474162+0000","objects_scrubbed":5,"log_size":2776,"log_dups_size":0,"ondisk_log_size":2776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:55:13.607739+0000","scrub_duration":0.030546663000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2770,"num_write_kb":31342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"44'3526","reported_seq":2945,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:07.150693+0000","last_change":"2023-11-04T15:38:07.150810+0000","last_active":"2023-11-04T15:38:07.150693+0000","last_peered":"2023-11-04T15:38:07.150693+0000","last_clean":"2023-11-04T15:38:07.150693+0000","last_became_active":"2023-11-04T15:27:36.146464+0000","last_became_peered":"2023-11-04T15:27:36.146464+0000","last_unstale":"2023-11-04T15:38:07.150693+0000","last_undegraded":"2023-11-04T15:38:07.150693+0000","last_fullsized":"2023-11-04T15:38:07.150693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3526","last_scrub_stamp":"2023-11-04T15:38:07.150668+0000","last_deep_scrub":"44'3526","last_deep_scrub_stamp":"2023-11-04T15:38:07.150668+0000","last_clean_scrub_stamp":"2023-11-04T15:38:07.150668+0000","objects_scrubbed":1,"log_size":3526,"log_dups_size":0,"ondisk_log_size":3526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:24.608949+0000","scrub_duration":0.0086108179999999993,"objects_trimmed":0,"snaptrim_duration":0.064516859999999995,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"44'3745","reported_seq":3797,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:57.703309+0000","last_change":"2023-11-04T15:37:57.703411+0000","last_active":"2023-11-04T15:37:57.703309+0000","last_peered":"2023-11-04T15:37:57.703309+0000","last_clean":"2023-11-04T15:37:57.703309+0000","last_became_active":"2023-11-04T15:27:35.769904+0000","last_became_peered":"2023-11-04T15:27:35.769904+0000","last_unstale":"2023-11-04T15:37:57.703309+0000","last_undegraded":"2023-11-04T15:37:57.703309+0000","last_fullsized":"2023-11-04T15:37:57.703309+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3745","last_scrub_stamp":"2023-11-04T15:37:57.703286+0000","last_deep_scrub":"44'3745","last_deep_scrub_stamp":"2023-11-04T15:37:57.703286+0000","last_clean_scrub_stamp":"2023-11-04T15:37:57.703286+0000","objects_scrubbed":3,"log_size":3745,"log_dups_size":0,"ondisk_log_size":3745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:21:23.757688+0000","scrub_duration":0.020686982,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3740,"num_write_kb":21755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"44'3556","reported_seq":3608,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:02.674712+0000","last_change":"2023-11-04T15:38:02.674801+0000","last_active":"2023-11-04T15:38:02.674712+0000","last_peered":"2023-11-04T15:38:02.674712+0000","last_clean":"2023-11-04T15:38:02.674712+0000","last_became_active":"2023-11-04T15:27:35.768413+0000","last_became_peered":"2023-11-04T15:27:35.768413+0000","last_unstale":"2023-11-04T15:38:02.674712+0000","last_undegraded":"2023-11-04T15:38:02.674712+0000","last_fullsized":"2023-11-04T15:38:02.674712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3556","last_scrub_stamp":"2023-11-04T15:38:02.674689+0000","last_deep_scrub":"44'3556","last_deep_scrub_stamp":"2023-11-04T15:38:02.674689+0000","last_clean_scrub_stamp":"2023-11-04T15:38:02.674689+0000","objects_scrubbed":2,"log_size":3556,"log_dups_size":0,"ondisk_log_size":3556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:52:12.771630+0000","scrub_duration":0.025634852,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3537,"num_write_kb":29647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"40'3937","reported_seq":3332,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:42.530756+0000","last_change":"2023-11-04T15:37:42.530849+0000","last_active":"2023-11-04T15:37:42.530756+0000","last_peered":"2023-11-04T15:37:42.530756+0000","last_clean":"2023-11-04T15:37:42.530756+0000","last_became_active":"2023-11-04T15:27:36.139524+0000","last_became_peered":"2023-11-04T15:27:36.139524+0000","last_unstale":"2023-11-04T15:37:42.530756+0000","last_undegraded":"2023-11-04T15:37:42.530756+0000","last_fullsized":"2023-11-04T15:37:42.530756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3937","last_scrub_stamp":"2023-11-04T15:37:42.530734+0000","last_deep_scrub":"40'3937","last_deep_scrub_stamp":"2023-11-04T15:37:42.530734+0000","last_clean_scrub_stamp":"2023-11-04T15:37:42.530734+0000","objects_scrubbed":0,"log_size":3937,"log_dups_size":0,"ondisk_log_size":3937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:07:56.161396+0000","scrub_duration":0.0048541679999999999,"objects_trimmed":0,"snaptrim_duration":0.068494678000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1248,"num_write_kb":670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"44'1642","reported_seq":1694,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:08.820848+0000","last_change":"2023-11-04T15:38:08.820939+0000","last_active":"2023-11-04T15:38:08.820848+0000","last_peered":"2023-11-04T15:38:08.820848+0000","last_clean":"2023-11-04T15:38:08.820848+0000","last_became_active":"2023-11-04T15:27:35.775917+0000","last_became_peered":"2023-11-04T15:27:35.775917+0000","last_unstale":"2023-11-04T15:38:08.820848+0000","last_undegraded":"2023-11-04T15:38:08.820848+0000","last_fullsized":"2023-11-04T15:38:08.820848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1642","last_scrub_stamp":"2023-11-04T15:38:08.820827+0000","last_deep_scrub":"44'1642","last_deep_scrub_stamp":"2023-11-04T15:38:08.820827+0000","last_clean_scrub_stamp":"2023-11-04T15:38:08.820827+0000","objects_scrubbed":5,"log_size":1642,"log_dups_size":0,"ondisk_log_size":1642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:44:06.273949+0000","scrub_duration":0.0476023,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1634,"num_write_kb":25426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"44'3473","reported_seq":2906,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:21.407271+0000","last_change":"2023-11-04T15:37:21.407382+0000","last_active":"2023-11-04T15:37:21.407271+0000","last_peered":"2023-11-04T15:37:21.407271+0000","last_clean":"2023-11-04T15:37:21.407271+0000","last_became_active":"2023-11-04T15:27:36.150557+0000","last_became_peered":"2023-11-04T15:27:36.150557+0000","last_unstale":"2023-11-04T15:37:21.407271+0000","last_undegraded":"2023-11-04T15:37:21.407271+0000","last_fullsized":"2023-11-04T15:37:21.407271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3473","last_scrub_stamp":"2023-11-04T15:37:21.407243+0000","last_deep_scrub":"44'3473","last_deep_scrub_stamp":"2023-11-04T15:37:21.407243+0000","last_clean_scrub_stamp":"2023-11-04T15:37:21.407243+0000","objects_scrubbed":1,"log_size":3473,"log_dups_size":0,"ondisk_log_size":3473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:18:27.087972+0000","scrub_duration":0.0082048629999999997,"objects_trimmed":0,"snaptrim_duration":0.062631718000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"44'3230","reported_seq":2725,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:37.265461+0000","last_change":"2023-11-04T15:38:37.265547+0000","last_active":"2023-11-04T15:38:37.265461+0000","last_peered":"2023-11-04T15:38:37.265461+0000","last_clean":"2023-11-04T15:38:37.265461+0000","last_became_active":"2023-11-04T15:27:36.149831+0000","last_became_peered":"2023-11-04T15:27:36.149831+0000","last_unstale":"2023-11-04T15:38:37.265461+0000","last_undegraded":"2023-11-04T15:38:37.265461+0000","last_fullsized":"2023-11-04T15:38:37.265461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3230","last_scrub_stamp":"2023-11-04T15:38:37.265437+0000","last_deep_scrub":"44'3230","last_deep_scrub_stamp":"2023-11-04T15:38:37.265437+0000","last_clean_scrub_stamp":"2023-11-04T15:38:37.265437+0000","objects_scrubbed":2,"log_size":3230,"log_dups_size":0,"ondisk_log_size":3230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T22:11:06.260972+0000","scrub_duration":0.0083613030000000005,"objects_trimmed":0,"snaptrim_duration":0.103639325,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1060,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"44'4779","reported_seq":4831,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:19.478819+0000","last_change":"2023-11-04T15:37:19.478909+0000","last_active":"2023-11-04T15:37:19.478819+0000","last_peered":"2023-11-04T15:37:19.478819+0000","last_clean":"2023-11-04T15:37:19.478819+0000","last_became_active":"2023-11-04T15:27:35.770022+0000","last_became_peered":"2023-11-04T15:27:35.770022+0000","last_unstale":"2023-11-04T15:37:19.478819+0000","last_undegraded":"2023-11-04T15:37:19.478819+0000","last_fullsized":"2023-11-04T15:37:19.478819+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4779","last_scrub_stamp":"2023-11-04T15:37:19.478796+0000","last_deep_scrub":"44'4779","last_deep_scrub_stamp":"2023-11-04T15:37:19.478796+0000","last_clean_scrub_stamp":"2023-11-04T15:37:19.478796+0000","objects_scrubbed":7,"log_size":4779,"log_dups_size":0,"ondisk_log_size":4779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:24.515597+0000","scrub_duration":0.083030119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28974830,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4772,"num_write_kb":50744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"44'3335","reported_seq":2791,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:16.935545+0000","last_change":"2023-11-04T15:38:16.935650+0000","last_active":"2023-11-04T15:38:16.935545+0000","last_peered":"2023-11-04T15:38:16.935545+0000","last_clean":"2023-11-04T15:38:16.935545+0000","last_became_active":"2023-11-04T15:27:36.138908+0000","last_became_peered":"2023-11-04T15:27:36.138908+0000","last_unstale":"2023-11-04T15:38:16.935545+0000","last_undegraded":"2023-11-04T15:38:16.935545+0000","last_fullsized":"2023-11-04T15:38:16.935545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3335","last_scrub_stamp":"2023-11-04T15:38:16.935521+0000","last_deep_scrub":"44'3335","last_deep_scrub_stamp":"2023-11-04T15:38:16.935521+0000","last_clean_scrub_stamp":"2023-11-04T15:38:16.935521+0000","objects_scrubbed":2,"log_size":3335,"log_dups_size":0,"ondisk_log_size":3335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:47:56.675047+0000","scrub_duration":0.010785885,"objects_trimmed":0,"snaptrim_duration":0.073000567000000002,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":1157,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"44'784","reported_seq":836,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:23.362195+0000","last_change":"2023-11-04T15:37:23.362327+0000","last_active":"2023-11-04T15:37:23.362195+0000","last_peered":"2023-11-04T15:37:23.362195+0000","last_clean":"2023-11-04T15:37:23.362195+0000","last_became_active":"2023-11-04T15:27:35.767858+0000","last_became_peered":"2023-11-04T15:27:35.767858+0000","last_unstale":"2023-11-04T15:37:23.362195+0000","last_undegraded":"2023-11-04T15:37:23.362195+0000","last_fullsized":"2023-11-04T15:37:23.362195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'784","last_scrub_stamp":"2023-11-04T15:37:23.362171+0000","last_deep_scrub":"44'784","last_deep_scrub_stamp":"2023-11-04T15:37:23.362171+0000","last_clean_scrub_stamp":"2023-11-04T15:37:23.362171+0000","objects_scrubbed":4,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:37.029904+0000","scrub_duration":0.042357839000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":779,"num_write_kb":20966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"40'3359","reported_seq":2795,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:25.666192+0000","last_change":"2023-11-04T15:37:25.666192+0000","last_active":"2023-11-04T15:37:25.666192+0000","last_peered":"2023-11-04T15:37:25.666192+0000","last_clean":"2023-11-04T15:37:25.666192+0000","last_became_active":"2023-11-04T15:27:36.143442+0000","last_became_peered":"2023-11-04T15:27:36.143442+0000","last_unstale":"2023-11-04T15:37:25.666192+0000","last_undegraded":"2023-11-04T15:37:25.666192+0000","last_fullsized":"2023-11-04T15:37:25.666192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3359","last_scrub_stamp":"2023-11-04T15:37:25.666058+0000","last_deep_scrub":"40'3359","last_deep_scrub_stamp":"2023-11-04T15:37:25.666058+0000","last_clean_scrub_stamp":"2023-11-04T15:37:25.666058+0000","objects_scrubbed":0,"log_size":3359,"log_dups_size":0,"ondisk_log_size":3359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:56:39.468680+0000","scrub_duration":0.003764154,"objects_trimmed":0,"snaptrim_duration":0.072078296,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1167,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"44'3780","reported_seq":3832,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:56.657179+0000","last_change":"2023-11-04T15:37:56.657328+0000","last_active":"2023-11-04T15:37:56.657179+0000","last_peered":"2023-11-04T15:37:56.657179+0000","last_clean":"2023-11-04T15:37:56.657179+0000","last_became_active":"2023-11-04T15:27:35.770539+0000","last_became_peered":"2023-11-04T15:27:35.770539+0000","last_unstale":"2023-11-04T15:37:56.657179+0000","last_undegraded":"2023-11-04T15:37:56.657179+0000","last_fullsized":"2023-11-04T15:37:56.657179+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3780","last_scrub_stamp":"2023-11-04T15:37:56.657156+0000","last_deep_scrub":"44'3780","last_deep_scrub_stamp":"2023-11-04T15:37:56.657156+0000","last_clean_scrub_stamp":"2023-11-04T15:37:56.657156+0000","objects_scrubbed":2,"log_size":3780,"log_dups_size":0,"ondisk_log_size":3780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:53.508705+0000","scrub_duration":0.023445829000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3770,"num_write_kb":38321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"44'3794","reported_seq":3161,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:14.135362+0000","last_change":"2023-11-04T15:38:14.135463+0000","last_active":"2023-11-04T15:38:14.135362+0000","last_peered":"2023-11-04T15:38:14.135362+0000","last_clean":"2023-11-04T15:38:14.135362+0000","last_became_active":"2023-11-04T15:27:36.146477+0000","last_became_peered":"2023-11-04T15:27:36.146477+0000","last_unstale":"2023-11-04T15:38:14.135362+0000","last_undegraded":"2023-11-04T15:38:14.135362+0000","last_fullsized":"2023-11-04T15:38:14.135362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3794","last_scrub_stamp":"2023-11-04T15:38:14.135338+0000","last_deep_scrub":"44'3794","last_deep_scrub_stamp":"2023-11-04T15:38:14.135338+0000","last_clean_scrub_stamp":"2023-11-04T15:38:14.135338+0000","objects_scrubbed":3,"log_size":3794,"log_dups_size":0,"ondisk_log_size":3794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:47:53.874864+0000","scrub_duration":0.014159603999999999,"objects_trimmed":0,"snaptrim_duration":0.063144525000000007,"stat_sum":{"num_bytes":8192,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1270,"num_write_kb":694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"44'2947","reported_seq":2999,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:53.659127+0000","last_change":"2023-11-04T15:37:53.659229+0000","last_active":"2023-11-04T15:37:53.659127+0000","last_peered":"2023-11-04T15:37:53.659127+0000","last_clean":"2023-11-04T15:37:53.659127+0000","last_became_active":"2023-11-04T15:27:35.771316+0000","last_became_peered":"2023-11-04T15:27:35.771316+0000","last_unstale":"2023-11-04T15:37:53.659127+0000","last_undegraded":"2023-11-04T15:37:53.659127+0000","last_fullsized":"2023-11-04T15:37:53.659127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2947","last_scrub_stamp":"2023-11-04T15:37:53.659103+0000","last_deep_scrub":"44'2947","last_deep_scrub_stamp":"2023-11-04T15:37:53.659103+0000","last_clean_scrub_stamp":"2023-11-04T15:37:53.659103+0000","objects_scrubbed":4,"log_size":2947,"log_dups_size":0,"ondisk_log_size":2947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:21:19.713505+0000","scrub_duration":0.039096767999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2943,"num_write_kb":28401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"44'3597","reported_seq":3019,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:09.671026+0000","last_change":"2023-11-04T15:37:09.671026+0000","last_active":"2023-11-04T15:37:09.671026+0000","last_peered":"2023-11-04T15:37:09.671026+0000","last_clean":"2023-11-04T15:37:09.671026+0000","last_became_active":"2023-11-04T15:27:36.144066+0000","last_became_peered":"2023-11-04T15:27:36.144066+0000","last_unstale":"2023-11-04T15:37:09.671026+0000","last_undegraded":"2023-11-04T15:37:09.671026+0000","last_fullsized":"2023-11-04T15:37:09.671026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3597","last_scrub_stamp":"2023-11-04T15:37:09.670901+0000","last_deep_scrub":"44'3597","last_deep_scrub_stamp":"2023-11-04T15:37:09.670901+0000","last_clean_scrub_stamp":"2023-11-04T15:37:09.670901+0000","objects_scrubbed":2,"log_size":3597,"log_dups_size":0,"ondisk_log_size":3597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T22:52:59.961460+0000","scrub_duration":0.010082327,"objects_trimmed":0,"snaptrim_duration":0.057889772999999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1118,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"44'931","reported_seq":983,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:46.627662+0000","last_change":"2023-11-04T15:37:46.627792+0000","last_active":"2023-11-04T15:37:46.627662+0000","last_peered":"2023-11-04T15:37:46.627662+0000","last_clean":"2023-11-04T15:37:46.627662+0000","last_became_active":"2023-11-04T15:27:35.767852+0000","last_became_peered":"2023-11-04T15:27:35.767852+0000","last_unstale":"2023-11-04T15:37:46.627662+0000","last_undegraded":"2023-11-04T15:37:46.627662+0000","last_fullsized":"2023-11-04T15:37:46.627662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'931","last_scrub_stamp":"2023-11-04T15:37:46.627638+0000","last_deep_scrub":"44'931","last_deep_scrub_stamp":"2023-11-04T15:37:46.627638+0000","last_clean_scrub_stamp":"2023-11-04T15:37:46.627638+0000","objects_scrubbed":5,"log_size":931,"log_dups_size":0,"ondisk_log_size":931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:40:26.233782+0000","scrub_duration":0.040590909000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":923,"num_write_kb":21087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"44'3553","reported_seq":2986,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:20.652542+0000","last_change":"2023-11-04T15:38:20.652681+0000","last_active":"2023-11-04T15:38:20.652542+0000","last_peered":"2023-11-04T15:38:20.652542+0000","last_clean":"2023-11-04T15:38:20.652542+0000","last_became_active":"2023-11-04T15:27:36.141167+0000","last_became_peered":"2023-11-04T15:27:36.141167+0000","last_unstale":"2023-11-04T15:38:20.652542+0000","last_undegraded":"2023-11-04T15:38:20.652542+0000","last_fullsized":"2023-11-04T15:38:20.652542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3553","last_scrub_stamp":"2023-11-04T15:38:20.652503+0000","last_deep_scrub":"44'3553","last_deep_scrub_stamp":"2023-11-04T15:38:20.652503+0000","last_clean_scrub_stamp":"2023-11-04T15:38:20.652503+0000","objects_scrubbed":1,"log_size":3553,"log_dups_size":0,"ondisk_log_size":3553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:48:00.392030+0000","scrub_duration":0.0095782799999999998,"objects_trimmed":0,"snaptrim_duration":0.057363947999999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1127,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"44'3229","reported_seq":3281,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:37.512770+0000","last_change":"2023-11-04T15:37:37.512913+0000","last_active":"2023-11-04T15:37:37.512770+0000","last_peered":"2023-11-04T15:37:37.512770+0000","last_clean":"2023-11-04T15:37:37.512770+0000","last_became_active":"2023-11-04T15:27:35.775171+0000","last_became_peered":"2023-11-04T15:27:35.775171+0000","last_unstale":"2023-11-04T15:37:37.512770+0000","last_undegraded":"2023-11-04T15:37:37.512770+0000","last_fullsized":"2023-11-04T15:37:37.512770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3229","last_scrub_stamp":"2023-11-04T15:37:37.512732+0000","last_deep_scrub":"44'3229","last_deep_scrub_stamp":"2023-11-04T15:37:37.512732+0000","last_clean_scrub_stamp":"2023-11-04T15:37:37.512732+0000","objects_scrubbed":4,"log_size":3229,"log_dups_size":0,"ondisk_log_size":3229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:07:51.143393+0000","scrub_duration":0.039893972,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3214,"num_write_kb":42509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"44'3490","reported_seq":2947,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:09.749095+0000","last_change":"2023-11-04T15:37:09.749095+0000","last_active":"2023-11-04T15:37:09.749095+0000","last_peered":"2023-11-04T15:37:09.749095+0000","last_clean":"2023-11-04T15:37:09.749095+0000","last_became_active":"2023-11-04T15:27:36.145560+0000","last_became_peered":"2023-11-04T15:27:36.145560+0000","last_unstale":"2023-11-04T15:37:09.749095+0000","last_undegraded":"2023-11-04T15:37:09.749095+0000","last_fullsized":"2023-11-04T15:37:09.749095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3490","last_scrub_stamp":"2023-11-04T15:37:09.748973+0000","last_deep_scrub":"44'3490","last_deep_scrub_stamp":"2023-11-04T15:37:09.748973+0000","last_clean_scrub_stamp":"2023-11-04T15:37:09.748973+0000","objects_scrubbed":5,"log_size":3490,"log_dups_size":0,"ondisk_log_size":3490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:31.358580+0000","scrub_duration":0.011863093,"objects_trimmed":0,"snaptrim_duration":0.07011676,"stat_sum":{"num_bytes":4151,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":1159,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"44'4215","reported_seq":4268,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:09.815711+0000","last_change":"2023-11-04T15:38:09.815860+0000","last_active":"2023-11-04T15:38:09.815711+0000","last_peered":"2023-11-04T15:38:09.815711+0000","last_clean":"2023-11-04T15:38:09.815711+0000","last_became_active":"2023-11-04T15:27:35.770873+0000","last_became_peered":"2023-11-04T15:27:35.770873+0000","last_unstale":"2023-11-04T15:38:09.815711+0000","last_undegraded":"2023-11-04T15:38:09.815711+0000","last_fullsized":"2023-11-04T15:38:09.815711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4215","last_scrub_stamp":"2023-11-04T15:38:09.815689+0000","last_deep_scrub":"44'4215","last_deep_scrub_stamp":"2023-11-04T15:38:09.815689+0000","last_clean_scrub_stamp":"2023-11-04T15:38:09.815689+0000","objects_scrubbed":1,"log_size":4215,"log_dups_size":0,"ondisk_log_size":4215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:27.273970+0000","scrub_duration":0.014824155,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4214,"num_write_kb":32525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"44'4092","reported_seq":3407,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:13.735284+0000","last_change":"2023-11-04T15:37:13.735284+0000","last_active":"2023-11-04T15:37:13.735284+0000","last_peered":"2023-11-04T15:37:13.735284+0000","last_clean":"2023-11-04T15:37:13.735284+0000","last_became_active":"2023-11-04T15:27:36.147535+0000","last_became_peered":"2023-11-04T15:27:36.147535+0000","last_unstale":"2023-11-04T15:37:13.735284+0000","last_undegraded":"2023-11-04T15:37:13.735284+0000","last_fullsized":"2023-11-04T15:37:13.735284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4092","last_scrub_stamp":"2023-11-04T15:37:13.735159+0000","last_deep_scrub":"44'4092","last_deep_scrub_stamp":"2023-11-04T15:37:13.735159+0000","last_clean_scrub_stamp":"2023-11-04T15:37:13.735159+0000","objects_scrubbed":2,"log_size":4092,"log_dups_size":0,"ondisk_log_size":4092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:20:39.611539+0000","scrub_duration":0.012119325,"objects_trimmed":0,"snaptrim_duration":0.055801837,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1294,"num_write_kb":719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"44'1592","reported_seq":1645,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:11.894655+0000","last_change":"2023-11-04T15:38:11.894759+0000","last_active":"2023-11-04T15:38:11.894655+0000","last_peered":"2023-11-04T15:38:11.894655+0000","last_clean":"2023-11-04T15:38:11.894655+0000","last_became_active":"2023-11-04T15:27:35.775918+0000","last_became_peered":"2023-11-04T15:27:35.775918+0000","last_unstale":"2023-11-04T15:38:11.894655+0000","last_undegraded":"2023-11-04T15:38:11.894655+0000","last_fullsized":"2023-11-04T15:38:11.894655+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1592","last_scrub_stamp":"2023-11-04T15:38:11.894631+0000","last_deep_scrub":"44'1592","last_deep_scrub_stamp":"2023-11-04T15:38:11.894631+0000","last_clean_scrub_stamp":"2023-11-04T15:38:11.894631+0000","objects_scrubbed":3,"log_size":1592,"log_dups_size":0,"ondisk_log_size":1592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:03:12.567650+0000","scrub_duration":0.018695843,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1587,"num_write_kb":12658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1143,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":127433,"num_objects":92,"num_object_clones":25,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":8,"num_read":46,"num_read_kb":30,"num_write":74822,"num_write_kb":40603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":254672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224379,"ondisk_log_size":224379,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":430735581,"num_objects":126,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":126,"num_whiteouts":0,"num_read":190,"num_read_kb":3338,"num_write":83456,"num_write_kb":897544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7850,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":861528064,"data_stored":861471162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83202,"ondisk_log_size":83202,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705808,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":663648,"kb_used_data":173208,"kb_used_omap":0,"kb_used_meta":490432,"kb_avail":93708192,"statfs":{"total":96636764160,"available":95957188608,"internally_reserved":0,"allocated":177364992,"data_stored":176999461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":502202368},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 15:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51400000000000001,"15min":0.40799999999999997},"min":{"1min":0.34799999999999998,"5min":0.182,"15min":0.156},"max":{"1min":0.64800000000000002,"5min":10.488,"15min":10.488},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.65100000000000002,"15min":0.46000000000000002},"min":{"1min":0.39000000000000001,"5min":0.20200000000000001,"15min":0.186},"max":{"1min":0.57699999999999996,"5min":13.055,"15min":13.055},"last":0.34000000000000002}]},{"osd":1,"last update":"Sat Nov 4 15:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.57399999999999995,"15min":0.439},"min":{"1min":0.35799999999999998,"5min":0.219,"15min":0.188},"max":{"1min":0.61899999999999999,"5min":12.347,"15min":12.347},"last":0.371},{"interface":"front","average":{"1min":0.502,"5min":0.55400000000000005,"15min":0.443},"min":{"1min":0.34699999999999998,"5min":0.23499999999999999,"15min":0.186},"max":{"1min":0.67300000000000004,"5min":12.853999999999999,"15min":12.853999999999999},"last":0.32300000000000001}]},{"osd":2,"last update":"Sat Nov 4 15:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.443,"15min":0.34499999999999997},"min":{"1min":0.26700000000000002,"5min":0.153,"15min":0.153},"max":{"1min":0.38600000000000001,"5min":11.709,"15min":11.709},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.436,"15min":0.35299999999999998},"min":{"1min":0.27800000000000002,"5min":0.17699999999999999,"15min":0.14899999999999999},"max":{"1min":0.40699999999999997,"5min":9.2629999999999999,"15min":9.2629999999999999},"last":0.27900000000000003}]}]},{"osd":2,"up_from":9,"seq":38654705807,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":952424,"kb_used_data":245472,"kb_used_omap":0,"kb_used_meta":706944,"kb_avail":93419416,"statfs":{"total":96636764160,"available":95661481984,"internally_reserved":0,"allocated":251363328,"data_stored":250991590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":723910656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 15:38:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.68600000000000005,"15min":0.46999999999999997},"min":{"1min":0.30199999999999999,"5min":0.16700000000000001,"15min":0.151},"max":{"1min":0.61699999999999999,"5min":21.297999999999998,"15min":21.297999999999998},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.58599999999999997,"15min":0.433},"min":{"1min":0.32400000000000001,"5min":0.21199999999999999,"15min":0.17399999999999999},"max":{"1min":0.54500000000000004,"5min":17.809000000000001,"15min":17.809000000000001},"last":0.52800000000000002}]},{"osd":1,"last update":"Sat Nov 4 15:38:45 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.56100000000000005,"15min":0.44900000000000001},"min":{"1min":0.29699999999999999,"5min":0.19500000000000001,"15min":0.17100000000000001},"max":{"1min":0.65500000000000003,"5min":10.851000000000001,"15min":10.851000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.56699999999999995,"15min":0.46400000000000002},"min":{"1min":0.38500000000000001,"5min":0.20899999999999999,"15min":0.20399999999999999},"max":{"1min":0.69599999999999995,"5min":8.9740000000000002,"15min":8.9740000000000002},"last":0.59799999999999998}]},{"osd":3,"last update":"Sat Nov 4 15:38:45 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.35499999999999998,"15min":0.32300000000000001},"min":{"1min":0.26200000000000001,"5min":0.16,"15min":0.14699999999999999},"max":{"1min":0.5,"5min":3.3929999999999998,"15min":3.3929999999999998},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.44400000000000001,"15min":0.373},"min":{"1min":0.26000000000000001,"5min":0.159,"15min":0.14899999999999999},"max":{"1min":0.52200000000000002,"5min":10.887,"15min":10.887},"last":0.40200000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705806,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":719272,"kb_used_data":188640,"kb_used_omap":0,"kb_used_meta":530624,"kb_avail":93652568,"statfs":{"total":96636764160,"available":95900229632,"internally_reserved":0,"allocated":193167360,"data_stored":192807863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":543358976},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 15:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.28199999999999997,"15min":0.318},"min":{"1min":0.21299999999999999,"5min":0.152,"15min":0.14399999999999999},"max":{"1min":0.42999999999999999,"5min":3.3610000000000002,"15min":12.768000000000001},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.34399999999999997,"15min":0.30099999999999999},"min":{"1min":0.24099999999999999,"5min":0.158,"15min":0.14399999999999999},"max":{"1min":0.44700000000000001,"5min":8.609,"15min":8.609},"last":0.29899999999999999}]},{"osd":2,"last update":"Sat Nov 4 15:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.45500000000000002,"15min":0.437},"min":{"1min":0.39200000000000002,"5min":0.215,"15min":0.189},"max":{"1min":0.625,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.42699999999999999,"15min":0.41999999999999998},"min":{"1min":0.35699999999999998,"5min":0.21299999999999999,"15min":0.192},"max":{"1min":0.61199999999999999,"5min":0.98199999999999998,"15min":1.5820000000000001},"last":0.44}]},{"osd":3,"last update":"Sat Nov 4 15:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.47399999999999998,"15min":0.436},"min":{"1min":0.36399999999999999,"5min":0.23100000000000001,"15min":0.20899999999999999},"max":{"1min":0.63100000000000001,"5min":6.7679999999999998,"15min":6.7679999999999998},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.45900000000000002,"15min":0.44700000000000001},"min":{"1min":0.41799999999999998,"5min":0.26500000000000001,"15min":0.24299999999999999},"max":{"1min":0.61299999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.46500000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705807,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":918208,"kb_used_data":237496,"kb_used_omap":0,"kb_used_meta":680704,"kb_avail":93453632,"statfs":{"total":96636764160,"available":95696519168,"internally_reserved":0,"allocated":243195904,"data_stored":242832608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":697040896},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 15:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.46200000000000002,"15min":0.32400000000000001},"min":{"1min":0.22700000000000001,"5min":0.14499999999999999,"15min":0.13500000000000001},"max":{"1min":0.44,"5min":12.731,"15min":12.731},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.30399999999999999,"15min":0.27900000000000003},"min":{"1min":0.253,"5min":0.16400000000000001,"15min":0.155},"max":{"1min":0.45900000000000002,"5min":4.1200000000000001,"15min":4.1200000000000001},"last":0.30399999999999999}]},{"osd":2,"last update":"Sat Nov 4 15:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.49099999999999999,"15min":0.434},"min":{"1min":0.38400000000000001,"5min":0.219,"15min":0.17599999999999999},"max":{"1min":0.70399999999999996,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.46500000000000002,"15min":0.433},"min":{"1min":0.36499999999999999,"5min":0.21099999999999999,"15min":0.187},"max":{"1min":0.72999999999999998,"5min":3.6749999999999998,"15min":3.6749999999999998},"last":0.52500000000000002}]},{"osd":3,"last update":"Sat Nov 4 15:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.5,"15min":0.44600000000000001},"min":{"1min":0.35899999999999999,"5min":0.20899999999999999,"15min":0.20300000000000001},"max":{"1min":0.71899999999999997,"5min":6.4660000000000002,"15min":6.4660000000000002},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.50600000000000001,"15min":0.45300000000000001},"min":{"1min":0.40600000000000003,"5min":0.23899999999999999,"15min":0.23000000000000001},"max":{"1min":0.70899999999999996,"5min":6.3540000000000001,"15min":6.3540000000000001},"last":0.49299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":242003968,"data_stored":241991173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":192552960,"data_stored":192552686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":250785792,"data_stored":250765155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":176185344,"data_stored":176162148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":69829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":73939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":45197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":65707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T15:39:10.070 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-11-04T15:27:35.748092+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=27, tm_sec=35, tm_wday=5, tm_yday=308, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=4, tm_hour=15, tm_min=37, tm_sec=4, tm_wday=5, tm_yday=308, tm_isdst=0) 2023-11-04T15:39:10.072 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-04T15:39:30.073 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T15:39:30.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.189+0000 7feb210d2640 1 Processor -- start 2023-11-04T15:39:30.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.189+0000 7feb210d2640 1 -- start start 2023-11-04T15:39:30.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.189+0000 7feb210d2640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb1c137270 0x7feb1c0a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:30.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.189+0000 7feb210d2640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7feb1c0a3e90 0x7feb1c139f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:30.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.189+0000 7feb210d2640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb1c0a4c20 con 0x7feb1c137650 2023-11-04T15:39:30.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.189+0000 7feb210d2640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb1c0a3060 con 0x7feb1c0a3e90 2023-11-04T15:39:30.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.189+0000 7feb210d2640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c0a5080 con 0x7feb1c137270 2023-11-04T15:39:30.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.190+0000 7feb1b59e640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7feb1c137650 0x7feb1c13a4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53278/0 (socket says 172.21.15.19:53278) 2023-11-04T15:39:30.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.190+0000 7feb1b59e640 1 -- 172.21.15.19:0/3591566752 learned_addr learned my addr 172.21.15.19:0/3591566752 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:39:30.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.190+0000 7feb1ad9d640 1 --2- 172.21.15.19:0/3591566752 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb1c137270 0x7feb1c0a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:30.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.190+0000 7feb1a59c640 1 --2- 172.21.15.19:0/3591566752 >> v2:172.21.15.96:3300/0 conn(0x7feb1c0a3e90 0x7feb1c139f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:30.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.190+0000 7feb19d9b640 1 -- 172.21.15.19:0/3591566752 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3198755915 0 0) 0x7feb1c0a4c20 con 0x7feb1c137650 2023-11-04T15:39:30.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.190+0000 7feb19d9b640 1 -- 172.21.15.19:0/3591566752 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb04003520 con 0x7feb1c137650 2023-11-04T15:39:30.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.190+0000 7feb1a59c640 1 -- 172.21.15.19:0/3591566752 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb1c137270 msgr2=0x7feb1c0a6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:39:30.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.190+0000 7feb1a59c640 1 --2- 172.21.15.19:0/3591566752 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb1c137270 0x7feb1c0a6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:30.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.190+0000 7feb1a59c640 1 -- 172.21.15.19:0/3591566752 >> v1:172.21.15.19:6789/0 conn(0x7feb1c137650 legacy=0x7feb1c13a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:30.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.190+0000 7feb1a59c640 1 -- 172.21.15.19:0/3591566752 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb1c0a3440 con 0x7feb1c0a3e90 2023-11-04T15:39:30.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.190+0000 7feb1ad9d640 1 --2- 172.21.15.19:0/3591566752 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb1c137270 0x7feb1c0a6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T15:39:30.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.191+0000 7feb1a59c640 1 --2- 172.21.15.19:0/3591566752 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb1c0a3e90 0x7feb1c139f60 secure :-1 s=READY pgs=2769 cs=0 l=1 rev1=1 crypto rx=0x7feb100097a0 tx=0x7feb1002b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba2a90a1985380fb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:39:30.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.191+0000 7feb19d9b640 1 -- 172.21.15.19:0/3591566752 <== mon.1 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1002f050 con 0x7feb1c0a3e90 2023-11-04T15:39:30.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.191+0000 7feb19d9b640 1 -- 172.21.15.19:0/3591566752 <== mon.1 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb10031700 con 0x7feb1c0a3e90 2023-11-04T15:39:30.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.191+0000 7feb19d9b640 1 -- 172.21.15.19:0/3591566752 <== mon.1 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb10031a90 con 0x7feb1c0a3e90 2023-11-04T15:39:30.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.192+0000 7feb210d2640 1 -- 172.21.15.19:0/3591566752 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb1c0a3e90 msgr2=0x7feb1c139f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:30.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.192+0000 7feb210d2640 1 --2- 172.21.15.19:0/3591566752 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb1c0a3e90 0x7feb1c139f60 secure :-1 s=READY pgs=2769 cs=0 l=1 rev1=1 crypto rx=0x7feb100097a0 tx=0x7feb1002b7a0 comp rx=0 tx=0).stop 2023-11-04T15:39:30.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.192+0000 7feb210d2640 1 -- 172.21.15.19:0/3591566752 shutdown_connections 2023-11-04T15:39:30.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.192+0000 7feb210d2640 1 --2- 172.21.15.19:0/3591566752 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb1c0a3e90 0x7feb1c139f60 unknown :-1 s=CLOSED pgs=2769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:30.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.192+0000 7feb210d2640 1 --2- 172.21.15.19:0/3591566752 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb1c137270 0x7feb1c0a6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:30.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.192+0000 7feb210d2640 1 -- 172.21.15.19:0/3591566752 >> 172.21.15.19:0/3591566752 conn(0x7feb1c0a8d70 msgr2=0x7feb1c0a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:39:30.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.192+0000 7feb210d2640 1 -- 172.21.15.19:0/3591566752 shutdown_connections 2023-11-04T15:39:30.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.192+0000 7feb210d2640 1 -- 172.21.15.19:0/3591566752 wait complete. 2023-11-04T15:39:30.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.193+0000 7feb210d2640 1 Processor -- start 2023-11-04T15:39:30.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.193+0000 7feb210d2640 1 -- start start 2023-11-04T15:39:30.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.194+0000 7feb210d2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb1c0a3e90 0x7feb1c097a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:30.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.194+0000 7feb210d2640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb1c137270 0x7feb1c097f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:30.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.194+0000 7feb210d2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb1c137650 0x7feb1c098480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:30.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.194+0000 7feb210d2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c098f60 con 0x7feb1c0a3e90 2023-11-04T15:39:30.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.194+0000 7feb210d2640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c09a0d0 con 0x7feb1c137650 2023-11-04T15:39:30.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.194+0000 7feb210d2640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c09a900 con 0x7feb1c137270 2023-11-04T15:39:30.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.194+0000 7feb1ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb1c0a3e90 0x7feb1c097a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:30.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.194+0000 7feb1ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb1c0a3e90 0x7feb1c097a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56416/0 (socket says 172.21.15.19:56416) 2023-11-04T15:39:30.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.194+0000 7feb1ad9d640 1 -- 172.21.15.19:0/1209276034 learned_addr learned my addr 172.21.15.19:0/1209276034 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:39:30.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.194+0000 7feb1b59e640 1 --2- 172.21.15.19:0/1209276034 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb1c137650 0x7feb1c098480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:30.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.194+0000 7feb1a59c640 1 --2- 172.21.15.19:0/1209276034 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb1c137270 0x7feb1c097f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:30.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.194+0000 7feb1ad9d640 1 -- 172.21.15.19:0/1209276034 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb1c137270 msgr2=0x7feb1c097f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:30.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.194+0000 7feb1ad9d640 1 --2- 172.21.15.19:0/1209276034 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb1c137270 0x7feb1c097f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:30.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.194+0000 7feb1ad9d640 1 -- 172.21.15.19:0/1209276034 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb1c137650 msgr2=0x7feb1c098480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:30.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.194+0000 7feb1ad9d640 1 --2- 172.21.15.19:0/1209276034 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb1c137650 0x7feb1c098480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:30.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.194+0000 7feb1ad9d640 1 -- 172.21.15.19:0/1209276034 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb0c009400 con 0x7feb1c0a3e90 2023-11-04T15:39:30.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.194+0000 7feb1ad9d640 1 --2- 172.21.15.19:0/1209276034 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb1c0a3e90 0x7feb1c097a00 secure :-1 s=READY pgs=3786 cs=0 l=1 rev1=1 crypto rx=0x7feb0c00ebe0 tx=0x7feb0c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:39:30.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.194+0000 7feb037fe640 1 -- 172.21.15.19:0/1209276034 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c009760 con 0x7feb1c0a3e90 2023-11-04T15:39:30.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.194+0000 7feb037fe640 1 -- 172.21.15.19:0/1209276034 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0c00cc30 con 0x7feb1c0a3e90 2023-11-04T15:39:30.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.194+0000 7feb210d2640 1 -- 172.21.15.19:0/1209276034 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb10009400 con 0x7feb1c0a3e90 2023-11-04T15:39:30.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.194+0000 7feb037fe640 1 -- 172.21.15.19:0/1209276034 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c00eee0 con 0x7feb1c0a3e90 2023-11-04T15:39:30.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.195+0000 7feb210d2640 1 -- 172.21.15.19:0/1209276034 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb1c09b500 con 0x7feb1c0a3e90 2023-11-04T15:39:30.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.196+0000 7feb210d2640 1 -- 172.21.15.19:0/1209276034 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb1c09c6f0 con 0x7feb1c0a3e90 2023-11-04T15:39:30.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.196+0000 7feb037fe640 1 -- 172.21.15.19:0/1209276034 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7feb0c013470 con 0x7feb1c0a3e90 2023-11-04T15:39:30.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.197+0000 7feb037fe640 1 --2- 172.21.15.19:0/1209276034 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7feb0806a430 0x7feb0806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:30.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.197+0000 7feb037fe640 1 -- 172.21.15.19:0/1209276034 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4434+0+0 (secure 0 0 0) 0x7feb0c088780 con 0x7feb1c0a3e90 2023-11-04T15:39:30.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.197+0000 7feb1a59c640 1 --2- 172.21.15.19:0/1209276034 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7feb0806a430 0x7feb0806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:30.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.197+0000 7feb1a59c640 1 --2- 172.21.15.19:0/1209276034 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7feb0806a430 0x7feb0806c8f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7feb10035000 tx=0x7feb10008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:39:30.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.201+0000 7feb037fe640 1 -- 172.21.15.19:0/1209276034 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7feb0c054250 con 0x7feb1c0a3e90 2023-11-04T15:39:30.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.375+0000 7feb210d2640 1 -- 172.21.15.19:0/1209276034 --> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feb1c0a5340 con 0x7feb0806a430 2023-11-04T15:39:30.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.383+0000 7feb037fe640 1 -- 172.21.15.19:0/1209276034 <== mgr.4114 v2:172.21.15.96:6816/83123 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282044 (secure 0 0 0) 0x7feb100319f0 con 0x7feb0806a430 2023-11-04T15:39:30.388 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:39:30.390 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-11-04T15:39:30.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.386+0000 7feb210d2640 1 -- 172.21.15.19:0/1209276034 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7feb0806a430 msgr2=0x7feb0806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:30.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.386+0000 7feb210d2640 1 --2- 172.21.15.19:0/1209276034 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7feb0806a430 0x7feb0806c8f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7feb10035000 tx=0x7feb10008030 comp rx=0 tx=0).stop 2023-11-04T15:39:30.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.386+0000 7feb210d2640 1 -- 172.21.15.19:0/1209276034 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb1c0a3e90 msgr2=0x7feb1c097a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:30.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.386+0000 7feb210d2640 1 --2- 172.21.15.19:0/1209276034 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb1c0a3e90 0x7feb1c097a00 secure :-1 s=READY pgs=3786 cs=0 l=1 rev1=1 crypto rx=0x7feb0c00ebe0 tx=0x7feb0c00c520 comp rx=0 tx=0).stop 2023-11-04T15:39:30.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.386+0000 7feb210d2640 1 -- 172.21.15.19:0/1209276034 shutdown_connections 2023-11-04T15:39:30.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.386+0000 7feb210d2640 1 --2- 172.21.15.19:0/1209276034 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7feb0806a430 0x7feb0806c8f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:30.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.386+0000 7feb210d2640 1 --2- 172.21.15.19:0/1209276034 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb1c137650 0x7feb1c098480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:30.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.386+0000 7feb210d2640 1 --2- 172.21.15.19:0/1209276034 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb1c137270 0x7feb1c097f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:30.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.386+0000 7feb210d2640 1 --2- 172.21.15.19:0/1209276034 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb1c0a3e90 0x7feb1c097a00 unknown :-1 s=CLOSED pgs=3786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:30.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.386+0000 7feb210d2640 1 -- 172.21.15.19:0/1209276034 >> 172.21.15.19:0/1209276034 conn(0x7feb1c0a8d70 msgr2=0x7feb1c0aad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:39:30.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.386+0000 7feb210d2640 1 -- 172.21.15.19:0/1209276034 shutdown_connections 2023-11-04T15:39:30.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.386+0000 7feb210d2640 1 -- 172.21.15.19:0/1209276034 wait complete. 2023-11-04T15:39:30.399 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":403,"stamp":"2023-11-04T15:39:29.092288+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":431453382,"num_objects":220,"num_object_clones":25,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":8,"num_read":352,"num_read_kb":3468,"num_write":158437,"num_write_kb":940563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7850,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":307700,"ondisk_log_size":307700,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":3253552,"kb_used_data":844816,"kb_used_omap":0,"kb_used_meta":2408704,"kb_avail":374233808,"statfs":{"total":386547056640,"available":383215419392,"internally_reserved":0,"allocated":865091584,"data_stored":863631522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2466512896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003204"},"pg_stats":[{"pgid":"4.3f","version":"40'3514","reported_seq":2963,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:08.783192+0000","last_change":"2023-11-04T15:37:08.783192+0000","last_active":"2023-11-04T15:37:08.783192+0000","last_peered":"2023-11-04T15:37:08.783192+0000","last_clean":"2023-11-04T15:37:08.783192+0000","last_became_active":"2023-11-04T15:27:36.150296+0000","last_became_peered":"2023-11-04T15:27:36.150296+0000","last_unstale":"2023-11-04T15:37:08.783192+0000","last_undegraded":"2023-11-04T15:37:08.783192+0000","last_fullsized":"2023-11-04T15:37:08.783192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3514","last_scrub_stamp":"2023-11-04T15:37:08.783013+0000","last_deep_scrub":"40'3514","last_deep_scrub_stamp":"2023-11-04T15:37:08.783013+0000","last_clean_scrub_stamp":"2023-11-04T15:37:08.783013+0000","objects_scrubbed":0,"log_size":3514,"log_dups_size":0,"ondisk_log_size":3514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:20:34.659393+0000","scrub_duration":0.0030156520000000002,"objects_trimmed":0,"snaptrim_duration":0.074678280999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1112,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"44'3336","reported_seq":2800,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:27.770913+0000","last_change":"2023-11-04T15:38:27.771063+0000","last_active":"2023-11-04T15:38:27.770913+0000","last_peered":"2023-11-04T15:38:27.770913+0000","last_clean":"2023-11-04T15:38:27.770913+0000","last_became_active":"2023-11-04T15:27:36.148939+0000","last_became_peered":"2023-11-04T15:27:36.148939+0000","last_unstale":"2023-11-04T15:38:27.770913+0000","last_undegraded":"2023-11-04T15:38:27.770913+0000","last_fullsized":"2023-11-04T15:38:27.770913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3336","last_scrub_stamp":"2023-11-04T15:38:27.770889+0000","last_deep_scrub":"44'3336","last_deep_scrub_stamp":"2023-11-04T15:38:27.770889+0000","last_clean_scrub_stamp":"2023-11-04T15:38:27.770889+0000","objects_scrubbed":4,"log_size":3336,"log_dups_size":0,"ondisk_log_size":3336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:29:32.990012+0000","scrub_duration":0.013599927,"objects_trimmed":0,"snaptrim_duration":0.059113046000000002,"stat_sum":{"num_bytes":35,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1118,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"44'3530","reported_seq":3015,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:39:03.167592+0000","last_change":"2023-11-04T15:39:03.167694+0000","last_active":"2023-11-04T15:39:03.167592+0000","last_peered":"2023-11-04T15:39:03.167592+0000","last_clean":"2023-11-04T15:39:03.167592+0000","last_became_active":"2023-11-04T15:27:36.149748+0000","last_became_peered":"2023-11-04T15:27:36.149748+0000","last_unstale":"2023-11-04T15:39:03.167592+0000","last_undegraded":"2023-11-04T15:39:03.167592+0000","last_fullsized":"2023-11-04T15:39:03.167592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3530","last_scrub_stamp":"2023-11-04T15:39:03.167569+0000","last_deep_scrub":"44'3530","last_deep_scrub_stamp":"2023-11-04T15:39:03.167569+0000","last_clean_scrub_stamp":"2023-11-04T15:39:03.167569+0000","objects_scrubbed":3,"log_size":3530,"log_dups_size":0,"ondisk_log_size":3530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:43:20.156908+0000","scrub_duration":0.013353248,"objects_trimmed":0,"snaptrim_duration":0.101592565,"stat_sum":{"num_bytes":8206,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":1149,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"40'3602","reported_seq":2996,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:13.718129+0000","last_change":"2023-11-04T15:38:13.718234+0000","last_active":"2023-11-04T15:38:13.718129+0000","last_peered":"2023-11-04T15:38:13.718129+0000","last_clean":"2023-11-04T15:38:13.718129+0000","last_became_active":"2023-11-04T15:27:36.139761+0000","last_became_peered":"2023-11-04T15:27:36.139761+0000","last_unstale":"2023-11-04T15:38:13.718129+0000","last_undegraded":"2023-11-04T15:38:13.718129+0000","last_fullsized":"2023-11-04T15:38:13.718129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3602","last_scrub_stamp":"2023-11-04T15:38:13.718107+0000","last_deep_scrub":"40'3602","last_deep_scrub_stamp":"2023-11-04T15:38:13.718107+0000","last_clean_scrub_stamp":"2023-11-04T15:38:13.718107+0000","objects_scrubbed":0,"log_size":3602,"log_dups_size":0,"ondisk_log_size":3602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:31.176388+0000","scrub_duration":0.0074235689999999997,"objects_trimmed":0,"snaptrim_duration":0.052924038,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1171,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"40'3725","reported_seq":3130,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:49.526048+0000","last_change":"2023-11-04T15:37:49.526154+0000","last_active":"2023-11-04T15:37:49.526048+0000","last_peered":"2023-11-04T15:37:49.526048+0000","last_clean":"2023-11-04T15:37:49.526048+0000","last_became_active":"2023-11-04T15:27:36.150017+0000","last_became_peered":"2023-11-04T15:27:36.150017+0000","last_unstale":"2023-11-04T15:37:49.526048+0000","last_undegraded":"2023-11-04T15:37:49.526048+0000","last_fullsized":"2023-11-04T15:37:49.526048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3725","last_scrub_stamp":"2023-11-04T15:37:49.526022+0000","last_deep_scrub":"40'3725","last_deep_scrub_stamp":"2023-11-04T15:37:49.526022+0000","last_clean_scrub_stamp":"2023-11-04T15:37:49.526022+0000","objects_scrubbed":0,"log_size":3725,"log_dups_size":0,"ondisk_log_size":3725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:46:35.934988+0000","scrub_duration":0.0051336519999999998,"objects_trimmed":0,"snaptrim_duration":0.073241305000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1192,"num_write_kb":641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"44'3328","reported_seq":2783,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:34.244312+0000","last_change":"2023-11-04T15:38:34.244401+0000","last_active":"2023-11-04T15:38:34.244312+0000","last_peered":"2023-11-04T15:38:34.244312+0000","last_clean":"2023-11-04T15:38:34.244312+0000","last_became_active":"2023-11-04T15:27:36.139036+0000","last_became_peered":"2023-11-04T15:27:36.139036+0000","last_unstale":"2023-11-04T15:38:34.244312+0000","last_undegraded":"2023-11-04T15:38:34.244312+0000","last_fullsized":"2023-11-04T15:38:34.244312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3328","last_scrub_stamp":"2023-11-04T15:38:34.244289+0000","last_deep_scrub":"44'3328","last_deep_scrub_stamp":"2023-11-04T15:38:34.244289+0000","last_clean_scrub_stamp":"2023-11-04T15:38:34.244289+0000","objects_scrubbed":1,"log_size":3328,"log_dups_size":0,"ondisk_log_size":3328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:39:09.364625+0000","scrub_duration":0.0082036850000000005,"objects_trimmed":0,"snaptrim_duration":0.102154117,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1074,"num_write_kb":603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"44'3356","reported_seq":2819,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:26.478185+0000","last_change":"2023-11-04T15:37:26.478185+0000","last_active":"2023-11-04T15:37:26.478185+0000","last_peered":"2023-11-04T15:37:26.478185+0000","last_clean":"2023-11-04T15:37:26.478185+0000","last_became_active":"2023-11-04T15:27:36.139121+0000","last_became_peered":"2023-11-04T15:27:36.139121+0000","last_unstale":"2023-11-04T15:37:26.478185+0000","last_undegraded":"2023-11-04T15:37:26.478185+0000","last_fullsized":"2023-11-04T15:37:26.478185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3356","last_scrub_stamp":"2023-11-04T15:37:26.478037+0000","last_deep_scrub":"44'3356","last_deep_scrub_stamp":"2023-11-04T15:37:26.478037+0000","last_clean_scrub_stamp":"2023-11-04T15:37:26.478037+0000","objects_scrubbed":5,"log_size":3356,"log_dups_size":0,"ondisk_log_size":3356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:38:01.386862+0000","scrub_duration":0.011615044999999999,"objects_trimmed":0,"snaptrim_duration":0.099827518000000004,"stat_sum":{"num_bytes":4117,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":2,"num_read_kb":1,"num_write":1086,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"40'3425","reported_seq":2855,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:39:06.166930+0000","last_change":"2023-11-04T15:39:06.167063+0000","last_active":"2023-11-04T15:39:06.166930+0000","last_peered":"2023-11-04T15:39:06.166930+0000","last_clean":"2023-11-04T15:39:06.166930+0000","last_became_active":"2023-11-04T15:27:36.147050+0000","last_became_peered":"2023-11-04T15:27:36.147050+0000","last_unstale":"2023-11-04T15:39:06.166930+0000","last_undegraded":"2023-11-04T15:39:06.166930+0000","last_fullsized":"2023-11-04T15:39:06.166930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3425","last_scrub_stamp":"2023-11-04T15:39:06.166908+0000","last_deep_scrub":"40'3425","last_deep_scrub_stamp":"2023-11-04T15:39:06.166908+0000","last_clean_scrub_stamp":"2023-11-04T15:39:06.166908+0000","objects_scrubbed":0,"log_size":3425,"log_dups_size":0,"ondisk_log_size":3425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:45:33.910969+0000","scrub_duration":0.0070322689999999998,"objects_trimmed":0,"snaptrim_duration":0.098810337999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"44'3562","reported_seq":2977,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:38.816297+0000","last_change":"2023-11-04T15:38:38.816421+0000","last_active":"2023-11-04T15:38:38.816297+0000","last_peered":"2023-11-04T15:38:38.816297+0000","last_clean":"2023-11-04T15:38:38.816297+0000","last_became_active":"2023-11-04T15:27:36.145825+0000","last_became_peered":"2023-11-04T15:27:36.145825+0000","last_unstale":"2023-11-04T15:38:38.816297+0000","last_undegraded":"2023-11-04T15:38:38.816297+0000","last_fullsized":"2023-11-04T15:38:38.816297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3562","last_scrub_stamp":"2023-11-04T15:38:38.816274+0000","last_deep_scrub":"44'3562","last_deep_scrub_stamp":"2023-11-04T15:38:38.816274+0000","last_clean_scrub_stamp":"2023-11-04T15:38:38.816274+0000","objects_scrubbed":1,"log_size":3562,"log_dups_size":0,"ondisk_log_size":3562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:39:40.398994+0000","scrub_duration":0.0076341400000000002,"objects_trimmed":0,"snaptrim_duration":0.072094483000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"44'3329","reported_seq":2857,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:55.514489+0000","last_change":"2023-11-04T15:37:55.514590+0000","last_active":"2023-11-04T15:37:55.514489+0000","last_peered":"2023-11-04T15:37:55.514489+0000","last_clean":"2023-11-04T15:37:55.514489+0000","last_became_active":"2023-11-04T15:27:36.150307+0000","last_became_peered":"2023-11-04T15:27:36.150307+0000","last_unstale":"2023-11-04T15:37:55.514489+0000","last_undegraded":"2023-11-04T15:37:55.514489+0000","last_fullsized":"2023-11-04T15:37:55.514489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3329","last_scrub_stamp":"2023-11-04T15:37:55.514464+0000","last_deep_scrub":"44'3329","last_deep_scrub_stamp":"2023-11-04T15:37:55.514464+0000","last_clean_scrub_stamp":"2023-11-04T15:37:55.514464+0000","objects_scrubbed":2,"log_size":3329,"log_dups_size":0,"ondisk_log_size":3329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:11:45.335660+0000","scrub_duration":0.011217928,"objects_trimmed":0,"snaptrim_duration":0.10012518099999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1064,"num_write_kb":572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"40'3202","reported_seq":2732,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:12.694264+0000","last_change":"2023-11-04T15:38:12.694422+0000","last_active":"2023-11-04T15:38:12.694264+0000","last_peered":"2023-11-04T15:38:12.694264+0000","last_clean":"2023-11-04T15:38:12.694264+0000","last_became_active":"2023-11-04T15:27:36.144988+0000","last_became_peered":"2023-11-04T15:27:36.144988+0000","last_unstale":"2023-11-04T15:38:12.694264+0000","last_undegraded":"2023-11-04T15:38:12.694264+0000","last_fullsized":"2023-11-04T15:38:12.694264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3202","last_scrub_stamp":"2023-11-04T15:38:12.694227+0000","last_deep_scrub":"40'3202","last_deep_scrub_stamp":"2023-11-04T15:38:12.694227+0000","last_clean_scrub_stamp":"2023-11-04T15:38:12.694227+0000","objects_scrubbed":0,"log_size":3202,"log_dups_size":0,"ondisk_log_size":3202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:44:10.147349+0000","scrub_duration":0.0048418030000000004,"objects_trimmed":0,"snaptrim_duration":0.052379294999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1028,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"44'3395","reported_seq":2835,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:21.176452+0000","last_change":"2023-11-04T15:38:21.176557+0000","last_active":"2023-11-04T15:38:21.176452+0000","last_peered":"2023-11-04T15:38:21.176452+0000","last_clean":"2023-11-04T15:38:21.176452+0000","last_became_active":"2023-11-04T15:27:36.149156+0000","last_became_peered":"2023-11-04T15:27:36.149156+0000","last_unstale":"2023-11-04T15:38:21.176452+0000","last_undegraded":"2023-11-04T15:38:21.176452+0000","last_fullsized":"2023-11-04T15:38:21.176452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3395","last_scrub_stamp":"2023-11-04T15:38:21.176427+0000","last_deep_scrub":"44'3395","last_deep_scrub_stamp":"2023-11-04T15:38:21.176427+0000","last_clean_scrub_stamp":"2023-11-04T15:38:21.176427+0000","objects_scrubbed":1,"log_size":3395,"log_dups_size":0,"ondisk_log_size":3395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:29:26.395550+0000","scrub_duration":0.011035761999999999,"objects_trimmed":0,"snaptrim_duration":0.064372897999999998,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1159,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"40'3255","reported_seq":2755,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:24.864365+0000","last_change":"2023-11-04T15:38:24.864474+0000","last_active":"2023-11-04T15:38:24.864365+0000","last_peered":"2023-11-04T15:38:24.864365+0000","last_clean":"2023-11-04T15:38:24.864365+0000","last_became_active":"2023-11-04T15:27:36.139824+0000","last_became_peered":"2023-11-04T15:27:36.139824+0000","last_unstale":"2023-11-04T15:38:24.864365+0000","last_undegraded":"2023-11-04T15:38:24.864365+0000","last_fullsized":"2023-11-04T15:38:24.864365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3255","last_scrub_stamp":"2023-11-04T15:38:24.864341+0000","last_deep_scrub":"40'3255","last_deep_scrub_stamp":"2023-11-04T15:38:24.864341+0000","last_clean_scrub_stamp":"2023-11-04T15:38:24.864341+0000","objects_scrubbed":0,"log_size":3255,"log_dups_size":0,"ondisk_log_size":3255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:32:57.678216+0000","scrub_duration":0.0057894940000000001,"objects_trimmed":0,"snaptrim_duration":0.070068697999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1062,"num_write_kb":575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"44'3539","reported_seq":2931,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:24.652151+0000","last_change":"2023-11-04T15:38:24.652151+0000","last_active":"2023-11-04T15:38:24.652151+0000","last_peered":"2023-11-04T15:38:24.652151+0000","last_clean":"2023-11-04T15:38:24.652151+0000","last_became_active":"2023-11-04T15:27:36.147273+0000","last_became_peered":"2023-11-04T15:27:36.147273+0000","last_unstale":"2023-11-04T15:38:24.652151+0000","last_undegraded":"2023-11-04T15:38:24.652151+0000","last_fullsized":"2023-11-04T15:38:24.652151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3539","last_scrub_stamp":"2023-11-04T15:38:24.652022+0000","last_deep_scrub":"44'3539","last_deep_scrub_stamp":"2023-11-04T15:38:24.652022+0000","last_clean_scrub_stamp":"2023-11-04T15:38:24.652022+0000","objects_scrubbed":1,"log_size":3539,"log_dups_size":0,"ondisk_log_size":3539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:16:59.050291+0000","scrub_duration":0.0093328639999999997,"objects_trimmed":0,"snaptrim_duration":0.055716603000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"40'3766","reported_seq":3171,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:15.722956+0000","last_change":"2023-11-04T15:38:15.722956+0000","last_active":"2023-11-04T15:38:15.722956+0000","last_peered":"2023-11-04T15:38:15.722956+0000","last_clean":"2023-11-04T15:38:15.722956+0000","last_became_active":"2023-11-04T15:27:36.148932+0000","last_became_peered":"2023-11-04T15:27:36.148932+0000","last_unstale":"2023-11-04T15:38:15.722956+0000","last_undegraded":"2023-11-04T15:38:15.722956+0000","last_fullsized":"2023-11-04T15:38:15.722956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3766","last_scrub_stamp":"2023-11-04T15:38:15.722815+0000","last_deep_scrub":"40'3766","last_deep_scrub_stamp":"2023-11-04T15:38:15.722815+0000","last_clean_scrub_stamp":"2023-11-04T15:38:15.722815+0000","objects_scrubbed":0,"log_size":3766,"log_dups_size":0,"ondisk_log_size":3766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:03:16.395834+0000","scrub_duration":0.0047167329999999999,"objects_trimmed":0,"snaptrim_duration":0.062648212999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1209,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"44'3539","reported_seq":2959,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:39:05.203578+0000","last_change":"2023-11-04T15:39:05.203578+0000","last_active":"2023-11-04T15:39:05.203578+0000","last_peered":"2023-11-04T15:39:05.203578+0000","last_clean":"2023-11-04T15:39:05.203578+0000","last_became_active":"2023-11-04T15:27:36.150856+0000","last_became_peered":"2023-11-04T15:27:36.150856+0000","last_unstale":"2023-11-04T15:39:05.203578+0000","last_undegraded":"2023-11-04T15:39:05.203578+0000","last_fullsized":"2023-11-04T15:39:05.203578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3539","last_scrub_stamp":"2023-11-04T15:39:05.203385+0000","last_deep_scrub":"44'3539","last_deep_scrub_stamp":"2023-11-04T15:39:05.203385+0000","last_clean_scrub_stamp":"2023-11-04T15:39:05.203385+0000","objects_scrubbed":1,"log_size":3539,"log_dups_size":0,"ondisk_log_size":3539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:27:48.900527+0000","scrub_duration":0.0087229419999999992,"objects_trimmed":0,"snaptrim_duration":0.099772735000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"40'3671","reported_seq":3012,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:33.881938+0000","last_change":"2023-11-04T15:38:33.881938+0000","last_active":"2023-11-04T15:38:33.881938+0000","last_peered":"2023-11-04T15:38:33.881938+0000","last_clean":"2023-11-04T15:38:33.881938+0000","last_became_active":"2023-11-04T15:27:36.144997+0000","last_became_peered":"2023-11-04T15:27:36.144997+0000","last_unstale":"2023-11-04T15:38:33.881938+0000","last_undegraded":"2023-11-04T15:38:33.881938+0000","last_fullsized":"2023-11-04T15:38:33.881938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3671","last_scrub_stamp":"2023-11-04T15:38:33.881801+0000","last_deep_scrub":"40'3671","last_deep_scrub_stamp":"2023-11-04T15:38:33.881801+0000","last_clean_scrub_stamp":"2023-11-04T15:38:33.881801+0000","objects_scrubbed":0,"log_size":3671,"log_dups_size":0,"ondisk_log_size":3671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:06:16.633743+0000","scrub_duration":0.0051090789999999999,"objects_trimmed":0,"snaptrim_duration":0.072563297999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1270,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"44'3139","reported_seq":2657,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:43.481511+0000","last_change":"2023-11-04T15:37:43.481511+0000","last_active":"2023-11-04T15:37:43.481511+0000","last_peered":"2023-11-04T15:37:43.481511+0000","last_clean":"2023-11-04T15:37:43.481511+0000","last_became_active":"2023-11-04T15:27:36.150555+0000","last_became_peered":"2023-11-04T15:27:36.150555+0000","last_unstale":"2023-11-04T15:37:43.481511+0000","last_undegraded":"2023-11-04T15:37:43.481511+0000","last_fullsized":"2023-11-04T15:37:43.481511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3139","last_scrub_stamp":"2023-11-04T15:37:43.481392+0000","last_deep_scrub":"44'3139","last_deep_scrub_stamp":"2023-11-04T15:37:43.481392+0000","last_clean_scrub_stamp":"2023-11-04T15:37:43.481392+0000","objects_scrubbed":2,"log_size":3139,"log_dups_size":0,"ondisk_log_size":3139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:46:29.890357+0000","scrub_duration":0.010710094,"objects_trimmed":0,"snaptrim_duration":0.101696772,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1042,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"44'3392","reported_seq":2827,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:20.801299+0000","last_change":"2023-11-04T15:38:20.801299+0000","last_active":"2023-11-04T15:38:20.801299+0000","last_peered":"2023-11-04T15:38:20.801299+0000","last_clean":"2023-11-04T15:38:20.801299+0000","last_became_active":"2023-11-04T15:27:36.147745+0000","last_became_peered":"2023-11-04T15:27:36.147745+0000","last_unstale":"2023-11-04T15:38:20.801299+0000","last_undegraded":"2023-11-04T15:38:20.801299+0000","last_fullsized":"2023-11-04T15:38:20.801299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3392","last_scrub_stamp":"2023-11-04T15:38:20.801150+0000","last_deep_scrub":"44'3392","last_deep_scrub_stamp":"2023-11-04T15:38:20.801150+0000","last_clean_scrub_stamp":"2023-11-04T15:38:20.801150+0000","objects_scrubbed":2,"log_size":3392,"log_dups_size":0,"ondisk_log_size":3392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:16:55.199419+0000","scrub_duration":0.0083994859999999994,"objects_trimmed":0,"snaptrim_duration":0.071588252000000005,"stat_sum":{"num_bytes":4128,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1173,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"44'3507","reported_seq":2930,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:47.451113+0000","last_change":"2023-11-04T15:37:47.451113+0000","last_active":"2023-11-04T15:37:47.451113+0000","last_peered":"2023-11-04T15:37:47.451113+0000","last_clean":"2023-11-04T15:37:47.451113+0000","last_became_active":"2023-11-04T15:27:36.150687+0000","last_became_peered":"2023-11-04T15:27:36.150687+0000","last_unstale":"2023-11-04T15:37:47.451113+0000","last_undegraded":"2023-11-04T15:37:47.451113+0000","last_fullsized":"2023-11-04T15:37:47.451113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3507","last_scrub_stamp":"2023-11-04T15:37:47.450975+0000","last_deep_scrub":"44'3507","last_deep_scrub_stamp":"2023-11-04T15:37:47.450975+0000","last_clean_scrub_stamp":"2023-11-04T15:37:47.450975+0000","objects_scrubbed":2,"log_size":3507,"log_dups_size":0,"ondisk_log_size":3507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:21:13.505376+0000","scrub_duration":0.0096580350000000006,"objects_trimmed":0,"snaptrim_duration":0.097896176000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1154,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2b","version":"44'3547","reported_seq":2997,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:18.707619+0000","last_change":"2023-11-04T15:38:18.707619+0000","last_active":"2023-11-04T15:38:18.707619+0000","last_peered":"2023-11-04T15:38:18.707619+0000","last_clean":"2023-11-04T15:38:18.707619+0000","last_became_active":"2023-11-04T15:27:36.143551+0000","last_became_peered":"2023-11-04T15:27:36.143551+0000","last_unstale":"2023-11-04T15:38:18.707619+0000","last_undegraded":"2023-11-04T15:38:18.707619+0000","last_fullsized":"2023-11-04T15:38:18.707619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3547","last_scrub_stamp":"2023-11-04T15:38:18.707479+0000","last_deep_scrub":"44'3547","last_deep_scrub_stamp":"2023-11-04T15:38:18.707479+0000","last_clean_scrub_stamp":"2023-11-04T15:38:18.707479+0000","objects_scrubbed":3,"log_size":3547,"log_dups_size":0,"ondisk_log_size":3547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:16:47.482996+0000","scrub_duration":0.01049517,"objects_trimmed":0,"snaptrim_duration":0.056037475000000003,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":1,"num_read_kb":0,"num_write":1178,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"44'3730","reported_seq":3100,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:14.873894+0000","last_change":"2023-11-04T15:38:14.873894+0000","last_active":"2023-11-04T15:38:14.873894+0000","last_peered":"2023-11-04T15:38:14.873894+0000","last_clean":"2023-11-04T15:38:14.873894+0000","last_became_active":"2023-11-04T15:27:36.145943+0000","last_became_peered":"2023-11-04T15:27:36.145943+0000","last_unstale":"2023-11-04T15:38:14.873894+0000","last_undegraded":"2023-11-04T15:38:14.873894+0000","last_fullsized":"2023-11-04T15:38:14.873894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3730","last_scrub_stamp":"2023-11-04T15:38:14.873735+0000","last_deep_scrub":"44'3730","last_deep_scrub_stamp":"2023-11-04T15:38:14.873735+0000","last_clean_scrub_stamp":"2023-11-04T15:38:14.873735+0000","objects_scrubbed":2,"log_size":3730,"log_dups_size":0,"ondisk_log_size":3730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:16:43.649252+0000","scrub_duration":0.011526497,"objects_trimmed":0,"snaptrim_duration":0.071549077000000003,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1242,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"40'3454","reported_seq":2902,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:22.189283+0000","last_change":"2023-11-04T15:38:22.189283+0000","last_active":"2023-11-04T15:38:22.189283+0000","last_peered":"2023-11-04T15:38:22.189283+0000","last_clean":"2023-11-04T15:38:22.189283+0000","last_became_active":"2023-11-04T15:27:36.144083+0000","last_became_peered":"2023-11-04T15:27:36.144083+0000","last_unstale":"2023-11-04T15:38:22.189283+0000","last_undegraded":"2023-11-04T15:38:22.189283+0000","last_fullsized":"2023-11-04T15:38:22.189283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3454","last_scrub_stamp":"2023-11-04T15:38:22.189124+0000","last_deep_scrub":"40'3454","last_deep_scrub_stamp":"2023-11-04T15:38:22.189124+0000","last_clean_scrub_stamp":"2023-11-04T15:38:22.189124+0000","objects_scrubbed":0,"log_size":3454,"log_dups_size":0,"ondisk_log_size":3454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:32:55.002998+0000","scrub_duration":0.0043707939999999999,"objects_trimmed":0,"snaptrim_duration":0.060959410999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1127,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"44'3635","reported_seq":3007,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:49.308455+0000","last_change":"2023-11-04T15:38:49.308586+0000","last_active":"2023-11-04T15:38:49.308455+0000","last_peered":"2023-11-04T15:38:49.308455+0000","last_clean":"2023-11-04T15:38:49.308455+0000","last_became_active":"2023-11-04T15:27:36.146546+0000","last_became_peered":"2023-11-04T15:27:36.146546+0000","last_unstale":"2023-11-04T15:38:49.308455+0000","last_undegraded":"2023-11-04T15:38:49.308455+0000","last_fullsized":"2023-11-04T15:38:49.308455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3635","last_scrub_stamp":"2023-11-04T15:38:49.308433+0000","last_deep_scrub":"44'3635","last_deep_scrub_stamp":"2023-11-04T15:38:49.308433+0000","last_clean_scrub_stamp":"2023-11-04T15:38:49.308433+0000","objects_scrubbed":3,"log_size":3635,"log_dups_size":0,"ondisk_log_size":3635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:57:34.938072+0000","scrub_duration":0.013378011,"objects_trimmed":0,"snaptrim_duration":0.102597439,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1222,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"44'3167","reported_seq":2642,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:18.169777+0000","last_change":"2023-11-04T15:38:18.169777+0000","last_active":"2023-11-04T15:38:18.169777+0000","last_peered":"2023-11-04T15:38:18.169777+0000","last_clean":"2023-11-04T15:38:18.169777+0000","last_became_active":"2023-11-04T15:27:36.144047+0000","last_became_peered":"2023-11-04T15:27:36.144047+0000","last_unstale":"2023-11-04T15:38:18.169777+0000","last_undegraded":"2023-11-04T15:38:18.169777+0000","last_fullsized":"2023-11-04T15:38:18.169777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3167","last_scrub_stamp":"2023-11-04T15:38:18.169609+0000","last_deep_scrub":"44'3167","last_deep_scrub_stamp":"2023-11-04T15:38:18.169609+0000","last_clean_scrub_stamp":"2023-11-04T15:38:18.169609+0000","objects_scrubbed":1,"log_size":3167,"log_dups_size":0,"ondisk_log_size":3167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:16:52.567878+0000","scrub_duration":0.0076393160000000002,"objects_trimmed":0,"snaptrim_duration":0.064725415999999994,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1115,"num_write_kb":609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"44'3494","reported_seq":2907,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:27.132214+0000","last_change":"2023-11-04T15:38:27.132214+0000","last_active":"2023-11-04T15:38:27.132214+0000","last_peered":"2023-11-04T15:38:27.132214+0000","last_clean":"2023-11-04T15:38:27.132214+0000","last_became_active":"2023-11-04T15:27:36.144458+0000","last_became_peered":"2023-11-04T15:27:36.144458+0000","last_unstale":"2023-11-04T15:38:27.132214+0000","last_undegraded":"2023-11-04T15:38:27.132214+0000","last_fullsized":"2023-11-04T15:38:27.132214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3494","last_scrub_stamp":"2023-11-04T15:38:27.132005+0000","last_deep_scrub":"44'3494","last_deep_scrub_stamp":"2023-11-04T15:38:27.132005+0000","last_clean_scrub_stamp":"2023-11-04T15:38:27.132005+0000","objects_scrubbed":1,"log_size":3494,"log_dups_size":0,"ondisk_log_size":3494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:54:38.317360+0000","scrub_duration":0.0090200420000000007,"objects_trimmed":0,"snaptrim_duration":0.066118209999999997,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"44'3387","reported_seq":2839,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:38.465038+0000","last_change":"2023-11-04T15:37:38.465038+0000","last_active":"2023-11-04T15:37:38.465038+0000","last_peered":"2023-11-04T15:37:38.465038+0000","last_clean":"2023-11-04T15:37:38.465038+0000","last_became_active":"2023-11-04T15:27:36.150270+0000","last_became_peered":"2023-11-04T15:27:36.150270+0000","last_unstale":"2023-11-04T15:37:38.465038+0000","last_undegraded":"2023-11-04T15:37:38.465038+0000","last_fullsized":"2023-11-04T15:37:38.465038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3387","last_scrub_stamp":"2023-11-04T15:37:38.464840+0000","last_deep_scrub":"44'3387","last_deep_scrub_stamp":"2023-11-04T15:37:38.464840+0000","last_clean_scrub_stamp":"2023-11-04T15:37:38.464840+0000","objects_scrubbed":1,"log_size":3387,"log_dups_size":0,"ondisk_log_size":3387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:40:18.070984+0000","scrub_duration":0.0081071519999999994,"objects_trimmed":0,"snaptrim_duration":0.104674168,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"44'3290","reported_seq":2734,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:40.874529+0000","last_change":"2023-11-04T15:38:40.874529+0000","last_active":"2023-11-04T15:38:40.874529+0000","last_peered":"2023-11-04T15:38:40.874529+0000","last_clean":"2023-11-04T15:38:40.874529+0000","last_became_active":"2023-11-04T15:28:20.871378+0000","last_became_peered":"2023-11-04T15:28:20.871378+0000","last_unstale":"2023-11-04T15:38:40.874529+0000","last_undegraded":"2023-11-04T15:38:40.874529+0000","last_fullsized":"2023-11-04T15:38:40.874529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3290","last_scrub_stamp":"2023-11-04T15:38:40.874398+0000","last_deep_scrub":"44'3290","last_deep_scrub_stamp":"2023-11-04T15:38:40.874398+0000","last_clean_scrub_stamp":"2023-11-04T15:38:40.874398+0000","objects_scrubbed":4,"log_size":3290,"log_dups_size":0,"ondisk_log_size":3290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:39:15.994733+0000","scrub_duration":0.011484166000000001,"objects_trimmed":0,"snaptrim_duration":0.074381663000000001,"stat_sum":{"num_bytes":9,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1152,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"44'3581","reported_seq":3023,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:43.871394+0000","last_change":"2023-11-04T15:38:43.871487+0000","last_active":"2023-11-04T15:38:43.871394+0000","last_peered":"2023-11-04T15:38:43.871394+0000","last_clean":"2023-11-04T15:38:43.871394+0000","last_became_active":"2023-11-04T15:27:36.145392+0000","last_became_peered":"2023-11-04T15:27:36.145392+0000","last_unstale":"2023-11-04T15:38:43.871394+0000","last_undegraded":"2023-11-04T15:38:43.871394+0000","last_fullsized":"2023-11-04T15:38:43.871394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3581","last_scrub_stamp":"2023-11-04T15:38:43.871369+0000","last_deep_scrub":"44'3581","last_deep_scrub_stamp":"2023-11-04T15:38:43.871369+0000","last_clean_scrub_stamp":"2023-11-04T15:38:43.871369+0000","objects_scrubbed":3,"log_size":3581,"log_dups_size":0,"ondisk_log_size":3581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T22:11:12.866904+0000","scrub_duration":0.012712273,"objects_trimmed":0,"snaptrim_duration":0.070714202000000004,"stat_sum":{"num_bytes":12288,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1167,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"40'3386","reported_seq":2874,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:10.551561+0000","last_change":"2023-11-04T15:37:10.551561+0000","last_active":"2023-11-04T15:37:10.551561+0000","last_peered":"2023-11-04T15:37:10.551561+0000","last_clean":"2023-11-04T15:37:10.551561+0000","last_became_active":"2023-11-04T15:27:36.145273+0000","last_became_peered":"2023-11-04T15:27:36.145273+0000","last_unstale":"2023-11-04T15:37:10.551561+0000","last_undegraded":"2023-11-04T15:37:10.551561+0000","last_fullsized":"2023-11-04T15:37:10.551561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3386","last_scrub_stamp":"2023-11-04T15:37:10.551443+0000","last_deep_scrub":"40'3386","last_deep_scrub_stamp":"2023-11-04T15:37:10.551443+0000","last_clean_scrub_stamp":"2023-11-04T15:37:10.551443+0000","objects_scrubbed":0,"log_size":3386,"log_dups_size":0,"ondisk_log_size":3386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:21:56.476755+0000","scrub_duration":0.005704687,"objects_trimmed":0,"snaptrim_duration":0.101784969,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1155,"num_write_kb":603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"40'3889","reported_seq":3226,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:09.188765+0000","last_change":"2023-11-04T15:38:09.188849+0000","last_active":"2023-11-04T15:38:09.188765+0000","last_peered":"2023-11-04T15:38:09.188765+0000","last_clean":"2023-11-04T15:38:09.188765+0000","last_became_active":"2023-11-04T15:27:36.144053+0000","last_became_peered":"2023-11-04T15:27:36.144053+0000","last_unstale":"2023-11-04T15:38:09.188765+0000","last_undegraded":"2023-11-04T15:38:09.188765+0000","last_fullsized":"2023-11-04T15:38:09.188765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3889","last_scrub_stamp":"2023-11-04T15:38:09.188744+0000","last_deep_scrub":"40'3889","last_deep_scrub_stamp":"2023-11-04T15:38:09.188744+0000","last_clean_scrub_stamp":"2023-11-04T15:38:09.188744+0000","objects_scrubbed":0,"log_size":3889,"log_dups_size":0,"ondisk_log_size":3889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:03:09.861762+0000","scrub_duration":0.0044858370000000003,"objects_trimmed":0,"snaptrim_duration":0.061944979999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1328,"num_write_kb":706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"40'3720","reported_seq":3117,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:06.685722+0000","last_change":"2023-11-04T15:38:06.685839+0000","last_active":"2023-11-04T15:38:06.685722+0000","last_peered":"2023-11-04T15:38:06.685722+0000","last_clean":"2023-11-04T15:38:06.685722+0000","last_became_active":"2023-11-04T15:27:36.148342+0000","last_became_peered":"2023-11-04T15:27:36.148342+0000","last_unstale":"2023-11-04T15:38:06.685722+0000","last_undegraded":"2023-11-04T15:38:06.685722+0000","last_fullsized":"2023-11-04T15:38:06.685722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3720","last_scrub_stamp":"2023-11-04T15:38:06.685700+0000","last_deep_scrub":"40'3720","last_deep_scrub_stamp":"2023-11-04T15:38:06.685700+0000","last_clean_scrub_stamp":"2023-11-04T15:38:06.685700+0000","objects_scrubbed":0,"log_size":3720,"log_dups_size":0,"ondisk_log_size":3720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:11:56.506896+0000","scrub_duration":0.0061541349999999998,"objects_trimmed":0,"snaptrim_duration":0.056486557999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"44'3426","reported_seq":2840,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:12.141869+0000","last_change":"2023-11-04T15:38:12.141869+0000","last_active":"2023-11-04T15:38:12.141869+0000","last_peered":"2023-11-04T15:38:12.141869+0000","last_clean":"2023-11-04T15:38:12.141869+0000","last_became_active":"2023-11-04T15:27:36.148951+0000","last_became_peered":"2023-11-04T15:27:36.148951+0000","last_unstale":"2023-11-04T15:38:12.141869+0000","last_undegraded":"2023-11-04T15:38:12.141869+0000","last_fullsized":"2023-11-04T15:38:12.141869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3426","last_scrub_stamp":"2023-11-04T15:38:12.141744+0000","last_deep_scrub":"44'3426","last_deep_scrub_stamp":"2023-11-04T15:38:12.141744+0000","last_clean_scrub_stamp":"2023-11-04T15:38:12.141744+0000","objects_scrubbed":2,"log_size":3426,"log_dups_size":0,"ondisk_log_size":3426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:16:40.917261+0000","scrub_duration":0.011982881000000001,"objects_trimmed":0,"snaptrim_duration":0.066218149000000004,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1176,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"44'2988","reported_seq":3041,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:52.513356+0000","last_change":"2023-11-04T15:37:52.513356+0000","last_active":"2023-11-04T15:37:52.513356+0000","last_peered":"2023-11-04T15:37:52.513356+0000","last_clean":"2023-11-04T15:37:52.513356+0000","last_became_active":"2023-11-04T15:27:35.775616+0000","last_became_peered":"2023-11-04T15:27:35.775616+0000","last_unstale":"2023-11-04T15:37:52.513356+0000","last_undegraded":"2023-11-04T15:37:52.513356+0000","last_fullsized":"2023-11-04T15:37:52.513356+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2988","last_scrub_stamp":"2023-11-04T15:37:52.513236+0000","last_deep_scrub":"44'2988","last_deep_scrub_stamp":"2023-11-04T15:37:52.513236+0000","last_clean_scrub_stamp":"2023-11-04T15:37:52.513236+0000","objects_scrubbed":4,"log_size":2988,"log_dups_size":0,"ondisk_log_size":2988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:52:02.610178+0000","scrub_duration":0.028368865,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2984,"num_write_kb":24202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"44'3309","reported_seq":2739,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:43.389469+0000","last_change":"2023-11-04T15:38:43.389597+0000","last_active":"2023-11-04T15:38:43.389469+0000","last_peered":"2023-11-04T15:38:43.389469+0000","last_clean":"2023-11-04T15:38:43.389469+0000","last_became_active":"2023-11-04T15:27:36.150276+0000","last_became_peered":"2023-11-04T15:27:36.150276+0000","last_unstale":"2023-11-04T15:38:43.389469+0000","last_undegraded":"2023-11-04T15:38:43.389469+0000","last_fullsized":"2023-11-04T15:38:43.389469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3309","last_scrub_stamp":"2023-11-04T15:38:43.389445+0000","last_deep_scrub":"44'3309","last_deep_scrub_stamp":"2023-11-04T15:38:43.389445+0000","last_clean_scrub_stamp":"2023-11-04T15:38:43.389445+0000","objects_scrubbed":1,"log_size":3309,"log_dups_size":0,"ondisk_log_size":3309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:57:45.575550+0000","scrub_duration":0.0084261809999999996,"objects_trimmed":0,"snaptrim_duration":0.101095329,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1177,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"44'464","reported_seq":517,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:01.615577+0000","last_change":"2023-11-04T15:38:01.615577+0000","last_active":"2023-11-04T15:38:01.615577+0000","last_peered":"2023-11-04T15:38:01.615577+0000","last_clean":"2023-11-04T15:38:01.615577+0000","last_became_active":"2023-11-04T15:27:35.776297+0000","last_became_peered":"2023-11-04T15:27:35.776297+0000","last_unstale":"2023-11-04T15:38:01.615577+0000","last_undegraded":"2023-11-04T15:38:01.615577+0000","last_fullsized":"2023-11-04T15:38:01.615577+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'464","last_scrub_stamp":"2023-11-04T15:38:01.615441+0000","last_deep_scrub":"44'464","last_deep_scrub_stamp":"2023-11-04T15:38:01.615441+0000","last_clean_scrub_stamp":"2023-11-04T15:38:01.615441+0000","objects_scrubbed":2,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:11:51.436637+0000","scrub_duration":0.021155086,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":462,"num_write_kb":12396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"44'3489","reported_seq":2923,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:22.680227+0000","last_change":"2023-11-04T15:37:22.680321+0000","last_active":"2023-11-04T15:37:22.680227+0000","last_peered":"2023-11-04T15:37:22.680227+0000","last_clean":"2023-11-04T15:37:22.680227+0000","last_became_active":"2023-11-04T15:27:36.139580+0000","last_became_peered":"2023-11-04T15:27:36.139580+0000","last_unstale":"2023-11-04T15:37:22.680227+0000","last_undegraded":"2023-11-04T15:37:22.680227+0000","last_fullsized":"2023-11-04T15:37:22.680227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3489","last_scrub_stamp":"2023-11-04T15:37:22.680205+0000","last_deep_scrub":"44'3489","last_deep_scrub_stamp":"2023-11-04T15:37:22.680205+0000","last_clean_scrub_stamp":"2023-11-04T15:37:22.680205+0000","objects_scrubbed":4,"log_size":3489,"log_dups_size":0,"ondisk_log_size":3489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:18:28.360934+0000","scrub_duration":0.013912934,"objects_trimmed":0,"snaptrim_duration":0.074768939000000006,"stat_sum":{"num_bytes":8192,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1207,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"44'721","reported_seq":774,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:46.471682+0000","last_change":"2023-11-04T15:37:46.471682+0000","last_active":"2023-11-04T15:37:46.471682+0000","last_peered":"2023-11-04T15:37:46.471682+0000","last_clean":"2023-11-04T15:37:46.471682+0000","last_became_active":"2023-11-04T15:27:35.775486+0000","last_became_peered":"2023-11-04T15:27:35.775486+0000","last_unstale":"2023-11-04T15:37:46.471682+0000","last_undegraded":"2023-11-04T15:37:46.471682+0000","last_fullsized":"2023-11-04T15:37:46.471682+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'721","last_scrub_stamp":"2023-11-04T15:37:46.471516+0000","last_deep_scrub":"44'721","last_deep_scrub_stamp":"2023-11-04T15:37:46.471516+0000","last_clean_scrub_stamp":"2023-11-04T15:37:46.471516+0000","objects_scrubbed":4,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:43.323066+0000","scrub_duration":0.043075086999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":707,"num_write_kb":16815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"44'3444","reported_seq":2888,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:23.861171+0000","last_change":"2023-11-04T15:38:23.861287+0000","last_active":"2023-11-04T15:38:23.861171+0000","last_peered":"2023-11-04T15:38:23.861171+0000","last_clean":"2023-11-04T15:38:23.861171+0000","last_became_active":"2023-11-04T15:27:36.139789+0000","last_became_peered":"2023-11-04T15:27:36.139789+0000","last_unstale":"2023-11-04T15:38:23.861171+0000","last_undegraded":"2023-11-04T15:38:23.861171+0000","last_fullsized":"2023-11-04T15:38:23.861171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3444","last_scrub_stamp":"2023-11-04T15:38:23.861140+0000","last_deep_scrub":"44'3444","last_deep_scrub_stamp":"2023-11-04T15:38:23.861140+0000","last_clean_scrub_stamp":"2023-11-04T15:38:23.861140+0000","objects_scrubbed":1,"log_size":3444,"log_dups_size":0,"ondisk_log_size":3444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:29:29.080263+0000","scrub_duration":0.0081163280000000008,"objects_trimmed":0,"snaptrim_duration":0.073936136,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"44'1621","reported_seq":1674,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:25.495295+0000","last_change":"2023-11-04T15:37:25.495295+0000","last_active":"2023-11-04T15:37:25.495295+0000","last_peered":"2023-11-04T15:37:25.495295+0000","last_clean":"2023-11-04T15:37:25.495295+0000","last_became_active":"2023-11-04T15:27:35.775895+0000","last_became_peered":"2023-11-04T15:27:35.775895+0000","last_unstale":"2023-11-04T15:37:25.495295+0000","last_undegraded":"2023-11-04T15:37:25.495295+0000","last_fullsized":"2023-11-04T15:37:25.495295+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1621","last_scrub_stamp":"2023-11-04T15:37:25.495162+0000","last_deep_scrub":"44'1621","last_deep_scrub_stamp":"2023-11-04T15:37:25.495162+0000","last_clean_scrub_stamp":"2023-11-04T15:37:25.495162+0000","objects_scrubbed":7,"log_size":1621,"log_dups_size":0,"ondisk_log_size":1621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:31:16.990792+0000","scrub_duration":0.024403523,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":1625,"num_write_kb":22714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"44'1200","reported_seq":1253,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:53.730547+0000","last_change":"2023-11-04T15:37:53.730547+0000","last_active":"2023-11-04T15:37:53.730547+0000","last_peered":"2023-11-04T15:37:53.730547+0000","last_clean":"2023-11-04T15:37:53.730547+0000","last_became_active":"2023-11-04T15:27:35.767594+0000","last_became_peered":"2023-11-04T15:27:35.767594+0000","last_unstale":"2023-11-04T15:37:53.730547+0000","last_undegraded":"2023-11-04T15:37:53.730547+0000","last_fullsized":"2023-11-04T15:37:53.730547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1200","last_scrub_stamp":"2023-11-04T15:37:53.730377+0000","last_deep_scrub":"44'1200","last_deep_scrub_stamp":"2023-11-04T15:37:53.730377+0000","last_clean_scrub_stamp":"2023-11-04T15:37:53.730377+0000","objects_scrubbed":2,"log_size":1200,"log_dups_size":0,"ondisk_log_size":1200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:46:40.139343+0000","scrub_duration":0.015421646000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1190,"num_write_kb":15478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"40'3688","reported_seq":3063,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:14.481041+0000","last_change":"2023-11-04T15:37:14.481041+0000","last_active":"2023-11-04T15:37:14.481041+0000","last_peered":"2023-11-04T15:37:14.481041+0000","last_clean":"2023-11-04T15:37:14.481041+0000","last_became_active":"2023-11-04T15:27:36.148282+0000","last_became_peered":"2023-11-04T15:27:36.148282+0000","last_unstale":"2023-11-04T15:37:14.481041+0000","last_undegraded":"2023-11-04T15:37:14.481041+0000","last_fullsized":"2023-11-04T15:37:14.481041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3688","last_scrub_stamp":"2023-11-04T15:37:14.480897+0000","last_deep_scrub":"40'3688","last_deep_scrub_stamp":"2023-11-04T15:37:14.480897+0000","last_clean_scrub_stamp":"2023-11-04T15:37:14.480897+0000","objects_scrubbed":0,"log_size":3688,"log_dups_size":0,"ondisk_log_size":3688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:24:49.251475+0000","scrub_duration":0.0044870750000000001,"objects_trimmed":0,"snaptrim_duration":0.102136719,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1244,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"44'2395","reported_seq":2448,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:45.653046+0000","last_change":"2023-11-04T15:37:45.653046+0000","last_active":"2023-11-04T15:37:45.653046+0000","last_peered":"2023-11-04T15:37:45.653046+0000","last_clean":"2023-11-04T15:37:45.653046+0000","last_became_active":"2023-11-04T15:27:35.771554+0000","last_became_peered":"2023-11-04T15:27:35.771554+0000","last_unstale":"2023-11-04T15:37:45.653046+0000","last_undegraded":"2023-11-04T15:37:45.653046+0000","last_fullsized":"2023-11-04T15:37:45.653046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2395","last_scrub_stamp":"2023-11-04T15:37:45.652911+0000","last_deep_scrub":"44'2395","last_deep_scrub_stamp":"2023-11-04T15:37:45.652911+0000","last_clean_scrub_stamp":"2023-11-04T15:37:45.652911+0000","objects_scrubbed":3,"log_size":2395,"log_dups_size":0,"ondisk_log_size":2395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:07:59.283572+0000","scrub_duration":0.025961439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2386,"num_write_kb":21701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"44'3603","reported_seq":3001,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:25.600392+0000","last_change":"2023-11-04T15:37:25.600392+0000","last_active":"2023-11-04T15:37:25.600392+0000","last_peered":"2023-11-04T15:37:25.600392+0000","last_clean":"2023-11-04T15:37:25.600392+0000","last_became_active":"2023-11-04T15:27:36.149146+0000","last_became_peered":"2023-11-04T15:27:36.149146+0000","last_unstale":"2023-11-04T15:37:25.600392+0000","last_undegraded":"2023-11-04T15:37:25.600392+0000","last_fullsized":"2023-11-04T15:37:25.600392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3603","last_scrub_stamp":"2023-11-04T15:37:25.600176+0000","last_deep_scrub":"44'3603","last_deep_scrub_stamp":"2023-11-04T15:37:25.600176+0000","last_clean_scrub_stamp":"2023-11-04T15:37:25.600176+0000","objects_scrubbed":3,"log_size":3603,"log_dups_size":0,"ondisk_log_size":3603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:18:31.280905+0000","scrub_duration":0.0137854,"objects_trimmed":0,"snaptrim_duration":0.055767874000000002,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"44'3591","reported_seq":3644,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:28.306981+0000","last_change":"2023-11-04T15:38:28.306981+0000","last_active":"2023-11-04T15:38:28.306981+0000","last_peered":"2023-11-04T15:38:28.306981+0000","last_clean":"2023-11-04T15:38:28.306981+0000","last_became_active":"2023-11-04T15:27:35.773689+0000","last_became_peered":"2023-11-04T15:27:35.773689+0000","last_unstale":"2023-11-04T15:38:28.306981+0000","last_undegraded":"2023-11-04T15:38:28.306981+0000","last_fullsized":"2023-11-04T15:38:28.306981+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3591","last_scrub_stamp":"2023-11-04T15:38:28.306858+0000","last_deep_scrub":"44'3591","last_deep_scrub_stamp":"2023-11-04T15:38:28.306858+0000","last_clean_scrub_stamp":"2023-11-04T15:38:28.306858+0000","objects_scrubbed":4,"log_size":3591,"log_dups_size":0,"ondisk_log_size":3591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:06:11.058800+0000","scrub_duration":0.034148234999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582982,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3581,"num_write_kb":38716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"44'3514","reported_seq":2913,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:14.746264+0000","last_change":"2023-11-04T15:37:14.746264+0000","last_active":"2023-11-04T15:37:14.746264+0000","last_peered":"2023-11-04T15:37:14.746264+0000","last_clean":"2023-11-04T15:37:14.746264+0000","last_became_active":"2023-11-04T15:27:36.141695+0000","last_became_peered":"2023-11-04T15:27:36.141695+0000","last_unstale":"2023-11-04T15:37:14.746264+0000","last_undegraded":"2023-11-04T15:37:14.746264+0000","last_fullsized":"2023-11-04T15:37:14.746264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3514","last_scrub_stamp":"2023-11-04T15:37:14.746134+0000","last_deep_scrub":"44'3514","last_deep_scrub_stamp":"2023-11-04T15:37:14.746134+0000","last_clean_scrub_stamp":"2023-11-04T15:37:14.746134+0000","objects_scrubbed":3,"log_size":3514,"log_dups_size":0,"ondisk_log_size":3514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:36.355741+0000","scrub_duration":0.013556656,"objects_trimmed":0,"snaptrim_duration":0.057953993000000002,"stat_sum":{"num_bytes":4107,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1230,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"44'1581","reported_seq":1634,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:05.474337+0000","last_change":"2023-11-04T15:38:05.474337+0000","last_active":"2023-11-04T15:38:05.474337+0000","last_peered":"2023-11-04T15:38:05.474337+0000","last_clean":"2023-11-04T15:38:05.474337+0000","last_became_active":"2023-11-04T15:27:35.773818+0000","last_became_peered":"2023-11-04T15:27:35.773818+0000","last_unstale":"2023-11-04T15:38:05.474337+0000","last_undegraded":"2023-11-04T15:38:05.474337+0000","last_fullsized":"2023-11-04T15:38:05.474337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1581","last_scrub_stamp":"2023-11-04T15:38:05.474220+0000","last_deep_scrub":"44'1581","last_deep_scrub_stamp":"2023-11-04T15:38:05.474220+0000","last_clean_scrub_stamp":"2023-11-04T15:38:05.474220+0000","objects_scrubbed":4,"log_size":1581,"log_dups_size":0,"ondisk_log_size":1581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:03:06.147239+0000","scrub_duration":0.038580360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1569,"num_write_kb":30603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"40'3300","reported_seq":2761,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:48.498756+0000","last_change":"2023-11-04T15:37:48.498756+0000","last_active":"2023-11-04T15:37:48.498756+0000","last_peered":"2023-11-04T15:37:48.498756+0000","last_clean":"2023-11-04T15:37:48.498756+0000","last_became_active":"2023-11-04T15:27:36.150653+0000","last_became_peered":"2023-11-04T15:27:36.150653+0000","last_unstale":"2023-11-04T15:37:48.498756+0000","last_undegraded":"2023-11-04T15:37:48.498756+0000","last_fullsized":"2023-11-04T15:37:48.498756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3300","last_scrub_stamp":"2023-11-04T15:37:48.498559+0000","last_deep_scrub":"40'3300","last_deep_scrub_stamp":"2023-11-04T15:37:48.498559+0000","last_clean_scrub_stamp":"2023-11-04T15:37:48.498559+0000","objects_scrubbed":0,"log_size":3300,"log_dups_size":0,"ondisk_log_size":3300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:55:19.632136+0000","scrub_duration":0.0039129610000000004,"objects_trimmed":0,"snaptrim_duration":0.070970674999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1129,"num_write_kb":600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"44'4025","reported_seq":4078,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:41.344248+0000","last_change":"2023-11-04T15:37:41.344248+0000","last_active":"2023-11-04T15:37:41.344248+0000","last_peered":"2023-11-04T15:37:41.344248+0000","last_clean":"2023-11-04T15:37:41.344248+0000","last_became_active":"2023-11-04T15:27:35.772815+0000","last_became_peered":"2023-11-04T15:27:35.772815+0000","last_unstale":"2023-11-04T15:37:41.344248+0000","last_undegraded":"2023-11-04T15:37:41.344248+0000","last_fullsized":"2023-11-04T15:37:41.344248+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4025","last_scrub_stamp":"2023-11-04T15:37:41.344035+0000","last_deep_scrub":"44'4025","last_deep_scrub_stamp":"2023-11-04T15:37:41.344035+0000","last_clean_scrub_stamp":"2023-11-04T15:37:41.344035+0000","objects_scrubbed":4,"log_size":4025,"log_dups_size":0,"ondisk_log_size":4025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:07:54.974697+0000","scrub_duration":0.037607953,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4019,"num_write_kb":36923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1207,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"40'3784","reported_seq":3141,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:21.440272+0000","last_change":"2023-11-04T15:37:21.440272+0000","last_active":"2023-11-04T15:37:21.440272+0000","last_peered":"2023-11-04T15:37:21.440272+0000","last_clean":"2023-11-04T15:37:21.440272+0000","last_became_active":"2023-11-04T15:27:36.150667+0000","last_became_peered":"2023-11-04T15:27:36.150667+0000","last_unstale":"2023-11-04T15:37:21.440272+0000","last_undegraded":"2023-11-04T15:37:21.440272+0000","last_fullsized":"2023-11-04T15:37:21.440272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3784","last_scrub_stamp":"2023-11-04T15:37:21.440149+0000","last_deep_scrub":"40'3784","last_deep_scrub_stamp":"2023-11-04T15:37:21.440149+0000","last_clean_scrub_stamp":"2023-11-04T15:37:21.440149+0000","objects_scrubbed":0,"log_size":3784,"log_dups_size":0,"ondisk_log_size":3784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:35.107882+0000","scrub_duration":0.0057867910000000003,"objects_trimmed":0,"snaptrim_duration":0.098687114000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1287,"num_write_kb":684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"44'2127","reported_seq":2180,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:02.405082+0000","last_change":"2023-11-04T15:38:02.405082+0000","last_active":"2023-11-04T15:38:02.405082+0000","last_peered":"2023-11-04T15:38:02.405082+0000","last_clean":"2023-11-04T15:38:02.405082+0000","last_became_active":"2023-11-04T15:27:35.775063+0000","last_became_peered":"2023-11-04T15:27:35.775063+0000","last_unstale":"2023-11-04T15:38:02.405082+0000","last_undegraded":"2023-11-04T15:38:02.405082+0000","last_fullsized":"2023-11-04T15:38:02.405082+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2127","last_scrub_stamp":"2023-11-04T15:38:02.404947+0000","last_deep_scrub":"44'2127","last_deep_scrub_stamp":"2023-11-04T15:38:02.404947+0000","last_clean_scrub_stamp":"2023-11-04T15:38:02.404947+0000","objects_scrubbed":2,"log_size":2127,"log_dups_size":0,"ondisk_log_size":2127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:43:59.858069+0000","scrub_duration":0.024080308000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2118,"num_write_kb":30816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"44'3319","reported_seq":2802,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:46.325522+0000","last_change":"2023-11-04T15:38:46.325522+0000","last_active":"2023-11-04T15:38:46.325522+0000","last_peered":"2023-11-04T15:38:46.325522+0000","last_clean":"2023-11-04T15:38:46.325522+0000","last_became_active":"2023-11-04T15:27:36.139103+0000","last_became_peered":"2023-11-04T15:27:36.139103+0000","last_unstale":"2023-11-04T15:38:46.325522+0000","last_undegraded":"2023-11-04T15:38:46.325522+0000","last_fullsized":"2023-11-04T15:38:46.325522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3319","last_scrub_stamp":"2023-11-04T15:38:46.325396+0000","last_deep_scrub":"44'3319","last_deep_scrub_stamp":"2023-11-04T15:38:46.325396+0000","last_clean_scrub_stamp":"2023-11-04T15:38:46.325396+0000","objects_scrubbed":2,"log_size":3319,"log_dups_size":0,"ondisk_log_size":3319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:10:49.251976+0000","scrub_duration":0.0094029769999999999,"objects_trimmed":0,"snaptrim_duration":0.10468400899999999,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1091,"num_write_kb":593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"44'1936","reported_seq":1989,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:32.267244+0000","last_change":"2023-11-04T15:38:32.267330+0000","last_active":"2023-11-04T15:38:32.267244+0000","last_peered":"2023-11-04T15:38:32.267244+0000","last_clean":"2023-11-04T15:38:32.267244+0000","last_became_active":"2023-11-04T15:27:35.773449+0000","last_became_peered":"2023-11-04T15:27:35.773449+0000","last_unstale":"2023-11-04T15:38:32.267244+0000","last_undegraded":"2023-11-04T15:38:32.267244+0000","last_fullsized":"2023-11-04T15:38:32.267244+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1936","last_scrub_stamp":"2023-11-04T15:38:32.267220+0000","last_deep_scrub":"44'1936","last_deep_scrub_stamp":"2023-11-04T15:38:32.267220+0000","last_clean_scrub_stamp":"2023-11-04T15:38:32.267220+0000","objects_scrubbed":2,"log_size":1936,"log_dups_size":0,"ondisk_log_size":1936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:39:33.849939+0000","scrub_duration":0.019926309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1929,"num_write_kb":17119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"40'3519","reported_seq":2954,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:23.652627+0000","last_change":"2023-11-04T15:37:23.652627+0000","last_active":"2023-11-04T15:37:23.652627+0000","last_peered":"2023-11-04T15:37:23.652627+0000","last_clean":"2023-11-04T15:37:23.652627+0000","last_became_active":"2023-11-04T15:27:36.141086+0000","last_became_peered":"2023-11-04T15:27:36.141086+0000","last_unstale":"2023-11-04T15:37:23.652627+0000","last_undegraded":"2023-11-04T15:37:23.652627+0000","last_fullsized":"2023-11-04T15:37:23.652627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3519","last_scrub_stamp":"2023-11-04T15:37:23.652509+0000","last_deep_scrub":"40'3519","last_deep_scrub_stamp":"2023-11-04T15:37:23.652509+0000","last_clean_scrub_stamp":"2023-11-04T15:37:23.652509+0000","objects_scrubbed":0,"log_size":3519,"log_dups_size":0,"ondisk_log_size":3519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:28.689310+0000","scrub_duration":0.0061970940000000002,"objects_trimmed":0,"snaptrim_duration":0.059170119,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1142,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"44'657","reported_seq":710,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:06.186834+0000","last_change":"2023-11-04T15:38:06.186834+0000","last_active":"2023-11-04T15:38:06.186834+0000","last_peered":"2023-11-04T15:38:06.186834+0000","last_clean":"2023-11-04T15:38:06.186834+0000","last_became_active":"2023-11-04T15:27:35.769001+0000","last_became_peered":"2023-11-04T15:27:35.769001+0000","last_unstale":"2023-11-04T15:38:06.186834+0000","last_undegraded":"2023-11-04T15:38:06.186834+0000","last_fullsized":"2023-11-04T15:38:06.186834+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'657","last_scrub_stamp":"2023-11-04T15:38:06.186659+0000","last_deep_scrub":"44'657","last_deep_scrub_stamp":"2023-11-04T15:38:06.186659+0000","last_clean_scrub_stamp":"2023-11-04T15:38:06.186659+0000","objects_scrubbed":2,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:44:03.639782+0000","scrub_duration":0.022387719,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":656,"num_write_kb":15166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"44'3666","reported_seq":3095,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:24.311349+0000","last_change":"2023-11-04T15:37:24.311349+0000","last_active":"2023-11-04T15:37:24.311349+0000","last_peered":"2023-11-04T15:37:24.311349+0000","last_clean":"2023-11-04T15:37:24.311349+0000","last_became_active":"2023-11-04T15:27:36.147034+0000","last_became_peered":"2023-11-04T15:27:36.147034+0000","last_unstale":"2023-11-04T15:37:24.311349+0000","last_undegraded":"2023-11-04T15:37:24.311349+0000","last_fullsized":"2023-11-04T15:37:24.311349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3666","last_scrub_stamp":"2023-11-04T15:37:24.311202+0000","last_deep_scrub":"44'3666","last_deep_scrub_stamp":"2023-11-04T15:37:24.311202+0000","last_clean_scrub_stamp":"2023-11-04T15:37:24.311202+0000","objects_scrubbed":3,"log_size":3666,"log_dups_size":0,"ondisk_log_size":3666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:56:38.113824+0000","scrub_duration":0.0088871530000000001,"objects_trimmed":0,"snaptrim_duration":0.064750725999999995,"stat_sum":{"num_bytes":4196,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1197,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"44'119","reported_seq":211,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:08.425104+0000","last_change":"2023-11-04T15:38:08.425208+0000","last_active":"2023-11-04T15:38:08.425104+0000","last_peered":"2023-11-04T15:38:08.425104+0000","last_clean":"2023-11-04T15:38:08.425104+0000","last_became_active":"2023-11-04T15:27:26.266242+0000","last_became_peered":"2023-11-04T15:27:26.266242+0000","last_unstale":"2023-11-04T15:38:08.425104+0000","last_undegraded":"2023-11-04T15:38:08.425104+0000","last_fullsized":"2023-11-04T15:38:08.425104+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'119","last_scrub_stamp":"2023-11-04T15:38:08.425081+0000","last_deep_scrub":"44'119","last_deep_scrub_stamp":"2023-11-04T15:38:08.425081+0000","last_clean_scrub_stamp":"2023-11-04T15:38:08.425081+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:16:37.200598+0000","scrub_duration":0.0054415069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:17.352034+0000","last_change":"2023-11-04T15:38:17.352138+0000","last_active":"2023-11-04T15:38:17.352034+0000","last_peered":"2023-11-04T15:38:17.352034+0000","last_clean":"2023-11-04T15:38:17.352034+0000","last_became_active":"2023-11-04T15:27:31.619798+0000","last_became_peered":"2023-11-04T15:27:31.619798+0000","last_unstale":"2023-11-04T15:38:17.352034+0000","last_undegraded":"2023-11-04T15:38:17.352034+0000","last_fullsized":"2023-11-04T15:38:17.352034+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:38:17.352004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:38:17.352004+0000","last_clean_scrub_stamp":"2023-11-04T15:38:17.352004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:29:22.571127+0000","scrub_duration":0.0014758830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"44'3636","reported_seq":3689,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:51.207512+0000","last_change":"2023-11-04T15:37:51.207512+0000","last_active":"2023-11-04T15:37:51.207512+0000","last_peered":"2023-11-04T15:37:51.207512+0000","last_clean":"2023-11-04T15:37:51.207512+0000","last_became_active":"2023-11-04T15:27:35.769150+0000","last_became_peered":"2023-11-04T15:27:35.769150+0000","last_unstale":"2023-11-04T15:37:51.207512+0000","last_undegraded":"2023-11-04T15:37:51.207512+0000","last_fullsized":"2023-11-04T15:37:51.207512+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3636","last_scrub_stamp":"2023-11-04T15:37:51.207371+0000","last_deep_scrub":"44'3636","last_deep_scrub_stamp":"2023-11-04T15:37:51.207371+0000","last_clean_scrub_stamp":"2023-11-04T15:37:51.207371+0000","objects_scrubbed":7,"log_size":3636,"log_dups_size":0,"ondisk_log_size":3636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:21:17.261772+0000","scrub_duration":0.064187266000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3620,"num_write_kb":52059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"44'3669","reported_seq":3088,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:03.410603+0000","last_change":"2023-11-04T15:38:03.410603+0000","last_active":"2023-11-04T15:38:03.410603+0000","last_peered":"2023-11-04T15:38:03.410603+0000","last_clean":"2023-11-04T15:38:03.410603+0000","last_became_active":"2023-11-04T15:27:36.140619+0000","last_became_peered":"2023-11-04T15:27:36.140619+0000","last_unstale":"2023-11-04T15:38:03.410603+0000","last_undegraded":"2023-11-04T15:38:03.410603+0000","last_fullsized":"2023-11-04T15:38:03.410603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3669","last_scrub_stamp":"2023-11-04T15:38:03.410431+0000","last_deep_scrub":"44'3669","last_deep_scrub_stamp":"2023-11-04T15:38:03.410431+0000","last_clean_scrub_stamp":"2023-11-04T15:38:03.410431+0000","objects_scrubbed":1,"log_size":3669,"log_dups_size":0,"ondisk_log_size":3669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:20.868712+0000","scrub_duration":0.009666315,"objects_trimmed":0,"snaptrim_duration":0.10532783499999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:10.460636+0000","last_change":"2023-11-04T15:38:10.460766+0000","last_active":"2023-11-04T15:38:10.460636+0000","last_peered":"2023-11-04T15:38:10.460636+0000","last_clean":"2023-11-04T15:38:10.460636+0000","last_became_active":"2023-11-04T15:27:31.621889+0000","last_became_peered":"2023-11-04T15:27:31.621889+0000","last_unstale":"2023-11-04T15:38:10.460636+0000","last_undegraded":"2023-11-04T15:38:10.460636+0000","last_fullsized":"2023-11-04T15:38:10.460636+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:38:10.460616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:38:10.460616+0000","last_clean_scrub_stamp":"2023-11-04T15:38:10.460616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:47:50.200142+0000","scrub_duration":0.002140351,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"44'3688","reported_seq":3907,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:52.624125+0000","last_change":"2023-11-04T15:37:52.624125+0000","last_active":"2023-11-04T15:37:52.624125+0000","last_peered":"2023-11-04T15:37:52.624125+0000","last_clean":"2023-11-04T15:37:52.624125+0000","last_became_active":"2023-11-04T15:27:35.770364+0000","last_became_peered":"2023-11-04T15:27:35.770364+0000","last_unstale":"2023-11-04T15:37:52.624125+0000","last_undegraded":"2023-11-04T15:37:52.624125+0000","last_fullsized":"2023-11-04T15:37:52.624125+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3688","last_scrub_stamp":"2023-11-04T15:37:52.623993+0000","last_deep_scrub":"44'3688","last_deep_scrub_stamp":"2023-11-04T15:37:52.623993+0000","last_clean_scrub_stamp":"2023-11-04T15:37:52.623993+0000","objects_scrubbed":4,"log_size":3688,"log_dups_size":0,"ondisk_log_size":3688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:49.475542+0000","scrub_duration":0.043049095000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15883313,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":166,"num_read_kb":3338,"num_write":3668,"num_write_kb":29714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"44'3553","reported_seq":2998,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:24.639702+0000","last_change":"2023-11-04T15:37:24.639702+0000","last_active":"2023-11-04T15:37:24.639702+0000","last_peered":"2023-11-04T15:37:24.639702+0000","last_clean":"2023-11-04T15:37:24.639702+0000","last_became_active":"2023-11-04T15:27:36.144459+0000","last_became_peered":"2023-11-04T15:27:36.144459+0000","last_unstale":"2023-11-04T15:37:24.639702+0000","last_undegraded":"2023-11-04T15:37:24.639702+0000","last_fullsized":"2023-11-04T15:37:24.639702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3553","last_scrub_stamp":"2023-11-04T15:37:24.639567+0000","last_deep_scrub":"44'3553","last_deep_scrub_stamp":"2023-11-04T15:37:24.639567+0000","last_clean_scrub_stamp":"2023-11-04T15:37:24.639567+0000","objects_scrubbed":2,"log_size":3553,"log_dups_size":0,"ondisk_log_size":3553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:38.307301+0000","scrub_duration":0.010629794999999999,"objects_trimmed":0,"snaptrim_duration":0.072685394,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:46.281358+0000","last_change":"2023-11-04T15:37:46.281358+0000","last_active":"2023-11-04T15:37:46.281358+0000","last_peered":"2023-11-04T15:37:46.281358+0000","last_clean":"2023-11-04T15:37:46.281358+0000","last_became_active":"2023-11-04T15:27:31.622378+0000","last_became_peered":"2023-11-04T15:27:31.622378+0000","last_unstale":"2023-11-04T15:37:46.281358+0000","last_undegraded":"2023-11-04T15:37:46.281358+0000","last_fullsized":"2023-11-04T15:37:46.281358+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:37:46.281232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:37:46.281232+0000","last_clean_scrub_stamp":"2023-11-04T15:37:46.281232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:55:17.414809+0000","scrub_duration":0.0016098729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"44'6085","reported_seq":6139,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:50.250495+0000","last_change":"2023-11-04T15:37:50.250593+0000","last_active":"2023-11-04T15:37:50.250495+0000","last_peered":"2023-11-04T15:37:50.250495+0000","last_clean":"2023-11-04T15:37:50.250495+0000","last_became_active":"2023-11-04T15:27:35.774339+0000","last_became_peered":"2023-11-04T15:27:35.774339+0000","last_unstale":"2023-11-04T15:37:50.250495+0000","last_undegraded":"2023-11-04T15:37:50.250495+0000","last_fullsized":"2023-11-04T15:37:50.250495+0000","mapping_epoch":16,"log_start":"26'400","ondisk_log_start":"26'400","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'6085","last_scrub_stamp":"2023-11-04T15:37:50.250469+0000","last_deep_scrub":"44'6085","last_deep_scrub_stamp":"2023-11-04T15:37:50.250469+0000","last_clean_scrub_stamp":"2023-11-04T15:37:50.250469+0000","objects_scrubbed":6,"log_size":5685,"log_dups_size":0,"ondisk_log_size":5685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:47.102018+0000","scrub_duration":0.070893610999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6078,"num_write_kb":43849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"44'3173","reported_seq":2651,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:10.305048+0000","last_change":"2023-11-04T15:37:10.305048+0000","last_active":"2023-11-04T15:37:10.305048+0000","last_peered":"2023-11-04T15:37:10.305048+0000","last_clean":"2023-11-04T15:37:10.305048+0000","last_became_active":"2023-11-04T15:27:36.146930+0000","last_became_peered":"2023-11-04T15:27:36.146930+0000","last_unstale":"2023-11-04T15:37:10.305048+0000","last_undegraded":"2023-11-04T15:37:10.305048+0000","last_fullsized":"2023-11-04T15:37:10.305048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3173","last_scrub_stamp":"2023-11-04T15:37:10.304861+0000","last_deep_scrub":"44'3173","last_deep_scrub_stamp":"2023-11-04T15:37:10.304861+0000","last_clean_scrub_stamp":"2023-11-04T15:37:10.304861+0000","objects_scrubbed":1,"log_size":3173,"log_dups_size":0,"ondisk_log_size":3173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:31.914468+0000","scrub_duration":0.0078700769999999996,"objects_trimmed":0,"snaptrim_duration":0.067233409999999993,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1111,"num_write_kb":606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:14.382747+0000","last_change":"2023-11-04T15:38:14.382871+0000","last_active":"2023-11-04T15:38:14.382747+0000","last_peered":"2023-11-04T15:38:14.382747+0000","last_clean":"2023-11-04T15:38:14.382747+0000","last_became_active":"2023-11-04T15:27:31.621849+0000","last_became_peered":"2023-11-04T15:27:31.621849+0000","last_unstale":"2023-11-04T15:38:14.382747+0000","last_undegraded":"2023-11-04T15:38:14.382747+0000","last_fullsized":"2023-11-04T15:38:14.382747+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:38:14.382726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:38:14.382726+0000","last_clean_scrub_stamp":"2023-11-04T15:38:14.382726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:16:48.780994+0000","scrub_duration":0.0020309239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"44'3280","reported_seq":3333,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:27.660076+0000","last_change":"2023-11-04T15:37:27.660076+0000","last_active":"2023-11-04T15:37:27.660076+0000","last_peered":"2023-11-04T15:37:27.660076+0000","last_clean":"2023-11-04T15:37:27.660076+0000","last_became_active":"2023-11-04T15:27:35.769730+0000","last_became_peered":"2023-11-04T15:27:35.769730+0000","last_unstale":"2023-11-04T15:37:27.660076+0000","last_undegraded":"2023-11-04T15:37:27.660076+0000","last_fullsized":"2023-11-04T15:37:27.660076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3280","last_scrub_stamp":"2023-11-04T15:37:27.659954+0000","last_deep_scrub":"44'3280","last_deep_scrub_stamp":"2023-11-04T15:37:27.659954+0000","last_clean_scrub_stamp":"2023-11-04T15:37:27.659954+0000","objects_scrubbed":5,"log_size":3280,"log_dups_size":0,"ondisk_log_size":3280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:41.327688+0000","scrub_duration":0.054452754999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3258,"num_write_kb":30072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"44'3434","reported_seq":2864,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:18.421706+0000","last_change":"2023-11-04T15:37:18.421706+0000","last_active":"2023-11-04T15:37:18.421706+0000","last_peered":"2023-11-04T15:37:18.421706+0000","last_clean":"2023-11-04T15:37:18.421706+0000","last_became_active":"2023-11-04T15:27:36.144417+0000","last_became_peered":"2023-11-04T15:27:36.144417+0000","last_unstale":"2023-11-04T15:37:18.421706+0000","last_undegraded":"2023-11-04T15:37:18.421706+0000","last_fullsized":"2023-11-04T15:37:18.421706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3434","last_scrub_stamp":"2023-11-04T15:37:18.421580+0000","last_deep_scrub":"44'3434","last_deep_scrub_stamp":"2023-11-04T15:37:18.421580+0000","last_clean_scrub_stamp":"2023-11-04T15:37:18.421580+0000","objects_scrubbed":3,"log_size":3434,"log_dups_size":0,"ondisk_log_size":3434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:37:14.873581+0000","scrub_duration":0.011594345000000001,"objects_trimmed":0,"snaptrim_duration":0.067418286999999993,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"44'3108","reported_seq":3161,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:28.595288+0000","last_change":"2023-11-04T15:37:28.595288+0000","last_active":"2023-11-04T15:37:28.595288+0000","last_peered":"2023-11-04T15:37:28.595288+0000","last_clean":"2023-11-04T15:37:28.595288+0000","last_became_active":"2023-11-04T15:27:35.769772+0000","last_became_peered":"2023-11-04T15:27:35.769772+0000","last_unstale":"2023-11-04T15:37:28.595288+0000","last_undegraded":"2023-11-04T15:37:28.595288+0000","last_fullsized":"2023-11-04T15:37:28.595288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3108","last_scrub_stamp":"2023-11-04T15:37:28.595114+0000","last_deep_scrub":"44'3108","last_deep_scrub_stamp":"2023-11-04T15:37:28.595114+0000","last_clean_scrub_stamp":"2023-11-04T15:37:28.595114+0000","objects_scrubbed":3,"log_size":3108,"log_dups_size":0,"ondisk_log_size":3108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:56:42.397736+0000","scrub_duration":0.034473323,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3101,"num_write_kb":32806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:47.235098+0000","last_change":"2023-11-04T15:37:47.235098+0000","last_active":"2023-11-04T15:37:47.235098+0000","last_peered":"2023-11-04T15:37:47.235098+0000","last_clean":"2023-11-04T15:37:47.235098+0000","last_became_active":"2023-11-04T15:27:31.622350+0000","last_became_peered":"2023-11-04T15:27:31.622350+0000","last_unstale":"2023-11-04T15:37:47.235098+0000","last_undegraded":"2023-11-04T15:37:47.235098+0000","last_fullsized":"2023-11-04T15:37:47.235098+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:37:47.234970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:37:47.234970+0000","last_clean_scrub_stamp":"2023-11-04T15:37:47.234970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:46:33.643935+0000","scrub_duration":0.00154751,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"43'3419","reported_seq":2906,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:09.350908+0000","last_change":"2023-11-04T15:37:09.350908+0000","last_active":"2023-11-04T15:37:09.350908+0000","last_peered":"2023-11-04T15:37:09.350908+0000","last_clean":"2023-11-04T15:37:09.350908+0000","last_became_active":"2023-11-04T15:27:36.143991+0000","last_became_peered":"2023-11-04T15:27:36.143991+0000","last_unstale":"2023-11-04T15:37:09.350908+0000","last_undegraded":"2023-11-04T15:37:09.350908+0000","last_fullsized":"2023-11-04T15:37:09.350908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3419","last_scrub_stamp":"2023-11-04T15:37:09.350786+0000","last_deep_scrub":"43'3419","last_deep_scrub_stamp":"2023-11-04T15:37:09.350786+0000","last_clean_scrub_stamp":"2023-11-04T15:37:09.350786+0000","objects_scrubbed":2,"log_size":3419,"log_dups_size":0,"ondisk_log_size":3419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:20:35.227166+0000","scrub_duration":0.0074817540000000002,"objects_trimmed":0,"snaptrim_duration":0.062728023999999993,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":1116,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"44'4469","reported_seq":4522,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:56.224142+0000","last_change":"2023-11-04T15:37:56.224142+0000","last_active":"2023-11-04T15:37:56.224142+0000","last_peered":"2023-11-04T15:37:56.224142+0000","last_clean":"2023-11-04T15:37:56.224142+0000","last_became_active":"2023-11-04T15:27:35.769095+0000","last_became_peered":"2023-11-04T15:27:35.769095+0000","last_unstale":"2023-11-04T15:37:56.224142+0000","last_undegraded":"2023-11-04T15:37:56.224142+0000","last_fullsized":"2023-11-04T15:37:56.224142+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4469","last_scrub_stamp":"2023-11-04T15:37:56.224006+0000","last_deep_scrub":"44'4469","last_deep_scrub_stamp":"2023-11-04T15:37:56.224006+0000","last_clean_scrub_stamp":"2023-11-04T15:37:56.224006+0000","objects_scrubbed":5,"log_size":4469,"log_dups_size":0,"ondisk_log_size":4469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:52:06.320947+0000","scrub_duration":0.052842531999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4451,"num_write_kb":27035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:23.393957+0000","last_change":"2023-11-04T15:38:23.394103+0000","last_active":"2023-11-04T15:38:23.393957+0000","last_peered":"2023-11-04T15:38:23.393957+0000","last_clean":"2023-11-04T15:38:23.393957+0000","last_became_active":"2023-11-04T15:27:31.619702+0000","last_became_peered":"2023-11-04T15:27:31.619702+0000","last_unstale":"2023-11-04T15:38:23.393957+0000","last_undegraded":"2023-11-04T15:38:23.393957+0000","last_fullsized":"2023-11-04T15:38:23.393957+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:38:23.393926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:38:23.393926+0000","last_clean_scrub_stamp":"2023-11-04T15:38:23.393926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:54:34.579281+0000","scrub_duration":0.001751711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"40'3558","reported_seq":2956,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:19.665851+0000","last_change":"2023-11-04T15:37:19.665851+0000","last_active":"2023-11-04T15:37:19.665851+0000","last_peered":"2023-11-04T15:37:19.665851+0000","last_clean":"2023-11-04T15:37:19.665851+0000","last_became_active":"2023-11-04T15:27:36.139707+0000","last_became_peered":"2023-11-04T15:27:36.139707+0000","last_unstale":"2023-11-04T15:37:19.665851+0000","last_undegraded":"2023-11-04T15:37:19.665851+0000","last_fullsized":"2023-11-04T15:37:19.665851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3558","last_scrub_stamp":"2023-11-04T15:37:19.665726+0000","last_deep_scrub":"40'3558","last_deep_scrub_stamp":"2023-11-04T15:37:19.665726+0000","last_clean_scrub_stamp":"2023-11-04T15:37:19.665726+0000","objects_scrubbed":0,"log_size":3558,"log_dups_size":0,"ondisk_log_size":3558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:24:54.436304+0000","scrub_duration":0.0061987099999999996,"objects_trimmed":0,"snaptrim_duration":0.073815121999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"44'1219","reported_seq":1272,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:59.151132+0000","last_change":"2023-11-04T15:37:59.151132+0000","last_active":"2023-11-04T15:37:59.151132+0000","last_peered":"2023-11-04T15:37:59.151132+0000","last_clean":"2023-11-04T15:37:59.151132+0000","last_became_active":"2023-11-04T15:27:35.768320+0000","last_became_peered":"2023-11-04T15:27:35.768320+0000","last_unstale":"2023-11-04T15:37:59.151132+0000","last_undegraded":"2023-11-04T15:37:59.151132+0000","last_fullsized":"2023-11-04T15:37:59.151132+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1219","last_scrub_stamp":"2023-11-04T15:37:59.150991+0000","last_deep_scrub":"44'1219","last_deep_scrub_stamp":"2023-11-04T15:37:59.150991+0000","last_clean_scrub_stamp":"2023-11-04T15:37:59.150991+0000","objects_scrubbed":5,"log_size":1219,"log_dups_size":0,"ondisk_log_size":1219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:11:48.972187+0000","scrub_duration":0.031930034000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1211,"num_write_kb":18003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:42.307944+0000","last_change":"2023-11-04T15:37:42.307944+0000","last_active":"2023-11-04T15:37:42.307944+0000","last_peered":"2023-11-04T15:37:42.307944+0000","last_clean":"2023-11-04T15:37:42.307944+0000","last_became_active":"2023-11-04T15:27:31.624347+0000","last_became_peered":"2023-11-04T15:27:31.624347+0000","last_unstale":"2023-11-04T15:37:42.307944+0000","last_undegraded":"2023-11-04T15:37:42.307944+0000","last_fullsized":"2023-11-04T15:37:42.307944+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:37:42.307817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:37:42.307817+0000","last_clean_scrub_stamp":"2023-11-04T15:37:42.307817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:40:21.913960+0000","scrub_duration":0.002137136,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"44'3609","reported_seq":3026,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:29.793752+0000","last_change":"2023-11-04T15:38:29.793847+0000","last_active":"2023-11-04T15:38:29.793752+0000","last_peered":"2023-11-04T15:38:29.793752+0000","last_clean":"2023-11-04T15:38:29.793752+0000","last_became_active":"2023-11-04T15:27:36.137897+0000","last_became_peered":"2023-11-04T15:27:36.137897+0000","last_unstale":"2023-11-04T15:38:29.793752+0000","last_undegraded":"2023-11-04T15:38:29.793752+0000","last_fullsized":"2023-11-04T15:38:29.793752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3609","last_scrub_stamp":"2023-11-04T15:38:29.793727+0000","last_deep_scrub":"44'3609","last_deep_scrub_stamp":"2023-11-04T15:38:29.793727+0000","last_clean_scrub_stamp":"2023-11-04T15:38:29.793727+0000","objects_scrubbed":1,"log_size":3609,"log_dups_size":0,"ondisk_log_size":3609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:54:40.979082+0000","scrub_duration":0.0096043740000000006,"objects_trimmed":0,"snaptrim_duration":0.069534850999999995,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"44'835","reported_seq":888,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:58.635650+0000","last_change":"2023-11-04T15:37:58.635650+0000","last_active":"2023-11-04T15:37:58.635650+0000","last_peered":"2023-11-04T15:37:58.635650+0000","last_clean":"2023-11-04T15:37:58.635650+0000","last_became_active":"2023-11-04T15:27:35.772121+0000","last_became_peered":"2023-11-04T15:27:35.772121+0000","last_unstale":"2023-11-04T15:37:58.635650+0000","last_undegraded":"2023-11-04T15:37:58.635650+0000","last_fullsized":"2023-11-04T15:37:58.635650+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'835","last_scrub_stamp":"2023-11-04T15:37:58.635523+0000","last_deep_scrub":"44'835","last_deep_scrub_stamp":"2023-11-04T15:37:58.635523+0000","last_clean_scrub_stamp":"2023-11-04T15:37:58.635523+0000","objects_scrubbed":6,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:52:08.732465+0000","scrub_duration":0.064600797000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":960,"num_write_kb":25976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:18.360275+0000","last_change":"2023-11-04T15:38:18.360275+0000","last_active":"2023-11-04T15:38:18.360275+0000","last_peered":"2023-11-04T15:38:18.360275+0000","last_clean":"2023-11-04T15:38:18.360275+0000","last_became_active":"2023-11-04T15:27:31.619831+0000","last_became_peered":"2023-11-04T15:27:31.619831+0000","last_unstale":"2023-11-04T15:38:18.360275+0000","last_undegraded":"2023-11-04T15:38:18.360275+0000","last_fullsized":"2023-11-04T15:38:18.360275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T15:38:18.360157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T15:38:18.360157+0000","last_clean_scrub_stamp":"2023-11-04T15:38:18.360157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:32:51.174031+0000","scrub_duration":0.0014914360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"44'3481","reported_seq":2937,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:10.702911+0000","last_change":"2023-11-04T15:37:10.702911+0000","last_active":"2023-11-04T15:37:10.702911+0000","last_peered":"2023-11-04T15:37:10.702911+0000","last_clean":"2023-11-04T15:37:10.702911+0000","last_became_active":"2023-11-04T15:27:36.140871+0000","last_became_peered":"2023-11-04T15:27:36.140871+0000","last_unstale":"2023-11-04T15:37:10.702911+0000","last_undegraded":"2023-11-04T15:37:10.702911+0000","last_fullsized":"2023-11-04T15:37:10.702911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3481","last_scrub_stamp":"2023-11-04T15:37:10.702789+0000","last_deep_scrub":"44'3481","last_deep_scrub_stamp":"2023-11-04T15:37:10.702789+0000","last_clean_scrub_stamp":"2023-11-04T15:37:10.702789+0000","objects_scrubbed":1,"log_size":3481,"log_dups_size":0,"ondisk_log_size":3481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:23:02.723895+0000","scrub_duration":0.008399541,"objects_trimmed":0,"snaptrim_duration":0.058381362999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"40'3644","reported_seq":3060,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:22.639061+0000","last_change":"2023-11-04T15:37:22.639061+0000","last_active":"2023-11-04T15:37:22.639061+0000","last_peered":"2023-11-04T15:37:22.639061+0000","last_clean":"2023-11-04T15:37:22.639061+0000","last_became_active":"2023-11-04T15:27:36.139487+0000","last_became_peered":"2023-11-04T15:27:36.139487+0000","last_unstale":"2023-11-04T15:37:22.639061+0000","last_undegraded":"2023-11-04T15:37:22.639061+0000","last_fullsized":"2023-11-04T15:37:22.639061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3644","last_scrub_stamp":"2023-11-04T15:37:22.638916+0000","last_deep_scrub":"40'3644","last_deep_scrub_stamp":"2023-11-04T15:37:22.638916+0000","last_clean_scrub_stamp":"2023-11-04T15:37:22.638916+0000","objects_scrubbed":0,"log_size":3644,"log_dups_size":0,"ondisk_log_size":3644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T03:37:19.090917+0000","scrub_duration":0.0049130600000000003,"objects_trimmed":0,"snaptrim_duration":0.056621590999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"44'2776","reported_seq":2829,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:42.474282+0000","last_change":"2023-11-04T15:37:42.474282+0000","last_active":"2023-11-04T15:37:42.474282+0000","last_peered":"2023-11-04T15:37:42.474282+0000","last_clean":"2023-11-04T15:37:42.474282+0000","last_became_active":"2023-11-04T15:27:35.775356+0000","last_became_peered":"2023-11-04T15:27:35.775356+0000","last_unstale":"2023-11-04T15:37:42.474282+0000","last_undegraded":"2023-11-04T15:37:42.474282+0000","last_fullsized":"2023-11-04T15:37:42.474282+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2776","last_scrub_stamp":"2023-11-04T15:37:42.474162+0000","last_deep_scrub":"44'2776","last_deep_scrub_stamp":"2023-11-04T15:37:42.474162+0000","last_clean_scrub_stamp":"2023-11-04T15:37:42.474162+0000","objects_scrubbed":5,"log_size":2776,"log_dups_size":0,"ondisk_log_size":2776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T21:55:13.607739+0000","scrub_duration":0.030546663000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2770,"num_write_kb":31342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"44'3526","reported_seq":2946,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:07.150810+0000","last_change":"2023-11-04T15:38:07.150810+0000","last_active":"2023-11-04T15:38:07.150810+0000","last_peered":"2023-11-04T15:38:07.150810+0000","last_clean":"2023-11-04T15:38:07.150810+0000","last_became_active":"2023-11-04T15:27:36.146464+0000","last_became_peered":"2023-11-04T15:27:36.146464+0000","last_unstale":"2023-11-04T15:38:07.150810+0000","last_undegraded":"2023-11-04T15:38:07.150810+0000","last_fullsized":"2023-11-04T15:38:07.150810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3526","last_scrub_stamp":"2023-11-04T15:38:07.150668+0000","last_deep_scrub":"44'3526","last_deep_scrub_stamp":"2023-11-04T15:38:07.150668+0000","last_clean_scrub_stamp":"2023-11-04T15:38:07.150668+0000","objects_scrubbed":1,"log_size":3526,"log_dups_size":0,"ondisk_log_size":3526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:24.608949+0000","scrub_duration":0.0086108179999999993,"objects_trimmed":0,"snaptrim_duration":0.064516859999999995,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"44'3745","reported_seq":3797,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:57.703309+0000","last_change":"2023-11-04T15:37:57.703411+0000","last_active":"2023-11-04T15:37:57.703309+0000","last_peered":"2023-11-04T15:37:57.703309+0000","last_clean":"2023-11-04T15:37:57.703309+0000","last_became_active":"2023-11-04T15:27:35.769904+0000","last_became_peered":"2023-11-04T15:27:35.769904+0000","last_unstale":"2023-11-04T15:37:57.703309+0000","last_undegraded":"2023-11-04T15:37:57.703309+0000","last_fullsized":"2023-11-04T15:37:57.703309+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3745","last_scrub_stamp":"2023-11-04T15:37:57.703286+0000","last_deep_scrub":"44'3745","last_deep_scrub_stamp":"2023-11-04T15:37:57.703286+0000","last_clean_scrub_stamp":"2023-11-04T15:37:57.703286+0000","objects_scrubbed":3,"log_size":3745,"log_dups_size":0,"ondisk_log_size":3745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:21:23.757688+0000","scrub_duration":0.020686982,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3740,"num_write_kb":21755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"44'3556","reported_seq":3608,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:02.674712+0000","last_change":"2023-11-04T15:38:02.674801+0000","last_active":"2023-11-04T15:38:02.674712+0000","last_peered":"2023-11-04T15:38:02.674712+0000","last_clean":"2023-11-04T15:38:02.674712+0000","last_became_active":"2023-11-04T15:27:35.768413+0000","last_became_peered":"2023-11-04T15:27:35.768413+0000","last_unstale":"2023-11-04T15:38:02.674712+0000","last_undegraded":"2023-11-04T15:38:02.674712+0000","last_fullsized":"2023-11-04T15:38:02.674712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3556","last_scrub_stamp":"2023-11-04T15:38:02.674689+0000","last_deep_scrub":"44'3556","last_deep_scrub_stamp":"2023-11-04T15:38:02.674689+0000","last_clean_scrub_stamp":"2023-11-04T15:38:02.674689+0000","objects_scrubbed":2,"log_size":3556,"log_dups_size":0,"ondisk_log_size":3556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:52:12.771630+0000","scrub_duration":0.025634852,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3537,"num_write_kb":29647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"40'3937","reported_seq":3333,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:42.530849+0000","last_change":"2023-11-04T15:37:42.530849+0000","last_active":"2023-11-04T15:37:42.530849+0000","last_peered":"2023-11-04T15:37:42.530849+0000","last_clean":"2023-11-04T15:37:42.530849+0000","last_became_active":"2023-11-04T15:27:36.139524+0000","last_became_peered":"2023-11-04T15:27:36.139524+0000","last_unstale":"2023-11-04T15:37:42.530849+0000","last_undegraded":"2023-11-04T15:37:42.530849+0000","last_fullsized":"2023-11-04T15:37:42.530849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3937","last_scrub_stamp":"2023-11-04T15:37:42.530734+0000","last_deep_scrub":"40'3937","last_deep_scrub_stamp":"2023-11-04T15:37:42.530734+0000","last_clean_scrub_stamp":"2023-11-04T15:37:42.530734+0000","objects_scrubbed":0,"log_size":3937,"log_dups_size":0,"ondisk_log_size":3937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:07:56.161396+0000","scrub_duration":0.0048541679999999999,"objects_trimmed":0,"snaptrim_duration":0.068494678000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1248,"num_write_kb":670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"44'1642","reported_seq":1694,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:08.820848+0000","last_change":"2023-11-04T15:38:08.820939+0000","last_active":"2023-11-04T15:38:08.820848+0000","last_peered":"2023-11-04T15:38:08.820848+0000","last_clean":"2023-11-04T15:38:08.820848+0000","last_became_active":"2023-11-04T15:27:35.775917+0000","last_became_peered":"2023-11-04T15:27:35.775917+0000","last_unstale":"2023-11-04T15:38:08.820848+0000","last_undegraded":"2023-11-04T15:38:08.820848+0000","last_fullsized":"2023-11-04T15:38:08.820848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1642","last_scrub_stamp":"2023-11-04T15:38:08.820827+0000","last_deep_scrub":"44'1642","last_deep_scrub_stamp":"2023-11-04T15:38:08.820827+0000","last_clean_scrub_stamp":"2023-11-04T15:38:08.820827+0000","objects_scrubbed":5,"log_size":1642,"log_dups_size":0,"ondisk_log_size":1642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T20:44:06.273949+0000","scrub_duration":0.0476023,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1634,"num_write_kb":25426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"44'3473","reported_seq":2907,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:21.407382+0000","last_change":"2023-11-04T15:37:21.407382+0000","last_active":"2023-11-04T15:37:21.407382+0000","last_peered":"2023-11-04T15:37:21.407382+0000","last_clean":"2023-11-04T15:37:21.407382+0000","last_became_active":"2023-11-04T15:27:36.150557+0000","last_became_peered":"2023-11-04T15:27:36.150557+0000","last_unstale":"2023-11-04T15:37:21.407382+0000","last_undegraded":"2023-11-04T15:37:21.407382+0000","last_fullsized":"2023-11-04T15:37:21.407382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3473","last_scrub_stamp":"2023-11-04T15:37:21.407243+0000","last_deep_scrub":"44'3473","last_deep_scrub_stamp":"2023-11-04T15:37:21.407243+0000","last_clean_scrub_stamp":"2023-11-04T15:37:21.407243+0000","objects_scrubbed":1,"log_size":3473,"log_dups_size":0,"ondisk_log_size":3473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T18:18:27.087972+0000","scrub_duration":0.0082048629999999997,"objects_trimmed":0,"snaptrim_duration":0.062631718000000003,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"44'3230","reported_seq":2725,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:37.265461+0000","last_change":"2023-11-04T15:38:37.265547+0000","last_active":"2023-11-04T15:38:37.265461+0000","last_peered":"2023-11-04T15:38:37.265461+0000","last_clean":"2023-11-04T15:38:37.265461+0000","last_became_active":"2023-11-04T15:27:36.149831+0000","last_became_peered":"2023-11-04T15:27:36.149831+0000","last_unstale":"2023-11-04T15:38:37.265461+0000","last_undegraded":"2023-11-04T15:38:37.265461+0000","last_fullsized":"2023-11-04T15:38:37.265461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3230","last_scrub_stamp":"2023-11-04T15:38:37.265437+0000","last_deep_scrub":"44'3230","last_deep_scrub_stamp":"2023-11-04T15:38:37.265437+0000","last_clean_scrub_stamp":"2023-11-04T15:38:37.265437+0000","objects_scrubbed":2,"log_size":3230,"log_dups_size":0,"ondisk_log_size":3230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T22:11:06.260972+0000","scrub_duration":0.0083613030000000005,"objects_trimmed":0,"snaptrim_duration":0.103639325,"stat_sum":{"num_bytes":8192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1060,"num_write_kb":590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"44'4779","reported_seq":4831,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:19.478819+0000","last_change":"2023-11-04T15:37:19.478909+0000","last_active":"2023-11-04T15:37:19.478819+0000","last_peered":"2023-11-04T15:37:19.478819+0000","last_clean":"2023-11-04T15:37:19.478819+0000","last_became_active":"2023-11-04T15:27:35.770022+0000","last_became_peered":"2023-11-04T15:27:35.770022+0000","last_unstale":"2023-11-04T15:37:19.478819+0000","last_undegraded":"2023-11-04T15:37:19.478819+0000","last_fullsized":"2023-11-04T15:37:19.478819+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4779","last_scrub_stamp":"2023-11-04T15:37:19.478796+0000","last_deep_scrub":"44'4779","last_deep_scrub_stamp":"2023-11-04T15:37:19.478796+0000","last_clean_scrub_stamp":"2023-11-04T15:37:19.478796+0000","objects_scrubbed":7,"log_size":4779,"log_dups_size":0,"ondisk_log_size":4779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:24.515597+0000","scrub_duration":0.083030119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28974830,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4772,"num_write_kb":50744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"44'3335","reported_seq":2791,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:16.935545+0000","last_change":"2023-11-04T15:38:16.935650+0000","last_active":"2023-11-04T15:38:16.935545+0000","last_peered":"2023-11-04T15:38:16.935545+0000","last_clean":"2023-11-04T15:38:16.935545+0000","last_became_active":"2023-11-04T15:27:36.138908+0000","last_became_peered":"2023-11-04T15:27:36.138908+0000","last_unstale":"2023-11-04T15:38:16.935545+0000","last_undegraded":"2023-11-04T15:38:16.935545+0000","last_fullsized":"2023-11-04T15:38:16.935545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3335","last_scrub_stamp":"2023-11-04T15:38:16.935521+0000","last_deep_scrub":"44'3335","last_deep_scrub_stamp":"2023-11-04T15:38:16.935521+0000","last_clean_scrub_stamp":"2023-11-04T15:38:16.935521+0000","objects_scrubbed":2,"log_size":3335,"log_dups_size":0,"ondisk_log_size":3335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:47:56.675047+0000","scrub_duration":0.010785885,"objects_trimmed":0,"snaptrim_duration":0.073000567000000002,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":1157,"num_write_kb":620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"44'784","reported_seq":836,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:23.362195+0000","last_change":"2023-11-04T15:37:23.362327+0000","last_active":"2023-11-04T15:37:23.362195+0000","last_peered":"2023-11-04T15:37:23.362195+0000","last_clean":"2023-11-04T15:37:23.362195+0000","last_became_active":"2023-11-04T15:27:35.767858+0000","last_became_peered":"2023-11-04T15:27:35.767858+0000","last_unstale":"2023-11-04T15:37:23.362195+0000","last_undegraded":"2023-11-04T15:37:23.362195+0000","last_fullsized":"2023-11-04T15:37:23.362195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'784","last_scrub_stamp":"2023-11-04T15:37:23.362171+0000","last_deep_scrub":"44'784","last_deep_scrub_stamp":"2023-11-04T15:37:23.362171+0000","last_clean_scrub_stamp":"2023-11-04T15:37:23.362171+0000","objects_scrubbed":4,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:07:37.029904+0000","scrub_duration":0.042357839000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":779,"num_write_kb":20966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"40'3359","reported_seq":2795,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:25.666192+0000","last_change":"2023-11-04T15:37:25.666192+0000","last_active":"2023-11-04T15:37:25.666192+0000","last_peered":"2023-11-04T15:37:25.666192+0000","last_clean":"2023-11-04T15:37:25.666192+0000","last_became_active":"2023-11-04T15:27:36.143442+0000","last_became_peered":"2023-11-04T15:27:36.143442+0000","last_unstale":"2023-11-04T15:37:25.666192+0000","last_undegraded":"2023-11-04T15:37:25.666192+0000","last_fullsized":"2023-11-04T15:37:25.666192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3359","last_scrub_stamp":"2023-11-04T15:37:25.666058+0000","last_deep_scrub":"40'3359","last_deep_scrub_stamp":"2023-11-04T15:37:25.666058+0000","last_clean_scrub_stamp":"2023-11-04T15:37:25.666058+0000","objects_scrubbed":0,"log_size":3359,"log_dups_size":0,"ondisk_log_size":3359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:56:39.468680+0000","scrub_duration":0.003764154,"objects_trimmed":0,"snaptrim_duration":0.072078296,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1167,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"44'3780","reported_seq":3832,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:56.657179+0000","last_change":"2023-11-04T15:37:56.657328+0000","last_active":"2023-11-04T15:37:56.657179+0000","last_peered":"2023-11-04T15:37:56.657179+0000","last_clean":"2023-11-04T15:37:56.657179+0000","last_became_active":"2023-11-04T15:27:35.770539+0000","last_became_peered":"2023-11-04T15:27:35.770539+0000","last_unstale":"2023-11-04T15:37:56.657179+0000","last_undegraded":"2023-11-04T15:37:56.657179+0000","last_fullsized":"2023-11-04T15:37:56.657179+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3780","last_scrub_stamp":"2023-11-04T15:37:56.657156+0000","last_deep_scrub":"44'3780","last_deep_scrub_stamp":"2023-11-04T15:37:56.657156+0000","last_clean_scrub_stamp":"2023-11-04T15:37:56.657156+0000","objects_scrubbed":2,"log_size":3780,"log_dups_size":0,"ondisk_log_size":3780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:53.508705+0000","scrub_duration":0.023445829000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3770,"num_write_kb":38321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"44'3794","reported_seq":3161,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:14.135362+0000","last_change":"2023-11-04T15:38:14.135463+0000","last_active":"2023-11-04T15:38:14.135362+0000","last_peered":"2023-11-04T15:38:14.135362+0000","last_clean":"2023-11-04T15:38:14.135362+0000","last_became_active":"2023-11-04T15:27:36.146477+0000","last_became_peered":"2023-11-04T15:27:36.146477+0000","last_unstale":"2023-11-04T15:38:14.135362+0000","last_undegraded":"2023-11-04T15:38:14.135362+0000","last_fullsized":"2023-11-04T15:38:14.135362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3794","last_scrub_stamp":"2023-11-04T15:38:14.135338+0000","last_deep_scrub":"44'3794","last_deep_scrub_stamp":"2023-11-04T15:38:14.135338+0000","last_clean_scrub_stamp":"2023-11-04T15:38:14.135338+0000","objects_scrubbed":3,"log_size":3794,"log_dups_size":0,"ondisk_log_size":3794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:47:53.874864+0000","scrub_duration":0.014159603999999999,"objects_trimmed":0,"snaptrim_duration":0.063144525000000007,"stat_sum":{"num_bytes":8192,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1270,"num_write_kb":694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"44'2947","reported_seq":2999,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:53.659127+0000","last_change":"2023-11-04T15:37:53.659229+0000","last_active":"2023-11-04T15:37:53.659127+0000","last_peered":"2023-11-04T15:37:53.659127+0000","last_clean":"2023-11-04T15:37:53.659127+0000","last_became_active":"2023-11-04T15:27:35.771316+0000","last_became_peered":"2023-11-04T15:27:35.771316+0000","last_unstale":"2023-11-04T15:37:53.659127+0000","last_undegraded":"2023-11-04T15:37:53.659127+0000","last_fullsized":"2023-11-04T15:37:53.659127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'2947","last_scrub_stamp":"2023-11-04T15:37:53.659103+0000","last_deep_scrub":"44'2947","last_deep_scrub_stamp":"2023-11-04T15:37:53.659103+0000","last_clean_scrub_stamp":"2023-11-04T15:37:53.659103+0000","objects_scrubbed":4,"log_size":2947,"log_dups_size":0,"ondisk_log_size":2947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:21:19.713505+0000","scrub_duration":0.039096767999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2943,"num_write_kb":28401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"44'3597","reported_seq":3019,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:09.671026+0000","last_change":"2023-11-04T15:37:09.671026+0000","last_active":"2023-11-04T15:37:09.671026+0000","last_peered":"2023-11-04T15:37:09.671026+0000","last_clean":"2023-11-04T15:37:09.671026+0000","last_became_active":"2023-11-04T15:27:36.144066+0000","last_became_peered":"2023-11-04T15:27:36.144066+0000","last_unstale":"2023-11-04T15:37:09.671026+0000","last_undegraded":"2023-11-04T15:37:09.671026+0000","last_fullsized":"2023-11-04T15:37:09.671026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3597","last_scrub_stamp":"2023-11-04T15:37:09.670901+0000","last_deep_scrub":"44'3597","last_deep_scrub_stamp":"2023-11-04T15:37:09.670901+0000","last_clean_scrub_stamp":"2023-11-04T15:37:09.670901+0000","objects_scrubbed":2,"log_size":3597,"log_dups_size":0,"ondisk_log_size":3597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T22:52:59.961460+0000","scrub_duration":0.010082327,"objects_trimmed":0,"snaptrim_duration":0.057889772999999999,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1118,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"44'931","reported_seq":983,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:46.627662+0000","last_change":"2023-11-04T15:37:46.627792+0000","last_active":"2023-11-04T15:37:46.627662+0000","last_peered":"2023-11-04T15:37:46.627662+0000","last_clean":"2023-11-04T15:37:46.627662+0000","last_became_active":"2023-11-04T15:27:35.767852+0000","last_became_peered":"2023-11-04T15:27:35.767852+0000","last_unstale":"2023-11-04T15:37:46.627662+0000","last_undegraded":"2023-11-04T15:37:46.627662+0000","last_fullsized":"2023-11-04T15:37:46.627662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'931","last_scrub_stamp":"2023-11-04T15:37:46.627638+0000","last_deep_scrub":"44'931","last_deep_scrub_stamp":"2023-11-04T15:37:46.627638+0000","last_clean_scrub_stamp":"2023-11-04T15:37:46.627638+0000","objects_scrubbed":5,"log_size":931,"log_dups_size":0,"ondisk_log_size":931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T16:40:26.233782+0000","scrub_duration":0.040590909000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":923,"num_write_kb":21087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"44'3553","reported_seq":2986,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:20.652542+0000","last_change":"2023-11-04T15:38:20.652681+0000","last_active":"2023-11-04T15:38:20.652542+0000","last_peered":"2023-11-04T15:38:20.652542+0000","last_clean":"2023-11-04T15:38:20.652542+0000","last_became_active":"2023-11-04T15:27:36.141167+0000","last_became_peered":"2023-11-04T15:27:36.141167+0000","last_unstale":"2023-11-04T15:38:20.652542+0000","last_undegraded":"2023-11-04T15:38:20.652542+0000","last_fullsized":"2023-11-04T15:38:20.652542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3553","last_scrub_stamp":"2023-11-04T15:38:20.652503+0000","last_deep_scrub":"44'3553","last_deep_scrub_stamp":"2023-11-04T15:38:20.652503+0000","last_clean_scrub_stamp":"2023-11-04T15:38:20.652503+0000","objects_scrubbed":1,"log_size":3553,"log_dups_size":0,"ondisk_log_size":3553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T01:48:00.392030+0000","scrub_duration":0.0095782799999999998,"objects_trimmed":0,"snaptrim_duration":0.057363947999999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1127,"num_write_kb":621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"44'3229","reported_seq":3281,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:37.512770+0000","last_change":"2023-11-04T15:37:37.512913+0000","last_active":"2023-11-04T15:37:37.512770+0000","last_peered":"2023-11-04T15:37:37.512770+0000","last_clean":"2023-11-04T15:37:37.512770+0000","last_became_active":"2023-11-04T15:27:35.775171+0000","last_became_peered":"2023-11-04T15:27:35.775171+0000","last_unstale":"2023-11-04T15:37:37.512770+0000","last_undegraded":"2023-11-04T15:37:37.512770+0000","last_fullsized":"2023-11-04T15:37:37.512770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3229","last_scrub_stamp":"2023-11-04T15:37:37.512732+0000","last_deep_scrub":"44'3229","last_deep_scrub_stamp":"2023-11-04T15:37:37.512732+0000","last_clean_scrub_stamp":"2023-11-04T15:37:37.512732+0000","objects_scrubbed":4,"log_size":3229,"log_dups_size":0,"ondisk_log_size":3229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T02:07:51.143393+0000","scrub_duration":0.039893972,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3214,"num_write_kb":42509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"44'3490","reported_seq":2947,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:09.749095+0000","last_change":"2023-11-04T15:37:09.749095+0000","last_active":"2023-11-04T15:37:09.749095+0000","last_peered":"2023-11-04T15:37:09.749095+0000","last_clean":"2023-11-04T15:37:09.749095+0000","last_became_active":"2023-11-04T15:27:36.145560+0000","last_became_peered":"2023-11-04T15:27:36.145560+0000","last_unstale":"2023-11-04T15:37:09.749095+0000","last_undegraded":"2023-11-04T15:37:09.749095+0000","last_fullsized":"2023-11-04T15:37:09.749095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'3490","last_scrub_stamp":"2023-11-04T15:37:09.748973+0000","last_deep_scrub":"44'3490","last_deep_scrub_stamp":"2023-11-04T15:37:09.748973+0000","last_clean_scrub_stamp":"2023-11-04T15:37:09.748973+0000","objects_scrubbed":5,"log_size":3490,"log_dups_size":0,"ondisk_log_size":3490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:31:31.358580+0000","scrub_duration":0.011863093,"objects_trimmed":0,"snaptrim_duration":0.07011676,"stat_sum":{"num_bytes":4151,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":1159,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"44'4215","reported_seq":4268,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:09.815711+0000","last_change":"2023-11-04T15:38:09.815860+0000","last_active":"2023-11-04T15:38:09.815711+0000","last_peered":"2023-11-04T15:38:09.815711+0000","last_clean":"2023-11-04T15:38:09.815711+0000","last_became_active":"2023-11-04T15:27:35.770873+0000","last_became_peered":"2023-11-04T15:27:35.770873+0000","last_unstale":"2023-11-04T15:38:09.815711+0000","last_undegraded":"2023-11-04T15:38:09.815711+0000","last_fullsized":"2023-11-04T15:38:09.815711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4215","last_scrub_stamp":"2023-11-04T15:38:09.815689+0000","last_deep_scrub":"44'4215","last_deep_scrub_stamp":"2023-11-04T15:38:09.815689+0000","last_clean_scrub_stamp":"2023-11-04T15:38:09.815689+0000","objects_scrubbed":1,"log_size":4215,"log_dups_size":0,"ondisk_log_size":4215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T23:18:27.273970+0000","scrub_duration":0.014824155,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4214,"num_write_kb":32525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"44'4092","reported_seq":3407,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:37:13.735284+0000","last_change":"2023-11-04T15:37:13.735284+0000","last_active":"2023-11-04T15:37:13.735284+0000","last_peered":"2023-11-04T15:37:13.735284+0000","last_clean":"2023-11-04T15:37:13.735284+0000","last_became_active":"2023-11-04T15:27:36.147535+0000","last_became_peered":"2023-11-04T15:27:36.147535+0000","last_unstale":"2023-11-04T15:37:13.735284+0000","last_undegraded":"2023-11-04T15:37:13.735284+0000","last_fullsized":"2023-11-04T15:37:13.735284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'4092","last_scrub_stamp":"2023-11-04T15:37:13.735159+0000","last_deep_scrub":"44'4092","last_deep_scrub_stamp":"2023-11-04T15:37:13.735159+0000","last_clean_scrub_stamp":"2023-11-04T15:37:13.735159+0000","objects_scrubbed":2,"log_size":4092,"log_dups_size":0,"ondisk_log_size":4092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T17:20:39.611539+0000","scrub_duration":0.012119325,"objects_trimmed":0,"snaptrim_duration":0.055801837,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1294,"num_write_kb":719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"44'1592","reported_seq":1645,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-04T15:38:11.894655+0000","last_change":"2023-11-04T15:38:11.894759+0000","last_active":"2023-11-04T15:38:11.894655+0000","last_peered":"2023-11-04T15:38:11.894655+0000","last_clean":"2023-11-04T15:38:11.894655+0000","last_became_active":"2023-11-04T15:27:35.775918+0000","last_became_peered":"2023-11-04T15:27:35.775918+0000","last_unstale":"2023-11-04T15:38:11.894655+0000","last_undegraded":"2023-11-04T15:38:11.894655+0000","last_fullsized":"2023-11-04T15:38:11.894655+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1592","last_scrub_stamp":"2023-11-04T15:38:11.894631+0000","last_deep_scrub":"44'1592","last_deep_scrub_stamp":"2023-11-04T15:38:11.894631+0000","last_clean_scrub_stamp":"2023-11-04T15:38:11.894631+0000","objects_scrubbed":3,"log_size":1592,"log_dups_size":0,"ondisk_log_size":1592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-06T00:03:12.567650+0000","scrub_duration":0.018695843,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1587,"num_write_kb":12658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1143,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":127433,"num_objects":92,"num_object_clones":25,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":8,"num_read":46,"num_read_kb":30,"num_write":74822,"num_write_kb":40603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":254672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224379,"ondisk_log_size":224379,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":430735581,"num_objects":126,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":126,"num_whiteouts":0,"num_read":190,"num_read_kb":3338,"num_write":83456,"num_write_kb":897544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7850,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":861528064,"data_stored":861471162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83202,"ondisk_log_size":83202,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705812,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":663648,"kb_used_data":173208,"kb_used_omap":0,"kb_used_meta":490432,"kb_avail":93708192,"statfs":{"total":96636764160,"available":95957188608,"internally_reserved":0,"allocated":177364992,"data_stored":176999461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":502202368},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 15:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51400000000000001,"15min":0.40799999999999997},"min":{"1min":0.34799999999999998,"5min":0.182,"15min":0.156},"max":{"1min":0.64800000000000002,"5min":10.488,"15min":10.488},"last":0.375},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.65100000000000002,"15min":0.46000000000000002},"min":{"1min":0.39000000000000001,"5min":0.20200000000000001,"15min":0.186},"max":{"1min":0.57699999999999996,"5min":13.055,"15min":13.055},"last":0.437}]},{"osd":1,"last update":"Sat Nov 4 15:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.57399999999999995,"15min":0.439},"min":{"1min":0.35799999999999998,"5min":0.219,"15min":0.188},"max":{"1min":0.61899999999999999,"5min":12.347,"15min":12.347},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.55400000000000005,"15min":0.443},"min":{"1min":0.34699999999999998,"5min":0.23499999999999999,"15min":0.186},"max":{"1min":0.67300000000000004,"5min":12.853999999999999,"15min":12.853999999999999},"last":0.40000000000000002}]},{"osd":2,"last update":"Sat Nov 4 15:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.443,"15min":0.34499999999999997},"min":{"1min":0.26700000000000002,"5min":0.153,"15min":0.153},"max":{"1min":0.38600000000000001,"5min":11.709,"15min":11.709},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.436,"15min":0.35299999999999998},"min":{"1min":0.27800000000000002,"5min":0.17699999999999999,"15min":0.14899999999999999},"max":{"1min":0.40699999999999997,"5min":9.2629999999999999,"15min":9.2629999999999999},"last":0.29499999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705811,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":952424,"kb_used_data":245472,"kb_used_omap":0,"kb_used_meta":706944,"kb_avail":93419416,"statfs":{"total":96636764160,"available":95661481984,"internally_reserved":0,"allocated":251363328,"data_stored":250991590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":723910656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 15:38:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.68600000000000005,"15min":0.46999999999999997},"min":{"1min":0.30199999999999999,"5min":0.16700000000000001,"15min":0.151},"max":{"1min":0.61699999999999999,"5min":21.297999999999998,"15min":21.297999999999998},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.58599999999999997,"15min":0.433},"min":{"1min":0.32400000000000001,"5min":0.21199999999999999,"15min":0.17399999999999999},"max":{"1min":0.54500000000000004,"5min":17.809000000000001,"15min":17.809000000000001},"last":0.434}]},{"osd":1,"last update":"Sat Nov 4 15:38:45 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.56100000000000005,"15min":0.44900000000000001},"min":{"1min":0.29699999999999999,"5min":0.19500000000000001,"15min":0.17100000000000001},"max":{"1min":0.65500000000000003,"5min":10.851000000000001,"15min":10.851000000000001},"last":0.5},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.56699999999999995,"15min":0.46400000000000002},"min":{"1min":0.38500000000000001,"5min":0.20899999999999999,"15min":0.20399999999999999},"max":{"1min":0.69599999999999995,"5min":8.9740000000000002,"15min":8.9740000000000002},"last":0.47999999999999998}]},{"osd":3,"last update":"Sat Nov 4 15:38:45 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.35499999999999998,"15min":0.32300000000000001},"min":{"1min":0.26200000000000001,"5min":0.16,"15min":0.14699999999999999},"max":{"1min":0.5,"5min":3.3929999999999998,"15min":3.3929999999999998},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.44400000000000001,"15min":0.373},"min":{"1min":0.26000000000000001,"5min":0.159,"15min":0.14899999999999999},"max":{"1min":0.52200000000000002,"5min":10.887,"15min":10.887},"last":0.45700000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705810,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":719272,"kb_used_data":188640,"kb_used_omap":0,"kb_used_meta":530624,"kb_avail":93652568,"statfs":{"total":96636764160,"available":95900229632,"internally_reserved":0,"allocated":193167360,"data_stored":192807863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":543358976},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 15:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.28199999999999997,"15min":0.318},"min":{"1min":0.21299999999999999,"5min":0.152,"15min":0.14399999999999999},"max":{"1min":0.42999999999999999,"5min":3.3610000000000002,"15min":12.768000000000001},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.34399999999999997,"15min":0.30099999999999999},"min":{"1min":0.24099999999999999,"5min":0.158,"15min":0.14399999999999999},"max":{"1min":0.44700000000000001,"5min":8.609,"15min":8.609},"last":0.26000000000000001}]},{"osd":2,"last update":"Sat Nov 4 15:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.45500000000000002,"15min":0.437},"min":{"1min":0.39200000000000002,"5min":0.215,"15min":0.189},"max":{"1min":0.625,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.502},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.42699999999999999,"15min":0.41999999999999998},"min":{"1min":0.35699999999999998,"5min":0.21299999999999999,"15min":0.192},"max":{"1min":0.61199999999999999,"5min":0.98199999999999998,"15min":1.5820000000000001},"last":0.54300000000000004}]},{"osd":3,"last update":"Sat Nov 4 15:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.47399999999999998,"15min":0.436},"min":{"1min":0.36399999999999999,"5min":0.23100000000000001,"15min":0.20899999999999999},"max":{"1min":0.63100000000000001,"5min":6.7679999999999998,"15min":6.7679999999999998},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.45900000000000002,"15min":0.44700000000000001},"min":{"1min":0.41799999999999998,"5min":0.26500000000000001,"15min":0.24299999999999999},"max":{"1min":0.61299999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.58599999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705811,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":918208,"kb_used_data":237496,"kb_used_omap":0,"kb_used_meta":680704,"kb_avail":93453632,"statfs":{"total":96636764160,"available":95696519168,"internally_reserved":0,"allocated":243195904,"data_stored":242832608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":697040896},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 15:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.46200000000000002,"15min":0.32400000000000001},"min":{"1min":0.22700000000000001,"5min":0.14499999999999999,"15min":0.13500000000000001},"max":{"1min":0.44,"5min":12.731,"15min":12.731},"last":0.312},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.30399999999999999,"15min":0.27900000000000003},"min":{"1min":0.253,"5min":0.16400000000000001,"15min":0.155},"max":{"1min":0.45900000000000002,"5min":4.1200000000000001,"15min":4.1200000000000001},"last":0.27200000000000002}]},{"osd":2,"last update":"Sat Nov 4 15:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.49099999999999999,"15min":0.434},"min":{"1min":0.38400000000000001,"5min":0.219,"15min":0.17599999999999999},"max":{"1min":0.70399999999999996,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.46500000000000002,"15min":0.433},"min":{"1min":0.36499999999999999,"5min":0.21099999999999999,"15min":0.187},"max":{"1min":0.72999999999999998,"5min":3.6749999999999998,"15min":3.6749999999999998},"last":0.44600000000000001}]},{"osd":3,"last update":"Sat Nov 4 15:38:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.5,"15min":0.44600000000000001},"min":{"1min":0.35899999999999999,"5min":0.20899999999999999,"15min":0.20300000000000001},"max":{"1min":0.71899999999999997,"5min":6.4660000000000002,"15min":6.4660000000000002},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.50600000000000001,"15min":0.45300000000000001},"min":{"1min":0.40600000000000003,"5min":0.23899999999999999,"15min":0.23000000000000001},"max":{"1min":0.70899999999999996,"5min":6.3540000000000001,"15min":6.3540000000000001},"last":0.42899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":242003968,"data_stored":241991173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":192552960,"data_stored":192552686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":250785792,"data_stored":250765155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":176185344,"data_stored":176162148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":69829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":73939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":45197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":65707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T15:39:30.407 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-04T15:39:30.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.543+0000 7f0f6648f640 1 Processor -- start 2023-11-04T15:39:30.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.543+0000 7f0f6648f640 1 -- start start 2023-11-04T15:39:30.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.543+0000 7f0f6648f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0f60137120 0x7f0f60137500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:30.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.543+0000 7f0f6648f640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f600a3c30 con 0x7f0f6013a640 2023-11-04T15:39:30.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.543+0000 7f0f6648f640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f600a4fa0 con 0x7f0f600a6120 2023-11-04T15:39:30.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.543+0000 7f0f6648f640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f600a4990 con 0x7f0f60137120 2023-11-04T15:39:30.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.543+0000 7f0f64a2c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0f6013a640 0x7f0f60142270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53294/0 (socket says 172.21.15.19:53294) 2023-11-04T15:39:30.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.543+0000 7f0f64a2c640 1 -- 172.21.15.19:0/1004978518 learned_addr learned my addr 172.21.15.19:0/1004978518 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:39:30.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.544+0000 7f0f5ffff640 1 --2- 172.21.15.19:0/1004978518 >> v2:172.21.15.96:3300/0 conn(0x7f0f60137120 0x7f0f60137500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:30.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.544+0000 7f0f5effd640 1 -- 172.21.15.19:0/1004978518 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1844857215 0 0) 0x7f0f600a3c30 con 0x7f0f6013a640 2023-11-04T15:39:30.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.544+0000 7f0f5effd640 1 -- 172.21.15.19:0/1004978518 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f48003520 con 0x7f0f6013a640 2023-11-04T15:39:30.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.544+0000 7f0f5effd640 1 -- 172.21.15.19:0/1004978518 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1351761182 0 0) 0x7f0f48003520 con 0x7f0f6013a640 2023-11-04T15:39:30.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.544+0000 7f0f5effd640 1 -- 172.21.15.19:0/1004978518 >> v2:172.21.15.96:3300/0 conn(0x7f0f60137120 msgr2=0x7f0f60137500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:39:30.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.544+0000 7f0f5effd640 1 --2- 172.21.15.19:0/1004978518 >> v2:172.21.15.96:3300/0 conn(0x7f0f60137120 0x7f0f60137500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:30.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.544+0000 7f0f5effd640 1 -- 172.21.15.19:0/1004978518 >> v1:172.21.15.96:6789/0 conn(0x7f0f600a6120 legacy=0x7f0f60139f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:30.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.544+0000 7f0f5effd640 1 -- 172.21.15.19:0/1004978518 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f600a2ef0 con 0x7f0f6013a640 2023-11-04T15:39:30.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.544+0000 7f0f5effd640 1 -- 172.21.15.19:0/1004978518 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3646097784 0 0) 0x7f0f58001a10 con 0x7f0f6013a640 2023-11-04T15:39:30.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.544+0000 7f0f5effd640 1 -- 172.21.15.19:0/1004978518 >> v1:172.21.15.19:6789/0 conn(0x7f0f6013a640 legacy=0x7f0f60142270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:30.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.544+0000 7f0f5effd640 1 --2- 172.21.15.19:0/1004978518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f48003970 0x7f0f48003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:30.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.544+0000 7f0f5effd640 1 --2- 172.21.15.19:0/1004978518 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f480047c0 0x7f0f48004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:30.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.544+0000 7f0f5effd640 1 --2- 172.21.15.19:0/1004978518 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0f48005180 0x7f0f4800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:30.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.544+0000 7f0f5effd640 1 -- 172.21.15.19:0/1004978518 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f600a4990 con 0x7f0f48003970 2023-11-04T15:39:30.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.544+0000 7f0f5effd640 1 -- 172.21.15.19:0/1004978518 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4800c120 con 0x7f0f480047c0 2023-11-04T15:39:30.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.544+0000 7f0f5effd640 1 -- 172.21.15.19:0/1004978518 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4800c2e0 con 0x7f0f48005180 2023-11-04T15:39:30.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.544+0000 7f0f5ffff640 1 --2- 172.21.15.19:0/1004978518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f48003970 0x7f0f48003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:30.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.544+0000 7f0f5f7fe640 1 --2- 172.21.15.19:0/1004978518 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f480047c0 0x7f0f48004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:30.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.544+0000 7f0f64a2c640 1 --2- 172.21.15.19:0/1004978518 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0f48005180 0x7f0f4800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:30.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.544+0000 7f0f5ffff640 1 -- 172.21.15.19:0/1004978518 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0f48005180 msgr2=0x7f0f4800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:39:30.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.544+0000 7f0f5ffff640 1 --2- 172.21.15.19:0/1004978518 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0f48005180 0x7f0f4800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:30.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.544+0000 7f0f5ffff640 1 -- 172.21.15.19:0/1004978518 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f480047c0 msgr2=0x7f0f48004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:39:30.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.544+0000 7f0f5ffff640 1 --2- 172.21.15.19:0/1004978518 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f480047c0 0x7f0f48004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:30.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.544+0000 7f0f5ffff640 1 -- 172.21.15.19:0/1004978518 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f48003520 con 0x7f0f48003970 2023-11-04T15:39:30.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.544+0000 7f0f64a2c640 1 -- 172.21.15.19:0/1004978518 reap_dead start 2023-11-04T15:39:30.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.545+0000 7f0f5ffff640 1 --2- 172.21.15.19:0/1004978518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f48003970 0x7f0f48003d90 secure :-1 s=READY pgs=3788 cs=0 l=1 rev1=1 crypto rx=0x7f0f50009ac0 tx=0x7f0f480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb7670c9cbf7cc77 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:39:30.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.545+0000 7f0f5effd640 1 -- 172.21.15.19:0/1004978518 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5002c6b0 con 0x7f0f48003970 2023-11-04T15:39:30.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.545+0000 7f0f5effd640 1 -- 172.21.15.19:0/1004978518 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5002c810 con 0x7f0f48003970 2023-11-04T15:39:30.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.545+0000 7f0f5effd640 1 -- 172.21.15.19:0/1004978518 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5002cba0 con 0x7f0f48003970 2023-11-04T15:39:30.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.546+0000 7f0f6648f640 1 -- 172.21.15.19:0/1004978518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f48003970 msgr2=0x7f0f48003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:30.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.546+0000 7f0f6648f640 1 --2- 172.21.15.19:0/1004978518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f48003970 0x7f0f48003d90 secure :-1 s=READY pgs=3788 cs=0 l=1 rev1=1 crypto rx=0x7f0f50009ac0 tx=0x7f0f480057f0 comp rx=0 tx=0).stop 2023-11-04T15:39:30.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.546+0000 7f0f6648f640 1 -- 172.21.15.19:0/1004978518 shutdown_connections 2023-11-04T15:39:30.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.546+0000 7f0f6648f640 1 --2- 172.21.15.19:0/1004978518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f48003970 0x7f0f48003d90 unknown :-1 s=CLOSED pgs=3788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:30.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.546+0000 7f0f6648f640 1 -- 172.21.15.19:0/1004978518 >> 172.21.15.19:0/1004978518 conn(0x7f0f600a8d00 msgr2=0x7f0f600a9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:39:30.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.546+0000 7f0f6648f640 1 -- 172.21.15.19:0/1004978518 shutdown_connections 2023-11-04T15:39:30.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.546+0000 7f0f6648f640 1 -- 172.21.15.19:0/1004978518 wait complete. 2023-11-04T15:39:30.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.547+0000 7f0f6648f640 1 Processor -- start 2023-11-04T15:39:30.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.547+0000 7f0f6648f640 1 -- start start 2023-11-04T15:39:30.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.547+0000 7f0f6648f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0f48003970 0x7f0f60133a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:30.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.547+0000 7f0f6648f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f60133f40 0x7f0f60134360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:30.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.547+0000 7f0f6648f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f600a0c40 0x7f0f600a10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:30.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.547+0000 7f0f6648f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6009ff20 con 0x7f0f600a0c40 2023-11-04T15:39:30.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.547+0000 7f0f6648f640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f601348a0 con 0x7f0f60133f40 2023-11-04T15:39:30.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.547+0000 7f0f6648f640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f600a2110 con 0x7f0f48003970 2023-11-04T15:39:30.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.547+0000 7f0f64a2c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f600a0c40 0x7f0f600a10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:30.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.547+0000 7f0f5ffff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0f48003970 0x7f0f60133a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:30.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.547+0000 7f0f64a2c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f600a0c40 0x7f0f600a10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56436/0 (socket says 172.21.15.19:56436) 2023-11-04T15:39:30.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.547+0000 7f0f64a2c640 1 -- 172.21.15.19:0/722464570 learned_addr learned my addr 172.21.15.19:0/722464570 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:39:30.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.547+0000 7f0f5f7fe640 1 --2- 172.21.15.19:0/722464570 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f60133f40 0x7f0f60134360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:30.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.548+0000 7f0f64a2c640 1 -- 172.21.15.19:0/722464570 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0f48003970 msgr2=0x7f0f60133a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:30.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.548+0000 7f0f64a2c640 1 --2- 172.21.15.19:0/722464570 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0f48003970 0x7f0f60133a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:30.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.548+0000 7f0f64a2c640 1 -- 172.21.15.19:0/722464570 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f60133f40 msgr2=0x7f0f60134360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:30.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.548+0000 7f0f64a2c640 1 --2- 172.21.15.19:0/722464570 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f60133f40 0x7f0f60134360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:30.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.548+0000 7f0f64a2c640 1 -- 172.21.15.19:0/722464570 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6009f910 con 0x7f0f600a0c40 2023-11-04T15:39:30.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.548+0000 7f0f64a2c640 1 --2- 172.21.15.19:0/722464570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f600a0c40 0x7f0f600a10c0 secure :-1 s=READY pgs=3789 cs=0 l=1 rev1=1 crypto rx=0x7f0f600a44a0 tx=0x7f0f5800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:39:30.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.548+0000 7f0f5cff9640 1 -- 172.21.15.19:0/722464570 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5800ec10 con 0x7f0f600a0c40 2023-11-04T15:39:30.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.548+0000 7f0f5cff9640 1 -- 172.21.15.19:0/722464570 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5800ed70 con 0x7f0f600a0c40 2023-11-04T15:39:30.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.548+0000 7f0f6648f640 1 -- 172.21.15.19:0/722464570 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f6009f450 con 0x7f0f600a0c40 2023-11-04T15:39:30.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.548+0000 7f0f5cff9640 1 -- 172.21.15.19:0/722464570 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5800eee0 con 0x7f0f600a0c40 2023-11-04T15:39:30.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.548+0000 7f0f6648f640 1 -- 172.21.15.19:0/722464570 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f6009fb60 con 0x7f0f600a0c40 2023-11-04T15:39:30.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.549+0000 7f0f6648f640 1 -- 172.21.15.19:0/722464570 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f60067d60 con 0x7f0f600a0c40 2023-11-04T15:39:30.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.550+0000 7f0f5cff9640 1 -- 172.21.15.19:0/722464570 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0f58014650 con 0x7f0f600a0c40 2023-11-04T15:39:30.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.550+0000 7f0f5cff9640 1 --2- 172.21.15.19:0/722464570 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f0f4c06a430 0x7f0f4c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:30.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.550+0000 7f0f5cff9640 1 -- 172.21.15.19:0/722464570 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4434+0+0 (secure 0 0 0) 0x7f0f580881d0 con 0x7f0f600a0c40 2023-11-04T15:39:30.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.550+0000 7f0f5ffff640 1 --2- 172.21.15.19:0/722464570 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f0f4c06a430 0x7f0f4c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:30.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.551+0000 7f0f5ffff640 1 --2- 172.21.15.19:0/722464570 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f0f4c06a430 0x7f0f4c06c8f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0f50036000 tx=0x7f0f50030000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:39:30.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.554+0000 7f0f5cff9640 1 -- 172.21.15.19:0/722464570 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0f58053d50 con 0x7f0f600a0c40 2023-11-04T15:39:30.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.732+0000 7f0f6648f640 1 -- 172.21.15.19:0/722464570 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f0f600aa5d0 con 0x7f0f600a0c40 2023-11-04T15:39:30.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.735+0000 7f0f5cff9640 1 -- 172.21.15.19:0/722464570 <== mon.0 v2:172.21.15.19:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0f58053d50 con 0x7f0f600a0c40 2023-11-04T15:39:30.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.736+0000 7f0f5cff9640 1 -- 172.21.15.19:0/722464570 <== mon.0 v2:172.21.15.19:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) v1 ==== 123+0+0 (secure 0 0 0) 0x7f0f58057370 con 0x7f0f600a0c40 2023-11-04T15:39:30.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.738+0000 7f0f6648f640 1 -- 172.21.15.19:0/722464570 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f0f4c06a430 msgr2=0x7f0f4c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:30.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.738+0000 7f0f6648f640 1 --2- 172.21.15.19:0/722464570 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f0f4c06a430 0x7f0f4c06c8f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0f50036000 tx=0x7f0f50030000 comp rx=0 tx=0).stop 2023-11-04T15:39:30.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.738+0000 7f0f6648f640 1 -- 172.21.15.19:0/722464570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f600a0c40 msgr2=0x7f0f600a10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:30.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.738+0000 7f0f6648f640 1 --2- 172.21.15.19:0/722464570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f600a0c40 0x7f0f600a10c0 secure :-1 s=READY pgs=3789 cs=0 l=1 rev1=1 crypto rx=0x7f0f600a44a0 tx=0x7f0f5800e530 comp rx=0 tx=0).stop 2023-11-04T15:39:30.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.738+0000 7f0f6648f640 1 -- 172.21.15.19:0/722464570 shutdown_connections 2023-11-04T15:39:30.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.738+0000 7f0f6648f640 1 --2- 172.21.15.19:0/722464570 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f0f4c06a430 0x7f0f4c06c8f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:30.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.738+0000 7f0f6648f640 1 --2- 172.21.15.19:0/722464570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f600a0c40 0x7f0f600a10c0 unknown :-1 s=CLOSED pgs=3789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:30.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.738+0000 7f0f6648f640 1 --2- 172.21.15.19:0/722464570 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f60133f40 0x7f0f60134360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:30.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.738+0000 7f0f6648f640 1 --2- 172.21.15.19:0/722464570 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0f48003970 0x7f0f60133a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:30.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.738+0000 7f0f6648f640 1 -- 172.21.15.19:0/722464570 >> 172.21.15.19:0/722464570 conn(0x7f0f600a8d00 msgr2=0x7f0f60134a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:39:30.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.738+0000 7f0f6648f640 1 -- 172.21.15.19:0/722464570 shutdown_connections 2023-11-04T15:39:30.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.738+0000 7f0f6648f640 1 -- 172.21.15.19:0/722464570 wait complete. 2023-11-04T15:39:30.750 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-04T15:39:30.751 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T15:39:30.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.855+0000 7f93ac8b6640 1 Processor -- start 2023-11-04T15:39:30.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.855+0000 7f93ac8b6640 1 -- start start 2023-11-04T15:39:30.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.855+0000 7f93ac8b6640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f93a8137650 0x7f93a80a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:30.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.855+0000 7f93ac8b6640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a80a4c20 con 0x7f93a8137270 2023-11-04T15:39:30.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.855+0000 7f93ac8b6640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a813ad80 con 0x7f93a80a3e90 2023-11-04T15:39:30.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.855+0000 7f93ac8b6640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a80a3060 con 0x7f93a8137650 2023-11-04T15:39:30.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.855+0000 7f93a659c640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f93a8137270 0x7f93a8139f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53300/0 (socket says 172.21.15.19:53300) 2023-11-04T15:39:30.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.855+0000 7f93a659c640 1 -- 172.21.15.19:0/1539084590 learned_addr learned my addr 172.21.15.19:0/1539084590 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:39:30.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.856+0000 7f93a5d9b640 1 -- 172.21.15.19:0/1539084590 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4106952993 0 0) 0x7f93a80a4c20 con 0x7f93a8137270 2023-11-04T15:39:30.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.856+0000 7f93a5d9b640 1 -- 172.21.15.19:0/1539084590 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9394003520 con 0x7f93a8137270 2023-11-04T15:39:30.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.856+0000 7f93a6d9d640 1 --2- 172.21.15.19:0/1539084590 >> v2:172.21.15.96:3300/0 conn(0x7f93a8137650 0x7f93a80a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:30.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.856+0000 7f93a5d9b640 1 -- 172.21.15.19:0/1539084590 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 232299211 0 0) 0x7f9394003520 con 0x7f93a8137270 2023-11-04T15:39:30.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.856+0000 7f93a5d9b640 1 -- 172.21.15.19:0/1539084590 >> v2:172.21.15.96:3300/0 conn(0x7f93a8137650 msgr2=0x7f93a80a6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:39:30.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.856+0000 7f93a5d9b640 1 --2- 172.21.15.19:0/1539084590 >> v2:172.21.15.96:3300/0 conn(0x7f93a8137650 0x7f93a80a6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:30.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.856+0000 7f93a5d9b640 1 -- 172.21.15.19:0/1539084590 >> v1:172.21.15.96:6789/0 conn(0x7f93a80a3e90 legacy=0x7f93a813a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:39:30.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.856+0000 7f93a5d9b640 1 -- 172.21.15.19:0/1539084590 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a80a5080 con 0x7f93a8137270 2023-11-04T15:39:30.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.856+0000 7f93a5d9b640 1 -- 172.21.15.19:0/1539084590 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3646097784 0 0) 0x7f9398001670 con 0x7f93a8137270 2023-11-04T15:39:30.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.856+0000 7f93a5d9b640 1 -- 172.21.15.19:0/1539084590 >> v1:172.21.15.19:6789/0 conn(0x7f93a8137270 legacy=0x7f93a8139f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:30.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.856+0000 7f93a5d9b640 1 --2- 172.21.15.19:0/1539084590 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f93940039c0 0x7f9394003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:30.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.856+0000 7f93a5d9b640 1 --2- 172.21.15.19:0/1539084590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93940047c0 0x7f9394004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:30.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.856+0000 7f93a5d9b640 1 --2- 172.21.15.19:0/1539084590 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9394005380 0x7f939400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:30.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.856+0000 7f93a5d9b640 1 -- 172.21.15.19:0/1539084590 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a80a3060 con 0x7f93940047c0 2023-11-04T15:39:30.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.856+0000 7f93a5d9b640 1 -- 172.21.15.19:0/1539084590 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939400c260 con 0x7f9394005380 2023-11-04T15:39:30.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.856+0000 7f93a5d9b640 1 -- 172.21.15.19:0/1539084590 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f939400c420 con 0x7f93940039c0 2023-11-04T15:39:30.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.856+0000 7f939dd9b640 1 --2- 172.21.15.19:0/1539084590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93940047c0 0x7f9394004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:30.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.856+0000 7f93a659c640 1 --2- 172.21.15.19:0/1539084590 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f93940039c0 0x7f9394003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:30.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.856+0000 7f93a6d9d640 1 --2- 172.21.15.19:0/1539084590 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9394005380 0x7f939400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:30.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.856+0000 7f939dd9b640 1 -- 172.21.15.19:0/1539084590 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f93940039c0 msgr2=0x7f9394003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:39:30.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.856+0000 7f939dd9b640 1 --2- 172.21.15.19:0/1539084590 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f93940039c0 0x7f9394003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:30.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.856+0000 7f939dd9b640 1 -- 172.21.15.19:0/1539084590 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9394005380 msgr2=0x7f939400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:39:30.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.856+0000 7f939dd9b640 1 --2- 172.21.15.19:0/1539084590 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9394005380 0x7f939400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:30.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.856+0000 7f939dd9b640 1 -- 172.21.15.19:0/1539084590 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9394003520 con 0x7f93940047c0 2023-11-04T15:39:30.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.856+0000 7f93a6d9d640 1 -- 172.21.15.19:0/1539084590 reap_dead start 2023-11-04T15:39:30.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.857+0000 7f939dd9b640 1 --2- 172.21.15.19:0/1539084590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93940047c0 0x7f9394004c40 secure :-1 s=READY pgs=3791 cs=0 l=1 rev1=1 crypto rx=0x7f93a80a4270 tx=0x7f93940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=834209abbc0be041 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:39:30.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.857+0000 7f93a5d9b640 1 -- 172.21.15.19:0/1539084590 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93900052d0 con 0x7f93940047c0 2023-11-04T15:39:30.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.857+0000 7f93a5d9b640 1 -- 172.21.15.19:0/1539084590 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f939002e050 con 0x7f93940047c0 2023-11-04T15:39:30.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.857+0000 7f93a5d9b640 1 -- 172.21.15.19:0/1539084590 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9390003850 con 0x7f93940047c0 2023-11-04T15:39:30.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.858+0000 7f93ac8b6640 1 -- 172.21.15.19:0/1539084590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93940047c0 msgr2=0x7f9394004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:30.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.858+0000 7f93ac8b6640 1 --2- 172.21.15.19:0/1539084590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93940047c0 0x7f9394004c40 secure :-1 s=READY pgs=3791 cs=0 l=1 rev1=1 crypto rx=0x7f93a80a4270 tx=0x7f93940057f0 comp rx=0 tx=0).stop 2023-11-04T15:39:30.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.858+0000 7f93ac8b6640 1 -- 172.21.15.19:0/1539084590 shutdown_connections 2023-11-04T15:39:30.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.858+0000 7f93ac8b6640 1 --2- 172.21.15.19:0/1539084590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93940047c0 0x7f9394004c40 unknown :-1 s=CLOSED pgs=3791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:30.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.858+0000 7f93ac8b6640 1 -- 172.21.15.19:0/1539084590 >> 172.21.15.19:0/1539084590 conn(0x7f93a80a8d70 msgr2=0x7f93a80a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:39:30.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.858+0000 7f93ac8b6640 1 -- 172.21.15.19:0/1539084590 shutdown_connections 2023-11-04T15:39:30.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.858+0000 7f93ac8b6640 1 -- 172.21.15.19:0/1539084590 wait complete. 2023-11-04T15:39:30.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.859+0000 7f93ac8b6640 1 Processor -- start 2023-11-04T15:39:30.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.859+0000 7f93ac8b6640 1 -- start start 2023-11-04T15:39:30.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.859+0000 7f93ac8b6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93940047c0 0x7f93a8097a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:30.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.860+0000 7f93ac8b6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93a809c3e0 0x7f93a8097f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:30.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.860+0000 7f93ac8b6640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f93a8098480 0x7f93a8133a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:30.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.860+0000 7f93ac8b6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a809a360 con 0x7f93940047c0 2023-11-04T15:39:30.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.860+0000 7f93ac8b6640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a8098ef0 con 0x7f93a809c3e0 2023-11-04T15:39:30.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.860+0000 7f93ac8b6640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a809a760 con 0x7f93a8098480 2023-11-04T15:39:30.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.860+0000 7f93a659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93940047c0 0x7f93a8097a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:30.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.860+0000 7f93a659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93940047c0 0x7f93a8097a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56456/0 (socket says 172.21.15.19:56456) 2023-11-04T15:39:30.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.860+0000 7f93a659c640 1 -- 172.21.15.19:0/1501520147 learned_addr learned my addr 172.21.15.19:0/1501520147 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:39:30.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.860+0000 7f93a6d9d640 1 --2- 172.21.15.19:0/1501520147 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f93a8098480 0x7f93a8133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:30.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.860+0000 7f939dd9b640 1 --2- 172.21.15.19:0/1501520147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93a809c3e0 0x7f93a8097f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:30.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.860+0000 7f93a659c640 1 -- 172.21.15.19:0/1501520147 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f93a8098480 msgr2=0x7f93a8133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:30.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.860+0000 7f93a659c640 1 --2- 172.21.15.19:0/1501520147 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f93a8098480 0x7f93a8133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:30.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.860+0000 7f93a659c640 1 -- 172.21.15.19:0/1501520147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93a809c3e0 msgr2=0x7f93a8097f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:30.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.860+0000 7f93a659c640 1 --2- 172.21.15.19:0/1501520147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93a809c3e0 0x7f93a8097f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:30.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.860+0000 7f93a659c640 1 -- 172.21.15.19:0/1501520147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a809b740 con 0x7f93940047c0 2023-11-04T15:39:30.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.860+0000 7f93a6d9d640 1 --2- 172.21.15.19:0/1501520147 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f93a8098480 0x7f93a8133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T15:39:30.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.860+0000 7f93a659c640 1 --2- 172.21.15.19:0/1501520147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93940047c0 0x7f93a8097a00 secure :-1 s=READY pgs=3792 cs=0 l=1 rev1=1 crypto rx=0x7f9398007290 tx=0x7f9398007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:39:30.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.860+0000 7f939f7fe640 1 -- 172.21.15.19:0/1501520147 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9398001630 con 0x7f93940047c0 2023-11-04T15:39:30.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.860+0000 7f939f7fe640 1 -- 172.21.15.19:0/1501520147 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f939800f9c0 con 0x7f93940047c0 2023-11-04T15:39:30.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.860+0000 7f939f7fe640 1 -- 172.21.15.19:0/1501520147 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939800fd70 con 0x7f93940047c0 2023-11-04T15:39:30.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.860+0000 7f93ac8b6640 1 -- 172.21.15.19:0/1501520147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93a80999f0 con 0x7f93940047c0 2023-11-04T15:39:30.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.860+0000 7f93ac8b6640 1 -- 172.21.15.19:0/1501520147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a809b2e0 con 0x7f93940047c0 2023-11-04T15:39:30.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.861+0000 7f93ac8b6640 1 -- 172.21.15.19:0/1501520147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93a8067d60 con 0x7f93940047c0 2023-11-04T15:39:30.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.862+0000 7f939f7fe640 1 -- 172.21.15.19:0/1501520147 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f939801d460 con 0x7f93940047c0 2023-11-04T15:39:30.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.862+0000 7f939f7fe640 1 --2- 172.21.15.19:0/1501520147 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f938806a460 0x7f938806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:30.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.862+0000 7f939f7fe640 1 -- 172.21.15.19:0/1501520147 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4434+0+0 (secure 0 0 0) 0x7f9398088540 con 0x7f93940047c0 2023-11-04T15:39:30.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.862+0000 7f939dd9b640 1 --2- 172.21.15.19:0/1501520147 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f938806a460 0x7f938806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:30.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.863+0000 7f939dd9b640 1 --2- 172.21.15.19:0/1501520147 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f938806a460 0x7f938806c920 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9390033000 tx=0x7f9390009030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:39:30.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:30.866+0000 7f939f7fe640 1 -- 172.21.15.19:0/1501520147 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9398053f90 con 0x7f93940047c0 2023-11-04T15:39:31.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.080+0000 7f93ac8b6640 1 -- 172.21.15.19:0/1501520147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93a8136250 con 0x7f93940047c0 2023-11-04T15:39:31.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.080+0000 7f939f7fe640 1 -- 172.21.15.19:0/1501520147 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3130 (secure 0 0 0) 0x7f93980575b0 con 0x7f93940047c0 2023-11-04T15:39:31.083 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:39:31.084 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4219,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6819/3642584554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3642584554},{"type":"v1","addr":"172.21.15.96:6819","nonce":3642584554}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T15:27:36.125743+0000","modified":"2023-11-04T15:27:38.140154+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6817/2992197248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2992197248},{"type":"v1","addr":"172.21.15.19:6817","nonce":2992197248}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T15:39:31.085 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 6 2023-11-04T15:39:31.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.082+0000 7f93ac8b6640 1 -- 172.21.15.19:0/1501520147 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f938806a460 msgr2=0x7f938806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:31.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.082+0000 7f93ac8b6640 1 --2- 172.21.15.19:0/1501520147 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f938806a460 0x7f938806c920 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9390033000 tx=0x7f9390009030 comp rx=0 tx=0).stop 2023-11-04T15:39:31.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.082+0000 7f93ac8b6640 1 -- 172.21.15.19:0/1501520147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93940047c0 msgr2=0x7f93a8097a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:31.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.082+0000 7f93ac8b6640 1 --2- 172.21.15.19:0/1501520147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93940047c0 0x7f93a8097a00 secure :-1 s=READY pgs=3792 cs=0 l=1 rev1=1 crypto rx=0x7f9398007290 tx=0x7f9398007750 comp rx=0 tx=0).stop 2023-11-04T15:39:31.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.082+0000 7f93ac8b6640 1 -- 172.21.15.19:0/1501520147 shutdown_connections 2023-11-04T15:39:31.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.082+0000 7f93ac8b6640 1 --2- 172.21.15.19:0/1501520147 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f938806a460 0x7f938806c920 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:31.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.082+0000 7f93ac8b6640 1 --2- 172.21.15.19:0/1501520147 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f93a8098480 0x7f93a8133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:31.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.082+0000 7f93ac8b6640 1 --2- 172.21.15.19:0/1501520147 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93a809c3e0 0x7f93a8097f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:31.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.082+0000 7f93ac8b6640 1 --2- 172.21.15.19:0/1501520147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93940047c0 0x7f93a8097a00 unknown :-1 s=CLOSED pgs=3792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:31.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.082+0000 7f93ac8b6640 1 -- 172.21.15.19:0/1501520147 >> 172.21.15.19:0/1501520147 conn(0x7f93a80a8d70 msgr2=0x7f93a80aab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:39:31.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.082+0000 7f93ac8b6640 1 -- 172.21.15.19:0/1501520147 shutdown_connections 2023-11-04T15:39:31.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.082+0000 7f93ac8b6640 1 -- 172.21.15.19:0/1501520147 wait complete. 2023-11-04T15:39:31.095 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T15:39:31.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.199+0000 7fa3e304c640 1 Processor -- start 2023-11-04T15:39:31.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.199+0000 7fa3e304c640 1 -- start start 2023-11-04T15:39:31.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.199+0000 7fa3e304c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3dc137700 0x7fa3dc143350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:31.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.199+0000 7fa3e304c640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3dc13ae20 con 0x7fa3dc06b590 2023-11-04T15:39:31.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.199+0000 7fa3e304c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3dc06c900 con 0x7fa3dc137320 2023-11-04T15:39:31.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.199+0000 7fa3e304c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc06c6f0 con 0x7fa3dc137700 2023-11-04T15:39:31.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.199+0000 7fa3dbfff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa3dc06b590 0x7fa3dc13a710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53314/0 (socket says 172.21.15.19:53314) 2023-11-04T15:39:31.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.199+0000 7fa3dbfff640 1 -- 172.21.15.19:0/3589795077 learned_addr learned my addr 172.21.15.19:0/3589795077 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:39:31.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.199+0000 7fa3e15e9640 1 --2- 172.21.15.19:0/3589795077 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3dc137700 0x7fa3dc143350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:31.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.199+0000 7fa3db7fe640 1 -- 172.21.15.19:0/3589795077 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 546464496 0 0) 0x7fa3dc13ae20 con 0x7fa3dc06b590 2023-11-04T15:39:31.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.200+0000 7fa3db7fe640 1 -- 172.21.15.19:0/3589795077 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3cc003520 con 0x7fa3dc06b590 2023-11-04T15:39:31.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.200+0000 7fa3db7fe640 1 -- 172.21.15.19:0/3589795077 <== mon.1 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3829888300 0 0) 0x7fa3dc06c900 con 0x7fa3dc137320 2023-11-04T15:39:31.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.200+0000 7fa3db7fe640 1 -- 172.21.15.19:0/3589795077 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3dc13ae20 con 0x7fa3dc137320 2023-11-04T15:39:31.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.200+0000 7fa3db7fe640 1 -- 172.21.15.19:0/3589795077 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 48079383 0 0) 0x7fa3cc003520 con 0x7fa3dc06b590 2023-11-04T15:39:31.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.200+0000 7fa3db7fe640 1 -- 172.21.15.19:0/3589795077 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3dc137700 msgr2=0x7fa3dc143350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:39:31.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.200+0000 7fa3db7fe640 1 --2- 172.21.15.19:0/3589795077 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3dc137700 0x7fa3dc143350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:31.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.200+0000 7fa3db7fe640 1 -- 172.21.15.19:0/3589795077 >> v1:172.21.15.96:6789/0 conn(0x7fa3dc137320 legacy=0x7fa3dc13a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:31.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.200+0000 7fa3db7fe640 1 -- 172.21.15.19:0/3589795077 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3dc0a6810 con 0x7fa3dc06b590 2023-11-04T15:39:31.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.200+0000 7fa3db7fe640 1 -- 172.21.15.19:0/3589795077 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3646097784 0 0) 0x7fa3c8001670 con 0x7fa3dc06b590 2023-11-04T15:39:31.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.200+0000 7fa3db7fe640 1 -- 172.21.15.19:0/3589795077 >> v1:172.21.15.19:6789/0 conn(0x7fa3dc06b590 legacy=0x7fa3dc13a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:31.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.200+0000 7fa3db7fe640 1 --2- 172.21.15.19:0/3589795077 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3dc137700 0x7fa3cc003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:31.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.200+0000 7fa3db7fe640 1 --2- 172.21.15.19:0/3589795077 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3cc0040e0 0x7fa3cc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:31.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.200+0000 7fa3db7fe640 1 --2- 172.21.15.19:0/3589795077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3cc004d00 0x7fa3cc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:31.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.200+0000 7fa3db7fe640 1 -- 172.21.15.19:0/3589795077 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc06c6f0 con 0x7fa3cc0040e0 2023-11-04T15:39:31.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.200+0000 7fa3db7fe640 1 -- 172.21.15.19:0/3589795077 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc00bb40 con 0x7fa3cc004d00 2023-11-04T15:39:31.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.200+0000 7fa3db7fe640 1 -- 172.21.15.19:0/3589795077 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc00bd00 con 0x7fa3dc137700 2023-11-04T15:39:31.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.200+0000 7fa3dbfff640 1 --2- 172.21.15.19:0/3589795077 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3cc0040e0 0x7fa3cc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:31.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.200+0000 7fa3e0de8640 1 --2- 172.21.15.19:0/3589795077 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3dc137700 0x7fa3cc003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:31.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.200+0000 7fa3e15e9640 1 --2- 172.21.15.19:0/3589795077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3cc004d00 0x7fa3cc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:31.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.200+0000 7fa3dbfff640 1 -- 172.21.15.19:0/3589795077 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3dc137700 msgr2=0x7fa3cc003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:39:31.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.200+0000 7fa3dbfff640 1 --2- 172.21.15.19:0/3589795077 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3dc137700 0x7fa3cc003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:31.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.200+0000 7fa3dbfff640 1 -- 172.21.15.19:0/3589795077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3cc004d00 msgr2=0x7fa3cc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:39:31.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.200+0000 7fa3dbfff640 1 --2- 172.21.15.19:0/3589795077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3cc004d00 0x7fa3cc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:31.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.200+0000 7fa3dbfff640 1 -- 172.21.15.19:0/3589795077 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3cc003520 con 0x7fa3cc0040e0 2023-11-04T15:39:31.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.201+0000 7fa3dbfff640 1 --2- 172.21.15.19:0/3589795077 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3cc0040e0 0x7fa3cc0047c0 secure :-1 s=READY pgs=3794 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8007fa0 tx=0x7fa3cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40eb400b25fa33d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:39:31.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.201+0000 7fa3db7fe640 1 -- 172.21.15.19:0/3589795077 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c8005ad0 con 0x7fa3cc0040e0 2023-11-04T15:39:31.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.201+0000 7fa3db7fe640 1 -- 172.21.15.19:0/3589795077 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa3c8005c30 con 0x7fa3cc0040e0 2023-11-04T15:39:31.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.201+0000 7fa3db7fe640 1 -- 172.21.15.19:0/3589795077 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c80072d0 con 0x7fa3cc0040e0 2023-11-04T15:39:31.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.202+0000 7fa3e304c640 1 -- 172.21.15.19:0/3589795077 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3cc0040e0 msgr2=0x7fa3cc0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:31.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.202+0000 7fa3e304c640 1 --2- 172.21.15.19:0/3589795077 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3cc0040e0 0x7fa3cc0047c0 secure :-1 s=READY pgs=3794 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8007fa0 tx=0x7fa3cc0057f0 comp rx=0 tx=0).stop 2023-11-04T15:39:31.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.202+0000 7fa3e15e9640 1 -- 172.21.15.19:0/3589795077 reap_dead start 2023-11-04T15:39:31.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.202+0000 7fa3e304c640 1 -- 172.21.15.19:0/3589795077 shutdown_connections 2023-11-04T15:39:31.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.202+0000 7fa3e304c640 1 -- 172.21.15.19:0/3589795077 >> 172.21.15.19:0/3589795077 conn(0x7fa3dc0a6b70 msgr2=0x7fa3dc0a6f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:39:31.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.202+0000 7fa3e304c640 1 -- 172.21.15.19:0/3589795077 shutdown_connections 2023-11-04T15:39:31.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.202+0000 7fa3e304c640 1 -- 172.21.15.19:0/3589795077 wait complete. 2023-11-04T15:39:31.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.203+0000 7fa3e304c640 1 Processor -- start 2023-11-04T15:39:31.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.203+0000 7fa3e304c640 1 -- start start 2023-11-04T15:39:31.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.203+0000 7fa3e304c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3cc0040e0 0x7fa3dc132c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:31.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.203+0000 7fa3e304c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3dc133140 0x7fa3dc09be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:31.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.203+0000 7fa3e304c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3dc09c350 0x7fa3dc09c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:31.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.203+0000 7fa3e304c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc09f9f0 con 0x7fa3dc09c350 2023-11-04T15:39:31.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.203+0000 7fa3e304c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc0a3b80 con 0x7fa3dc133140 2023-11-04T15:39:31.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.203+0000 7fa3e304c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc09e750 con 0x7fa3cc0040e0 2023-11-04T15:39:31.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.203+0000 7fa3e15e9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3dc09c350 0x7fa3dc09c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:31.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.203+0000 7fa3e15e9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3dc09c350 0x7fa3dc09c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56470/0 (socket says 172.21.15.19:56470) 2023-11-04T15:39:31.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.203+0000 7fa3e15e9640 1 -- 172.21.15.19:0/3317825357 learned_addr learned my addr 172.21.15.19:0/3317825357 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:39:31.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.204+0000 7fa3e15e9640 1 -- 172.21.15.19:0/3317825357 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3cc0040e0 msgr2=0x7fa3dc132c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:31.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.204+0000 7fa3dbfff640 1 --2- 172.21.15.19:0/3317825357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3dc133140 0x7fa3dc09be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:31.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.204+0000 7fa3e0de8640 1 --2- 172.21.15.19:0/3317825357 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3cc0040e0 0x7fa3dc132c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:31.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.204+0000 7fa3e15e9640 1 --2- 172.21.15.19:0/3317825357 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3cc0040e0 0x7fa3dc132c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:31.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.204+0000 7fa3e15e9640 1 -- 172.21.15.19:0/3317825357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3dc133140 msgr2=0x7fa3dc09be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:31.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.204+0000 7fa3e15e9640 1 --2- 172.21.15.19:0/3317825357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3dc133140 0x7fa3dc09be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:31.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.204+0000 7fa3e15e9640 1 -- 172.21.15.19:0/3317825357 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3dc0a2e60 con 0x7fa3dc09c350 2023-11-04T15:39:31.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.204+0000 7fa3e15e9640 1 --2- 172.21.15.19:0/3317825357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3dc09c350 0x7fa3dc09c7d0 secure :-1 s=READY pgs=3795 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc0a1190 tx=0x7fa3d400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:39:31.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.204+0000 7fa3d97fa640 1 -- 172.21.15.19:0/3317825357 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d400e040 con 0x7fa3dc09c350 2023-11-04T15:39:31.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.204+0000 7fa3d97fa640 1 -- 172.21.15.19:0/3317825357 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa3d400f040 con 0x7fa3dc09c350 2023-11-04T15:39:31.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.204+0000 7fa3e304c640 1 -- 172.21.15.19:0/3317825357 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3dc09d620 con 0x7fa3dc09c350 2023-11-04T15:39:31.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.204+0000 7fa3d97fa640 1 -- 172.21.15.19:0/3317825357 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4015430 con 0x7fa3dc09c350 2023-11-04T15:39:31.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.204+0000 7fa3e304c640 1 -- 172.21.15.19:0/3317825357 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3dc09ea10 con 0x7fa3dc09c350 2023-11-04T15:39:31.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.205+0000 7fa3e304c640 1 -- 172.21.15.19:0/3317825357 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3dc067d60 con 0x7fa3dc09c350 2023-11-04T15:39:31.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.205+0000 7fa3d97fa640 1 -- 172.21.15.19:0/3317825357 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa3d4015590 con 0x7fa3dc09c350 2023-11-04T15:39:31.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.206+0000 7fa3d97fa640 1 --2- 172.21.15.19:0/3317825357 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa3c006a460 0x7fa3c006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:31.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.206+0000 7fa3d97fa640 1 -- 172.21.15.19:0/3317825357 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4434+0+0 (secure 0 0 0) 0x7fa3d4088e10 con 0x7fa3dc09c350 2023-11-04T15:39:31.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.206+0000 7fa3e0de8640 1 --2- 172.21.15.19:0/3317825357 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa3c006a460 0x7fa3c006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:31.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.206+0000 7fa3e0de8640 1 --2- 172.21.15.19:0/3317825357 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa3c006a460 0x7fa3c006c920 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0000c00 tx=0x7fa3d0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:39:31.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.210+0000 7fa3d97fa640 1 -- 172.21.15.19:0/3317825357 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa3d4054a30 con 0x7fa3dc09c350 2023-11-04T15:39:31.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.421+0000 7fa3e304c640 1 -- 172.21.15.19:0/3317825357 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3dc06b370 con 0x7fa3dc09c350 2023-11-04T15:39:31.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.422+0000 7fa3d97fa640 1 -- 172.21.15.19:0/3317825357 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3130 (secure 0 0 0) 0x7fa3d4022c50 con 0x7fa3dc09c350 2023-11-04T15:39:31.424 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:39:31.425 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4219,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6819/3642584554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3642584554},{"type":"v1","addr":"172.21.15.96:6819","nonce":3642584554}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T15:27:36.125743+0000","modified":"2023-11-04T15:27:38.140154+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6817/2992197248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":2992197248},{"type":"v1","addr":"172.21.15.19:6817","nonce":2992197248}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T15:39:31.426 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 6 2023-11-04T15:39:31.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.423+0000 7fa3e304c640 1 -- 172.21.15.19:0/3317825357 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa3c006a460 msgr2=0x7fa3c006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:31.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.423+0000 7fa3e304c640 1 --2- 172.21.15.19:0/3317825357 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa3c006a460 0x7fa3c006c920 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0000c00 tx=0x7fa3d0009040 comp rx=0 tx=0).stop 2023-11-04T15:39:31.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.423+0000 7fa3e304c640 1 -- 172.21.15.19:0/3317825357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3dc09c350 msgr2=0x7fa3dc09c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:31.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.423+0000 7fa3e304c640 1 --2- 172.21.15.19:0/3317825357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3dc09c350 0x7fa3dc09c7d0 secure :-1 s=READY pgs=3795 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc0a1190 tx=0x7fa3d400f580 comp rx=0 tx=0).stop 2023-11-04T15:39:31.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.423+0000 7fa3e304c640 1 -- 172.21.15.19:0/3317825357 shutdown_connections 2023-11-04T15:39:31.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.423+0000 7fa3e304c640 1 --2- 172.21.15.19:0/3317825357 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fa3c006a460 0x7fa3c006c920 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:31.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.423+0000 7fa3e304c640 1 --2- 172.21.15.19:0/3317825357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3dc09c350 0x7fa3dc09c7d0 unknown :-1 s=CLOSED pgs=3795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:31.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.423+0000 7fa3e304c640 1 --2- 172.21.15.19:0/3317825357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3dc133140 0x7fa3dc09be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:31.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.423+0000 7fa3e304c640 1 --2- 172.21.15.19:0/3317825357 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3cc0040e0 0x7fa3dc132c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:31.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.423+0000 7fa3e304c640 1 -- 172.21.15.19:0/3317825357 >> 172.21.15.19:0/3317825357 conn(0x7fa3dc0a6b70 msgr2=0x7fa3dc137e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:39:31.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.423+0000 7fa3e304c640 1 -- 172.21.15.19:0/3317825357 shutdown_connections 2023-11-04T15:39:31.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.424+0000 7fa3e304c640 1 -- 172.21.15.19:0/3317825357 wait complete. 2023-11-04T15:39:31.436 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T15:39:31.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.540+0000 7f21ad53c640 1 Processor -- start 2023-11-04T15:39:31.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.540+0000 7f21ad53c640 1 -- start start 2023-11-04T15:39:31.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.540+0000 7f21ad53c640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f21a8137270 0x7f21a80a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:31.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.540+0000 7f21ad53c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f21a80a3e90 0x7f21a8139f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:31.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.540+0000 7f21ad53c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a80a4c20 con 0x7f21a8137650 2023-11-04T15:39:31.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.540+0000 7f21ad53c640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a80a3060 con 0x7f21a8137270 2023-11-04T15:39:31.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.540+0000 7f21ad53c640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a80a5080 con 0x7f21a80a3e90 2023-11-04T15:39:31.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.541+0000 7f21a6ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f21a8137270 0x7f21a80a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:31.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.541+0000 7f21a6ffd640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f21a8137270 0x7f21a80a6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56476/0 (socket says 172.21.15.19:56476) 2023-11-04T15:39:31.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.541+0000 7f21a6ffd640 1 -- 172.21.15.19:0/3702981699 learned_addr learned my addr 172.21.15.19:0/3702981699 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:39:31.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.541+0000 7f21a67fc640 1 --2- 172.21.15.19:0/3702981699 >> v2:172.21.15.96:3300/0 conn(0x7f21a80a3e90 0x7f21a8139f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:31.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.541+0000 7f21a6ffd640 1 -- 172.21.15.19:0/3702981699 >> v2:172.21.15.96:3300/0 conn(0x7f21a80a3e90 msgr2=0x7f21a8139f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:39:31.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.541+0000 7f21a6ffd640 1 --2- 172.21.15.19:0/3702981699 >> v2:172.21.15.96:3300/0 conn(0x7f21a80a3e90 0x7f21a8139f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:31.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.541+0000 7f21a6ffd640 1 -- 172.21.15.19:0/3702981699 >> v1:172.21.15.96:6789/0 conn(0x7f21a8137650 legacy=0x7f21a813a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:31.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.541+0000 7f21a6ffd640 1 -- 172.21.15.19:0/3702981699 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a80a3440 con 0x7f21a8137270 2023-11-04T15:39:31.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.542+0000 7f21a6ffd640 1 --2- 172.21.15.19:0/3702981699 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21a8137270 0x7f21a80a6200 secure :-1 s=READY pgs=3796 cs=0 l=1 rev1=1 crypto rx=0x7f21a80aa140 tx=0x7f219802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f20501408520502 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:39:31.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.542+0000 7f21a5ffb640 1 -- 172.21.15.19:0/3702981699 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219802c9f0 con 0x7f21a8137270 2023-11-04T15:39:31.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.542+0000 7f21a5ffb640 1 -- 172.21.15.19:0/3702981699 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f219802cb50 con 0x7f21a8137270 2023-11-04T15:39:31.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.542+0000 7f21a5ffb640 1 -- 172.21.15.19:0/3702981699 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21980343f0 con 0x7f21a8137270 2023-11-04T15:39:31.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.542+0000 7f21ad53c640 1 -- 172.21.15.19:0/3702981699 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21a8137270 msgr2=0x7f21a80a6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:31.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.542+0000 7f21ad53c640 1 --2- 172.21.15.19:0/3702981699 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21a8137270 0x7f21a80a6200 secure :-1 s=READY pgs=3796 cs=0 l=1 rev1=1 crypto rx=0x7f21a80aa140 tx=0x7f219802be50 comp rx=0 tx=0).stop 2023-11-04T15:39:31.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.542+0000 7f21ad53c640 1 -- 172.21.15.19:0/3702981699 shutdown_connections 2023-11-04T15:39:31.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.542+0000 7f21ad53c640 1 --2- 172.21.15.19:0/3702981699 >> v2:172.21.15.96:3300/0 conn(0x7f21a80a3e90 0x7f21a8139f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:31.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.542+0000 7f21ad53c640 1 --2- 172.21.15.19:0/3702981699 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21a8137270 0x7f21a80a6200 unknown :-1 s=CLOSED pgs=3796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:31.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.542+0000 7f21ad53c640 1 -- 172.21.15.19:0/3702981699 >> 172.21.15.19:0/3702981699 conn(0x7f21a80a8d70 msgr2=0x7f21a80a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:39:31.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.542+0000 7f21ad53c640 1 -- 172.21.15.19:0/3702981699 shutdown_connections 2023-11-04T15:39:31.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.542+0000 7f21ad53c640 1 -- 172.21.15.19:0/3702981699 wait complete. 2023-11-04T15:39:31.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.543+0000 7f21ad53c640 1 Processor -- start 2023-11-04T15:39:31.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.543+0000 7f21ad53c640 1 -- start start 2023-11-04T15:39:31.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.544+0000 7f21ad53c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f21a80a3e90 0x7f21a81ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:31.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.544+0000 7f21ad53c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21a8137270 0x7f21a81cf400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:31.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.544+0000 7f21ad53c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21a8137650 0x7f21a81cf940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:31.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.544+0000 7f21ad53c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a80a1e60 con 0x7f21a8137650 2023-11-04T15:39:31.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.544+0000 7f21ad53c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a809f780 con 0x7f21a8137270 2023-11-04T15:39:31.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.544+0000 7f21ad53c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a809f220 con 0x7f21a80a3e90 2023-11-04T15:39:31.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.544+0000 7f21a77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21a8137650 0x7f21a81cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:31.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.544+0000 7f21a77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21a8137650 0x7f21a81cf940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56482/0 (socket says 172.21.15.19:56482) 2023-11-04T15:39:31.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.544+0000 7f21a77fe640 1 -- 172.21.15.19:0/674707998 learned_addr learned my addr 172.21.15.19:0/674707998 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:39:31.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.544+0000 7f21a67fc640 1 --2- 172.21.15.19:0/674707998 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21a8137270 0x7f21a81cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:31.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.544+0000 7f21a6ffd640 1 --2- 172.21.15.19:0/674707998 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f21a80a3e90 0x7f21a81ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:31.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.544+0000 7f21a77fe640 1 -- 172.21.15.19:0/674707998 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f21a80a3e90 msgr2=0x7f21a81ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:31.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.544+0000 7f21a77fe640 1 --2- 172.21.15.19:0/674707998 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f21a80a3e90 0x7f21a81ceec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:31.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.544+0000 7f21a77fe640 1 -- 172.21.15.19:0/674707998 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21a8137270 msgr2=0x7f21a81cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:31.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.544+0000 7f21a77fe640 1 --2- 172.21.15.19:0/674707998 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21a8137270 0x7f21a81cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:31.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.544+0000 7f21a77fe640 1 -- 172.21.15.19:0/674707998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2198009b30 con 0x7f21a8137650 2023-11-04T15:39:31.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.545+0000 7f21a77fe640 1 --2- 172.21.15.19:0/674707998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21a8137650 0x7f21a81cf940 secure :-1 s=READY pgs=3797 cs=0 l=1 rev1=1 crypto rx=0x7f21a0001eb0 tx=0x7f21a000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:39:31.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.545+0000 7f219f7fe640 1 -- 172.21.15.19:0/674707998 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a00052d0 con 0x7f21a8137650 2023-11-04T15:39:31.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.545+0000 7f219f7fe640 1 -- 172.21.15.19:0/674707998 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f21a0005430 con 0x7f21a8137650 2023-11-04T15:39:31.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.545+0000 7f21ad53c640 1 -- 172.21.15.19:0/674707998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a809da20 con 0x7f21a8137650 2023-11-04T15:39:31.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.545+0000 7f219f7fe640 1 -- 172.21.15.19:0/674707998 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a0003830 con 0x7f21a8137650 2023-11-04T15:39:31.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.545+0000 7f21ad53c640 1 -- 172.21.15.19:0/674707998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a809fd20 con 0x7f21a8137650 2023-11-04T15:39:31.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.546+0000 7f21ad53c640 1 -- 172.21.15.19:0/674707998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21a8067d60 con 0x7f21a8137650 2023-11-04T15:39:31.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.546+0000 7f219f7fe640 1 -- 172.21.15.19:0/674707998 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f21a0003990 con 0x7f21a8137650 2023-11-04T15:39:31.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.547+0000 7f219f7fe640 1 --2- 172.21.15.19:0/674707998 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f218806a430 0x7f218806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:31.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.547+0000 7f219f7fe640 1 -- 172.21.15.19:0/674707998 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4434+0+0 (secure 0 0 0) 0x7f21a00877e0 con 0x7f21a8137650 2023-11-04T15:39:31.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.547+0000 7f21a6ffd640 1 --2- 172.21.15.19:0/674707998 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f218806a430 0x7f218806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:31.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.547+0000 7f21a6ffd640 1 --2- 172.21.15.19:0/674707998 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f218806a430 0x7f218806c8f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2198035000 tx=0x7f2198030000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:39:31.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.551+0000 7f219f7fe640 1 -- 172.21.15.19:0/674707998 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f21a0053370 con 0x7f21a8137650 2023-11-04T15:39:31.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.727+0000 7f21ad53c640 1 -- 172.21.15.19:0/674707998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21a809da20 con 0x7f21a8137650 2023-11-04T15:39:31.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.728+0000 7f219f7fe640 1 -- 172.21.15.19:0/674707998 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+13353 (secure 0 0 0) 0x7f21a809da20 con 0x7f21a8137650 2023-11-04T15:39:31.730 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:39:31.731 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":44,"fsid":"e87311d5-496a-4b07-9654-358fe5bbf950","created":"2023-11-04T15:27:14.865121+0000","modified":"2023-11-04T15:37:04.713203+0000","last_up_change":"2023-11-04T15:27:24.162282+0000","last_in_change":"2023-11-04T15:27:15.971035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T15:27:24.987312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-04T15:27:30.500235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-04T15:27:34.476271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-04T15:27:35.096759+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":65,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"34818469-ebf2-4dd4-8119-af19a0121036","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":82879},{"type":"v1","addr":"172.21.15.19:6801","nonce":82879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":82879},{"type":"v1","addr":"172.21.15.19:6803","nonce":82879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":82879},{"type":"v1","addr":"172.21.15.19:6807","nonce":82879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":82879},{"type":"v1","addr":"172.21.15.19:6805","nonce":82879}]},"public_addr":"172.21.15.19:6801/82879","cluster_addr":"172.21.15.19:6803/82879","heartbeat_back_addr":"172.21.15.19:6807/82879","heartbeat_front_addr":"172.21.15.19:6805/82879","state":["exists","up"]},{"osd":1,"uuid":"92dab290-7912-4eea-b6f6-c754c2480721","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":82880},{"type":"v1","addr":"172.21.15.19:6809","nonce":82880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":82880},{"type":"v1","addr":"172.21.15.19:6811","nonce":82880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":82880},{"type":"v1","addr":"172.21.15.19:6815","nonce":82880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":82880},{"type":"v1","addr":"172.21.15.19:6813","nonce":82880}]},"public_addr":"172.21.15.19:6809/82880","cluster_addr":"172.21.15.19:6811/82880","heartbeat_back_addr":"172.21.15.19:6815/82880","heartbeat_front_addr":"172.21.15.19:6813/82880","state":["exists","up"]},{"osd":2,"uuid":"1be47db4-6dd1-4ce5-832b-bc6ad30c78c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":83458},{"type":"v1","addr":"172.21.15.96:6808","nonce":83458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":83458},{"type":"v1","addr":"172.21.15.96:6811","nonce":83458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":83458},{"type":"v1","addr":"172.21.15.96:6815","nonce":83458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":83458},{"type":"v1","addr":"172.21.15.96:6813","nonce":83458}]},"public_addr":"172.21.15.96:6808/83458","cluster_addr":"172.21.15.96:6811/83458","heartbeat_back_addr":"172.21.15.96:6815/83458","heartbeat_front_addr":"172.21.15.96:6813/83458","state":["exists","up"]},{"osd":3,"uuid":"46505800-d64f-49ef-b811-5b5979f48252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":83459},{"type":"v1","addr":"172.21.15.96:6801","nonce":83459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":83459},{"type":"v1","addr":"172.21.15.96:6803","nonce":83459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6807","nonce":83459},{"type":"v1","addr":"172.21.15.96:6809","nonce":83459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":83459},{"type":"v1","addr":"172.21.15.96:6805","nonce":83459}]},"public_addr":"172.21.15.96:6801/83459","cluster_addr":"172.21.15.96:6803/83459","heartbeat_back_addr":"172.21.15.96:6809/83459","heartbeat_front_addr":"172.21.15.96:6805/83459","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.081547+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.132075+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.094919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T15:27:21.074106+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.24","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.130:0/185843238":"2023-11-04T16:36:55.500269+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":4,"snaps":[{"begin":60,"length":6}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T15:39:31.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.730+0000 7f21ad53c640 1 -- 172.21.15.19:0/674707998 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f218806a430 msgr2=0x7f218806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:31.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.730+0000 7f21ad53c640 1 --2- 172.21.15.19:0/674707998 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f218806a430 0x7f218806c8f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2198035000 tx=0x7f2198030000 comp rx=0 tx=0).stop 2023-11-04T15:39:31.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.730+0000 7f21ad53c640 1 -- 172.21.15.19:0/674707998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21a8137650 msgr2=0x7f21a81cf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:31.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.730+0000 7f21ad53c640 1 --2- 172.21.15.19:0/674707998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21a8137650 0x7f21a81cf940 secure :-1 s=READY pgs=3797 cs=0 l=1 rev1=1 crypto rx=0x7f21a0001eb0 tx=0x7f21a000c890 comp rx=0 tx=0).stop 2023-11-04T15:39:31.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.730+0000 7f21ad53c640 1 -- 172.21.15.19:0/674707998 shutdown_connections 2023-11-04T15:39:31.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.730+0000 7f21ad53c640 1 --2- 172.21.15.19:0/674707998 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f218806a430 0x7f218806c8f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:31.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.730+0000 7f21ad53c640 1 --2- 172.21.15.19:0/674707998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21a8137650 0x7f21a81cf940 unknown :-1 s=CLOSED pgs=3797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:31.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.730+0000 7f21ad53c640 1 --2- 172.21.15.19:0/674707998 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21a8137270 0x7f21a81cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:31.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.730+0000 7f21ad53c640 1 --2- 172.21.15.19:0/674707998 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f21a80a3e90 0x7f21a81ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:31.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.730+0000 7f21ad53c640 1 -- 172.21.15.19:0/674707998 >> 172.21.15.19:0/674707998 conn(0x7f21a80a8d70 msgr2=0x7f21a8139d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:39:31.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.730+0000 7f21ad53c640 1 -- 172.21.15.19:0/674707998 shutdown_connections 2023-11-04T15:39:31.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.730+0000 7f21ad53c640 1 -- 172.21.15.19:0/674707998 wait complete. 2023-11-04T15:39:31.743 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-04T15:39:31.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.848+0000 7f497968b640 1 Processor -- start 2023-11-04T15:39:31.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.848+0000 7f497968b640 1 -- start start 2023-11-04T15:39:31.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.849+0000 7f497968b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4974138a00 0x7f49740a31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:31.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.849+0000 7f497968b640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f497406ddb0 con 0x7f497413e0f0 2023-11-04T15:39:31.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.849+0000 7f497968b640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f497406e5b0 con 0x7f4974138620 2023-11-04T15:39:31.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.849+0000 7f497968b640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4974137ed0 con 0x7f4974138a00 2023-11-04T15:39:31.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.849+0000 7f49737fe640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f497413e0f0 0x7f49741404e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53330/0 (socket says 172.21.15.19:53330) 2023-11-04T15:39:31.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.849+0000 7f49737fe640 1 -- 172.21.15.19:0/2490065236 learned_addr learned my addr 172.21.15.19:0/2490065236 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:39:31.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.849+0000 7f49727fc640 1 --2- 172.21.15.19:0/2490065236 >> v2:172.21.15.96:3300/0 conn(0x7f4974138a00 0x7f49740a31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:31.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.849+0000 7f4971ffb640 1 -- 172.21.15.19:0/2490065236 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3363782045 0 0) 0x7f497406ddb0 con 0x7f497413e0f0 2023-11-04T15:39:31.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.849+0000 7f4971ffb640 1 -- 172.21.15.19:0/2490065236 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4960003520 con 0x7f497413e0f0 2023-11-04T15:39:31.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.849+0000 7f4971ffb640 1 -- 172.21.15.19:0/2490065236 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3481358557 0 0) 0x7f4960003520 con 0x7f497413e0f0 2023-11-04T15:39:31.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.849+0000 7f4971ffb640 1 -- 172.21.15.19:0/2490065236 >> v2:172.21.15.96:3300/0 conn(0x7f4974138a00 msgr2=0x7f49740a31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:39:31.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.849+0000 7f4971ffb640 1 --2- 172.21.15.19:0/2490065236 >> v2:172.21.15.96:3300/0 conn(0x7f4974138a00 0x7f49740a31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:31.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.849+0000 7f4971ffb640 1 -- 172.21.15.19:0/2490065236 >> v1:172.21.15.96:6789/0 conn(0x7f4974138620 legacy=0x7f49740a2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:31.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.849+0000 7f4971ffb640 1 -- 172.21.15.19:0/2490065236 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49740a1fa0 con 0x7f497413e0f0 2023-11-04T15:39:31.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.849+0000 7f4971ffb640 1 -- 172.21.15.19:0/2490065236 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3646097784 0 0) 0x7f49640019f0 con 0x7f497413e0f0 2023-11-04T15:39:31.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.850+0000 7f4971ffb640 1 -- 172.21.15.19:0/2490065236 >> v1:172.21.15.19:6789/0 conn(0x7f497413e0f0 legacy=0x7f49741404e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:31.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.850+0000 7f4971ffb640 1 --2- 172.21.15.19:0/2490065236 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4960003970 0x7f4960003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:31.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.850+0000 7f4971ffb640 1 --2- 172.21.15.19:0/2490065236 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49600047c0 0x7f4960004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:31.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.850+0000 7f4971ffb640 1 --2- 172.21.15.19:0/2490065236 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49600052a0 0x7f496000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:31.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.850+0000 7f4971ffb640 1 -- 172.21.15.19:0/2490065236 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4974137ed0 con 0x7f49600047c0 2023-11-04T15:39:31.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.850+0000 7f4971ffb640 1 -- 172.21.15.19:0/2490065236 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496000c170 con 0x7f49600052a0 2023-11-04T15:39:31.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.850+0000 7f4971ffb640 1 -- 172.21.15.19:0/2490065236 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f496000c330 con 0x7f4960003970 2023-11-04T15:39:31.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.850+0000 7f49727fc640 1 --2- 172.21.15.19:0/2490065236 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49600047c0 0x7f4960004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:31.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.850+0000 7f4972ffd640 1 --2- 172.21.15.19:0/2490065236 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4960003970 0x7f4960003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:31.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.850+0000 7f49737fe640 1 --2- 172.21.15.19:0/2490065236 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49600052a0 0x7f496000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:31.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.850+0000 7f49727fc640 1 -- 172.21.15.19:0/2490065236 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4960003970 msgr2=0x7f4960003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:39:31.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.850+0000 7f49727fc640 1 --2- 172.21.15.19:0/2490065236 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4960003970 0x7f4960003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:31.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.850+0000 7f49727fc640 1 -- 172.21.15.19:0/2490065236 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49600052a0 msgr2=0x7f496000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:39:31.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.850+0000 7f49727fc640 1 --2- 172.21.15.19:0/2490065236 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49600052a0 0x7f496000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:31.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.850+0000 7f49727fc640 1 -- 172.21.15.19:0/2490065236 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4960003520 con 0x7f49600047c0 2023-11-04T15:39:31.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.850+0000 7f49737fe640 1 -- 172.21.15.19:0/2490065236 reap_dead start 2023-11-04T15:39:31.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.851+0000 7f49727fc640 1 --2- 172.21.15.19:0/2490065236 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49600047c0 0x7f4960004c40 secure :-1 s=READY pgs=3799 cs=0 l=1 rev1=1 crypto rx=0x7f495c009a90 tx=0x7f49600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f123d78e8bae042d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:39:31.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.851+0000 7f4971ffb640 1 -- 172.21.15.19:0/2490065236 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c02c680 con 0x7f49600047c0 2023-11-04T15:39:31.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.851+0000 7f4971ffb640 1 -- 172.21.15.19:0/2490065236 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f495c02c7e0 con 0x7f49600047c0 2023-11-04T15:39:31.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.851+0000 7f4971ffb640 1 -- 172.21.15.19:0/2490065236 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c02cb90 con 0x7f49600047c0 2023-11-04T15:39:31.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.851+0000 7f497968b640 1 -- 172.21.15.19:0/2490065236 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49600047c0 msgr2=0x7f4960004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:31.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.851+0000 7f497968b640 1 --2- 172.21.15.19:0/2490065236 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49600047c0 0x7f4960004c40 secure :-1 s=READY pgs=3799 cs=0 l=1 rev1=1 crypto rx=0x7f495c009a90 tx=0x7f49600057f0 comp rx=0 tx=0).stop 2023-11-04T15:39:31.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.851+0000 7f497968b640 1 -- 172.21.15.19:0/2490065236 shutdown_connections 2023-11-04T15:39:31.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.851+0000 7f497968b640 1 --2- 172.21.15.19:0/2490065236 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49600047c0 0x7f4960004c40 unknown :-1 s=CLOSED pgs=3799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:31.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.851+0000 7f497968b640 1 -- 172.21.15.19:0/2490065236 >> 172.21.15.19:0/2490065236 conn(0x7f49740a8280 msgr2=0x7f49740a8690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:39:31.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.851+0000 7f497968b640 1 -- 172.21.15.19:0/2490065236 shutdown_connections 2023-11-04T15:39:31.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.851+0000 7f497968b640 1 -- 172.21.15.19:0/2490065236 wait complete. 2023-11-04T15:39:31.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.853+0000 7f497968b640 1 Processor -- start 2023-11-04T15:39:31.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.853+0000 7f497968b640 1 -- start start 2023-11-04T15:39:31.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.853+0000 7f497968b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49600047c0 0x7f49741cf620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:31.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.853+0000 7f497968b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f497409b650 0x7f49741cfb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:31.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.853+0000 7f497968b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49741d00a0 0x7f4974131810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:31.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.853+0000 7f497968b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497413d920 con 0x7f49741d00a0 2023-11-04T15:39:31.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.853+0000 7f497968b640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49740995e0 con 0x7f49600047c0 2023-11-04T15:39:31.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.853+0000 7f497968b640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49740999a0 con 0x7f497409b650 2023-11-04T15:39:31.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.853+0000 7f49737fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49741d00a0 0x7f4974131810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:31.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.853+0000 7f49737fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49741d00a0 0x7f4974131810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56504/0 (socket says 172.21.15.19:56504) 2023-11-04T15:39:31.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.853+0000 7f49737fe640 1 -- 172.21.15.19:0/764411718 learned_addr learned my addr 172.21.15.19:0/764411718 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:39:31.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.853+0000 7f49727fc640 1 --2- 172.21.15.19:0/764411718 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f497409b650 0x7f49741cfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:31.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.853+0000 7f4972ffd640 1 --2- 172.21.15.19:0/764411718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49600047c0 0x7f49741cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:31.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.854+0000 7f49737fe640 1 -- 172.21.15.19:0/764411718 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f497409b650 msgr2=0x7f49741cfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:31.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.854+0000 7f49737fe640 1 --2- 172.21.15.19:0/764411718 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f497409b650 0x7f49741cfb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:31.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.854+0000 7f49737fe640 1 -- 172.21.15.19:0/764411718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49600047c0 msgr2=0x7f49741cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:31.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.854+0000 7f49737fe640 1 --2- 172.21.15.19:0/764411718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49600047c0 0x7f49741cf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:31.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.854+0000 7f49737fe640 1 -- 172.21.15.19:0/764411718 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f497409a9b0 con 0x7f49741d00a0 2023-11-04T15:39:31.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.854+0000 7f49737fe640 1 --2- 172.21.15.19:0/764411718 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49741d00a0 0x7f4974131810 secure :-1 s=READY pgs=3800 cs=0 l=1 rev1=1 crypto rx=0x7f497406caa0 tx=0x7f4964007ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:39:31.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.854+0000 7f496b7fe640 1 -- 172.21.15.19:0/764411718 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496400aab0 con 0x7f49741d00a0 2023-11-04T15:39:31.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.854+0000 7f496b7fe640 1 -- 172.21.15.19:0/764411718 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f496400ac30 con 0x7f49741d00a0 2023-11-04T15:39:31.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.854+0000 7f497968b640 1 -- 172.21.15.19:0/764411718 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f497409e130 con 0x7f49741d00a0 2023-11-04T15:39:31.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.854+0000 7f496b7fe640 1 -- 172.21.15.19:0/764411718 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49640133f0 con 0x7f49741d00a0 2023-11-04T15:39:31.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.854+0000 7f497968b640 1 -- 172.21.15.19:0/764411718 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f497409e610 con 0x7f49741d00a0 2023-11-04T15:39:31.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.855+0000 7f497968b640 1 -- 172.21.15.19:0/764411718 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4974067d60 con 0x7f49741d00a0 2023-11-04T15:39:31.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.855+0000 7f496b7fe640 1 -- 172.21.15.19:0/764411718 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4964013550 con 0x7f49741d00a0 2023-11-04T15:39:31.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.856+0000 7f496b7fe640 1 --2- 172.21.15.19:0/764411718 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f495406a430 0x7f495406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:31.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.856+0000 7f496b7fe640 1 -- 172.21.15.19:0/764411718 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4434+0+0 (secure 0 0 0) 0x7f4964088b30 con 0x7f49741d00a0 2023-11-04T15:39:31.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.856+0000 7f4972ffd640 1 --2- 172.21.15.19:0/764411718 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f495406a430 0x7f495406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:31.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.856+0000 7f4972ffd640 1 --2- 172.21.15.19:0/764411718 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f495406a430 0x7f495406c8f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f496c0017e0 tx=0x7f496c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:39:31.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:31.860+0000 7f496b7fe640 1 -- 172.21.15.19:0/764411718 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4964054750 con 0x7f49741d00a0 2023-11-04T15:39:32.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.076+0000 7f497968b640 1 -- 172.21.15.19:0/764411718 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f49740a6260 con 0x7f49741d00a0 2023-11-04T15:39:32.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.089+0000 7f496b7fe640 1 -- 172.21.15.19:0/764411718 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4964017020 con 0x7f49741d00a0 2023-11-04T15:39:32.092 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-04T15:39:32.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.092+0000 7f497968b640 1 -- 172.21.15.19:0/764411718 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f495406a430 msgr2=0x7f495406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:32.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.092+0000 7f497968b640 1 --2- 172.21.15.19:0/764411718 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f495406a430 0x7f495406c8f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f496c0017e0 tx=0x7f496c009040 comp rx=0 tx=0).stop 2023-11-04T15:39:32.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.092+0000 7f497968b640 1 -- 172.21.15.19:0/764411718 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49741d00a0 msgr2=0x7f4974131810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:32.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.092+0000 7f497968b640 1 --2- 172.21.15.19:0/764411718 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49741d00a0 0x7f4974131810 secure :-1 s=READY pgs=3800 cs=0 l=1 rev1=1 crypto rx=0x7f497406caa0 tx=0x7f4964007ae0 comp rx=0 tx=0).stop 2023-11-04T15:39:32.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.093+0000 7f497968b640 1 -- 172.21.15.19:0/764411718 shutdown_connections 2023-11-04T15:39:32.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.093+0000 7f497968b640 1 --2- 172.21.15.19:0/764411718 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f495406a430 0x7f495406c8f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:32.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.093+0000 7f497968b640 1 --2- 172.21.15.19:0/764411718 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49741d00a0 0x7f4974131810 unknown :-1 s=CLOSED pgs=3800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:32.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.093+0000 7f497968b640 1 --2- 172.21.15.19:0/764411718 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f497409b650 0x7f49741cfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:32.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.093+0000 7f497968b640 1 --2- 172.21.15.19:0/764411718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49600047c0 0x7f49741cf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:32.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.093+0000 7f497968b640 1 -- 172.21.15.19:0/764411718 >> 172.21.15.19:0/764411718 conn(0x7f49740a8280 msgr2=0x7f4974132830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:39:32.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.093+0000 7f497968b640 1 -- 172.21.15.19:0/764411718 shutdown_connections 2023-11-04T15:39:32.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.093+0000 7f497968b640 1 -- 172.21.15.19:0/764411718 wait complete. 2023-11-04T15:39:32.109 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-04T15:39:32.135 INFO:tasks.ceph.mds.a.smithi019.stdout:starting mds.a at 2023-11-04T15:39:32.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.216+0000 7f88e2e26640 1 Processor -- start 2023-11-04T15:39:32.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.216+0000 7f88e2e26640 1 -- start start 2023-11-04T15:39:32.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.216+0000 7f88e2e26640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f88dc135e70 0x7f88dc0a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:32.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.217+0000 7f88e2e26640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f88dc136250 0x7f88dc13a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:32.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.217+0000 7f88e2e26640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f88dc1366b0 0x7f88dc13a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:32.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.217+0000 7f88e2e26640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88dc0a4e30 con 0x7f88dc1366b0 2023-11-04T15:39:32.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.217+0000 7f88e2e26640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88dc0a6740 con 0x7f88dc136250 2023-11-04T15:39:32.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.217+0000 7f88e2e26640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc0a4bb0 con 0x7f88dc135e70 2023-11-04T15:39:32.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.217+0000 7f88e13c3640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f88dc1366b0 0x7f88dc13a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:32.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.217+0000 7f88e13c3640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f88dc1366b0 0x7f88dc13a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56524/0 (socket says 172.21.15.19:56524) 2023-11-04T15:39:32.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.217+0000 7f88e13c3640 1 -- 172.21.15.19:0/1791850849 learned_addr learned my addr 172.21.15.19:0/1791850849 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:39:32.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.217+0000 7f88dbfff640 1 --2- 172.21.15.19:0/1791850849 >> v2:172.21.15.96:3300/0 conn(0x7f88dc136250 0x7f88dc13a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:32.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.217+0000 7f88e0bc2640 1 --2- 172.21.15.19:0/1791850849 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f88dc135e70 0x7f88dc0a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:32.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.217+0000 7f88e13c3640 1 -- 172.21.15.19:0/1791850849 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f88dc135e70 msgr2=0x7f88dc0a6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:39:32.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.217+0000 7f88e13c3640 1 --2- 172.21.15.19:0/1791850849 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f88dc135e70 0x7f88dc0a6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:32.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.217+0000 7f88e13c3640 1 -- 172.21.15.19:0/1791850849 >> v2:172.21.15.96:3300/0 conn(0x7f88dc136250 msgr2=0x7f88dc13a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:39:32.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.217+0000 7f88e13c3640 1 --2- 172.21.15.19:0/1791850849 >> v2:172.21.15.96:3300/0 conn(0x7f88dc136250 0x7f88dc13a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:32.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.217+0000 7f88e13c3640 1 -- 172.21.15.19:0/1791850849 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88dc0a5340 con 0x7f88dc1366b0 2023-11-04T15:39:32.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.217+0000 7f88dbfff640 1 --2- 172.21.15.19:0/1791850849 >> v2:172.21.15.96:3300/0 conn(0x7f88dc136250 0x7f88dc13a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T15:39:32.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.218+0000 7f88e13c3640 1 --2- 172.21.15.19:0/1791850849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88dc1366b0 0x7f88dc13a550 secure :-1 s=READY pgs=3804 cs=0 l=1 rev1=1 crypto rx=0x7f88dc0ad2a0 tx=0x7f88d402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c875775d0e0c75fe server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:39:32.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.218+0000 7f88db7fe640 1 -- 172.21.15.19:0/1791850849 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d402c9e0 con 0x7f88dc1366b0 2023-11-04T15:39:32.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.218+0000 7f88db7fe640 1 -- 172.21.15.19:0/1791850849 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f88d402cb40 con 0x7f88dc1366b0 2023-11-04T15:39:32.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.218+0000 7f88db7fe640 1 -- 172.21.15.19:0/1791850849 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d40343f0 con 0x7f88dc1366b0 2023-11-04T15:39:32.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.218+0000 7f88e2e26640 1 -- 172.21.15.19:0/1791850849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88dc1366b0 msgr2=0x7f88dc13a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:32.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.218+0000 7f88e2e26640 1 --2- 172.21.15.19:0/1791850849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88dc1366b0 0x7f88dc13a550 secure :-1 s=READY pgs=3804 cs=0 l=1 rev1=1 crypto rx=0x7f88dc0ad2a0 tx=0x7f88d402be40 comp rx=0 tx=0).stop 2023-11-04T15:39:32.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.218+0000 7f88e2e26640 1 -- 172.21.15.19:0/1791850849 shutdown_connections 2023-11-04T15:39:32.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.218+0000 7f88e2e26640 1 --2- 172.21.15.19:0/1791850849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88dc1366b0 0x7f88dc13a550 unknown :-1 s=CLOSED pgs=3804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:32.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.218+0000 7f88e2e26640 1 --2- 172.21.15.19:0/1791850849 >> v2:172.21.15.96:3300/0 conn(0x7f88dc136250 0x7f88dc13a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:32.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.218+0000 7f88e2e26640 1 --2- 172.21.15.19:0/1791850849 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f88dc135e70 0x7f88dc0a6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:32.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.218+0000 7f88e2e26640 1 -- 172.21.15.19:0/1791850849 >> 172.21.15.19:0/1791850849 conn(0x7f88dc0a8d00 msgr2=0x7f88dc0a9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:39:32.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.218+0000 7f88e2e26640 1 -- 172.21.15.19:0/1791850849 shutdown_connections 2023-11-04T15:39:32.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.218+0000 7f88e2e26640 1 -- 172.21.15.19:0/1791850849 wait complete. 2023-11-04T15:39:32.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.219+0000 7f88e2e26640 1 Processor -- start 2023-11-04T15:39:32.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.219+0000 7f88e2e26640 1 -- start start 2023-11-04T15:39:32.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.220+0000 7f88e2e26640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88dc135e70 0x7f88dc09aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:32.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.220+0000 7f88e2e26640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f88dc136250 0x7f88dc09af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:32.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.220+0000 7f88e2e26640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88dc1366b0 0x7f88dc09b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:32.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.220+0000 7f88e2e26640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc09dd50 con 0x7f88dc135e70 2023-11-04T15:39:32.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.220+0000 7f88e2e26640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc09bfe0 con 0x7f88dc1366b0 2023-11-04T15:39:32.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.220+0000 7f88e2e26640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc09db20 con 0x7f88dc136250 2023-11-04T15:39:32.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.220+0000 7f88e0bc2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88dc135e70 0x7f88dc09aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:32.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.220+0000 7f88e0bc2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88dc135e70 0x7f88dc09aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56526/0 (socket says 172.21.15.19:56526) 2023-11-04T15:39:32.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.220+0000 7f88e0bc2640 1 -- 172.21.15.19:0/1311780749 learned_addr learned my addr 172.21.15.19:0/1311780749 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:39:32.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.220+0000 7f88e0bc2640 1 -- 172.21.15.19:0/1311780749 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f88dc136250 msgr2=0x7f88dc09af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:32.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.220+0000 7f88e0bc2640 1 --2- 172.21.15.19:0/1311780749 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f88dc136250 0x7f88dc09af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:32.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.220+0000 7f88e0bc2640 1 -- 172.21.15.19:0/1311780749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88dc1366b0 msgr2=0x7f88dc09b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:32.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.220+0000 7f88e0bc2640 1 --2- 172.21.15.19:0/1311780749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88dc1366b0 0x7f88dc09b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:32.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.220+0000 7f88e0bc2640 1 -- 172.21.15.19:0/1311780749 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d4009b30 con 0x7f88dc135e70 2023-11-04T15:39:32.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.221+0000 7f88e0bc2640 1 --2- 172.21.15.19:0/1311780749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88dc135e70 0x7f88dc09aa10 secure :-1 s=READY pgs=3805 cs=0 l=1 rev1=1 crypto rx=0x7f88d000c7f0 tx=0x7f88d000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:39:32.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.221+0000 7f88d97fa640 1 -- 172.21.15.19:0/1311780749 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d0004220 con 0x7f88dc135e70 2023-11-04T15:39:32.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.221+0000 7f88d97fa640 1 -- 172.21.15.19:0/1311780749 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f88d0004380 con 0x7f88dc135e70 2023-11-04T15:39:32.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.221+0000 7f88e2e26640 1 -- 172.21.15.19:0/1311780749 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88dc09ca10 con 0x7f88dc135e70 2023-11-04T15:39:32.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.221+0000 7f88d97fa640 1 -- 172.21.15.19:0/1311780749 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d0007860 con 0x7f88dc135e70 2023-11-04T15:39:32.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.221+0000 7f88e2e26640 1 -- 172.21.15.19:0/1311780749 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88dc09ed10 con 0x7f88dc135e70 2023-11-04T15:39:32.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.222+0000 7f88e2e26640 1 -- 172.21.15.19:0/1311780749 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88dc067d60 con 0x7f88dc135e70 2023-11-04T15:39:32.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.222+0000 7f88d97fa640 1 -- 172.21.15.19:0/1311780749 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f88d0007bd0 con 0x7f88dc135e70 2023-11-04T15:39:32.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.222+0000 7f88d97fa640 1 --2- 172.21.15.19:0/1311780749 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f88c006a430 0x7f88c006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:32.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.223+0000 7f88d97fa640 1 -- 172.21.15.19:0/1311780749 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4492+0+0 (secure 0 0 0) 0x7f88d00881c0 con 0x7f88dc135e70 2023-11-04T15:39:32.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.223+0000 7f88dbfff640 1 --2- 172.21.15.19:0/1311780749 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f88c006a430 0x7f88c006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:32.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.223+0000 7f88dbfff640 1 --2- 172.21.15.19:0/1311780749 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f88c006a430 0x7f88c006c8f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f88dc09ccd0 tx=0x7f88c8008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:39:32.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.227+0000 7f88d97fa640 1 -- 172.21.15.19:0/1311780749 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f88d0053c70 con 0x7f88dc135e70 2023-11-04T15:39:32.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:32.439+0000 7f88e2e26640 1 -- 172.21.15.19:0/1311780749 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f88dc09c9b0 con 0x7f88dc135e70 2023-11-04T15:39:33.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.093+0000 7f88d97fa640 1 -- 172.21.15.19:0/1311780749 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7f88d0057290 con 0x7f88dc135e70 2023-11-04T15:39:33.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.096+0000 7f88e2e26640 1 -- 172.21.15.19:0/1311780749 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f88c006a430 msgr2=0x7f88c006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:33.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.096+0000 7f88e2e26640 1 --2- 172.21.15.19:0/1311780749 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f88c006a430 0x7f88c006c8f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f88dc09ccd0 tx=0x7f88c8008040 comp rx=0 tx=0).stop 2023-11-04T15:39:33.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.096+0000 7f88e2e26640 1 -- 172.21.15.19:0/1311780749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88dc135e70 msgr2=0x7f88dc09aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:33.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.096+0000 7f88e2e26640 1 --2- 172.21.15.19:0/1311780749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88dc135e70 0x7f88dc09aa10 secure :-1 s=READY pgs=3805 cs=0 l=1 rev1=1 crypto rx=0x7f88d000c7f0 tx=0x7f88d000ccb0 comp rx=0 tx=0).stop 2023-11-04T15:39:33.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.096+0000 7f88e2e26640 1 -- 172.21.15.19:0/1311780749 shutdown_connections 2023-11-04T15:39:33.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.096+0000 7f88e2e26640 1 --2- 172.21.15.19:0/1311780749 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f88c006a430 0x7f88c006c8f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:33.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.096+0000 7f88e2e26640 1 --2- 172.21.15.19:0/1311780749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88dc1366b0 0x7f88dc09b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:33.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.096+0000 7f88e2e26640 1 --2- 172.21.15.19:0/1311780749 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f88dc136250 0x7f88dc09af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:33.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.096+0000 7f88e2e26640 1 --2- 172.21.15.19:0/1311780749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88dc135e70 0x7f88dc09aa10 unknown :-1 s=CLOSED pgs=3805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:33.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.096+0000 7f88e2e26640 1 -- 172.21.15.19:0/1311780749 >> 172.21.15.19:0/1311780749 conn(0x7f88dc0a8d00 msgr2=0x7f88dc139e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:39:33.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.096+0000 7f88e2e26640 1 -- 172.21.15.19:0/1311780749 shutdown_connections 2023-11-04T15:39:33.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.096+0000 7f88e2e26640 1 -- 172.21.15.19:0/1311780749 wait complete. 2023-11-04T15:39:33.113 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-04T15:39:33.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.267+0000 7fde38641640 1 Processor -- start 2023-11-04T15:39:33.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.267+0000 7fde38641640 1 -- start start 2023-11-04T15:39:33.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.268+0000 7fde38641640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fde3006c440 0x7fde30137670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:33.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.268+0000 7fde38641640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde3013a7d0 0x7fde30142400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:33.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.268+0000 7fde38641640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde30136b50 con 0x7fde30137290 2023-11-04T15:39:33.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.268+0000 7fde38641640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde300a1170 con 0x7fde3006c440 2023-11-04T15:39:33.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.268+0000 7fde38641640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3006cd10 con 0x7fde3013a7d0 2023-11-04T15:39:33.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.268+0000 7fde363dd640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fde30137290 0x7fde3013a0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53350/0 (socket says 172.21.15.19:53350) 2023-11-04T15:39:33.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.268+0000 7fde363dd640 1 -- 172.21.15.19:0/3099616965 learned_addr learned my addr 172.21.15.19:0/3099616965 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:39:33.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.268+0000 7fde353db640 1 -- 172.21.15.19:0/3099616965 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3590053466 0 0) 0x7fde30136b50 con 0x7fde30137290 2023-11-04T15:39:33.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.268+0000 7fde353db640 1 -- 172.21.15.19:0/3099616965 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde18003520 con 0x7fde30137290 2023-11-04T15:39:33.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.268+0000 7fde35bdc640 1 --2- 172.21.15.19:0/3099616965 >> v2:172.21.15.96:3300/0 conn(0x7fde3006c440 0x7fde30137670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:33.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.268+0000 7fde36bde640 1 --2- 172.21.15.19:0/3099616965 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde3013a7d0 0x7fde30142400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:33.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.269+0000 7fde353db640 1 -- 172.21.15.19:0/3099616965 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 244554160 0 0) 0x7fde18003520 con 0x7fde30137290 2023-11-04T15:39:33.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.269+0000 7fde353db640 1 -- 172.21.15.19:0/3099616965 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde3013a7d0 msgr2=0x7fde30142400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:39:33.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.269+0000 7fde353db640 1 --2- 172.21.15.19:0/3099616965 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde3013a7d0 0x7fde30142400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:33.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.269+0000 7fde353db640 1 -- 172.21.15.19:0/3099616965 >> v2:172.21.15.96:3300/0 conn(0x7fde3006c440 msgr2=0x7fde30137670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:39:33.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.269+0000 7fde353db640 1 --2- 172.21.15.19:0/3099616965 >> v2:172.21.15.96:3300/0 conn(0x7fde3006c440 0x7fde30137670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:33.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.269+0000 7fde353db640 1 -- 172.21.15.19:0/3099616965 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3006ca50 con 0x7fde30137290 2023-11-04T15:39:33.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.269+0000 7fde353db640 1 -- 172.21.15.19:0/3099616965 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3646097784 0 0) 0x7fde200019f0 con 0x7fde30137290 2023-11-04T15:39:33.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.269+0000 7fde353db640 1 -- 172.21.15.19:0/3099616965 >> v1:172.21.15.19:6789/0 conn(0x7fde30137290 legacy=0x7fde3013a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:33.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.269+0000 7fde353db640 1 --2- 172.21.15.19:0/3099616965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde18003970 0x7fde18003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:33.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.269+0000 7fde353db640 1 --2- 172.21.15.19:0/3099616965 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde3013a7d0 0x7fde180047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:33.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.269+0000 7fde353db640 1 --2- 172.21.15.19:0/3099616965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde18004d00 0x7fde18005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:33.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.269+0000 7fde353db640 1 -- 172.21.15.19:0/3099616965 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde300a1170 con 0x7fde18003970 2023-11-04T15:39:33.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.269+0000 7fde353db640 1 -- 172.21.15.19:0/3099616965 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3006cd10 con 0x7fde18004d00 2023-11-04T15:39:33.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.269+0000 7fde353db640 1 -- 172.21.15.19:0/3099616965 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde18014190 con 0x7fde3013a7d0 2023-11-04T15:39:33.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.269+0000 7fde363dd640 1 --2- 172.21.15.19:0/3099616965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde18003970 0x7fde18003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:33.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.269+0000 7fde36bde640 1 --2- 172.21.15.19:0/3099616965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde18004d00 0x7fde18005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:33.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.269+0000 7fde35bdc640 1 --2- 172.21.15.19:0/3099616965 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde3013a7d0 0x7fde180047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:33.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.269+0000 7fde363dd640 1 -- 172.21.15.19:0/3099616965 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde3013a7d0 msgr2=0x7fde180047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:39:33.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.269+0000 7fde363dd640 1 --2- 172.21.15.19:0/3099616965 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde3013a7d0 0x7fde180047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:33.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.269+0000 7fde363dd640 1 -- 172.21.15.19:0/3099616965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde18004d00 msgr2=0x7fde18005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:39:33.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.269+0000 7fde363dd640 1 --2- 172.21.15.19:0/3099616965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde18004d00 0x7fde18005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:33.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.269+0000 7fde363dd640 1 -- 172.21.15.19:0/3099616965 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde18003520 con 0x7fde18003970 2023-11-04T15:39:33.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.270+0000 7fde363dd640 1 --2- 172.21.15.19:0/3099616965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde18003970 0x7fde18003d90 secure :-1 s=READY pgs=3807 cs=0 l=1 rev1=1 crypto rx=0x7fde2000a790 tx=0x7fde180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd1efd28c69b2d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:39:33.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.270+0000 7fde353db640 1 -- 172.21.15.19:0/3099616965 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde20034630 con 0x7fde18003970 2023-11-04T15:39:33.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.270+0000 7fde353db640 1 -- 172.21.15.19:0/3099616965 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fde2002f070 con 0x7fde18003970 2023-11-04T15:39:33.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.270+0000 7fde353db640 1 -- 172.21.15.19:0/3099616965 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde20034a10 con 0x7fde18003970 2023-11-04T15:39:33.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.271+0000 7fde38641640 1 -- 172.21.15.19:0/3099616965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde18003970 msgr2=0x7fde18003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:33.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.271+0000 7fde38641640 1 --2- 172.21.15.19:0/3099616965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde18003970 0x7fde18003d90 secure :-1 s=READY pgs=3807 cs=0 l=1 rev1=1 crypto rx=0x7fde2000a790 tx=0x7fde180057f0 comp rx=0 tx=0).stop 2023-11-04T15:39:33.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.271+0000 7fde36bde640 1 -- 172.21.15.19:0/3099616965 reap_dead start 2023-11-04T15:39:33.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.271+0000 7fde38641640 1 -- 172.21.15.19:0/3099616965 shutdown_connections 2023-11-04T15:39:33.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.271+0000 7fde38641640 1 -- 172.21.15.19:0/3099616965 >> 172.21.15.19:0/3099616965 conn(0x7fde300a6dc0 msgr2=0x7fde300a71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:39:33.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.271+0000 7fde38641640 1 -- 172.21.15.19:0/3099616965 shutdown_connections 2023-11-04T15:39:33.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.271+0000 7fde38641640 1 -- 172.21.15.19:0/3099616965 wait complete. 2023-11-04T15:39:33.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.272+0000 7fde38641640 1 Processor -- start 2023-11-04T15:39:33.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.272+0000 7fde38641640 1 -- start start 2023-11-04T15:39:33.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.272+0000 7fde38641640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde18003970 0x7fde301358c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:33.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.272+0000 7fde38641640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde30135e00 0x7fde30136260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:33.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.272+0000 7fde38641640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde3009ead0 0x7fde3009ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:33.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.272+0000 7fde38641640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde30137d20 con 0x7fde18003970 2023-11-04T15:39:33.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.272+0000 7fde38641640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3009d2f0 con 0x7fde3009ead0 2023-11-04T15:39:33.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.272+0000 7fde38641640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3009d950 con 0x7fde30135e00 2023-11-04T15:39:33.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.272+0000 7fde363dd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde18003970 0x7fde301358c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:33.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.272+0000 7fde363dd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde18003970 0x7fde301358c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56556/0 (socket says 172.21.15.19:56556) 2023-11-04T15:39:33.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.272+0000 7fde363dd640 1 -- 172.21.15.19:0/2118243720 learned_addr learned my addr 172.21.15.19:0/2118243720 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:39:33.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.272+0000 7fde35bdc640 1 --2- 172.21.15.19:0/2118243720 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde30135e00 0x7fde30136260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:33.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.272+0000 7fde36bde640 1 --2- 172.21.15.19:0/2118243720 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde3009ead0 0x7fde3009ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:33.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.273+0000 7fde363dd640 1 -- 172.21.15.19:0/2118243720 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde30135e00 msgr2=0x7fde30136260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:33.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.273+0000 7fde363dd640 1 --2- 172.21.15.19:0/2118243720 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde30135e00 0x7fde30136260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:33.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.273+0000 7fde363dd640 1 -- 172.21.15.19:0/2118243720 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde3009ead0 msgr2=0x7fde3009ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:33.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.273+0000 7fde363dd640 1 --2- 172.21.15.19:0/2118243720 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde3009ead0 0x7fde3009ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:33.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.273+0000 7fde363dd640 1 -- 172.21.15.19:0/2118243720 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3009cdf0 con 0x7fde18003970 2023-11-04T15:39:33.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.273+0000 7fde363dd640 1 --2- 172.21.15.19:0/2118243720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde18003970 0x7fde301358c0 secure :-1 s=READY pgs=3808 cs=0 l=1 rev1=1 crypto rx=0x7fde20000f80 tx=0x7fde20001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:39:33.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.273+0000 7fde2effd640 1 -- 172.21.15.19:0/2118243720 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde200356d0 con 0x7fde18003970 2023-11-04T15:39:33.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.273+0000 7fde2effd640 1 -- 172.21.15.19:0/2118243720 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fde20035830 con 0x7fde18003970 2023-11-04T15:39:33.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.273+0000 7fde2effd640 1 -- 172.21.15.19:0/2118243720 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde20035be0 con 0x7fde18003970 2023-11-04T15:39:33.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.273+0000 7fde38641640 1 -- 172.21.15.19:0/2118243720 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde3009dc10 con 0x7fde18003970 2023-11-04T15:39:33.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.273+0000 7fde38641640 1 -- 172.21.15.19:0/2118243720 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde3009c470 con 0x7fde18003970 2023-11-04T15:39:33.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.274+0000 7fde38641640 1 -- 172.21.15.19:0/2118243720 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde3009de50 con 0x7fde18003970 2023-11-04T15:39:33.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.274+0000 7fde2effd640 1 -- 172.21.15.19:0/2118243720 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fde20031030 con 0x7fde18003970 2023-11-04T15:39:33.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.275+0000 7fde2effd640 1 --2- 172.21.15.19:0/2118243720 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fde1c06a430 0x7fde1c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:33.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.275+0000 7fde2effd640 1 -- 172.21.15.19:0/2118243720 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4492+0+0 (secure 0 0 0) 0x7fde200aabf0 con 0x7fde18003970 2023-11-04T15:39:33.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.275+0000 7fde35bdc640 1 --2- 172.21.15.19:0/2118243720 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fde1c06a430 0x7fde1c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:33.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.275+0000 7fde35bdc640 1 --2- 172.21.15.19:0/2118243720 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fde1c06a430 0x7fde1c06c8f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fde30137e90 tx=0x7fde24009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:39:33.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.279+0000 7fde2effd640 1 -- 172.21.15.19:0/2118243720 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fde200766c0 con 0x7fde18003970 2023-11-04T15:39:33.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:33.454+0000 7fde38641640 1 -- 172.21.15.19:0/2118243720 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fde3004e040 con 0x7fde18003970 2023-11-04T15:39:34.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.104+0000 7fde2effd640 1 -- 172.21.15.19:0/2118243720 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v46) v1 ==== 181+0+0 (secure 0 0 0) 0x7fde2004d0d0 con 0x7fde18003970 2023-11-04T15:39:34.107 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' removed 2023-11-04T15:39:34.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.109+0000 7fde38641640 1 -- 172.21.15.19:0/2118243720 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fde1c06a430 msgr2=0x7fde1c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:34.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.109+0000 7fde38641640 1 --2- 172.21.15.19:0/2118243720 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fde1c06a430 0x7fde1c06c8f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fde30137e90 tx=0x7fde24009190 comp rx=0 tx=0).stop 2023-11-04T15:39:34.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.109+0000 7fde38641640 1 -- 172.21.15.19:0/2118243720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde18003970 msgr2=0x7fde301358c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:34.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.109+0000 7fde38641640 1 --2- 172.21.15.19:0/2118243720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde18003970 0x7fde301358c0 secure :-1 s=READY pgs=3808 cs=0 l=1 rev1=1 crypto rx=0x7fde20000f80 tx=0x7fde20001cb0 comp rx=0 tx=0).stop 2023-11-04T15:39:34.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.109+0000 7fde38641640 1 -- 172.21.15.19:0/2118243720 shutdown_connections 2023-11-04T15:39:34.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.109+0000 7fde38641640 1 --2- 172.21.15.19:0/2118243720 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7fde1c06a430 0x7fde1c06c8f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:34.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.109+0000 7fde38641640 1 --2- 172.21.15.19:0/2118243720 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde3009ead0 0x7fde3009ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:34.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.109+0000 7fde38641640 1 --2- 172.21.15.19:0/2118243720 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde30135e00 0x7fde30136260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:34.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.109+0000 7fde38641640 1 --2- 172.21.15.19:0/2118243720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde18003970 0x7fde301358c0 unknown :-1 s=CLOSED pgs=3808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:34.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.109+0000 7fde38641640 1 -- 172.21.15.19:0/2118243720 >> 172.21.15.19:0/2118243720 conn(0x7fde300a6dc0 msgr2=0x7fde30137ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:39:34.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.109+0000 7fde38641640 1 -- 172.21.15.19:0/2118243720 shutdown_connections 2023-11-04T15:39:34.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.109+0000 7fde38641640 1 -- 172.21.15.19:0/2118243720 wait complete. 2023-11-04T15:39:34.128 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-04T15:39:34.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.257+0000 7f0886739640 1 Processor -- start 2023-11-04T15:39:34.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.258+0000 7f0886739640 1 -- start start 2023-11-04T15:39:34.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.258+0000 7f0886739640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f088013d3c0 0x7f088013f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:34.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.258+0000 7f0886739640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f088013fcf0 0x7f08801420e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:34.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.258+0000 7f0886739640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08800a0590 con 0x7f0880133c70 2023-11-04T15:39:34.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.258+0000 7f0886739640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f088006aa40 con 0x7f088013d3c0 2023-11-04T15:39:34.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.258+0000 7f0886739640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08800a0eb0 con 0x7f088013fcf0 2023-11-04T15:39:34.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.258+0000 7f087f7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f088013d3c0 0x7f088013f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:34.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.258+0000 7f087ffff640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0880133c70 0x7f0880134050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53364/0 (socket says 172.21.15.19:53364) 2023-11-04T15:39:34.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.258+0000 7f087f7fe640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f088013d3c0 0x7f088013f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56570/0 (socket says 172.21.15.19:56570) 2023-11-04T15:39:34.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.258+0000 7f087ffff640 1 -- 172.21.15.19:0/1331437563 learned_addr learned my addr 172.21.15.19:0/1331437563 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-11-04T15:39:34.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.258+0000 7f0884cd6640 1 --2- 172.21.15.19:0/1331437563 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f088013fcf0 0x7f08801420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:34.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.258+0000 7f087f7fe640 1 -- 172.21.15.19:0/1331437563 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f088013fcf0 msgr2=0x7f08801420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T15:39:34.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.258+0000 7f087f7fe640 1 --2- 172.21.15.19:0/1331437563 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f088013fcf0 0x7f08801420e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:34.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.258+0000 7f087f7fe640 1 -- 172.21.15.19:0/1331437563 >> v1:172.21.15.19:6789/0 conn(0x7f0880133c70 legacy=0x7f0880134050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:34.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.258+0000 7f087f7fe640 1 -- 172.21.15.19:0/1331437563 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08800a1170 con 0x7f088013d3c0 2023-11-04T15:39:34.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.259+0000 7f087f7fe640 1 --2- 172.21.15.19:0/1331437563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f088013d3c0 0x7f088013f7b0 secure :-1 s=READY pgs=3810 cs=0 l=1 rev1=1 crypto rx=0x7f08680097a0 tx=0x7f086802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fd89c9b8cc3889a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:39:34.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.259+0000 7f087effd640 1 -- 172.21.15.19:0/1331437563 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086802e070 con 0x7f088013d3c0 2023-11-04T15:39:34.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.259+0000 7f087effd640 1 -- 172.21.15.19:0/1331437563 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f08680315a0 con 0x7f088013d3c0 2023-11-04T15:39:34.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.259+0000 7f087effd640 1 -- 172.21.15.19:0/1331437563 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0868031950 con 0x7f088013d3c0 2023-11-04T15:39:34.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.260+0000 7f0886739640 1 -- 172.21.15.19:0/1331437563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f088013d3c0 msgr2=0x7f088013f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:34.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.260+0000 7f0886739640 1 --2- 172.21.15.19:0/1331437563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f088013d3c0 0x7f088013f7b0 secure :-1 s=READY pgs=3810 cs=0 l=1 rev1=1 crypto rx=0x7f08680097a0 tx=0x7f086802b840 comp rx=0 tx=0).stop 2023-11-04T15:39:34.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.260+0000 7f0886739640 1 -- 172.21.15.19:0/1331437563 shutdown_connections 2023-11-04T15:39:34.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.260+0000 7f0886739640 1 --2- 172.21.15.19:0/1331437563 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f088013fcf0 0x7f08801420e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:34.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.260+0000 7f0886739640 1 --2- 172.21.15.19:0/1331437563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f088013d3c0 0x7f088013f7b0 unknown :-1 s=CLOSED pgs=3810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:34.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.260+0000 7f0886739640 1 -- 172.21.15.19:0/1331437563 >> 172.21.15.19:0/1331437563 conn(0x7f08800a8fa0 msgr2=0x7f08800a93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:39:34.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.260+0000 7f0886739640 1 -- 172.21.15.19:0/1331437563 shutdown_connections 2023-11-04T15:39:34.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.260+0000 7f0886739640 1 -- 172.21.15.19:0/1331437563 wait complete. 2023-11-04T15:39:34.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.261+0000 7f0886739640 1 Processor -- start 2023-11-04T15:39:34.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.261+0000 7f0886739640 1 -- start start 2023-11-04T15:39:34.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.262+0000 7f0886739640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0880133c70 0x7f0880134e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:34.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.262+0000 7f0886739640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f088013d3c0 0x7f0880135340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:34.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.262+0000 7f0886739640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f088013fcf0 0x7f08801ceef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:34.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.262+0000 7f0886739640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08801349b0 con 0x7f088013d3c0 2023-11-04T15:39:34.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.262+0000 7f0886739640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08800712b0 con 0x7f0880133c70 2023-11-04T15:39:34.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.262+0000 7f0886739640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f088006f550 con 0x7f088013fcf0 2023-11-04T15:39:34.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.262+0000 7f087f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f088013d3c0 0x7f0880135340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:34.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.262+0000 7f087f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f088013d3c0 0x7f0880135340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56586/0 (socket says 172.21.15.19:56586) 2023-11-04T15:39:34.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.262+0000 7f087f7fe640 1 -- 172.21.15.19:0/1348618235 learned_addr learned my addr 172.21.15.19:0/1348618235 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-11-04T15:39:34.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.262+0000 7f0884cd6640 1 --2- 172.21.15.19:0/1348618235 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f088013fcf0 0x7f08801ceef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:34.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.262+0000 7f087ffff640 1 --2- 172.21.15.19:0/1348618235 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0880133c70 0x7f0880134e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:34.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.262+0000 7f087f7fe640 1 -- 172.21.15.19:0/1348618235 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f088013fcf0 msgr2=0x7f08801ceef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:34.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.262+0000 7f087f7fe640 1 --2- 172.21.15.19:0/1348618235 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f088013fcf0 0x7f08801ceef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:34.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.262+0000 7f087f7fe640 1 -- 172.21.15.19:0/1348618235 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0880133c70 msgr2=0x7f0880134e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:34.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.262+0000 7f087f7fe640 1 --2- 172.21.15.19:0/1348618235 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0880133c70 0x7f0880134e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:34.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.262+0000 7f087f7fe640 1 -- 172.21.15.19:0/1348618235 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0868009400 con 0x7f088013d3c0 2023-11-04T15:39:34.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.262+0000 7f087f7fe640 1 --2- 172.21.15.19:0/1348618235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f088013d3c0 0x7f0880135340 secure :-1 s=READY pgs=3811 cs=0 l=1 rev1=1 crypto rx=0x7f086802b880 tx=0x7f08680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:39:34.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.262+0000 7f087cff9640 1 -- 172.21.15.19:0/1348618235 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0868032900 con 0x7f088013d3c0 2023-11-04T15:39:34.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.262+0000 7f087cff9640 1 -- 172.21.15.19:0/1348618235 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0868032a60 con 0x7f088013d3c0 2023-11-04T15:39:34.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.262+0000 7f0886739640 1 -- 172.21.15.19:0/1348618235 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f088006ead0 con 0x7f088013d3c0 2023-11-04T15:39:34.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.262+0000 7f087cff9640 1 -- 172.21.15.19:0/1348618235 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0868032e30 con 0x7f088013d3c0 2023-11-04T15:39:34.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.262+0000 7f0886739640 1 -- 172.21.15.19:0/1348618235 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0880135880 con 0x7f088013d3c0 2023-11-04T15:39:34.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.263+0000 7f0886739640 1 -- 172.21.15.19:0/1348618235 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0880071420 con 0x7f088013d3c0 2023-11-04T15:39:34.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.264+0000 7f087cff9640 1 -- 172.21.15.19:0/1348618235 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f086804d3f0 con 0x7f088013d3c0 2023-11-04T15:39:34.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.264+0000 7f087cff9640 1 --2- 172.21.15.19:0/1348618235 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f086006a430 0x7f086006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T15:39:34.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.264+0000 7f087cff9640 1 -- 172.21.15.19:0/1348618235 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4054+0+0 (secure 0 0 0) 0x7f08680a9e00 con 0x7f088013d3c0 2023-11-04T15:39:34.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.264+0000 7f087ffff640 1 --2- 172.21.15.19:0/1348618235 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f086006a430 0x7f086006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T15:39:34.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.265+0000 7f087ffff640 1 --2- 172.21.15.19:0/1348618235 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f086006a430 0x7f086006c8f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0870007fd0 tx=0x7f0870007e80 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T15:39:34.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.269+0000 7f087cff9640 1 -- 172.21.15.19:0/1348618235 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0868075b10 con 0x7f088013d3c0 2023-11-04T15:39:34.391 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:39:34.394 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:39:34.397 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:39:34.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:34.485+0000 7f0886739640 1 -- 172.21.15.19:0/1348618235 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f088004e040 con 0x7f088013d3c0 2023-11-04T15:39:35.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:35.102+0000 7f087cff9640 1 -- 172.21.15.19:0/1348618235 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v47) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0868079130 con 0x7f088013d3c0 2023-11-04T15:39:35.104 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' removed 2023-11-04T15:39:35.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:35.106+0000 7f0886739640 1 -- 172.21.15.19:0/1348618235 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f086006a430 msgr2=0x7f086006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:35.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:35.106+0000 7f0886739640 1 --2- 172.21.15.19:0/1348618235 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f086006a430 0x7f086006c8f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0870007fd0 tx=0x7f0870007e80 comp rx=0 tx=0).stop 2023-11-04T15:39:35.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:35.106+0000 7f0886739640 1 -- 172.21.15.19:0/1348618235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f088013d3c0 msgr2=0x7f0880135340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T15:39:35.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:35.106+0000 7f0886739640 1 --2- 172.21.15.19:0/1348618235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f088013d3c0 0x7f0880135340 secure :-1 s=READY pgs=3811 cs=0 l=1 rev1=1 crypto rx=0x7f086802b880 tx=0x7f08680046c0 comp rx=0 tx=0).stop 2023-11-04T15:39:35.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:35.107+0000 7f0886739640 1 -- 172.21.15.19:0/1348618235 shutdown_connections 2023-11-04T15:39:35.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:35.107+0000 7f0886739640 1 --2- 172.21.15.19:0/1348618235 >> [v2:172.21.15.96:6816/83123,v1:172.21.15.96:6817/83123] conn(0x7f086006a430 0x7f086006c8f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:35.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:35.107+0000 7f0886739640 1 --2- 172.21.15.19:0/1348618235 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f088013fcf0 0x7f08801ceef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:35.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:35.107+0000 7f0886739640 1 --2- 172.21.15.19:0/1348618235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f088013d3c0 0x7f0880135340 unknown :-1 s=CLOSED pgs=3811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:35.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:35.107+0000 7f0886739640 1 --2- 172.21.15.19:0/1348618235 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0880133c70 0x7f0880134e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T15:39:35.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:35.107+0000 7f0886739640 1 -- 172.21.15.19:0/1348618235 >> 172.21.15.19:0/1348618235 conn(0x7f08800a8fa0 msgr2=0x7f0880130c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T15:39:35.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:35.108+0000 7f0886739640 1 -- 172.21.15.19:0/1348618235 shutdown_connections 2023-11-04T15:39:35.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-11-04T15:39:35.108+0000 7f0886739640 1 -- 172.21.15.19:0/1348618235 wait complete. 2023-11-04T15:39:35.133 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-04T15:39:35.134 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T15:39:35.134 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T15:39:35.185 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T15:39:35.186 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T15:39:35.186 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T15:39:35.198 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T15:39:35.199 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-04T15:39:35.199 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-04T15:39:35.199 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T15:39:35.288 INFO:tasks.ceph.osd.0:Stopped 2023-11-04T15:39:35.288 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-04T15:39:35.289 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T15:39:35.347 INFO:tasks.ceph.osd.1:Stopped 2023-11-04T15:39:35.348 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-04T15:39:35.348 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T15:39:35.416 INFO:tasks.ceph.osd.2:Stopped 2023-11-04T15:39:35.416 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-04T15:39:35.417 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T15:39:35.480 INFO:tasks.ceph.osd.3:Stopped 2023-11-04T15:39:35.481 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-04T15:39:35.481 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-04T15:39:35.481 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T15:39:35.504 INFO:tasks.ceph.mgr.x:Stopped 2023-11-04T15:39:35.505 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-04T15:39:35.505 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T15:39:35.530 INFO:tasks.ceph.mgr.y:Stopped 2023-11-04T15:39:35.531 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-04T15:39:35.531 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-04T15:39:35.532 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T15:39:35.556 INFO:tasks.ceph.mon.a:Stopped 2023-11-04T15:39:35.557 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-04T15:39:35.558 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T15:39:35.580 INFO:tasks.ceph.mon.b:Stopped 2023-11-04T15:39:35.581 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-04T15:39:35.581 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T15:39:35.631 INFO:tasks.ceph.mon.c:Stopped 2023-11-04T15:39:35.631 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-04T15:39:35.632 DEBUG:teuthology.orchestra.run.smithi019:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2023-11-04T15:39:35.730 INFO:teuthology.orchestra.run.smithi019.stdout:2023-11-04T15:27:31.620957+0000 mon.a (mon.0) 84 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-11-04T15:39:35.731 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-11-04T15:39:35.731 DEBUG:teuthology.orchestra.run.smithi019:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2023-11-04T15:39:35.764 DEBUG:teuthology.orchestra.run.smithi019:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2023-11-04T15:39:35.837 DEBUG:teuthology.orchestra.run.smithi019:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2023-11-04T15:39:35.909 INFO:teuthology.orchestra.run.smithi019.stdout:2023-11-04T15:27:31.620957+0000 mon.a (mon.0) 84 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-11-04T15:39:35.909 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi019.front.sepia.ceph.com 2023-11-04T15:39:35.910 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-04T15:39:36.136 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi019.front.sepia.ceph.com 2023-11-04T15:39:36.137 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-04T15:39:36.224 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi096.front.sepia.ceph.com 2023-11-04T15:39:36.224 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-04T15:39:36.621 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi096.front.sepia.ceph.com 2023-11-04T15:39:36.622 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-04T15:39:36.712 INFO:tasks.ceph:Archiving mon data... 2023-11-04T15:39:36.714 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-11-04_14:52:48-smoke-reef-release-distro-default-smithi/7447748/data/mon.a.tgz 2023-11-04T15:39:36.714 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2023-11-04T15:39:36.732 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.OQg5m6oJKu 2023-11-04T15:39:36.732 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.OQg5m6oJKu 2023-11-04T15:39:36.863 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.OQg5m6oJKu 2023-11-04T15:39:36.952 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.OQg5m6oJKu is 246KB 2023-11-04T15:39:37.046 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.OQg5m6oJKu 2023-11-04T15:39:37.061 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-11-04_14:52:48-smoke-reef-release-distro-default-smithi/7447748/data/mon.b.tgz 2023-11-04T15:39:37.061 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2023-11-04T15:39:37.077 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.0fBoH735JF 2023-11-04T15:39:37.077 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.0fBoH735JF 2023-11-04T15:39:37.207 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.0fBoH735JF 2023-11-04T15:39:37.291 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.0fBoH735JF is 247KB 2023-11-04T15:39:37.385 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.0fBoH735JF 2023-11-04T15:39:37.399 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-11-04_14:52:48-smoke-reef-release-distro-default-smithi/7447748/data/mon.c.tgz 2023-11-04T15:39:37.400 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2023-11-04T15:39:37.452 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.gQRXTOKfmM 2023-11-04T15:39:37.453 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.gQRXTOKfmM 2023-11-04T15:39:37.564 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.gQRXTOKfmM 2023-11-04T15:39:37.649 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.gQRXTOKfmM is 247KB 2023-11-04T15:39:37.743 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.gQRXTOKfmM 2023-11-04T15:39:37.757 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-04T15:39:37.758 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-04T15:39:37.760 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-04T15:39:37.799 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-04T15:39:37.831 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-04T15:39:37.831 DEBUG:teuthology.orchestra.run.smithi019:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-04T15:39:37.835 DEBUG:teuthology.orchestra.run.smithi096:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-04T15:39:37.865 DEBUG:teuthology.orchestra.run.smithi130:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-04T15:39:37.868 INFO:teuthology.orchestra.run.smithi019.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-04T15:39:37.891 INFO:teuthology.orchestra.run.smithi096.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-04T15:39:37.903 INFO:teuthology.orchestra.run.smithi130.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-04T15:39:37.908 INFO:tasks.ceph:Archiving crash dumps... 2023-11-04T15:39:37.910 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-11-04_14:52:48-smoke-reef-release-distro-default-smithi/7447748/remote/smithi019/crash 2023-11-04T15:39:37.911 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-04T15:39:37.947 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-11-04_14:52:48-smoke-reef-release-distro-default-smithi/7447748/remote/smithi096/crash 2023-11-04T15:39:37.948 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-04T15:39:37.975 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-11-04_14:52:48-smoke-reef-release-distro-default-smithi/7447748/remote/smithi130/crash 2023-11-04T15:39:37.976 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-04T15:39:38.080 INFO:tasks.ceph:Shutting down logrotate 2023-11-04T15:39:38.081 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:39:38.084 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:39:38.086 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T15:39:38.169 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-04T15:39:38.202 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-04T15:39:38.230 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-04T15:39:38.258 INFO:tasks.ceph:Compressing logs... 2023-11-04T15:39:38.259 DEBUG:teuthology.orchestra.run.smithi019:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-04T15:39:38.262 DEBUG:teuthology.orchestra.run.smithi096:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-04T15:39:38.272 DEBUG:teuthology.orchestra.run.smithi130:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-04T15:41:25.045 INFO:tasks.ceph:Archiving logs... 2023-11-04T15:41:25.046 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-11-04_14:52:48-smoke-reef-release-distro-default-smithi/7447748/remote/smithi019/log 2023-11-04T15:41:25.047 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-04T15:41:51.064 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-11-04_14:52:48-smoke-reef-release-distro-default-smithi/7447748/remote/smithi096/log 2023-11-04T15:41:51.065 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-04T15:42:02.393 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-11-04_14:52:48-smoke-reef-release-distro-default-smithi/7447748/remote/smithi130/log 2023-11-04T15:42:02.394 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-04T15:42:06.386 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-04T15:42:06.396 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-04T15:42:06.397 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-04T15:42:06.399 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-04T15:42:06.402 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-04T15:42:06.462 INFO:teuthology.task.install.rpm:Removing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on rpm system. 2023-11-04T15:42:06.463 DEBUG:teuthology.orchestra.run.smithi019:> 2023-11-04T15:42:06.463 DEBUG:teuthology.orchestra.run.smithi019:> for d in ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ; do 2023-11-04T15:42:06.463 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y remove $d || true 2023-11-04T15:42:06.464 DEBUG:teuthology.orchestra.run.smithi019:> done 2023-11-04T15:42:06.485 INFO:teuthology.task.install.rpm:Removing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on rpm system. 2023-11-04T15:42:06.485 DEBUG:teuthology.orchestra.run.smithi096:> 2023-11-04T15:42:06.485 DEBUG:teuthology.orchestra.run.smithi096:> for d in ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ; do 2023-11-04T15:42:06.485 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y remove $d || true 2023-11-04T15:42:06.486 DEBUG:teuthology.orchestra.run.smithi096:> done 2023-11-04T15:42:06.508 INFO:teuthology.task.install.rpm:Removing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on rpm system. 2023-11-04T15:42:06.508 DEBUG:teuthology.orchestra.run.smithi130:> 2023-11-04T15:42:06.508 DEBUG:teuthology.orchestra.run.smithi130:> for d in ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ; do 2023-11-04T15:42:06.509 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y remove $d || true 2023-11-04T15:42:06.509 DEBUG:teuthology.orchestra.run.smithi130:> done 2023-11-04T15:42:06.862 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:42:06.863 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:42:06.863 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repo Size 2023-11-04T15:42:06.864 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:42:06.864 INFO:teuthology.orchestra.run.smithi096.stdout:Removing: 2023-11-04T15:42:06.864 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-radosgw x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 31 M 2023-11-04T15:42:06.864 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:06.864 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2023-11-04T15:42:06.865 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:42:06.865 INFO:teuthology.orchestra.run.smithi096.stdout:Remove 1 Package 2023-11-04T15:42:06.865 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:06.865 INFO:teuthology.orchestra.run.smithi096.stdout:Freed space: 31 M 2023-11-04T15:42:06.865 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2023-11-04T15:42:06.866 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2023-11-04T15:42:06.866 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2023-11-04T15:42:06.878 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:42:06.879 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:42:06.879 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:42:06.880 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repo Size 2023-11-04T15:42:06.880 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:42:06.880 INFO:teuthology.orchestra.run.smithi130.stdout:Removing: 2023-11-04T15:42:06.880 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-radosgw x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 31 M 2023-11-04T15:42:06.881 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:06.881 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-11-04T15:42:06.881 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:42:06.881 INFO:teuthology.orchestra.run.smithi130.stdout:Remove 1 Package 2023-11-04T15:42:06.882 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:06.882 INFO:teuthology.orchestra.run.smithi130.stdout:Freed space: 31 M 2023-11-04T15:42:06.882 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-11-04T15:42:06.883 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-11-04T15:42:06.884 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-11-04T15:42:06.884 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:42:06.885 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repo Size 2023-11-04T15:42:06.885 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:42:06.885 INFO:teuthology.orchestra.run.smithi019.stdout:Removing: 2023-11-04T15:42:06.885 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-radosgw x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 31 M 2023-11-04T15:42:06.885 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:06.886 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2023-11-04T15:42:06.886 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:42:06.886 INFO:teuthology.orchestra.run.smithi019.stdout:Remove 1 Package 2023-11-04T15:42:06.886 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:06.886 INFO:teuthology.orchestra.run.smithi019.stdout:Freed space: 31 M 2023-11-04T15:42:06.887 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2023-11-04T15:42:06.887 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2023-11-04T15:42:06.887 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2023-11-04T15:42:06.888 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2023-11-04T15:42:06.888 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2023-11-04T15:42:06.900 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-11-04T15:42:06.900 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-11-04T15:42:06.902 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2023-11-04T15:42:06.903 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2023-11-04T15:42:06.954 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2023-11-04T15:42:06.973 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-11-04T15:42:06.978 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:42:06.978 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:42:06.979 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-04T15:42:06.979 INFO:teuthology.orchestra.run.smithi096.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-radosgw.target". 2023-11-04T15:42:06.979 INFO:teuthology.orchestra.run.smithi096.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-radosgw.target". 2023-11-04T15:42:06.979 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:06.980 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2023-11-04T15:42:06.983 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : ceph-radosgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:42:06.996 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:42:06.997 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:42:06.997 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-04T15:42:06.997 INFO:teuthology.orchestra.run.smithi130.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-radosgw.target". 2023-11-04T15:42:06.997 INFO:teuthology.orchestra.run.smithi130.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-radosgw.target". 2023-11-04T15:42:06.997 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:07.001 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : ceph-radosgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:42:07.006 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:42:07.006 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:42:07.007 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-04T15:42:07.007 INFO:teuthology.orchestra.run.smithi019.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-radosgw.target". 2023-11-04T15:42:07.007 INFO:teuthology.orchestra.run.smithi019.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-radosgw.target". 2023-11-04T15:42:07.007 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:07.011 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : ceph-radosgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:42:07.487 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:42:07.490 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:42:07.504 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:42:07.813 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-radosgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:42:07.813 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:07.813 INFO:teuthology.orchestra.run.smithi096.stdout:Removed: 2023-11-04T15:42:07.813 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-radosgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:07.814 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:07.814 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:42:07.843 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-radosgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:42:07.843 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:07.843 INFO:teuthology.orchestra.run.smithi019.stdout:Removed: 2023-11-04T15:42:07.843 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-radosgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:07.843 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:07.844 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:42:07.844 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-radosgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/1 2023-11-04T15:42:07.845 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:07.845 INFO:teuthology.orchestra.run.smithi130.stdout:Removed: 2023-11-04T15:42:07.845 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-radosgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:07.845 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:07.845 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:42:08.397 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:42:08.399 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:42:08.399 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2023-11-04T15:42:08.399 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:42:08.399 INFO:teuthology.orchestra.run.smithi096.stdout:Removing: 2023-11-04T15:42:08.399 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-test x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 164 M 2023-11-04T15:42:08.400 INFO:teuthology.orchestra.run.smithi096.stdout:Removing unused dependencies: 2023-11-04T15:42:08.400 INFO:teuthology.orchestra.run.smithi096.stdout: jq x86_64 1.6-15.el9 @appstream 408 k 2023-11-04T15:42:08.400 INFO:teuthology.orchestra.run.smithi096.stdout: oniguruma x86_64 6.9.6-1.el9.5 @CentOS-AppStream 746 k 2023-11-04T15:42:08.400 INFO:teuthology.orchestra.run.smithi096.stdout: socat x86_64 1.7.4.1-5.el9 @CentOS-AppStream 1.1 M 2023-11-04T15:42:08.400 INFO:teuthology.orchestra.run.smithi096.stdout: xmlstarlet x86_64 1.6.1-20.el9 @CentOS-AppStream 195 k 2023-11-04T15:42:08.401 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:08.401 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2023-11-04T15:42:08.401 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:42:08.401 INFO:teuthology.orchestra.run.smithi096.stdout:Remove 5 Packages 2023-11-04T15:42:08.401 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:08.401 INFO:teuthology.orchestra.run.smithi096.stdout:Freed space: 167 M 2023-11-04T15:42:08.402 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2023-11-04T15:42:08.403 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2023-11-04T15:42:08.403 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2023-11-04T15:42:08.413 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:42:08.414 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:42:08.415 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2023-11-04T15:42:08.415 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:42:08.415 INFO:teuthology.orchestra.run.smithi130.stdout:Removing: 2023-11-04T15:42:08.415 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-test x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 164 M 2023-11-04T15:42:08.416 INFO:teuthology.orchestra.run.smithi130.stdout:Removing unused dependencies: 2023-11-04T15:42:08.416 INFO:teuthology.orchestra.run.smithi130.stdout: jq x86_64 1.6-15.el9 @appstream 408 k 2023-11-04T15:42:08.416 INFO:teuthology.orchestra.run.smithi130.stdout: oniguruma x86_64 6.9.6-1.el9.5 @CentOS-AppStream 746 k 2023-11-04T15:42:08.416 INFO:teuthology.orchestra.run.smithi130.stdout: socat x86_64 1.7.4.1-5.el9 @CentOS-AppStream 1.1 M 2023-11-04T15:42:08.416 INFO:teuthology.orchestra.run.smithi130.stdout: xmlstarlet x86_64 1.6.1-20.el9 @CentOS-AppStream 195 k 2023-11-04T15:42:08.417 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:08.417 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-11-04T15:42:08.417 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:42:08.417 INFO:teuthology.orchestra.run.smithi130.stdout:Remove 5 Packages 2023-11-04T15:42:08.417 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:08.418 INFO:teuthology.orchestra.run.smithi130.stdout:Freed space: 167 M 2023-11-04T15:42:08.418 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-11-04T15:42:08.419 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-11-04T15:42:08.419 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-11-04T15:42:08.449 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2023-11-04T15:42:08.449 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2023-11-04T15:42:08.451 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:42:08.453 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:42:08.453 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2023-11-04T15:42:08.453 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:42:08.453 INFO:teuthology.orchestra.run.smithi019.stdout:Removing: 2023-11-04T15:42:08.453 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-test x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 164 M 2023-11-04T15:42:08.454 INFO:teuthology.orchestra.run.smithi019.stdout:Removing unused dependencies: 2023-11-04T15:42:08.454 INFO:teuthology.orchestra.run.smithi019.stdout: jq x86_64 1.6-15.el9 @appstream 408 k 2023-11-04T15:42:08.454 INFO:teuthology.orchestra.run.smithi019.stdout: oniguruma x86_64 6.9.6-1.el9.5 @CentOS-AppStream 746 k 2023-11-04T15:42:08.454 INFO:teuthology.orchestra.run.smithi019.stdout: socat x86_64 1.7.4.1-5.el9 @CentOS-AppStream 1.1 M 2023-11-04T15:42:08.454 INFO:teuthology.orchestra.run.smithi019.stdout: xmlstarlet x86_64 1.6.1-20.el9 @CentOS-AppStream 195 k 2023-11-04T15:42:08.455 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:08.455 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2023-11-04T15:42:08.455 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:42:08.455 INFO:teuthology.orchestra.run.smithi019.stdout:Remove 5 Packages 2023-11-04T15:42:08.455 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:08.456 INFO:teuthology.orchestra.run.smithi019.stdout:Freed space: 167 M 2023-11-04T15:42:08.456 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2023-11-04T15:42:08.457 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2023-11-04T15:42:08.457 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2023-11-04T15:42:08.465 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-11-04T15:42:08.466 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-11-04T15:42:08.506 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2023-11-04T15:42:08.507 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2023-11-04T15:42:08.651 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2023-11-04T15:42:08.653 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-11-04T15:42:08.725 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2023-11-04T15:42:08.760 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : ceph-test-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/5 2023-11-04T15:42:08.772 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : ceph-test-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/5 2023-11-04T15:42:08.798 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : jq-1.6-15.el9.x86_64 2/5 2023-11-04T15:42:08.819 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : jq-1.6-15.el9.x86_64 2/5 2023-11-04T15:42:08.832 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : oniguruma-6.9.6-1.el9.5.x86_64 3/5 2023-11-04T15:42:08.849 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : ceph-test-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/5 2023-11-04T15:42:08.866 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : socat-1.7.4.1-5.el9.x86_64 4/5 2023-11-04T15:42:08.887 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : oniguruma-6.9.6-1.el9.5.x86_64 3/5 2023-11-04T15:42:08.901 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : jq-1.6-15.el9.x86_64 2/5 2023-11-04T15:42:08.913 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : socat-1.7.4.1-5.el9.x86_64 4/5 2023-11-04T15:42:08.931 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2023-11-04T15:42:08.966 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : oniguruma-6.9.6-1.el9.5.x86_64 3/5 2023-11-04T15:42:08.979 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2023-11-04T15:42:09.000 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : socat-1.7.4.1-5.el9.x86_64 4/5 2023-11-04T15:42:09.068 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2023-11-04T15:42:09.399 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: xmlstarlet-1.6.1-20.el9.x86_64 5/5 2023-11-04T15:42:09.399 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-test-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/5 2023-11-04T15:42:09.399 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : jq-1.6-15.el9.x86_64 2/5 2023-11-04T15:42:09.399 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/5 2023-11-04T15:42:09.400 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/5 2023-11-04T15:42:09.474 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: xmlstarlet-1.6.1-20.el9.x86_64 5/5 2023-11-04T15:42:09.474 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-test-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/5 2023-11-04T15:42:09.474 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : jq-1.6-15.el9.x86_64 2/5 2023-11-04T15:42:09.474 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/5 2023-11-04T15:42:09.475 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/5 2023-11-04T15:42:09.495 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: xmlstarlet-1.6.1-20.el9.x86_64 5/5 2023-11-04T15:42:09.495 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-test-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/5 2023-11-04T15:42:09.495 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : jq-1.6-15.el9.x86_64 2/5 2023-11-04T15:42:09.496 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/5 2023-11-04T15:42:09.496 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/5 2023-11-04T15:42:09.720 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2023-11-04T15:42:09.721 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:09.721 INFO:teuthology.orchestra.run.smithi130.stdout:Removed: 2023-11-04T15:42:09.721 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-test-2:18.2.0-1181.gf7e9f9af.el9.x86_64 jq-1.6-15.el9.x86_64 2023-11-04T15:42:09.721 INFO:teuthology.orchestra.run.smithi130.stdout: oniguruma-6.9.6-1.el9.5.x86_64 socat-1.7.4.1-5.el9.x86_64 2023-11-04T15:42:09.722 INFO:teuthology.orchestra.run.smithi130.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-04T15:42:09.722 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:09.722 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:42:09.775 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2023-11-04T15:42:09.776 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:09.776 INFO:teuthology.orchestra.run.smithi096.stdout:Removed: 2023-11-04T15:42:09.776 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-test-2:18.2.0-1181.gf7e9f9af.el9.x86_64 jq-1.6-15.el9.x86_64 2023-11-04T15:42:09.776 INFO:teuthology.orchestra.run.smithi096.stdout: oniguruma-6.9.6-1.el9.5.x86_64 socat-1.7.4.1-5.el9.x86_64 2023-11-04T15:42:09.776 INFO:teuthology.orchestra.run.smithi096.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-04T15:42:09.776 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:09.777 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:42:09.820 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2023-11-04T15:42:09.820 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:09.820 INFO:teuthology.orchestra.run.smithi019.stdout:Removed: 2023-11-04T15:42:09.820 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-test-2:18.2.0-1181.gf7e9f9af.el9.x86_64 jq-1.6-15.el9.x86_64 2023-11-04T15:42:09.821 INFO:teuthology.orchestra.run.smithi019.stdout: oniguruma-6.9.6-1.el9.5.x86_64 socat-1.7.4.1-5.el9.x86_64 2023-11-04T15:42:09.821 INFO:teuthology.orchestra.run.smithi019.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-04T15:42:09.821 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:09.821 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:42:10.384 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:42:10.385 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:42:10.385 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2023-11-04T15:42:10.385 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:42:10.385 INFO:teuthology.orchestra.run.smithi130.stdout:Removing: 2023-11-04T15:42:10.386 INFO:teuthology.orchestra.run.smithi130.stdout: ceph x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 0 2023-11-04T15:42:10.386 INFO:teuthology.orchestra.run.smithi130.stdout:Removing unused dependencies: 2023-11-04T15:42:10.386 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mds x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 6.5 M 2023-11-04T15:42:10.386 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mon x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 20 M 2023-11-04T15:42:10.387 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:10.387 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-11-04T15:42:10.387 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:42:10.387 INFO:teuthology.orchestra.run.smithi130.stdout:Remove 3 Packages 2023-11-04T15:42:10.388 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:10.388 INFO:teuthology.orchestra.run.smithi130.stdout:Freed space: 26 M 2023-11-04T15:42:10.388 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-11-04T15:42:10.389 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-11-04T15:42:10.389 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-11-04T15:42:10.405 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-11-04T15:42:10.409 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-11-04T15:42:10.487 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:42:10.487 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:42:10.488 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2023-11-04T15:42:10.488 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:42:10.488 INFO:teuthology.orchestra.run.smithi096.stdout:Removing: 2023-11-04T15:42:10.488 INFO:teuthology.orchestra.run.smithi096.stdout: ceph x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 0 2023-11-04T15:42:10.489 INFO:teuthology.orchestra.run.smithi096.stdout:Removing unused dependencies: 2023-11-04T15:42:10.489 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mds x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 6.5 M 2023-11-04T15:42:10.489 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mon x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 20 M 2023-11-04T15:42:10.489 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:10.490 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2023-11-04T15:42:10.490 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:42:10.490 INFO:teuthology.orchestra.run.smithi096.stdout:Remove 3 Packages 2023-11-04T15:42:10.490 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:10.490 INFO:teuthology.orchestra.run.smithi096.stdout:Freed space: 26 M 2023-11-04T15:42:10.491 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2023-11-04T15:42:10.493 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2023-11-04T15:42:10.493 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2023-11-04T15:42:10.507 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2023-11-04T15:42:10.508 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2023-11-04T15:42:10.524 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:42:10.525 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:42:10.525 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2023-11-04T15:42:10.525 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:42:10.526 INFO:teuthology.orchestra.run.smithi019.stdout:Removing: 2023-11-04T15:42:10.526 INFO:teuthology.orchestra.run.smithi019.stdout: ceph x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 0 2023-11-04T15:42:10.526 INFO:teuthology.orchestra.run.smithi019.stdout:Removing unused dependencies: 2023-11-04T15:42:10.526 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mds x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 6.5 M 2023-11-04T15:42:10.527 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mon x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 20 M 2023-11-04T15:42:10.527 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:10.527 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2023-11-04T15:42:10.527 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:42:10.527 INFO:teuthology.orchestra.run.smithi019.stdout:Remove 3 Packages 2023-11-04T15:42:10.528 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:10.528 INFO:teuthology.orchestra.run.smithi019.stdout:Freed space: 26 M 2023-11-04T15:42:10.528 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2023-11-04T15:42:10.529 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-11-04T15:42:10.529 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2023-11-04T15:42:10.529 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2023-11-04T15:42:10.553 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2023-11-04T15:42:10.553 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2023-11-04T15:42:10.607 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : ceph-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/3 2023-11-04T15:42:10.616 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2023-11-04T15:42:10.631 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mds-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/3 2023-11-04T15:42:10.632 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:42:10.632 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-04T15:42:10.632 INFO:teuthology.orchestra.run.smithi130.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-mds.target". 2023-11-04T15:42:10.632 INFO:teuthology.orchestra.run.smithi130.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-mds.target". 2023-11-04T15:42:10.633 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:10.633 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : ceph-mds-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/3 2023-11-04T15:42:10.664 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2023-11-04T15:42:10.684 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mds-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/3 2023-11-04T15:42:10.698 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : ceph-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/3 2023-11-04T15:42:10.709 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mon-2:18.2.0-1181.gf7e9f9af.el9.x86_64 3/3 2023-11-04T15:42:10.709 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:42:10.709 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-04T15:42:10.709 INFO:teuthology.orchestra.run.smithi130.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-mon.target". 2023-11-04T15:42:10.709 INFO:teuthology.orchestra.run.smithi130.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-mon.target". 2023-11-04T15:42:10.710 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:10.711 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : ceph-mon-2:18.2.0-1181.gf7e9f9af.el9.x86_64 3/3 2023-11-04T15:42:10.721 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mds-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/3 2023-11-04T15:42:10.721 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:42:10.721 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-04T15:42:10.721 INFO:teuthology.orchestra.run.smithi096.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-mds.target". 2023-11-04T15:42:10.722 INFO:teuthology.orchestra.run.smithi096.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-mds.target". 2023-11-04T15:42:10.722 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:10.723 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : ceph-mds-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/3 2023-11-04T15:42:10.760 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : ceph-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/3 2023-11-04T15:42:10.782 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mds-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/3 2023-11-04T15:42:10.784 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mds-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/3 2023-11-04T15:42:10.784 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:42:10.784 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-04T15:42:10.785 INFO:teuthology.orchestra.run.smithi019.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-mds.target". 2023-11-04T15:42:10.785 INFO:teuthology.orchestra.run.smithi019.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-mds.target". 2023-11-04T15:42:10.785 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:10.786 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : ceph-mds-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/3 2023-11-04T15:42:10.808 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mon-2:18.2.0-1181.gf7e9f9af.el9.x86_64 3/3 2023-11-04T15:42:10.808 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:42:10.809 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-04T15:42:10.809 INFO:teuthology.orchestra.run.smithi096.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-mon.target". 2023-11-04T15:42:10.809 INFO:teuthology.orchestra.run.smithi096.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-mon.target". 2023-11-04T15:42:10.810 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:10.811 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : ceph-mon-2:18.2.0-1181.gf7e9f9af.el9.x86_64 3/3 2023-11-04T15:42:10.852 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mds-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/3 2023-11-04T15:42:10.879 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mon-2:18.2.0-1181.gf7e9f9af.el9.x86_64 3/3 2023-11-04T15:42:10.879 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:42:10.880 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-04T15:42:10.880 INFO:teuthology.orchestra.run.smithi019.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-mon.target". 2023-11-04T15:42:10.880 INFO:teuthology.orchestra.run.smithi019.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-mon.target". 2023-11-04T15:42:10.880 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:10.882 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : ceph-mon-2:18.2.0-1181.gf7e9f9af.el9.x86_64 3/3 2023-11-04T15:42:11.206 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mon-2:18.2.0-1181.gf7e9f9af.el9.x86_64 3/3 2023-11-04T15:42:11.206 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/3 2023-11-04T15:42:11.206 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mds-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/3 2023-11-04T15:42:11.274 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mon-2:18.2.0-1181.gf7e9f9af.el9.x86_64 3/3 2023-11-04T15:42:11.274 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/3 2023-11-04T15:42:11.274 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mds-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/3 2023-11-04T15:42:11.344 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mon-2:18.2.0-1181.gf7e9f9af.el9.x86_64 3/3 2023-11-04T15:42:11.344 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/3 2023-11-04T15:42:11.344 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mds-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/3 2023-11-04T15:42:11.509 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mon-2:18.2.0-1181.gf7e9f9af.el9.x86_64 3/3 2023-11-04T15:42:11.509 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:11.509 INFO:teuthology.orchestra.run.smithi130.stdout:Removed: 2023-11-04T15:42:11.509 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:11.510 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mds-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:11.510 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mon-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:11.510 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:11.510 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:42:11.683 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mon-2:18.2.0-1181.gf7e9f9af.el9.x86_64 3/3 2023-11-04T15:42:11.684 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:11.684 INFO:teuthology.orchestra.run.smithi096.stdout:Removed: 2023-11-04T15:42:11.684 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:11.684 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mds-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:11.685 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mon-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:11.685 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:11.685 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:42:11.700 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mon-2:18.2.0-1181.gf7e9f9af.el9.x86_64 3/3 2023-11-04T15:42:11.701 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:11.701 INFO:teuthology.orchestra.run.smithi019.stdout:Removed: 2023-11-04T15:42:11.701 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:11.701 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mds-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:11.701 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mon-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:11.702 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:11.702 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:42:12.059 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:42:12.070 INFO:teuthology.orchestra.run.smithi130.stdout:============================================================================================= 2023-11-04T15:42:12.071 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2023-11-04T15:42:12.071 INFO:teuthology.orchestra.run.smithi130.stdout:============================================================================================= 2023-11-04T15:42:12.071 INFO:teuthology.orchestra.run.smithi130.stdout:Removing: 2023-11-04T15:42:12.071 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-base x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 23 M 2023-11-04T15:42:12.072 INFO:teuthology.orchestra.run.smithi130.stdout:Removing dependent packages: 2023-11-04T15:42:12.072 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 400 k 2023-11-04T15:42:12.072 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-cephadm noarch 2:18.2.0-1181.gf7e9f9af.el9 @ceph-noarch 678 k 2023-11-04T15:42:12.072 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-dashboard noarch 2:18.2.0-1181.gf7e9f9af.el9 @ceph-noarch 7.6 M 2023-11-04T15:42:12.072 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-1181.gf7e9f9af.el9 @ceph-noarch 66 M 2023-11-04T15:42:12.073 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-rook noarch 2:18.2.0-1181.gf7e9f9af.el9 @ceph-noarch 567 k 2023-11-04T15:42:12.073 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-osd x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 61 M 2023-11-04T15:42:12.073 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-volume noarch 2:18.2.0-1181.gf7e9f9af.el9 @ceph-noarch 1.2 M 2023-11-04T15:42:12.073 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-mirror x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 12 M 2023-11-04T15:42:12.073 INFO:teuthology.orchestra.run.smithi130.stdout:Removing unused dependencies: 2023-11-04T15:42:12.074 INFO:teuthology.orchestra.run.smithi130.stdout: boost-program-options x86_64 1.75.0-8.el9 @CentOS-AppStream 278 k 2023-11-04T15:42:12.074 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-common x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 70 M 2023-11-04T15:42:12.074 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-grafana-dashboards noarch 2:18.2.0-1181.gf7e9f9af.el9 @ceph-noarch 319 k 2023-11-04T15:42:12.074 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 4.5 M 2023-11-04T15:42:12.075 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-modules-core noarch 2:18.2.0-1181.gf7e9f9af.el9 @ceph-noarch 1.4 M 2023-11-04T15:42:12.075 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-prometheus-alerts noarch 2:18.2.0-1181.gf7e9f9af.el9 @ceph-noarch 40 k 2023-11-04T15:42:12.075 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-selinux x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 138 k 2023-11-04T15:42:12.075 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas x86_64 3.0.4-8.el9 @CentOS-AppStream 68 k 2023-11-04T15:42:12.075 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 @CentOS-AppStream 11 M 2023-11-04T15:42:12.076 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 @CentOS-AppStream 40 k 2023-11-04T15:42:12.076 INFO:teuthology.orchestra.run.smithi130.stdout: fmt x86_64 8.1.1-5.el9 @epel 337 k 2023-11-04T15:42:12.076 INFO:teuthology.orchestra.run.smithi130.stdout: gperftools-libs x86_64 2.9.1-2.el9 @epel 1.4 M 2023-11-04T15:42:12.076 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow x86_64 9.0.0-9.el9 @epel 18 M 2023-11-04T15:42:12.076 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow-doc noarch 9.0.0-9.el9 @epel 122 k 2023-11-04T15:42:12.077 INFO:teuthology.orchestra.run.smithi130.stdout: libcephsqlite x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 434 k 2023-11-04T15:42:12.077 INFO:teuthology.orchestra.run.smithi130.stdout: libgfortran x86_64 11.4.1-2.3.el9 @CentOS-BaseOS 2.8 M 2023-11-04T15:42:12.077 INFO:teuthology.orchestra.run.smithi130.stdout: liboath x86_64 2.6.7-2.el9 @epel 94 k 2023-11-04T15:42:12.077 INFO:teuthology.orchestra.run.smithi130.stdout: libquadmath x86_64 11.4.1-2.3.el9 @CentOS-BaseOS 330 k 2023-11-04T15:42:12.077 INFO:teuthology.orchestra.run.smithi130.stdout: librabbitmq x86_64 0.11.0-7.el9 @appstream 102 k 2023-11-04T15:42:12.078 INFO:teuthology.orchestra.run.smithi130.stdout: libradosstriper1 x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 1.5 M 2023-11-04T15:42:12.078 INFO:teuthology.orchestra.run.smithi130.stdout: librdkafka x86_64 1.6.1-102.el9 @CentOS-AppStream 2.0 M 2023-11-04T15:42:12.078 INFO:teuthology.orchestra.run.smithi130.stdout: librgw2 x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 15 M 2023-11-04T15:42:12.078 INFO:teuthology.orchestra.run.smithi130.stdout: libunwind x86_64 1.6.2-1.el9 @epel 170 k 2023-11-04T15:42:12.078 INFO:teuthology.orchestra.run.smithi130.stdout: openblas x86_64 0.3.21-2.el9 @CentOS-AppStream 82 k 2023-11-04T15:42:12.079 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-openmp x86_64 0.3.21-2.el9 @CentOS-AppStream 39 M 2023-11-04T15:42:12.079 INFO:teuthology.orchestra.run.smithi130.stdout: parquet-libs x86_64 9.0.0-9.el9 @epel 2.8 M 2023-11-04T15:42:12.079 INFO:teuthology.orchestra.run.smithi130.stdout: python3-asyncssh noarch 2.13.2-3.el9 @epel 3.9 M 2023-11-04T15:42:12.079 INFO:teuthology.orchestra.run.smithi130.stdout: python3-babel noarch 2.9.1-2.el9 @CentOS-AppStream 27 M 2023-11-04T15:42:12.079 INFO:teuthology.orchestra.run.smithi130.stdout: python3-bcrypt x86_64 3.2.2-1.el9 @epel 87 k 2023-11-04T15:42:12.080 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cachetools noarch 4.2.4-1.el9 @epel 93 k 2023-11-04T15:42:12.080 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-argparse x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 186 k 2023-11-04T15:42:12.080 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-common x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 610 k 2023-11-04T15:42:12.080 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cephfs x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 506 k 2023-11-04T15:42:12.080 INFO:teuthology.orchestra.run.smithi130.stdout: python3-certifi noarch 2021.10.8-2.el9 @epel 11 k 2023-11-04T15:42:12.081 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cffi x86_64 1.14.5-5.el9 @CentOS-BaseOS 1.0 M 2023-11-04T15:42:12.081 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cheroot noarch 8.6.0-4.el9 @epel 675 k 2023-11-04T15:42:12.081 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cherrypy noarch 18.6.1-2.el9 @epel 1.1 M 2023-11-04T15:42:12.081 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cryptography x86_64 36.0.1-4.el9 @baseos 4.5 M 2023-11-04T15:42:12.081 INFO:teuthology.orchestra.run.smithi130.stdout: python3-devel x86_64 3.9.17-2.el9 @CentOS-AppStream 769 k 2023-11-04T15:42:12.082 INFO:teuthology.orchestra.run.smithi130.stdout: python3-google-auth noarch 1:2.23.3-1.el9 @epel 1.1 M 2023-11-04T15:42:12.082 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco noarch 8.2.1-3.el9 @epel 3.7 k 2023-11-04T15:42:12.082 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 @epel 24 k 2023-11-04T15:42:12.082 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 @epel 55 k 2023-11-04T15:42:12.082 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 @epel 33 k 2023-11-04T15:42:12.083 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-text noarch 3.2.0-6.el9 @epel 34 k 2023-11-04T15:42:12.083 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jinja2 noarch 2.11.3-4.el9 @CentOS-AppStream 1.1 M 2023-11-04T15:42:12.083 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpatch noarch 1.21-16.el9 @CentOS-AppStream 55 k 2023-11-04T15:42:12.083 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpointer noarch 2.0-4.el9 @CentOS-AppStream 34 k 2023-11-04T15:42:12.083 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jwt noarch 2.4.0-1.el9 @epel 103 k 2023-11-04T15:42:12.083 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 @epel 5.4 k 2023-11-04T15:42:12.084 INFO:teuthology.orchestra.run.smithi130.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 @epel 21 M 2023-11-04T15:42:12.084 INFO:teuthology.orchestra.run.smithi130.stdout: python3-logutils noarch 0.3.5-21.el9 @epel 126 k 2023-11-04T15:42:12.084 INFO:teuthology.orchestra.run.smithi130.stdout: python3-mako noarch 1.1.4-6.el9 @CentOS-AppStream 534 k 2023-11-04T15:42:12.084 INFO:teuthology.orchestra.run.smithi130.stdout: python3-markupsafe x86_64 1.1.1-12.el9 @CentOS-AppStream 60 k 2023-11-04T15:42:12.084 INFO:teuthology.orchestra.run.smithi130.stdout: python3-more-itertools noarch 8.12.0-2.el9 @epel 378 k 2023-11-04T15:42:12.085 INFO:teuthology.orchestra.run.smithi130.stdout: python3-natsort noarch 7.1.1-5.el9 @epel 215 k 2023-11-04T15:42:12.085 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy x86_64 1:1.20.1-5.el9 @CentOS-AppStream 25 M 2023-11-04T15:42:12.085 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 @CentOS-AppStream 965 k 2023-11-04T15:42:12.085 INFO:teuthology.orchestra.run.smithi130.stdout: python3-oauthlib noarch 3.1.1-5.el9 @CentOS-AppStream 888 k 2023-11-04T15:42:12.085 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pecan noarch 1.4.2-3.el9 @epel 1.3 M 2023-11-04T15:42:12.086 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ply noarch 3.11-14.el9 @CentOS-BaseOS 430 k 2023-11-04T15:42:12.086 INFO:teuthology.orchestra.run.smithi130.stdout: python3-portend noarch 3.1.0-2.el9 @epel 20 k 2023-11-04T15:42:12.086 INFO:teuthology.orchestra.run.smithi130.stdout: python3-prettytable noarch 0.7.2-27.el9 @CentOS-AppStream 166 k 2023-11-04T15:42:12.086 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 @epel 389 k 2023-11-04T15:42:12.086 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1 noarch 0.4.8-6.el9 @CentOS-AppStream 622 k 2023-11-04T15:42:12.087 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 @CentOS-AppStream 1.0 M 2023-11-04T15:42:12.087 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pycparser noarch 2.20-6.el9 @CentOS-BaseOS 745 k 2023-11-04T15:42:12.087 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pytz noarch 2021.1-5.el9 @appstream 176 k 2023-11-04T15:42:12.087 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rados x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 1.1 M 2023-11-04T15:42:12.087 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rbd x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 1.1 M 2023-11-04T15:42:12.088 INFO:teuthology.orchestra.run.smithi130.stdout: python3-repoze-lru noarch 0.7-16.el9 @epel 83 k 2023-11-04T15:42:12.088 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 @CentOS-AppStream 119 k 2023-11-04T15:42:12.088 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rgw x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 269 k 2023-11-04T15:42:12.088 INFO:teuthology.orchestra.run.smithi130.stdout: python3-routes noarch 2.5.1-5.el9 @epel 459 k 2023-11-04T15:42:12.088 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rsa noarch 4.9-2.el9 @epel 202 k 2023-11-04T15:42:12.088 INFO:teuthology.orchestra.run.smithi130.stdout: python3-scipy x86_64 1.6.2-8.el9 @CentOS-AppStream 64 M 2023-11-04T15:42:12.089 INFO:teuthology.orchestra.run.smithi130.stdout: python3-tempora noarch 5.0.0-2.el9 @epel 96 k 2023-11-04T15:42:12.089 INFO:teuthology.orchestra.run.smithi130.stdout: python3-toml noarch 0.10.2-6.el9 @CentOS-AppStream 99 k 2023-11-04T15:42:12.089 INFO:teuthology.orchestra.run.smithi130.stdout: python3-typing-extensions noarch 4.4.0-2.el9 @epel 249 k 2023-11-04T15:42:12.089 INFO:teuthology.orchestra.run.smithi130.stdout: python3-webob noarch 1.8.7-6.el9 @epel 1.2 M 2023-11-04T15:42:12.089 INFO:teuthology.orchestra.run.smithi130.stdout: python3-websocket-client noarch 1.2.3-2.el9 @epel 319 k 2023-11-04T15:42:12.090 INFO:teuthology.orchestra.run.smithi130.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 @epel 1.9 M 2023-11-04T15:42:12.090 INFO:teuthology.orchestra.run.smithi130.stdout: python3-zc-lockfile noarch 2.0-10.el9 @epel 35 k 2023-11-04T15:42:12.090 INFO:teuthology.orchestra.run.smithi130.stdout: re2 x86_64 1:20211101-3.el9 @epel 472 k 2023-11-04T15:42:12.090 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:12.090 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-11-04T15:42:12.091 INFO:teuthology.orchestra.run.smithi130.stdout:============================================================================================= 2023-11-04T15:42:12.091 INFO:teuthology.orchestra.run.smithi130.stdout:Remove 93 Packages 2023-11-04T15:42:12.091 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:12.093 INFO:teuthology.orchestra.run.smithi130.stdout:Freed space: 512 M 2023-11-04T15:42:12.093 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-11-04T15:42:12.106 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-11-04T15:42:12.106 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-11-04T15:42:12.280 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-11-04T15:42:12.281 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-11-04T15:42:12.293 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:42:12.305 INFO:teuthology.orchestra.run.smithi096.stdout:============================================================================================= 2023-11-04T15:42:12.306 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2023-11-04T15:42:12.306 INFO:teuthology.orchestra.run.smithi096.stdout:============================================================================================= 2023-11-04T15:42:12.306 INFO:teuthology.orchestra.run.smithi096.stdout:Removing: 2023-11-04T15:42:12.307 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-base x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 23 M 2023-11-04T15:42:12.307 INFO:teuthology.orchestra.run.smithi096.stdout:Removing dependent packages: 2023-11-04T15:42:12.307 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 400 k 2023-11-04T15:42:12.308 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-cephadm noarch 2:18.2.0-1181.gf7e9f9af.el9 @ceph-noarch 678 k 2023-11-04T15:42:12.308 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-dashboard noarch 2:18.2.0-1181.gf7e9f9af.el9 @ceph-noarch 7.6 M 2023-11-04T15:42:12.308 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-1181.gf7e9f9af.el9 @ceph-noarch 66 M 2023-11-04T15:42:12.308 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-rook noarch 2:18.2.0-1181.gf7e9f9af.el9 @ceph-noarch 567 k 2023-11-04T15:42:12.309 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-osd x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 61 M 2023-11-04T15:42:12.309 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-volume noarch 2:18.2.0-1181.gf7e9f9af.el9 @ceph-noarch 1.2 M 2023-11-04T15:42:12.309 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-mirror x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 12 M 2023-11-04T15:42:12.309 INFO:teuthology.orchestra.run.smithi096.stdout:Removing unused dependencies: 2023-11-04T15:42:12.310 INFO:teuthology.orchestra.run.smithi096.stdout: boost-program-options x86_64 1.75.0-8.el9 @CentOS-AppStream 278 k 2023-11-04T15:42:12.310 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-common x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 70 M 2023-11-04T15:42:12.310 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-grafana-dashboards noarch 2:18.2.0-1181.gf7e9f9af.el9 @ceph-noarch 319 k 2023-11-04T15:42:12.310 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 4.5 M 2023-11-04T15:42:12.310 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-modules-core noarch 2:18.2.0-1181.gf7e9f9af.el9 @ceph-noarch 1.4 M 2023-11-04T15:42:12.311 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-prometheus-alerts noarch 2:18.2.0-1181.gf7e9f9af.el9 @ceph-noarch 40 k 2023-11-04T15:42:12.311 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-selinux x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 138 k 2023-11-04T15:42:12.311 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas x86_64 3.0.4-8.el9 @CentOS-AppStream 68 k 2023-11-04T15:42:12.311 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 @CentOS-AppStream 11 M 2023-11-04T15:42:12.311 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 @CentOS-AppStream 40 k 2023-11-04T15:42:12.312 INFO:teuthology.orchestra.run.smithi096.stdout: fmt x86_64 8.1.1-5.el9 @epel 337 k 2023-11-04T15:42:12.312 INFO:teuthology.orchestra.run.smithi096.stdout: gperftools-libs x86_64 2.9.1-2.el9 @epel 1.4 M 2023-11-04T15:42:12.312 INFO:teuthology.orchestra.run.smithi096.stdout: libarrow x86_64 9.0.0-9.el9 @epel 18 M 2023-11-04T15:42:12.312 INFO:teuthology.orchestra.run.smithi096.stdout: libarrow-doc noarch 9.0.0-9.el9 @epel 122 k 2023-11-04T15:42:12.312 INFO:teuthology.orchestra.run.smithi096.stdout: libcephsqlite x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 434 k 2023-11-04T15:42:12.313 INFO:teuthology.orchestra.run.smithi096.stdout: libgfortran x86_64 11.4.1-2.3.el9 @CentOS-BaseOS 2.8 M 2023-11-04T15:42:12.313 INFO:teuthology.orchestra.run.smithi096.stdout: liboath x86_64 2.6.7-2.el9 @epel 94 k 2023-11-04T15:42:12.313 INFO:teuthology.orchestra.run.smithi096.stdout: libquadmath x86_64 11.4.1-2.3.el9 @CentOS-BaseOS 330 k 2023-11-04T15:42:12.313 INFO:teuthology.orchestra.run.smithi096.stdout: librabbitmq x86_64 0.11.0-7.el9 @appstream 102 k 2023-11-04T15:42:12.314 INFO:teuthology.orchestra.run.smithi096.stdout: libradosstriper1 x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 1.5 M 2023-11-04T15:42:12.314 INFO:teuthology.orchestra.run.smithi096.stdout: librdkafka x86_64 1.6.1-102.el9 @CentOS-AppStream 2.0 M 2023-11-04T15:42:12.314 INFO:teuthology.orchestra.run.smithi096.stdout: librgw2 x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 15 M 2023-11-04T15:42:12.314 INFO:teuthology.orchestra.run.smithi096.stdout: libunwind x86_64 1.6.2-1.el9 @epel 170 k 2023-11-04T15:42:12.315 INFO:teuthology.orchestra.run.smithi096.stdout: openblas x86_64 0.3.21-2.el9 @CentOS-AppStream 82 k 2023-11-04T15:42:12.315 INFO:teuthology.orchestra.run.smithi096.stdout: openblas-openmp x86_64 0.3.21-2.el9 @CentOS-AppStream 39 M 2023-11-04T15:42:12.315 INFO:teuthology.orchestra.run.smithi096.stdout: parquet-libs x86_64 9.0.0-9.el9 @epel 2.8 M 2023-11-04T15:42:12.315 INFO:teuthology.orchestra.run.smithi096.stdout: python3-asyncssh noarch 2.13.2-3.el9 @epel 3.9 M 2023-11-04T15:42:12.315 INFO:teuthology.orchestra.run.smithi096.stdout: python3-babel noarch 2.9.1-2.el9 @CentOS-AppStream 27 M 2023-11-04T15:42:12.316 INFO:teuthology.orchestra.run.smithi096.stdout: python3-bcrypt x86_64 3.2.2-1.el9 @epel 87 k 2023-11-04T15:42:12.316 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cachetools noarch 4.2.4-1.el9 @epel 93 k 2023-11-04T15:42:12.316 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-argparse x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 186 k 2023-11-04T15:42:12.316 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-common x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 610 k 2023-11-04T15:42:12.316 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cephfs x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 506 k 2023-11-04T15:42:12.316 INFO:teuthology.orchestra.run.smithi096.stdout: python3-certifi noarch 2021.10.8-2.el9 @epel 11 k 2023-11-04T15:42:12.317 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cffi x86_64 1.14.5-5.el9 @CentOS-BaseOS 1.0 M 2023-11-04T15:42:12.317 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cheroot noarch 8.6.0-4.el9 @epel 675 k 2023-11-04T15:42:12.317 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cherrypy noarch 18.6.1-2.el9 @epel 1.1 M 2023-11-04T15:42:12.317 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cryptography x86_64 36.0.1-4.el9 @baseos 4.5 M 2023-11-04T15:42:12.318 INFO:teuthology.orchestra.run.smithi096.stdout: python3-devel x86_64 3.9.17-2.el9 @CentOS-AppStream 769 k 2023-11-04T15:42:12.318 INFO:teuthology.orchestra.run.smithi096.stdout: python3-google-auth noarch 1:2.23.3-1.el9 @epel 1.1 M 2023-11-04T15:42:12.318 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco noarch 8.2.1-3.el9 @epel 3.7 k 2023-11-04T15:42:12.318 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 @epel 24 k 2023-11-04T15:42:12.319 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 @epel 55 k 2023-11-04T15:42:12.319 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 @epel 33 k 2023-11-04T15:42:12.319 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-text noarch 3.2.0-6.el9 @epel 34 k 2023-11-04T15:42:12.319 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jinja2 noarch 2.11.3-4.el9 @CentOS-AppStream 1.1 M 2023-11-04T15:42:12.319 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpatch noarch 1.21-16.el9 @CentOS-AppStream 55 k 2023-11-04T15:42:12.320 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpointer noarch 2.0-4.el9 @CentOS-AppStream 34 k 2023-11-04T15:42:12.320 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jwt noarch 2.4.0-1.el9 @epel 103 k 2023-11-04T15:42:12.320 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 @epel 5.4 k 2023-11-04T15:42:12.320 INFO:teuthology.orchestra.run.smithi096.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 @epel 21 M 2023-11-04T15:42:12.320 INFO:teuthology.orchestra.run.smithi096.stdout: python3-logutils noarch 0.3.5-21.el9 @epel 126 k 2023-11-04T15:42:12.321 INFO:teuthology.orchestra.run.smithi096.stdout: python3-mako noarch 1.1.4-6.el9 @CentOS-AppStream 534 k 2023-11-04T15:42:12.321 INFO:teuthology.orchestra.run.smithi096.stdout: python3-markupsafe x86_64 1.1.1-12.el9 @CentOS-AppStream 60 k 2023-11-04T15:42:12.321 INFO:teuthology.orchestra.run.smithi096.stdout: python3-more-itertools noarch 8.12.0-2.el9 @epel 378 k 2023-11-04T15:42:12.321 INFO:teuthology.orchestra.run.smithi096.stdout: python3-natsort noarch 7.1.1-5.el9 @epel 215 k 2023-11-04T15:42:12.321 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy x86_64 1:1.20.1-5.el9 @CentOS-AppStream 25 M 2023-11-04T15:42:12.322 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 @CentOS-AppStream 965 k 2023-11-04T15:42:12.322 INFO:teuthology.orchestra.run.smithi096.stdout: python3-oauthlib noarch 3.1.1-5.el9 @CentOS-AppStream 888 k 2023-11-04T15:42:12.322 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pecan noarch 1.4.2-3.el9 @epel 1.3 M 2023-11-04T15:42:12.322 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ply noarch 3.11-14.el9 @CentOS-BaseOS 430 k 2023-11-04T15:42:12.322 INFO:teuthology.orchestra.run.smithi096.stdout: python3-portend noarch 3.1.0-2.el9 @epel 20 k 2023-11-04T15:42:12.323 INFO:teuthology.orchestra.run.smithi096.stdout: python3-prettytable noarch 0.7.2-27.el9 @CentOS-AppStream 166 k 2023-11-04T15:42:12.323 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 @epel 389 k 2023-11-04T15:42:12.323 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1 noarch 0.4.8-6.el9 @CentOS-AppStream 622 k 2023-11-04T15:42:12.323 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 @CentOS-AppStream 1.0 M 2023-11-04T15:42:12.323 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pycparser noarch 2.20-6.el9 @CentOS-BaseOS 745 k 2023-11-04T15:42:12.323 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pytz noarch 2021.1-5.el9 @appstream 176 k 2023-11-04T15:42:12.324 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rados x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 1.1 M 2023-11-04T15:42:12.324 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rbd x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 1.1 M 2023-11-04T15:42:12.324 INFO:teuthology.orchestra.run.smithi096.stdout: python3-repoze-lru noarch 0.7-16.el9 @epel 83 k 2023-11-04T15:42:12.324 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 @CentOS-AppStream 119 k 2023-11-04T15:42:12.324 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rgw x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 269 k 2023-11-04T15:42:12.325 INFO:teuthology.orchestra.run.smithi096.stdout: python3-routes noarch 2.5.1-5.el9 @epel 459 k 2023-11-04T15:42:12.325 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rsa noarch 4.9-2.el9 @epel 202 k 2023-11-04T15:42:12.325 INFO:teuthology.orchestra.run.smithi096.stdout: python3-scipy x86_64 1.6.2-8.el9 @CentOS-AppStream 64 M 2023-11-04T15:42:12.325 INFO:teuthology.orchestra.run.smithi096.stdout: python3-tempora noarch 5.0.0-2.el9 @epel 96 k 2023-11-04T15:42:12.326 INFO:teuthology.orchestra.run.smithi096.stdout: python3-toml noarch 0.10.2-6.el9 @CentOS-AppStream 99 k 2023-11-04T15:42:12.326 INFO:teuthology.orchestra.run.smithi096.stdout: python3-typing-extensions noarch 4.4.0-2.el9 @epel 249 k 2023-11-04T15:42:12.326 INFO:teuthology.orchestra.run.smithi096.stdout: python3-webob noarch 1.8.7-6.el9 @epel 1.2 M 2023-11-04T15:42:12.326 INFO:teuthology.orchestra.run.smithi096.stdout: python3-websocket-client noarch 1.2.3-2.el9 @epel 319 k 2023-11-04T15:42:12.326 INFO:teuthology.orchestra.run.smithi096.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 @epel 1.9 M 2023-11-04T15:42:12.329 INFO:teuthology.orchestra.run.smithi096.stdout: python3-zc-lockfile noarch 2.0-10.el9 @epel 35 k 2023-11-04T15:42:12.330 INFO:teuthology.orchestra.run.smithi096.stdout: re2 x86_64 1:20211101-3.el9 @epel 472 k 2023-11-04T15:42:12.330 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:12.330 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2023-11-04T15:42:12.330 INFO:teuthology.orchestra.run.smithi096.stdout:============================================================================================= 2023-11-04T15:42:12.330 INFO:teuthology.orchestra.run.smithi096.stdout:Remove 93 Packages 2023-11-04T15:42:12.331 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:12.333 INFO:teuthology.orchestra.run.smithi096.stdout:Freed space: 512 M 2023-11-04T15:42:12.333 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2023-11-04T15:42:12.333 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:42:12.333 INFO:teuthology.orchestra.run.smithi019.stdout:============================================================================================= 2023-11-04T15:42:12.334 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2023-11-04T15:42:12.334 INFO:teuthology.orchestra.run.smithi019.stdout:============================================================================================= 2023-11-04T15:42:12.334 INFO:teuthology.orchestra.run.smithi019.stdout:Removing: 2023-11-04T15:42:12.334 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-base x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 23 M 2023-11-04T15:42:12.335 INFO:teuthology.orchestra.run.smithi019.stdout:Removing dependent packages: 2023-11-04T15:42:12.335 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 400 k 2023-11-04T15:42:12.335 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-cephadm noarch 2:18.2.0-1181.gf7e9f9af.el9 @ceph-noarch 678 k 2023-11-04T15:42:12.335 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-dashboard noarch 2:18.2.0-1181.gf7e9f9af.el9 @ceph-noarch 7.6 M 2023-11-04T15:42:12.335 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-1181.gf7e9f9af.el9 @ceph-noarch 66 M 2023-11-04T15:42:12.335 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-rook noarch 2:18.2.0-1181.gf7e9f9af.el9 @ceph-noarch 567 k 2023-11-04T15:42:12.336 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-osd x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 61 M 2023-11-04T15:42:12.336 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-volume noarch 2:18.2.0-1181.gf7e9f9af.el9 @ceph-noarch 1.2 M 2023-11-04T15:42:12.336 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-mirror x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 12 M 2023-11-04T15:42:12.336 INFO:teuthology.orchestra.run.smithi019.stdout:Removing unused dependencies: 2023-11-04T15:42:12.337 INFO:teuthology.orchestra.run.smithi019.stdout: boost-program-options x86_64 1.75.0-8.el9 @CentOS-AppStream 278 k 2023-11-04T15:42:12.337 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-common x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 70 M 2023-11-04T15:42:12.338 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-grafana-dashboards noarch 2:18.2.0-1181.gf7e9f9af.el9 @ceph-noarch 319 k 2023-11-04T15:42:12.338 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 4.5 M 2023-11-04T15:42:12.338 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-modules-core noarch 2:18.2.0-1181.gf7e9f9af.el9 @ceph-noarch 1.4 M 2023-11-04T15:42:12.339 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-prometheus-alerts noarch 2:18.2.0-1181.gf7e9f9af.el9 @ceph-noarch 40 k 2023-11-04T15:42:12.339 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-selinux x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 138 k 2023-11-04T15:42:12.339 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas x86_64 3.0.4-8.el9 @CentOS-AppStream 68 k 2023-11-04T15:42:12.339 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 @CentOS-AppStream 11 M 2023-11-04T15:42:12.340 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 @CentOS-AppStream 40 k 2023-11-04T15:42:12.340 INFO:teuthology.orchestra.run.smithi019.stdout: fmt x86_64 8.1.1-5.el9 @epel 337 k 2023-11-04T15:42:12.340 INFO:teuthology.orchestra.run.smithi019.stdout: gperftools-libs x86_64 2.9.1-2.el9 @epel 1.4 M 2023-11-04T15:42:12.341 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow x86_64 9.0.0-9.el9 @epel 18 M 2023-11-04T15:42:12.341 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-doc noarch 9.0.0-9.el9 @epel 122 k 2023-11-04T15:42:12.341 INFO:teuthology.orchestra.run.smithi019.stdout: libcephsqlite x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 434 k 2023-11-04T15:42:12.342 INFO:teuthology.orchestra.run.smithi019.stdout: libgfortran x86_64 11.4.1-2.3.el9 @CentOS-BaseOS 2.8 M 2023-11-04T15:42:12.342 INFO:teuthology.orchestra.run.smithi019.stdout: liboath x86_64 2.6.7-2.el9 @epel 94 k 2023-11-04T15:42:12.343 INFO:teuthology.orchestra.run.smithi019.stdout: libquadmath x86_64 11.4.1-2.3.el9 @CentOS-BaseOS 330 k 2023-11-04T15:42:12.343 INFO:teuthology.orchestra.run.smithi019.stdout: librabbitmq x86_64 0.11.0-7.el9 @appstream 102 k 2023-11-04T15:42:12.343 INFO:teuthology.orchestra.run.smithi019.stdout: libradosstriper1 x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 1.5 M 2023-11-04T15:42:12.344 INFO:teuthology.orchestra.run.smithi019.stdout: librdkafka x86_64 1.6.1-102.el9 @CentOS-AppStream 2.0 M 2023-11-04T15:42:12.344 INFO:teuthology.orchestra.run.smithi019.stdout: librgw2 x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 15 M 2023-11-04T15:42:12.345 INFO:teuthology.orchestra.run.smithi019.stdout: libunwind x86_64 1.6.2-1.el9 @epel 170 k 2023-11-04T15:42:12.345 INFO:teuthology.orchestra.run.smithi019.stdout: openblas x86_64 0.3.21-2.el9 @CentOS-AppStream 82 k 2023-11-04T15:42:12.345 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-openmp x86_64 0.3.21-2.el9 @CentOS-AppStream 39 M 2023-11-04T15:42:12.346 INFO:teuthology.orchestra.run.smithi019.stdout: parquet-libs x86_64 9.0.0-9.el9 @epel 2.8 M 2023-11-04T15:42:12.346 INFO:teuthology.orchestra.run.smithi019.stdout: python3-asyncssh noarch 2.13.2-3.el9 @epel 3.9 M 2023-11-04T15:42:12.346 INFO:teuthology.orchestra.run.smithi019.stdout: python3-babel noarch 2.9.1-2.el9 @CentOS-AppStream 27 M 2023-11-04T15:42:12.347 INFO:teuthology.orchestra.run.smithi019.stdout: python3-bcrypt x86_64 3.2.2-1.el9 @epel 87 k 2023-11-04T15:42:12.347 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cachetools noarch 4.2.4-1.el9 @epel 93 k 2023-11-04T15:42:12.347 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-argparse x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 186 k 2023-11-04T15:42:12.348 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-common x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 610 k 2023-11-04T15:42:12.348 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cephfs x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 506 k 2023-11-04T15:42:12.348 INFO:teuthology.orchestra.run.smithi019.stdout: python3-certifi noarch 2021.10.8-2.el9 @epel 11 k 2023-11-04T15:42:12.349 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cffi x86_64 1.14.5-5.el9 @CentOS-BaseOS 1.0 M 2023-11-04T15:42:12.349 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cheroot noarch 8.6.0-4.el9 @epel 675 k 2023-11-04T15:42:12.349 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cherrypy noarch 18.6.1-2.el9 @epel 1.1 M 2023-11-04T15:42:12.349 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cryptography x86_64 36.0.1-4.el9 @baseos 4.5 M 2023-11-04T15:42:12.349 INFO:teuthology.orchestra.run.smithi019.stdout: python3-devel x86_64 3.9.17-2.el9 @CentOS-AppStream 769 k 2023-11-04T15:42:12.350 INFO:teuthology.orchestra.run.smithi019.stdout: python3-google-auth noarch 1:2.23.3-1.el9 @epel 1.1 M 2023-11-04T15:42:12.350 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco noarch 8.2.1-3.el9 @epel 3.7 k 2023-11-04T15:42:12.350 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 @epel 24 k 2023-11-04T15:42:12.350 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 @epel 55 k 2023-11-04T15:42:12.350 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 @epel 33 k 2023-11-04T15:42:12.351 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-text noarch 3.2.0-6.el9 @epel 34 k 2023-11-04T15:42:12.351 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jinja2 noarch 2.11.3-4.el9 @CentOS-AppStream 1.1 M 2023-11-04T15:42:12.351 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpatch noarch 1.21-16.el9 @CentOS-AppStream 55 k 2023-11-04T15:42:12.351 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpointer noarch 2.0-4.el9 @CentOS-AppStream 34 k 2023-11-04T15:42:12.352 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jwt noarch 2.4.0-1.el9 @epel 103 k 2023-11-04T15:42:12.352 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 @epel 5.4 k 2023-11-04T15:42:12.352 INFO:teuthology.orchestra.run.smithi019.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 @epel 21 M 2023-11-04T15:42:12.353 INFO:teuthology.orchestra.run.smithi019.stdout: python3-logutils noarch 0.3.5-21.el9 @epel 126 k 2023-11-04T15:42:12.353 INFO:teuthology.orchestra.run.smithi019.stdout: python3-mako noarch 1.1.4-6.el9 @CentOS-AppStream 534 k 2023-11-04T15:42:12.354 INFO:teuthology.orchestra.run.smithi019.stdout: python3-markupsafe x86_64 1.1.1-12.el9 @CentOS-AppStream 60 k 2023-11-04T15:42:12.354 INFO:teuthology.orchestra.run.smithi019.stdout: python3-more-itertools noarch 8.12.0-2.el9 @epel 378 k 2023-11-04T15:42:12.354 INFO:teuthology.orchestra.run.smithi019.stdout: python3-natsort noarch 7.1.1-5.el9 @epel 215 k 2023-11-04T15:42:12.355 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy x86_64 1:1.20.1-5.el9 @CentOS-AppStream 25 M 2023-11-04T15:42:12.355 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 @CentOS-AppStream 965 k 2023-11-04T15:42:12.355 INFO:teuthology.orchestra.run.smithi019.stdout: python3-oauthlib noarch 3.1.1-5.el9 @CentOS-AppStream 888 k 2023-11-04T15:42:12.356 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan noarch 1.4.2-3.el9 @epel 1.3 M 2023-11-04T15:42:12.356 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ply noarch 3.11-14.el9 @CentOS-BaseOS 430 k 2023-11-04T15:42:12.356 INFO:teuthology.orchestra.run.smithi019.stdout: python3-portend noarch 3.1.0-2.el9 @epel 20 k 2023-11-04T15:42:12.357 INFO:teuthology.orchestra.run.smithi019.stdout: python3-prettytable noarch 0.7.2-27.el9 @CentOS-AppStream 166 k 2023-11-04T15:42:12.357 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 @epel 389 k 2023-11-04T15:42:12.357 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1 noarch 0.4.8-6.el9 @CentOS-AppStream 622 k 2023-11-04T15:42:12.358 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 @CentOS-AppStream 1.0 M 2023-11-04T15:42:12.358 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pycparser noarch 2.20-6.el9 @CentOS-BaseOS 745 k 2023-11-04T15:42:12.358 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pytz noarch 2021.1-5.el9 @appstream 176 k 2023-11-04T15:42:12.358 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rados x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 1.1 M 2023-11-04T15:42:12.359 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rbd x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 1.1 M 2023-11-04T15:42:12.359 INFO:teuthology.orchestra.run.smithi019.stdout: python3-repoze-lru noarch 0.7-16.el9 @epel 83 k 2023-11-04T15:42:12.359 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 @CentOS-AppStream 119 k 2023-11-04T15:42:12.360 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rgw x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 269 k 2023-11-04T15:42:12.360 INFO:teuthology.orchestra.run.smithi019.stdout: python3-routes noarch 2.5.1-5.el9 @epel 459 k 2023-11-04T15:42:12.360 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rsa noarch 4.9-2.el9 @epel 202 k 2023-11-04T15:42:12.360 INFO:teuthology.orchestra.run.smithi019.stdout: python3-scipy x86_64 1.6.2-8.el9 @CentOS-AppStream 64 M 2023-11-04T15:42:12.360 INFO:teuthology.orchestra.run.smithi019.stdout: python3-tempora noarch 5.0.0-2.el9 @epel 96 k 2023-11-04T15:42:12.360 INFO:teuthology.orchestra.run.smithi019.stdout: python3-toml noarch 0.10.2-6.el9 @CentOS-AppStream 99 k 2023-11-04T15:42:12.361 INFO:teuthology.orchestra.run.smithi019.stdout: python3-typing-extensions noarch 4.4.0-2.el9 @epel 249 k 2023-11-04T15:42:12.361 INFO:teuthology.orchestra.run.smithi019.stdout: python3-webob noarch 1.8.7-6.el9 @epel 1.2 M 2023-11-04T15:42:12.361 INFO:teuthology.orchestra.run.smithi019.stdout: python3-websocket-client noarch 1.2.3-2.el9 @epel 319 k 2023-11-04T15:42:12.361 INFO:teuthology.orchestra.run.smithi019.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 @epel 1.9 M 2023-11-04T15:42:12.361 INFO:teuthology.orchestra.run.smithi019.stdout: python3-zc-lockfile noarch 2.0-10.el9 @epel 35 k 2023-11-04T15:42:12.362 INFO:teuthology.orchestra.run.smithi019.stdout: re2 x86_64 1:20211101-3.el9 @epel 472 k 2023-11-04T15:42:12.362 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:12.362 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2023-11-04T15:42:12.362 INFO:teuthology.orchestra.run.smithi019.stdout:============================================================================================= 2023-11-04T15:42:12.362 INFO:teuthology.orchestra.run.smithi019.stdout:Remove 93 Packages 2023-11-04T15:42:12.363 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:12.363 INFO:teuthology.orchestra.run.smithi019.stdout:Freed space: 512 M 2023-11-04T15:42:12.363 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2023-11-04T15:42:12.364 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2023-11-04T15:42:12.364 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2023-11-04T15:42:12.365 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2023-11-04T15:42:12.365 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2023-11-04T15:42:12.517 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2023-11-04T15:42:12.518 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2023-11-04T15:42:12.576 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2023-11-04T15:42:12.577 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2023-11-04T15:42:13.352 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-11-04T15:42:13.352 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : ceph-mgr-rook-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/93 2023-11-04T15:42:13.429 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/93 2023-11-04T15:42:13.449 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/93 2023-11-04T15:42:13.449 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:42:13.449 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-04T15:42:13.449 INFO:teuthology.orchestra.run.smithi130.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-mgr.target". 2023-11-04T15:42:13.450 INFO:teuthology.orchestra.run.smithi130.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-mgr.target". 2023-11-04T15:42:13.450 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:13.450 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : ceph-mgr-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/93 2023-11-04T15:42:13.486 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/93 2023-11-04T15:42:13.519 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : ceph-mgr-modules-core-2:18.2.0-1181.gf7e9f9af.el9. 3/93 2023-11-04T15:42:13.520 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : ceph-mgr-dashboard-2:18.2.0-1181.gf7e9f9af.el9.noa 4/93 2023-11-04T15:42:13.575 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-1181.gf7e9f9af.el9.noa 4/93 2023-11-04T15:42:13.576 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : ceph-mgr-cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarc 5/93 2023-11-04T15:42:13.604 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2023-11-04T15:42:13.604 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : ceph-mgr-rook-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/93 2023-11-04T15:42:13.612 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarc 5/93 2023-11-04T15:42:13.653 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-cherrypy-18.6.1-2.el9.noarch 6/93 2023-11-04T15:42:13.669 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/93 2023-11-04T15:42:13.690 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/93 2023-11-04T15:42:13.690 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:42:13.690 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-04T15:42:13.691 INFO:teuthology.orchestra.run.smithi096.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-mgr.target". 2023-11-04T15:42:13.691 INFO:teuthology.orchestra.run.smithi096.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-mgr.target". 2023-11-04T15:42:13.691 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:13.692 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2023-11-04T15:42:13.692 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : ceph-mgr-rook-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/93 2023-11-04T15:42:13.692 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : ceph-mgr-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/93 2023-11-04T15:42:13.726 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/93 2023-11-04T15:42:13.744 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-cheroot-8.6.0-4.el9.noarch 7/93 2023-11-04T15:42:13.760 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : ceph-mgr-modules-core-2:18.2.0-1181.gf7e9f9af.el9. 3/93 2023-11-04T15:42:13.760 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : ceph-mgr-dashboard-2:18.2.0-1181.gf7e9f9af.el9.noa 4/93 2023-11-04T15:42:13.764 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/93 2023-11-04T15:42:13.784 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/93 2023-11-04T15:42:13.785 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:42:13.785 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-04T15:42:13.785 INFO:teuthology.orchestra.run.smithi019.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-mgr.target". 2023-11-04T15:42:13.785 INFO:teuthology.orchestra.run.smithi019.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-mgr.target". 2023-11-04T15:42:13.785 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:13.786 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : ceph-mgr-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/93 2023-11-04T15:42:13.791 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-kubernetes-1:26.1.0-2.el9.noarch 8/93 2023-11-04T15:42:13.792 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-1181.gf7e9f9af.el9.noa 4/93 2023-11-04T15:42:13.792 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : ceph-mgr-cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarc 5/93 2023-11-04T15:42:13.821 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/93 2023-11-04T15:42:13.827 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-google-auth-1:2.23.3-1.el9.noarch 9/93 2023-11-04T15:42:13.845 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarc 5/93 2023-11-04T15:42:13.853 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-jaraco-collections-3.0.0-8.el9.noarch 10/93 2023-11-04T15:42:13.855 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : ceph-mgr-modules-core-2:18.2.0-1181.gf7e9f9af.el9. 3/93 2023-11-04T15:42:13.855 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : ceph-mgr-dashboard-2:18.2.0-1181.gf7e9f9af.el9.noa 4/93 2023-11-04T15:42:13.881 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-jaraco-text-3.2.0-6.el9.noarch 11/93 2023-11-04T15:42:13.886 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-cherrypy-18.6.1-2.el9.noarch 6/93 2023-11-04T15:42:13.894 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-1181.gf7e9f9af.el9.noa 4/93 2023-11-04T15:42:13.894 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : ceph-mgr-cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarc 5/93 2023-11-04T15:42:13.922 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-jinja2-2.11.3-4.el9.noarch 12/93 2023-11-04T15:42:13.931 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarc 5/93 2023-11-04T15:42:13.954 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-pecan-1.4.2-3.el9.noarch 13/93 2023-11-04T15:42:13.972 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-cherrypy-18.6.1-2.el9.noarch 6/93 2023-11-04T15:42:13.977 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-cheroot-8.6.0-4.el9.noarch 7/93 2023-11-04T15:42:13.977 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-osd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 14/93 2023-11-04T15:42:13.978 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:42:13.978 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-04T15:42:13.978 INFO:teuthology.orchestra.run.smithi130.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-osd.target". 2023-11-04T15:42:13.978 INFO:teuthology.orchestra.run.smithi130.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-osd.target". 2023-11-04T15:42:13.979 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:13.985 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : ceph-osd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 14/93 2023-11-04T15:42:14.023 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-osd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 14/93 2023-11-04T15:42:14.033 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-kubernetes-1:26.1.0-2.el9.noarch 8/93 2023-11-04T15:42:14.041 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-volume-2:18.2.0-1181.gf7e9f9af.el9.noarch 15/93 2023-11-04T15:42:14.041 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:42:14.041 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-04T15:42:14.041 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:14.050 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : ceph-volume-2:18.2.0-1181.gf7e9f9af.el9.noarch 15/93 2023-11-04T15:42:14.061 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-google-auth-1:2.23.3-1.el9.noarch 9/93 2023-11-04T15:42:14.077 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-cheroot-8.6.0-4.el9.noarch 7/93 2023-11-04T15:42:14.086 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-jaraco-collections-3.0.0-8.el9.noarch 10/93 2023-11-04T15:42:14.113 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-volume-2:18.2.0-1181.gf7e9f9af.el9.noarch 15/93 2023-11-04T15:42:14.114 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-jaraco-text-3.2.0-6.el9.noarch 11/93 2023-11-04T15:42:14.151 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-babel-2.9.1-2.el9.noarch 16/93 2023-11-04T15:42:14.155 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-jinja2-2.11.3-4.el9.noarch 12/93 2023-11-04T15:42:14.178 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-jaraco-classes-3.2.1-5.el9.noarch 17/93 2023-11-04T15:42:14.188 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-pecan-1.4.2-3.el9.noarch 13/93 2023-11-04T15:42:14.210 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-rsa-4.9-2.el9.noarch 18/93 2023-11-04T15:42:14.211 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-osd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 14/93 2023-11-04T15:42:14.211 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:42:14.211 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-04T15:42:14.211 INFO:teuthology.orchestra.run.smithi096.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-osd.target". 2023-11-04T15:42:14.212 INFO:teuthology.orchestra.run.smithi096.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-osd.target". 2023-11-04T15:42:14.212 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:14.218 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : ceph-osd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 14/93 2023-11-04T15:42:14.227 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-kubernetes-1:26.1.0-2.el9.noarch 8/93 2023-11-04T15:42:14.237 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-pyasn1-modules-0.4.8-6.el9.noarch 19/93 2023-11-04T15:42:14.248 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-osd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 14/93 2023-11-04T15:42:14.261 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-requests-oauthlib-1.3.0-12.el9.noarch 20/93 2023-11-04T15:42:14.266 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-volume-2:18.2.0-1181.gf7e9f9af.el9.noarch 15/93 2023-11-04T15:42:14.266 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:42:14.266 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-04T15:42:14.266 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:14.275 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : ceph-volume-2:18.2.0-1181.gf7e9f9af.el9.noarch 15/93 2023-11-04T15:42:14.279 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-google-auth-1:2.23.3-1.el9.noarch 9/93 2023-11-04T15:42:14.294 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-pyOpenSSL-21.0.0-1.el9.noarch 21/93 2023-11-04T15:42:14.297 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-jaraco-collections-3.0.0-8.el9.noarch 10/93 2023-11-04T15:42:14.325 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-jaraco-text-3.2.0-6.el9.noarch 11/93 2023-11-04T15:42:14.337 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-asyncssh-2.13.2-3.el9.noarch 22/93 2023-11-04T15:42:14.337 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : ceph-mgr-diskprediction-local-2:18.2.0-1181.gf7e9f 23/93 2023-11-04T15:42:14.339 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-volume-2:18.2.0-1181.gf7e9f9af.el9.noarch 15/93 2023-11-04T15:42:14.366 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-jinja2-2.11.3-4.el9.noarch 12/93 2023-11-04T15:42:14.371 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-1181.gf7e9f 23/93 2023-11-04T15:42:14.385 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-babel-2.9.1-2.el9.noarch 16/93 2023-11-04T15:42:14.398 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-pecan-1.4.2-3.el9.noarch 13/93 2023-11-04T15:42:14.412 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-jaraco-classes-3.2.1-5.el9.noarch 17/93 2023-11-04T15:42:14.423 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-osd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 14/93 2023-11-04T15:42:14.424 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:42:14.424 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-04T15:42:14.424 INFO:teuthology.orchestra.run.smithi019.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-osd.target". 2023-11-04T15:42:14.424 INFO:teuthology.orchestra.run.smithi019.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-osd.target". 2023-11-04T15:42:14.424 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:14.431 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : ceph-osd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 14/93 2023-11-04T15:42:14.444 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-rsa-4.9-2.el9.noarch 18/93 2023-11-04T15:42:14.467 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-osd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 14/93 2023-11-04T15:42:14.471 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-pyasn1-modules-0.4.8-6.el9.noarch 19/93 2023-11-04T15:42:14.483 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-jsonpatch-1.21-16.el9.noarch 24/93 2023-11-04T15:42:14.486 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-volume-2:18.2.0-1181.gf7e9f9af.el9.noarch 15/93 2023-11-04T15:42:14.486 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:42:14.487 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-04T15:42:14.487 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:14.496 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-requests-oauthlib-1.3.0-12.el9.noarch 20/93 2023-11-04T15:42:14.496 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : ceph-volume-2:18.2.0-1181.gf7e9f9af.el9.noarch 15/93 2023-11-04T15:42:14.528 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-pyOpenSSL-21.0.0-1.el9.noarch 21/93 2023-11-04T15:42:14.543 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-scipy-1.6.2-8.el9.x86_64 25/93 2023-11-04T15:42:14.564 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-asyncssh-2.13.2-3.el9.noarch 22/93 2023-11-04T15:42:14.564 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : ceph-mgr-diskprediction-local-2:18.2.0-1181.gf7e9f 23/93 2023-11-04T15:42:14.568 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-volume-2:18.2.0-1181.gf7e9f9af.el9.noarch 15/93 2023-11-04T15:42:14.572 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 26/93 2023-11-04T15:42:14.597 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-bcrypt-3.2.2-1.el9.x86_64 27/93 2023-11-04T15:42:14.597 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-1181.gf7e9f 23/93 2023-11-04T15:42:14.613 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-babel-2.9.1-2.el9.noarch 16/93 2023-11-04T15:42:14.619 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: rbd-mirror-2:18.2.0-1181.gf7e9f9af.el9.x86_64 28/93 2023-11-04T15:42:14.620 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:42:14.620 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-04T15:42:14.620 INFO:teuthology.orchestra.run.smithi130.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target". 2023-11-04T15:42:14.620 INFO:teuthology.orchestra.run.smithi130.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target". 2023-11-04T15:42:14.621 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:14.621 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : rbd-mirror-2:18.2.0-1181.gf7e9f9af.el9.x86_64 28/93 2023-11-04T15:42:14.640 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-jaraco-classes-3.2.1-5.el9.noarch 17/93 2023-11-04T15:42:14.660 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: rbd-mirror-2:18.2.0-1181.gf7e9f9af.el9.x86_64 28/93 2023-11-04T15:42:14.673 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-rsa-4.9-2.el9.noarch 18/93 2023-11-04T15:42:14.690 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-mako-1.1.4-6.el9.noarch 29/93 2023-11-04T15:42:14.699 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-pyasn1-modules-0.4.8-6.el9.noarch 19/93 2023-11-04T15:42:14.710 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-jsonpatch-1.21-16.el9.noarch 24/93 2023-11-04T15:42:14.716 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-portend-3.1.0-2.el9.noarch 30/93 2023-11-04T15:42:14.724 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-requests-oauthlib-1.3.0-12.el9.noarch 20/93 2023-11-04T15:42:14.742 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-tempora-5.0.0-2.el9.noarch 31/93 2023-11-04T15:42:14.757 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-pyOpenSSL-21.0.0-1.el9.noarch 21/93 2023-11-04T15:42:14.776 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-scipy-1.6.2-8.el9.x86_64 25/93 2023-11-04T15:42:14.776 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-jaraco-functools-3.5.0-2.el9.noarch 32/93 2023-11-04T15:42:14.792 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-asyncssh-2.13.2-3.el9.noarch 22/93 2023-11-04T15:42:14.793 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : ceph-mgr-diskprediction-local-2:18.2.0-1181.gf7e9f 23/93 2023-11-04T15:42:14.805 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 26/93 2023-11-04T15:42:14.809 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-jwt-2.4.0-1.el9.noarch 33/93 2023-11-04T15:42:14.830 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-bcrypt-3.2.2-1.el9.x86_64 27/93 2023-11-04T15:42:14.836 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-jwt+crypto-2.4.0-1.el9.noarch 34/93 2023-11-04T15:42:14.842 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-1181.gf7e9f 23/93 2023-11-04T15:42:14.852 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: rbd-mirror-2:18.2.0-1181.gf7e9f9af.el9.x86_64 28/93 2023-11-04T15:42:14.853 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:42:14.853 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-04T15:42:14.853 INFO:teuthology.orchestra.run.smithi096.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target". 2023-11-04T15:42:14.853 INFO:teuthology.orchestra.run.smithi096.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target". 2023-11-04T15:42:14.853 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:14.854 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : rbd-mirror-2:18.2.0-1181.gf7e9f9af.el9.x86_64 28/93 2023-11-04T15:42:14.873 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-routes-2.5.1-5.el9.noarch 35/93 2023-11-04T15:42:14.894 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: rbd-mirror-2:18.2.0-1181.gf7e9f9af.el9.x86_64 28/93 2023-11-04T15:42:14.905 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-cryptography-36.0.1-4.el9.x86_64 36/93 2023-11-04T15:42:14.930 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-cffi-1.14.5-5.el9.x86_64 37/93 2023-11-04T15:42:14.931 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-mako-1.1.4-6.el9.noarch 29/93 2023-11-04T15:42:14.958 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-portend-3.1.0-2.el9.noarch 30/93 2023-11-04T15:42:14.963 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-jsonpatch-1.21-16.el9.noarch 24/93 2023-11-04T15:42:14.983 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-tempora-5.0.0-2.el9.noarch 31/93 2023-11-04T15:42:15.001 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-pycparser-2.20-6.el9.noarch 38/93 2023-11-04T15:42:15.009 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-jaraco-functools-3.5.0-2.el9.noarch 32/93 2023-11-04T15:42:15.029 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-scipy-1.6.2-8.el9.x86_64 25/93 2023-11-04T15:42:15.042 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-jwt-2.4.0-1.el9.noarch 33/93 2023-11-04T15:42:15.050 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-numpy-1:1.20.1-5.el9.x86_64 39/93 2023-11-04T15:42:15.058 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 26/93 2023-11-04T15:42:15.069 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-jwt+crypto-2.4.0-1.el9.noarch 34/93 2023-11-04T15:42:15.074 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : flexiblas-netlib-3.0.4-8.el9.x86_64 40/93 2023-11-04T15:42:15.083 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-bcrypt-3.2.2-1.el9.x86_64 27/93 2023-11-04T15:42:15.103 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 41/93 2023-11-04T15:42:15.105 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-routes-2.5.1-5.el9.noarch 35/93 2023-11-04T15:42:15.107 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: rbd-mirror-2:18.2.0-1181.gf7e9f9af.el9.x86_64 28/93 2023-11-04T15:42:15.107 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:42:15.107 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-04T15:42:15.108 INFO:teuthology.orchestra.run.smithi019.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target". 2023-11-04T15:42:15.108 INFO:teuthology.orchestra.run.smithi019.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target". 2023-11-04T15:42:15.108 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:15.109 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : rbd-mirror-2:18.2.0-1181.gf7e9f9af.el9.x86_64 28/93 2023-11-04T15:42:15.134 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : openblas-openmp-0.3.21-2.el9.x86_64 42/93 2023-11-04T15:42:15.138 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-cryptography-36.0.1-4.el9.x86_64 36/93 2023-11-04T15:42:15.147 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: rbd-mirror-2:18.2.0-1181.gf7e9f9af.el9.x86_64 28/93 2023-11-04T15:42:15.159 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : libgfortran-11.4.1-2.3.el9.x86_64 43/93 2023-11-04T15:42:15.171 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-cffi-1.14.5-5.el9.x86_64 37/93 2023-11-04T15:42:15.176 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-mako-1.1.4-6.el9.noarch 29/93 2023-11-04T15:42:15.182 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-1181.gf7e9f9a 44/93 2023-11-04T15:42:15.183 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:42:15.183 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-04T15:42:15.183 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:15.184 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : ceph-immutable-object-cache-2:18.2.0-1181.gf7e9f9a 44/93 2023-11-04T15:42:15.202 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-portend-3.1.0-2.el9.noarch 30/93 2023-11-04T15:42:15.219 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-1181.gf7e9f9a 44/93 2023-11-04T15:42:15.227 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-tempora-5.0.0-2.el9.noarch 31/93 2023-11-04T15:42:15.243 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-pycparser-2.20-6.el9.noarch 38/93 2023-11-04T15:42:15.244 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : openblas-0.3.21-2.el9.x86_64 45/93 2023-11-04T15:42:15.253 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-jaraco-functools-3.5.0-2.el9.noarch 32/93 2023-11-04T15:42:15.270 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : flexiblas-3.0.4-8.el9.x86_64 46/93 2023-11-04T15:42:15.278 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-jwt-2.4.0-1.el9.noarch 33/93 2023-11-04T15:42:15.283 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-numpy-1:1.20.1-5.el9.x86_64 39/93 2023-11-04T15:42:15.295 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-ply-3.11-14.el9.noarch 47/93 2023-11-04T15:42:15.305 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-jwt+crypto-2.4.0-1.el9.noarch 34/93 2023-11-04T15:42:15.307 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : flexiblas-netlib-3.0.4-8.el9.x86_64 40/93 2023-11-04T15:42:15.320 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-repoze-lru-0.7-16.el9.noarch 48/93 2023-11-04T15:42:15.335 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-routes-2.5.1-5.el9.noarch 35/93 2023-11-04T15:42:15.336 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 41/93 2023-11-04T15:42:15.346 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-jaraco-8.2.1-3.el9.noarch 49/93 2023-11-04T15:42:15.366 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-cryptography-36.0.1-4.el9.x86_64 36/93 2023-11-04T15:42:15.369 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : openblas-openmp-0.3.21-2.el9.x86_64 42/93 2023-11-04T15:42:15.371 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-more-itertools-8.12.0-2.el9.noarch 50/93 2023-11-04T15:42:15.394 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : libgfortran-11.4.1-2.3.el9.x86_64 43/93 2023-11-04T15:42:15.397 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-toml-0.10.2-6.el9.noarch 51/93 2023-11-04T15:42:15.400 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-cffi-1.14.5-5.el9.x86_64 37/93 2023-11-04T15:42:15.418 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-1181.gf7e9f9a 44/93 2023-11-04T15:42:15.418 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:42:15.418 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-04T15:42:15.419 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:15.419 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : ceph-immutable-object-cache-2:18.2.0-1181.gf7e9f9a 44/93 2023-11-04T15:42:15.428 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-pytz-2021.1-5.el9.noarch 52/93 2023-11-04T15:42:15.454 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-1181.gf7e9f9a 44/93 2023-11-04T15:42:15.456 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-devel-3.9.17-2.el9.x86_64 53/93 2023-11-04T15:42:15.470 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : openblas-0.3.21-2.el9.x86_64 45/93 2023-11-04T15:42:15.476 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-pycparser-2.20-6.el9.noarch 38/93 2023-11-04T15:42:15.482 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-jsonpointer-2.0-4.el9.noarch 54/93 2023-11-04T15:42:15.488 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : flexiblas-3.0.4-8.el9.x86_64 46/93 2023-11-04T15:42:15.515 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-typing-extensions-4.4.0-2.el9.noarch 55/93 2023-11-04T15:42:15.515 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-ply-3.11-14.el9.noarch 47/93 2023-11-04T15:42:15.519 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-numpy-1:1.20.1-5.el9.x86_64 39/93 2023-11-04T15:42:15.538 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-repoze-lru-0.7-16.el9.noarch 48/93 2023-11-04T15:42:15.543 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : flexiblas-netlib-3.0.4-8.el9.x86_64 40/93 2023-11-04T15:42:15.545 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-oauthlib-3.1.1-5.el9.noarch 56/93 2023-11-04T15:42:15.564 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-jaraco-8.2.1-3.el9.noarch 49/93 2023-11-04T15:42:15.572 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 41/93 2023-11-04T15:42:15.585 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-pyasn1-0.4.8-6.el9.noarch 57/93 2023-11-04T15:42:15.589 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-more-itertools-8.12.0-2.el9.noarch 50/93 2023-11-04T15:42:15.603 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : openblas-openmp-0.3.21-2.el9.x86_64 42/93 2023-11-04T15:42:15.621 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-logutils-0.3.5-21.el9.noarch 58/93 2023-11-04T15:42:15.623 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-toml-0.10.2-6.el9.noarch 51/93 2023-11-04T15:42:15.628 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : libgfortran-11.4.1-2.3.el9.x86_64 43/93 2023-11-04T15:42:15.653 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-webob-1.8.7-6.el9.noarch 59/93 2023-11-04T15:42:15.654 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-1181.gf7e9f9a 44/93 2023-11-04T15:42:15.654 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-04T15:42:15.654 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-04T15:42:15.654 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:15.655 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-pytz-2021.1-5.el9.noarch 52/93 2023-11-04T15:42:15.656 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : ceph-immutable-object-cache-2:18.2.0-1181.gf7e9f9a 44/93 2023-11-04T15:42:15.680 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-cachetools-4.2.4-1.el9.noarch 60/93 2023-11-04T15:42:15.696 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-1181.gf7e9f9a 44/93 2023-11-04T15:42:15.703 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-websocket-client-1.2.3-2.el9.noarch 61/93 2023-11-04T15:42:15.708 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-devel-3.9.17-2.el9.x86_64 53/93 2023-11-04T15:42:15.721 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : openblas-0.3.21-2.el9.x86_64 45/93 2023-11-04T15:42:15.729 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-certifi-2021.10.8-2.el9.noarch 62/93 2023-11-04T15:42:15.733 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-jsonpointer-2.0-4.el9.noarch 54/93 2023-11-04T15:42:15.747 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : flexiblas-3.0.4-8.el9.x86_64 46/93 2023-11-04T15:42:15.756 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-zc-lockfile-2.0-10.el9.noarch 63/93 2023-11-04T15:42:15.765 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-typing-extensions-4.4.0-2.el9.noarch 55/93 2023-11-04T15:42:15.772 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-ply-3.11-14.el9.noarch 47/93 2023-11-04T15:42:15.780 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-natsort-7.1.1-5.el9.noarch 64/93 2023-11-04T15:42:15.797 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-repoze-lru-0.7-16.el9.noarch 48/93 2023-11-04T15:42:15.805 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-oauthlib-3.1.1-5.el9.noarch 56/93 2023-11-04T15:42:15.805 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : ceph-grafana-dashboards-2:18.2.0-1181.gf7e9f9af.el 65/93 2023-11-04T15:42:15.823 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-jaraco-8.2.1-3.el9.noarch 49/93 2023-11-04T15:42:15.836 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : ceph-prometheus-alerts-2:18.2.0-1181.gf7e9f9af.el9 66/93 2023-11-04T15:42:15.836 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-pyasn1-0.4.8-6.el9.noarch 57/93 2023-11-04T15:42:15.849 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-more-itertools-8.12.0-2.el9.noarch 50/93 2023-11-04T15:42:15.864 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-logutils-0.3.5-21.el9.noarch 58/93 2023-11-04T15:42:15.873 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-werkzeug-2.0.3-3.el9.1.noarch 67/93 2023-11-04T15:42:15.874 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-toml-0.10.2-6.el9.noarch 51/93 2023-11-04T15:42:15.893 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-base-2:18.2.0-1181.gf7e9f9af.el9.x86_64 68/93 2023-11-04T15:42:15.894 INFO:teuthology.orchestra.run.smithi130.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2023-11-04T15:42:15.894 INFO:teuthology.orchestra.run.smithi130.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-crash.service". 2023-11-04T15:42:15.894 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:15.896 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-webob-1.8.7-6.el9.noarch 59/93 2023-11-04T15:42:15.902 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : ceph-base-2:18.2.0-1181.gf7e9f9af.el9.x86_64 68/93 2023-11-04T15:42:15.903 INFO:teuthology.orchestra.run.smithi130.stdout:warning: file /etc/logrotate.d/ceph: remove failed: No such file or directory 2023-11-04T15:42:15.903 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:15.906 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-pytz-2021.1-5.el9.noarch 52/93 2023-11-04T15:42:15.923 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-cachetools-4.2.4-1.el9.noarch 60/93 2023-11-04T15:42:15.934 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-devel-3.9.17-2.el9.x86_64 53/93 2023-11-04T15:42:15.946 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-websocket-client-1.2.3-2.el9.noarch 61/93 2023-11-04T15:42:15.960 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-jsonpointer-2.0-4.el9.noarch 54/93 2023-11-04T15:42:15.972 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-certifi-2021.10.8-2.el9.noarch 62/93 2023-11-04T15:42:15.992 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-typing-extensions-4.4.0-2.el9.noarch 55/93 2023-11-04T15:42:15.998 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-zc-lockfile-2.0-10.el9.noarch 63/93 2023-11-04T15:42:16.010 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-base-2:18.2.0-1181.gf7e9f9af.el9.x86_64 68/93 2023-11-04T15:42:16.010 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : ceph-selinux-2:18.2.0-1181.gf7e9f9af.el9.x86_64 69/93 2023-11-04T15:42:16.023 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-natsort-7.1.1-5.el9.noarch 64/93 2023-11-04T15:42:16.023 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-oauthlib-3.1.1-5.el9.noarch 56/93 2023-11-04T15:42:16.039 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : ceph-grafana-dashboards-2:18.2.0-1181.gf7e9f9af.el 65/93 2023-11-04T15:42:16.054 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-pyasn1-0.4.8-6.el9.noarch 57/93 2023-11-04T15:42:16.070 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : ceph-prometheus-alerts-2:18.2.0-1181.gf7e9f9af.el9 66/93 2023-11-04T15:42:16.082 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-logutils-0.3.5-21.el9.noarch 58/93 2023-11-04T15:42:16.098 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-werkzeug-2.0.3-3.el9.1.noarch 67/93 2023-11-04T15:42:16.114 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-webob-1.8.7-6.el9.noarch 59/93 2023-11-04T15:42:16.119 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-base-2:18.2.0-1181.gf7e9f9af.el9.x86_64 68/93 2023-11-04T15:42:16.119 INFO:teuthology.orchestra.run.smithi096.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2023-11-04T15:42:16.119 INFO:teuthology.orchestra.run.smithi096.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-crash.service". 2023-11-04T15:42:16.119 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:16.128 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : ceph-base-2:18.2.0-1181.gf7e9f9af.el9.x86_64 68/93 2023-11-04T15:42:16.128 INFO:teuthology.orchestra.run.smithi096.stdout:warning: file /etc/logrotate.d/ceph: remove failed: No such file or directory 2023-11-04T15:42:16.128 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:16.141 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-cachetools-4.2.4-1.el9.noarch 60/93 2023-11-04T15:42:16.173 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-websocket-client-1.2.3-2.el9.noarch 61/93 2023-11-04T15:42:16.198 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-certifi-2021.10.8-2.el9.noarch 62/93 2023-11-04T15:42:16.225 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-zc-lockfile-2.0-10.el9.noarch 63/93 2023-11-04T15:42:16.236 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-base-2:18.2.0-1181.gf7e9f9af.el9.x86_64 68/93 2023-11-04T15:42:16.237 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : ceph-selinux-2:18.2.0-1181.gf7e9f9af.el9.x86_64 69/93 2023-11-04T15:42:16.249 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-natsort-7.1.1-5.el9.noarch 64/93 2023-11-04T15:42:16.274 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : ceph-grafana-dashboards-2:18.2.0-1181.gf7e9f9af.el 65/93 2023-11-04T15:42:16.305 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : ceph-prometheus-alerts-2:18.2.0-1181.gf7e9f9af.el9 66/93 2023-11-04T15:42:16.341 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-werkzeug-2.0.3-3.el9.1.noarch 67/93 2023-11-04T15:42:16.365 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-base-2:18.2.0-1181.gf7e9f9af.el9.x86_64 68/93 2023-11-04T15:42:16.365 INFO:teuthology.orchestra.run.smithi019.stdout:Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2023-11-04T15:42:16.365 INFO:teuthology.orchestra.run.smithi019.stdout:Removed "/etc/systemd/system/ceph.target.wants/ceph-crash.service". 2023-11-04T15:42:16.365 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:16.375 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : ceph-base-2:18.2.0-1181.gf7e9f9af.el9.x86_64 68/93 2023-11-04T15:42:16.375 INFO:teuthology.orchestra.run.smithi019.stdout:warning: file /etc/logrotate.d/ceph: remove failed: No such file or directory 2023-11-04T15:42:16.375 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:16.504 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-base-2:18.2.0-1181.gf7e9f9af.el9.x86_64 68/93 2023-11-04T15:42:16.505 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : ceph-selinux-2:18.2.0-1181.gf7e9f9af.el9.x86_64 69/93 2023-11-04T15:42:23.940 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-selinux-2:18.2.0-1181.gf7e9f9af.el9.x86_64 69/93 2023-11-04T15:42:23.940 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /sys 2023-11-04T15:42:23.940 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /proc 2023-11-04T15:42:23.940 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /mnt 2023-11-04T15:42:23.941 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /var/tmp 2023-11-04T15:42:23.941 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /home 2023-11-04T15:42:23.941 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /root 2023-11-04T15:42:23.941 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /tmp 2023-11-04T15:42:23.941 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:23.984 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x86_64 70/93 2023-11-04T15:42:23.984 INFO:teuthology.orchestra.run.smithi130.stdout:warning: directory /var/lib/ceph: remove failed: Device or resource busy 2023-11-04T15:42:23.984 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:24.052 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x86_64 70/93 2023-11-04T15:42:24.078 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-rgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 71/93 2023-11-04T15:42:24.079 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : librgw2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 72/93 2023-11-04T15:42:24.162 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librgw2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 72/93 2023-11-04T15:42:24.184 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-selinux-2:18.2.0-1181.gf7e9f9af.el9.x86_64 69/93 2023-11-04T15:42:24.184 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /sys 2023-11-04T15:42:24.184 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /proc 2023-11-04T15:42:24.184 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /mnt 2023-11-04T15:42:24.184 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /var/tmp 2023-11-04T15:42:24.185 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /home 2023-11-04T15:42:24.185 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /root 2023-11-04T15:42:24.185 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /tmp 2023-11-04T15:42:24.185 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:24.187 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : parquet-libs-9.0.0-9.el9.x86_64 73/93 2023-11-04T15:42:24.222 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-cephfs-2:18.2.0-1181.gf7e9f9af.el9.x86_64 74/93 2023-11-04T15:42:24.225 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x86_64 70/93 2023-11-04T15:42:24.225 INFO:teuthology.orchestra.run.smithi096.stdout:warning: directory /var/lib/ceph: remove failed: Device or resource busy 2023-11-04T15:42:24.226 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:24.247 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : libarrow-9.0.0-9.el9.x86_64 75/93 2023-11-04T15:42:24.280 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : gperftools-libs-2.9.1-2.el9.x86_64 76/93 2023-11-04T15:42:24.305 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-rbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 77/93 2023-11-04T15:42:24.331 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-ceph-argparse-2:18.2.0-1181.gf7e9f9af.el9. 78/93 2023-11-04T15:42:24.359 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : libarrow-doc-9.0.0-9.el9.noarch 79/93 2023-11-04T15:42:24.360 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x86_64 70/93 2023-11-04T15:42:24.387 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-rgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 71/93 2023-11-04T15:42:24.387 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : librgw2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 72/93 2023-11-04T15:42:24.390 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x8 80/93 2023-11-04T15:42:24.416 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-prettytable-0.7.2-27.el9.noarch 81/93 2023-11-04T15:42:24.442 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-rados-2:18.2.0-1181.gf7e9f9af.el9.x86_64 82/93 2023-11-04T15:42:24.467 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : libunwind-1.6.2-1.el9.x86_64 83/93 2023-11-04T15:42:24.470 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librgw2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 72/93 2023-11-04T15:42:24.492 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : re2-1:20211101-3.el9.x86_64 84/93 2023-11-04T15:42:24.495 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : parquet-libs-9.0.0-9.el9.x86_64 73/93 2023-11-04T15:42:24.518 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : boost-program-options-1.75.0-8.el9.x86_64 85/93 2023-11-04T15:42:24.522 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-cephfs-2:18.2.0-1181.gf7e9f9af.el9.x86_64 74/93 2023-11-04T15:42:24.544 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : librabbitmq-0.11.0-7.el9.x86_64 86/93 2023-11-04T15:42:24.546 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : libarrow-9.0.0-9.el9.x86_64 75/93 2023-11-04T15:42:24.569 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : librdkafka-1.6.1-102.el9.x86_64 87/93 2023-11-04T15:42:24.571 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : gperftools-libs-2.9.1-2.el9.x86_64 76/93 2023-11-04T15:42:24.595 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : liboath-2.6.7-2.el9.x86_64 88/93 2023-11-04T15:42:24.595 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : libradosstriper1-2:18.2.0-1181.gf7e9f9af.el9.x86_6 89/93 2023-11-04T15:42:24.597 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-rbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 77/93 2023-11-04T15:42:24.622 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-ceph-argparse-2:18.2.0-1181.gf7e9f9af.el9. 78/93 2023-11-04T15:42:24.650 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : libarrow-doc-9.0.0-9.el9.noarch 79/93 2023-11-04T15:42:24.680 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libradosstriper1-2:18.2.0-1181.gf7e9f9af.el9.x86_6 89/93 2023-11-04T15:42:24.681 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x8 80/93 2023-11-04T15:42:24.707 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-prettytable-0.7.2-27.el9.noarch 81/93 2023-11-04T15:42:24.714 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : fmt-8.1.1-5.el9.x86_64 90/93 2023-11-04T15:42:24.733 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-rados-2:18.2.0-1181.gf7e9f9af.el9.x86_64 82/93 2023-11-04T15:42:24.739 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : libquadmath-11.4.1-2.3.el9.x86_64 91/93 2023-11-04T15:42:24.758 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : libunwind-1.6.2-1.el9.x86_64 83/93 2023-11-04T15:42:24.764 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : python3-markupsafe-1.1.1-12.el9.x86_64 92/93 2023-11-04T15:42:24.765 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : libcephsqlite-2:18.2.0-1181.gf7e9f9af.el9.x86_64 93/93 2023-11-04T15:42:24.783 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : re2-1:20211101-3.el9.x86_64 84/93 2023-11-04T15:42:24.809 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : boost-program-options-1.75.0-8.el9.x86_64 85/93 2023-11-04T15:42:24.835 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : librabbitmq-0.11.0-7.el9.x86_64 86/93 2023-11-04T15:42:24.860 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : librdkafka-1.6.1-102.el9.x86_64 87/93 2023-11-04T15:42:24.886 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : liboath-2.6.7-2.el9.x86_64 88/93 2023-11-04T15:42:24.886 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : libradosstriper1-2:18.2.0-1181.gf7e9f9af.el9.x86_6 89/93 2023-11-04T15:42:24.970 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libradosstriper1-2:18.2.0-1181.gf7e9f9af.el9.x86_6 89/93 2023-11-04T15:42:24.972 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-selinux-2:18.2.0-1181.gf7e9f9af.el9.x86_64 69/93 2023-11-04T15:42:24.973 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /sys 2023-11-04T15:42:24.973 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /proc 2023-11-04T15:42:24.973 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /mnt 2023-11-04T15:42:24.973 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /var/tmp 2023-11-04T15:42:24.973 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /home 2023-11-04T15:42:24.974 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /root 2023-11-04T15:42:24.974 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /tmp 2023-11-04T15:42:24.974 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:24.995 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : fmt-8.1.1-5.el9.x86_64 90/93 2023-11-04T15:42:25.020 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x86_64 70/93 2023-11-04T15:42:25.021 INFO:teuthology.orchestra.run.smithi019.stdout:warning: directory /var/lib/ceph: remove failed: Device or resource busy 2023-11-04T15:42:25.021 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:25.022 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : libquadmath-11.4.1-2.3.el9.x86_64 91/93 2023-11-04T15:42:25.046 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : python3-markupsafe-1.1.1-12.el9.x86_64 92/93 2023-11-04T15:42:25.047 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : libcephsqlite-2:18.2.0-1181.gf7e9f9af.el9.x86_64 93/93 2023-11-04T15:42:25.238 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x86_64 70/93 2023-11-04T15:42:25.265 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-rgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 71/93 2023-11-04T15:42:25.265 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : librgw2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 72/93 2023-11-04T15:42:25.348 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librgw2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 72/93 2023-11-04T15:42:25.373 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : parquet-libs-9.0.0-9.el9.x86_64 73/93 2023-11-04T15:42:25.408 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-cephfs-2:18.2.0-1181.gf7e9f9af.el9.x86_64 74/93 2023-11-04T15:42:25.433 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : libarrow-9.0.0-9.el9.x86_64 75/93 2023-11-04T15:42:25.458 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : gperftools-libs-2.9.1-2.el9.x86_64 76/93 2023-11-04T15:42:25.475 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libcephsqlite-2:18.2.0-1181.gf7e9f9af.el9.x86_64 93/93 2023-11-04T15:42:25.476 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 1/93 2023-11-04T15:42:25.476 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-base-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/93 2023-11-04T15:42:25.476 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x86_64 3/93 2023-11-04T15:42:25.476 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-1181.gf7e9f9af.el 4/93 2023-11-04T15:42:25.476 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-1181.gf7e9f9a 5/93 2023-11-04T15:42:25.477 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-2:18.2.0-1181.gf7e9f9af.el9.x86_64 6/93 2023-11-04T15:42:25.477 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarc 7/93 2023-11-04T15:42:25.477 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-1181.gf7e9f9af.el9.noa 8/93 2023-11-04T15:42:25.477 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-1181.gf7e9f 9/93 2023-11-04T15:42:25.477 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-1181.gf7e9f9af.el9. 10/93 2023-11-04T15:42:25.478 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-rook-2:18.2.0-1181.gf7e9f9af.el9.noarch 11/93 2023-11-04T15:42:25.478 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-osd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 12/93 2023-11-04T15:42:25.478 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-1181.gf7e9f9af.el9 13/93 2023-11-04T15:42:25.478 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-selinux-2:18.2.0-1181.gf7e9f9af.el9.x86_64 14/93 2023-11-04T15:42:25.478 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-volume-2:18.2.0-1181.gf7e9f9af.el9.noarch 15/93 2023-11-04T15:42:25.479 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 16/93 2023-11-04T15:42:25.479 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 17/93 2023-11-04T15:42:25.479 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 18/93 2023-11-04T15:42:25.479 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 19/93 2023-11-04T15:42:25.479 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 20/93 2023-11-04T15:42:25.480 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 21/93 2023-11-04T15:42:25.480 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 22/93 2023-11-04T15:42:25.480 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephsqlite-2:18.2.0-1181.gf7e9f9af.el9.x86_64 23/93 2023-11-04T15:42:25.480 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 24/93 2023-11-04T15:42:25.480 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 25/93 2023-11-04T15:42:25.486 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 26/93 2023-11-04T15:42:25.486 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 27/93 2023-11-04T15:42:25.487 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libradosstriper1-2:18.2.0-1181.gf7e9f9af.el9.x86_6 28/93 2023-11-04T15:42:25.487 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 29/93 2023-11-04T15:42:25.487 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librgw2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 30/93 2023-11-04T15:42:25.487 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 31/93 2023-11-04T15:42:25.488 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 32/93 2023-11-04T15:42:25.488 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 33/93 2023-11-04T15:42:25.488 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 34/93 2023-11-04T15:42:25.488 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 35/93 2023-11-04T15:42:25.488 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 36/93 2023-11-04T15:42:25.489 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 37/93 2023-11-04T15:42:25.489 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 38/93 2023-11-04T15:42:25.489 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-ceph-argparse-2:18.2.0-1181.gf7e9f9af.el9. 39/93 2023-11-04T15:42:25.489 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x8 40/93 2023-11-04T15:42:25.489 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cephfs-2:18.2.0-1181.gf7e9f9af.el9.x86_64 41/93 2023-11-04T15:42:25.490 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 42/93 2023-11-04T15:42:25.490 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/93 2023-11-04T15:42:25.490 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 44/93 2023-11-04T15:42:25.490 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 45/93 2023-11-04T15:42:25.490 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 46/93 2023-11-04T15:42:25.491 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 47/93 2023-11-04T15:42:25.491 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-google-auth-1:2.23.3-1.el9.noarch 48/93 2023-11-04T15:42:25.491 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 49/93 2023-11-04T15:42:25.491 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 50/93 2023-11-04T15:42:25.491 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 51/93 2023-11-04T15:42:25.491 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 52/93 2023-11-04T15:42:25.492 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 53/93 2023-11-04T15:42:25.492 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 54/93 2023-11-04T15:42:25.492 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 55/93 2023-11-04T15:42:25.492 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 56/93 2023-11-04T15:42:25.492 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 57/93 2023-11-04T15:42:25.493 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 58/93 2023-11-04T15:42:25.493 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 59/93 2023-11-04T15:42:25.493 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 60/93 2023-11-04T15:42:25.493 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 61/93 2023-11-04T15:42:25.493 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 62/93 2023-11-04T15:42:25.494 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 63/93 2023-11-04T15:42:25.494 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 64/93 2023-11-04T15:42:25.494 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/93 2023-11-04T15:42:25.494 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/93 2023-11-04T15:42:25.494 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/93 2023-11-04T15:42:25.495 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 68/93 2023-11-04T15:42:25.495 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-ply-3.11-14.el9.noarch 69/93 2023-11-04T15:42:25.495 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 70/93 2023-11-04T15:42:25.495 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 71/93 2023-11-04T15:42:25.495 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 72/93 2023-11-04T15:42:25.496 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 73/93 2023-11-04T15:42:25.496 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 74/93 2023-11-04T15:42:25.496 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 75/93 2023-11-04T15:42:25.496 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/93 2023-11-04T15:42:25.496 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rados-2:18.2.0-1181.gf7e9f9af.el9.x86_64 77/93 2023-11-04T15:42:25.497 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 78/93 2023-11-04T15:42:25.497 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 79/93 2023-11-04T15:42:25.497 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/93 2023-11-04T15:42:25.497 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 81/93 2023-11-04T15:42:25.497 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 82/93 2023-11-04T15:42:25.497 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 83/93 2023-11-04T15:42:25.498 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 84/93 2023-11-04T15:42:25.498 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 85/93 2023-11-04T15:42:25.498 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 86/93 2023-11-04T15:42:25.498 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 87/93 2023-11-04T15:42:25.498 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 88/93 2023-11-04T15:42:25.499 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 89/93 2023-11-04T15:42:25.499 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 90/93 2023-11-04T15:42:25.499 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 91/93 2023-11-04T15:42:25.499 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-mirror-2:18.2.0-1181.gf7e9f9af.el9.x86_64 92/93 2023-11-04T15:42:25.500 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-rbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 77/93 2023-11-04T15:42:25.509 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-ceph-argparse-2:18.2.0-1181.gf7e9f9af.el9. 78/93 2023-11-04T15:42:25.538 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : libarrow-doc-9.0.0-9.el9.noarch 79/93 2023-11-04T15:42:25.568 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x8 80/93 2023-11-04T15:42:25.594 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-prettytable-0.7.2-27.el9.noarch 81/93 2023-11-04T15:42:25.611 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-rados-2:18.2.0-1181.gf7e9f9af.el9.x86_64 82/93 2023-11-04T15:42:25.637 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : libunwind-1.6.2-1.el9.x86_64 83/93 2023-11-04T15:42:25.662 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : re2-1:20211101-3.el9.x86_64 84/93 2023-11-04T15:42:25.738 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : boost-program-options-1.75.0-8.el9.x86_64 85/93 2023-11-04T15:42:25.739 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : librabbitmq-0.11.0-7.el9.x86_64 86/93 2023-11-04T15:42:25.747 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libcephsqlite-2:18.2.0-1181.gf7e9f9af.el9.x86_64 93/93 2023-11-04T15:42:25.747 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 1/93 2023-11-04T15:42:25.747 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-base-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/93 2023-11-04T15:42:25.748 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x86_64 3/93 2023-11-04T15:42:25.748 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-1181.gf7e9f9af.el 4/93 2023-11-04T15:42:25.748 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-1181.gf7e9f9a 5/93 2023-11-04T15:42:25.748 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-2:18.2.0-1181.gf7e9f9af.el9.x86_64 6/93 2023-11-04T15:42:25.748 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarc 7/93 2023-11-04T15:42:25.749 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-1181.gf7e9f9af.el9.noa 8/93 2023-11-04T15:42:25.749 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-1181.gf7e9f 9/93 2023-11-04T15:42:25.749 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-1181.gf7e9f9af.el9. 10/93 2023-11-04T15:42:25.749 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-rook-2:18.2.0-1181.gf7e9f9af.el9.noarch 11/93 2023-11-04T15:42:25.749 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-osd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 12/93 2023-11-04T15:42:25.750 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-1181.gf7e9f9af.el9 13/93 2023-11-04T15:42:25.750 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-selinux-2:18.2.0-1181.gf7e9f9af.el9.x86_64 14/93 2023-11-04T15:42:25.750 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-volume-2:18.2.0-1181.gf7e9f9af.el9.noarch 15/93 2023-11-04T15:42:25.750 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 16/93 2023-11-04T15:42:25.750 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 17/93 2023-11-04T15:42:25.751 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 18/93 2023-11-04T15:42:25.751 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 19/93 2023-11-04T15:42:25.751 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 20/93 2023-11-04T15:42:25.751 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 21/93 2023-11-04T15:42:25.751 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 22/93 2023-11-04T15:42:25.752 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libcephsqlite-2:18.2.0-1181.gf7e9f9af.el9.x86_64 23/93 2023-11-04T15:42:25.752 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 24/93 2023-11-04T15:42:25.752 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 25/93 2023-11-04T15:42:25.752 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 26/93 2023-11-04T15:42:25.752 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 27/93 2023-11-04T15:42:25.752 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libradosstriper1-2:18.2.0-1181.gf7e9f9af.el9.x86_6 28/93 2023-11-04T15:42:25.753 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 29/93 2023-11-04T15:42:25.753 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librgw2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 30/93 2023-11-04T15:42:25.753 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 31/93 2023-11-04T15:42:25.753 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 32/93 2023-11-04T15:42:25.753 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 33/93 2023-11-04T15:42:25.754 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 34/93 2023-11-04T15:42:25.754 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 35/93 2023-11-04T15:42:25.754 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 36/93 2023-11-04T15:42:25.754 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 37/93 2023-11-04T15:42:25.754 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 38/93 2023-11-04T15:42:25.755 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-ceph-argparse-2:18.2.0-1181.gf7e9f9af.el9. 39/93 2023-11-04T15:42:25.755 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x8 40/93 2023-11-04T15:42:25.755 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cephfs-2:18.2.0-1181.gf7e9f9af.el9.x86_64 41/93 2023-11-04T15:42:25.755 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 42/93 2023-11-04T15:42:25.755 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/93 2023-11-04T15:42:25.755 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 44/93 2023-11-04T15:42:25.756 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 45/93 2023-11-04T15:42:25.756 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 46/93 2023-11-04T15:42:25.756 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 47/93 2023-11-04T15:42:25.756 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-google-auth-1:2.23.3-1.el9.noarch 48/93 2023-11-04T15:42:25.756 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 49/93 2023-11-04T15:42:25.757 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 50/93 2023-11-04T15:42:25.757 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 51/93 2023-11-04T15:42:25.757 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 52/93 2023-11-04T15:42:25.757 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 53/93 2023-11-04T15:42:25.757 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 54/93 2023-11-04T15:42:25.758 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 55/93 2023-11-04T15:42:25.758 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 56/93 2023-11-04T15:42:25.758 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 57/93 2023-11-04T15:42:25.758 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 58/93 2023-11-04T15:42:25.758 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 59/93 2023-11-04T15:42:25.759 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 60/93 2023-11-04T15:42:25.759 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 61/93 2023-11-04T15:42:25.759 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 62/93 2023-11-04T15:42:25.759 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 63/93 2023-11-04T15:42:25.759 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 64/93 2023-11-04T15:42:25.760 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/93 2023-11-04T15:42:25.760 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/93 2023-11-04T15:42:25.760 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/93 2023-11-04T15:42:25.760 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 68/93 2023-11-04T15:42:25.760 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-ply-3.11-14.el9.noarch 69/93 2023-11-04T15:42:25.761 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 70/93 2023-11-04T15:42:25.761 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 71/93 2023-11-04T15:42:25.761 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 72/93 2023-11-04T15:42:25.761 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 73/93 2023-11-04T15:42:25.761 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 74/93 2023-11-04T15:42:25.762 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 75/93 2023-11-04T15:42:25.762 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/93 2023-11-04T15:42:25.762 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rados-2:18.2.0-1181.gf7e9f9af.el9.x86_64 77/93 2023-11-04T15:42:25.762 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 78/93 2023-11-04T15:42:25.762 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 79/93 2023-11-04T15:42:25.763 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/93 2023-11-04T15:42:25.763 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 81/93 2023-11-04T15:42:25.763 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 82/93 2023-11-04T15:42:25.763 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 83/93 2023-11-04T15:42:25.763 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 84/93 2023-11-04T15:42:25.764 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 85/93 2023-11-04T15:42:25.764 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 86/93 2023-11-04T15:42:25.764 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 87/93 2023-11-04T15:42:25.764 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 88/93 2023-11-04T15:42:25.764 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 89/93 2023-11-04T15:42:25.765 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 90/93 2023-11-04T15:42:25.765 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 91/93 2023-11-04T15:42:25.765 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : rbd-mirror-2:18.2.0-1181.gf7e9f9af.el9.x86_64 92/93 2023-11-04T15:42:25.765 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : librdkafka-1.6.1-102.el9.x86_64 87/93 2023-11-04T15:42:25.789 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : liboath-2.6.7-2.el9.x86_64 88/93 2023-11-04T15:42:25.790 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : libradosstriper1-2:18.2.0-1181.gf7e9f9af.el9.x86_6 89/93 2023-11-04T15:42:25.858 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libradosstriper1-2:18.2.0-1181.gf7e9f9af.el9.x86_6 89/93 2023-11-04T15:42:25.884 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : fmt-8.1.1-5.el9.x86_64 90/93 2023-11-04T15:42:25.909 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : libquadmath-11.4.1-2.3.el9.x86_64 91/93 2023-11-04T15:42:25.934 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : python3-markupsafe-1.1.1-12.el9.x86_64 92/93 2023-11-04T15:42:25.934 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : libcephsqlite-2:18.2.0-1181.gf7e9f9af.el9.x86_64 93/93 2023-11-04T15:42:26.583 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libcephsqlite-2:18.2.0-1181.gf7e9f9af.el9.x86_64 93/93 2023-11-04T15:42:26.584 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 1/93 2023-11-04T15:42:26.584 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-base-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/93 2023-11-04T15:42:26.584 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x86_64 3/93 2023-11-04T15:42:26.584 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-1181.gf7e9f9af.el 4/93 2023-11-04T15:42:26.585 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-1181.gf7e9f9a 5/93 2023-11-04T15:42:26.585 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-2:18.2.0-1181.gf7e9f9af.el9.x86_64 6/93 2023-11-04T15:42:26.585 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarc 7/93 2023-11-04T15:42:26.585 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-1181.gf7e9f9af.el9.noa 8/93 2023-11-04T15:42:26.585 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-1181.gf7e9f 9/93 2023-11-04T15:42:26.586 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-1181.gf7e9f9af.el9. 10/93 2023-11-04T15:42:26.586 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-rook-2:18.2.0-1181.gf7e9f9af.el9.noarch 11/93 2023-11-04T15:42:26.586 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-osd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 12/93 2023-11-04T15:42:26.586 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-1181.gf7e9f9af.el9 13/93 2023-11-04T15:42:26.586 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-selinux-2:18.2.0-1181.gf7e9f9af.el9.x86_64 14/93 2023-11-04T15:42:26.587 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-volume-2:18.2.0-1181.gf7e9f9af.el9.noarch 15/93 2023-11-04T15:42:26.587 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 16/93 2023-11-04T15:42:26.587 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 17/93 2023-11-04T15:42:26.587 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 18/93 2023-11-04T15:42:26.587 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 19/93 2023-11-04T15:42:26.588 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 20/93 2023-11-04T15:42:26.588 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 21/93 2023-11-04T15:42:26.588 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 22/93 2023-11-04T15:42:26.588 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephsqlite-2:18.2.0-1181.gf7e9f9af.el9.x86_64 23/93 2023-11-04T15:42:26.588 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 24/93 2023-11-04T15:42:26.589 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 25/93 2023-11-04T15:42:26.595 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 26/93 2023-11-04T15:42:26.595 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 27/93 2023-11-04T15:42:26.595 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libradosstriper1-2:18.2.0-1181.gf7e9f9af.el9.x86_6 28/93 2023-11-04T15:42:26.596 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 29/93 2023-11-04T15:42:26.596 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librgw2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 30/93 2023-11-04T15:42:26.596 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 31/93 2023-11-04T15:42:26.596 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 32/93 2023-11-04T15:42:26.597 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 33/93 2023-11-04T15:42:26.597 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 34/93 2023-11-04T15:42:26.597 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 35/93 2023-11-04T15:42:26.597 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 36/93 2023-11-04T15:42:26.597 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 37/93 2023-11-04T15:42:26.598 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 38/93 2023-11-04T15:42:26.598 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ceph-argparse-2:18.2.0-1181.gf7e9f9af.el9. 39/93 2023-11-04T15:42:26.598 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x8 40/93 2023-11-04T15:42:26.598 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cephfs-2:18.2.0-1181.gf7e9f9af.el9.x86_64 41/93 2023-11-04T15:42:26.598 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 42/93 2023-11-04T15:42:26.598 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/93 2023-11-04T15:42:26.599 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 44/93 2023-11-04T15:42:26.599 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 45/93 2023-11-04T15:42:26.599 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 46/93 2023-11-04T15:42:26.599 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 47/93 2023-11-04T15:42:26.599 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-google-auth-1:2.23.3-1.el9.noarch 48/93 2023-11-04T15:42:26.600 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 49/93 2023-11-04T15:42:26.600 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 50/93 2023-11-04T15:42:26.600 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 51/93 2023-11-04T15:42:26.600 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 52/93 2023-11-04T15:42:26.600 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 53/93 2023-11-04T15:42:26.600 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 54/93 2023-11-04T15:42:26.601 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 55/93 2023-11-04T15:42:26.601 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 56/93 2023-11-04T15:42:26.601 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 57/93 2023-11-04T15:42:26.601 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 58/93 2023-11-04T15:42:26.601 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 59/93 2023-11-04T15:42:26.602 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 60/93 2023-11-04T15:42:26.602 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 61/93 2023-11-04T15:42:26.602 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 62/93 2023-11-04T15:42:26.602 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 63/93 2023-11-04T15:42:26.602 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 64/93 2023-11-04T15:42:26.603 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/93 2023-11-04T15:42:26.603 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/93 2023-11-04T15:42:26.603 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/93 2023-11-04T15:42:26.603 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 68/93 2023-11-04T15:42:26.603 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ply-3.11-14.el9.noarch 69/93 2023-11-04T15:42:26.604 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 70/93 2023-11-04T15:42:26.604 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 71/93 2023-11-04T15:42:26.604 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 72/93 2023-11-04T15:42:26.604 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 73/93 2023-11-04T15:42:26.604 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 74/93 2023-11-04T15:42:26.605 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 75/93 2023-11-04T15:42:26.605 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/93 2023-11-04T15:42:26.605 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rados-2:18.2.0-1181.gf7e9f9af.el9.x86_64 77/93 2023-11-04T15:42:26.605 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 78/93 2023-11-04T15:42:26.605 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 79/93 2023-11-04T15:42:26.605 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/93 2023-11-04T15:42:26.606 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 81/93 2023-11-04T15:42:26.606 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 82/93 2023-11-04T15:42:26.606 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 83/93 2023-11-04T15:42:26.606 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 84/93 2023-11-04T15:42:26.606 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 85/93 2023-11-04T15:42:26.607 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 86/93 2023-11-04T15:42:26.607 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 87/93 2023-11-04T15:42:26.607 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 88/93 2023-11-04T15:42:26.607 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 89/93 2023-11-04T15:42:26.607 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 90/93 2023-11-04T15:42:26.607 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 91/93 2023-11-04T15:42:26.608 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-mirror-2:18.2.0-1181.gf7e9f9af.el9.x86_64 92/93 2023-11-04T15:42:27.349 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : re2-1:20211101-3.el9.x86_64 93/93 2023-11-04T15:42:27.349 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:27.349 INFO:teuthology.orchestra.run.smithi130.stdout:Removed: 2023-11-04T15:42:27.350 INFO:teuthology.orchestra.run.smithi130.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-04T15:42:27.350 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-base-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:27.350 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:27.350 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-grafana-dashboards-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:42:27.350 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-immutable-object-cache-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:27.351 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:27.351 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:42:27.351 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-dashboard-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:42:27.351 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-diskprediction-local-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:42:27.351 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-modules-core-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:42:27.352 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-rook-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:42:27.352 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-osd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:27.352 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-prometheus-alerts-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:42:27.352 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-selinux-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:27.352 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-volume-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:42:27.353 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-04T15:42:27.353 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-04T15:42:27.353 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-04T15:42:27.353 INFO:teuthology.orchestra.run.smithi130.stdout: fmt-8.1.1-5.el9.x86_64 2023-11-04T15:42:27.353 INFO:teuthology.orchestra.run.smithi130.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-04T15:42:27.354 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-04T15:42:27.354 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-04T15:42:27.354 INFO:teuthology.orchestra.run.smithi130.stdout: libcephsqlite-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:27.354 INFO:teuthology.orchestra.run.smithi130.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-04T15:42:27.354 INFO:teuthology.orchestra.run.smithi130.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-04T15:42:27.355 INFO:teuthology.orchestra.run.smithi130.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-04T15:42:27.355 INFO:teuthology.orchestra.run.smithi130.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-04T15:42:27.355 INFO:teuthology.orchestra.run.smithi130.stdout: libradosstriper1-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:27.355 INFO:teuthology.orchestra.run.smithi130.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-04T15:42:27.355 INFO:teuthology.orchestra.run.smithi130.stdout: librgw2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:27.356 INFO:teuthology.orchestra.run.smithi130.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-04T15:42:27.356 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-04T15:42:27.356 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-04T15:42:27.356 INFO:teuthology.orchestra.run.smithi130.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-04T15:42:27.356 INFO:teuthology.orchestra.run.smithi130.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-04T15:42:27.357 INFO:teuthology.orchestra.run.smithi130.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-04T15:42:27.357 INFO:teuthology.orchestra.run.smithi130.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-04T15:42:27.357 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-04T15:42:27.357 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-argparse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:27.357 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:27.358 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cephfs-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:27.358 INFO:teuthology.orchestra.run.smithi130.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-04T15:42:27.358 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-04T15:42:27.358 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-04T15:42:27.358 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-04T15:42:27.359 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-04T15:42:27.359 INFO:teuthology.orchestra.run.smithi130.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-04T15:42:27.359 INFO:teuthology.orchestra.run.smithi130.stdout: python3-google-auth-1:2.23.3-1.el9.noarch 2023-11-04T15:42:27.359 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-04T15:42:27.359 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-04T15:42:27.359 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-04T15:42:27.360 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-04T15:42:27.360 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-04T15:42:27.360 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-04T15:42:27.360 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-04T15:42:27.360 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-04T15:42:27.361 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-04T15:42:27.361 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-04T15:42:27.361 INFO:teuthology.orchestra.run.smithi130.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-04T15:42:27.361 INFO:teuthology.orchestra.run.smithi130.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-04T15:42:27.361 INFO:teuthology.orchestra.run.smithi130.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-04T15:42:27.362 INFO:teuthology.orchestra.run.smithi130.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-04T15:42:27.362 INFO:teuthology.orchestra.run.smithi130.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-04T15:42:27.362 INFO:teuthology.orchestra.run.smithi130.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-04T15:42:27.362 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-04T15:42:27.362 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-04T15:42:27.363 INFO:teuthology.orchestra.run.smithi130.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-04T15:42:27.363 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-04T15:42:27.363 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ply-3.11-14.el9.noarch 2023-11-04T15:42:27.363 INFO:teuthology.orchestra.run.smithi130.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-04T15:42:27.363 INFO:teuthology.orchestra.run.smithi130.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-04T15:42:27.363 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-04T15:42:27.364 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-04T15:42:27.364 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-04T15:42:27.364 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-04T15:42:27.364 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-04T15:42:27.364 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rados-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:27.365 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:27.365 INFO:teuthology.orchestra.run.smithi130.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-04T15:42:27.365 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-04T15:42:27.365 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:27.365 INFO:teuthology.orchestra.run.smithi130.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-04T15:42:27.365 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-04T15:42:27.366 INFO:teuthology.orchestra.run.smithi130.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-04T15:42:27.366 INFO:teuthology.orchestra.run.smithi130.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-04T15:42:27.366 INFO:teuthology.orchestra.run.smithi130.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-04T15:42:27.366 INFO:teuthology.orchestra.run.smithi130.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-04T15:42:27.366 INFO:teuthology.orchestra.run.smithi130.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-04T15:42:27.367 INFO:teuthology.orchestra.run.smithi130.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-04T15:42:27.367 INFO:teuthology.orchestra.run.smithi130.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-04T15:42:27.367 INFO:teuthology.orchestra.run.smithi130.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-04T15:42:27.367 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-mirror-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:27.367 INFO:teuthology.orchestra.run.smithi130.stdout: re2-1:20211101-3.el9.x86_64 2023-11-04T15:42:27.367 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:27.368 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:42:27.384 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : re2-1:20211101-3.el9.x86_64 93/93 2023-11-04T15:42:27.384 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:27.384 INFO:teuthology.orchestra.run.smithi096.stdout:Removed: 2023-11-04T15:42:27.384 INFO:teuthology.orchestra.run.smithi096.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-04T15:42:27.385 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-base-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:27.385 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:27.385 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-grafana-dashboards-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:42:27.385 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-immutable-object-cache-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:27.385 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:27.386 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:42:27.386 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-dashboard-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:42:27.386 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-diskprediction-local-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:42:27.386 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-modules-core-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:42:27.386 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-rook-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:42:27.387 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-osd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:27.387 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-prometheus-alerts-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:42:27.387 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-selinux-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:27.387 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-volume-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:42:27.387 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-04T15:42:27.387 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-04T15:42:27.388 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-04T15:42:27.388 INFO:teuthology.orchestra.run.smithi096.stdout: fmt-8.1.1-5.el9.x86_64 2023-11-04T15:42:27.388 INFO:teuthology.orchestra.run.smithi096.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-04T15:42:27.388 INFO:teuthology.orchestra.run.smithi096.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-04T15:42:27.388 INFO:teuthology.orchestra.run.smithi096.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-04T15:42:27.389 INFO:teuthology.orchestra.run.smithi096.stdout: libcephsqlite-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:27.389 INFO:teuthology.orchestra.run.smithi096.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-04T15:42:27.389 INFO:teuthology.orchestra.run.smithi096.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-04T15:42:27.389 INFO:teuthology.orchestra.run.smithi096.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-04T15:42:27.389 INFO:teuthology.orchestra.run.smithi096.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-04T15:42:27.390 INFO:teuthology.orchestra.run.smithi096.stdout: libradosstriper1-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:27.390 INFO:teuthology.orchestra.run.smithi096.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-04T15:42:27.390 INFO:teuthology.orchestra.run.smithi096.stdout: librgw2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:27.390 INFO:teuthology.orchestra.run.smithi096.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-04T15:42:27.390 INFO:teuthology.orchestra.run.smithi096.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-04T15:42:27.391 INFO:teuthology.orchestra.run.smithi096.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-04T15:42:27.391 INFO:teuthology.orchestra.run.smithi096.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-04T15:42:27.391 INFO:teuthology.orchestra.run.smithi096.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-04T15:42:27.391 INFO:teuthology.orchestra.run.smithi096.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-04T15:42:27.391 INFO:teuthology.orchestra.run.smithi096.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-04T15:42:27.391 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-04T15:42:27.392 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-argparse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:27.392 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:27.392 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cephfs-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:27.392 INFO:teuthology.orchestra.run.smithi096.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-04T15:42:27.392 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-04T15:42:27.393 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-04T15:42:27.393 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-04T15:42:27.393 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-04T15:42:27.393 INFO:teuthology.orchestra.run.smithi096.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-04T15:42:27.393 INFO:teuthology.orchestra.run.smithi096.stdout: python3-google-auth-1:2.23.3-1.el9.noarch 2023-11-04T15:42:27.394 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-04T15:42:27.394 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-04T15:42:27.394 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-04T15:42:27.394 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-04T15:42:27.394 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-04T15:42:27.395 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-04T15:42:27.395 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-04T15:42:27.395 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-04T15:42:27.395 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-04T15:42:27.395 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-04T15:42:27.396 INFO:teuthology.orchestra.run.smithi096.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-04T15:42:27.396 INFO:teuthology.orchestra.run.smithi096.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-04T15:42:27.396 INFO:teuthology.orchestra.run.smithi096.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-04T15:42:27.396 INFO:teuthology.orchestra.run.smithi096.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-04T15:42:27.396 INFO:teuthology.orchestra.run.smithi096.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-04T15:42:27.397 INFO:teuthology.orchestra.run.smithi096.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-04T15:42:27.397 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-04T15:42:27.397 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-04T15:42:27.397 INFO:teuthology.orchestra.run.smithi096.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-04T15:42:27.397 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-04T15:42:27.397 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ply-3.11-14.el9.noarch 2023-11-04T15:42:27.398 INFO:teuthology.orchestra.run.smithi096.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-04T15:42:27.398 INFO:teuthology.orchestra.run.smithi096.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-04T15:42:27.398 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-04T15:42:27.398 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-04T15:42:27.398 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-04T15:42:27.399 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-04T15:42:27.399 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-04T15:42:27.399 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rados-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:27.399 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:27.399 INFO:teuthology.orchestra.run.smithi096.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-04T15:42:27.400 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-04T15:42:27.400 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:27.400 INFO:teuthology.orchestra.run.smithi096.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-04T15:42:27.400 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-04T15:42:27.400 INFO:teuthology.orchestra.run.smithi096.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-04T15:42:27.401 INFO:teuthology.orchestra.run.smithi096.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-04T15:42:27.401 INFO:teuthology.orchestra.run.smithi096.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-04T15:42:27.401 INFO:teuthology.orchestra.run.smithi096.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-04T15:42:27.401 INFO:teuthology.orchestra.run.smithi096.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-04T15:42:27.401 INFO:teuthology.orchestra.run.smithi096.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-04T15:42:27.401 INFO:teuthology.orchestra.run.smithi096.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-04T15:42:27.402 INFO:teuthology.orchestra.run.smithi096.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-04T15:42:27.402 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-mirror-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:27.402 INFO:teuthology.orchestra.run.smithi096.stdout: re2-1:20211101-3.el9.x86_64 2023-11-04T15:42:27.402 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:27.402 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:42:28.028 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:42:28.029 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:42:28.029 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2023-11-04T15:42:28.029 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:42:28.030 INFO:teuthology.orchestra.run.smithi130.stdout:Removing: 2023-11-04T15:42:28.030 INFO:teuthology.orchestra.run.smithi130.stdout: cephadm noarch 2:18.2.0-1181.gf7e9f9af.el9 @ceph-noarch 213 k 2023-11-04T15:42:28.030 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:28.030 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-11-04T15:42:28.030 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:42:28.031 INFO:teuthology.orchestra.run.smithi130.stdout:Remove 1 Package 2023-11-04T15:42:28.031 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:28.031 INFO:teuthology.orchestra.run.smithi130.stdout:Freed space: 213 k 2023-11-04T15:42:28.031 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-11-04T15:42:28.032 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-11-04T15:42:28.032 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-11-04T15:42:28.033 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-11-04T15:42:28.033 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-11-04T15:42:28.056 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:42:28.057 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:42:28.057 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2023-11-04T15:42:28.057 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:42:28.058 INFO:teuthology.orchestra.run.smithi096.stdout:Removing: 2023-11-04T15:42:28.058 INFO:teuthology.orchestra.run.smithi096.stdout: cephadm noarch 2:18.2.0-1181.gf7e9f9af.el9 @ceph-noarch 213 k 2023-11-04T15:42:28.058 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:28.058 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2023-11-04T15:42:28.058 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:42:28.059 INFO:teuthology.orchestra.run.smithi096.stdout:Remove 1 Package 2023-11-04T15:42:28.059 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:28.059 INFO:teuthology.orchestra.run.smithi096.stdout:Freed space: 213 k 2023-11-04T15:42:28.059 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2023-11-04T15:42:28.060 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2023-11-04T15:42:28.060 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2023-11-04T15:42:28.061 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2023-11-04T15:42:28.061 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2023-11-04T15:42:28.084 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-11-04T15:42:28.084 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/1 2023-11-04T15:42:28.114 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2023-11-04T15:42:28.114 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/1 2023-11-04T15:42:28.302 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : re2-1:20211101-3.el9.x86_64 93/93 2023-11-04T15:42:28.302 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:28.302 INFO:teuthology.orchestra.run.smithi019.stdout:Removed: 2023-11-04T15:42:28.302 INFO:teuthology.orchestra.run.smithi019.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-04T15:42:28.303 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-base-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:28.303 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:28.303 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-grafana-dashboards-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:42:28.303 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-immutable-object-cache-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:28.303 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:28.304 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:42:28.304 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-dashboard-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:42:28.304 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-diskprediction-local-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:42:28.304 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-modules-core-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:42:28.304 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-rook-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:42:28.304 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-osd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:28.305 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-prometheus-alerts-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:42:28.305 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-selinux-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:28.305 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-volume-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:42:28.306 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-04T15:42:28.306 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-04T15:42:28.306 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-04T15:42:28.306 INFO:teuthology.orchestra.run.smithi019.stdout: fmt-8.1.1-5.el9.x86_64 2023-11-04T15:42:28.306 INFO:teuthology.orchestra.run.smithi019.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-04T15:42:28.307 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-04T15:42:28.307 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-04T15:42:28.307 INFO:teuthology.orchestra.run.smithi019.stdout: libcephsqlite-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:28.307 INFO:teuthology.orchestra.run.smithi019.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-04T15:42:28.307 INFO:teuthology.orchestra.run.smithi019.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-04T15:42:28.308 INFO:teuthology.orchestra.run.smithi019.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-04T15:42:28.308 INFO:teuthology.orchestra.run.smithi019.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-04T15:42:28.308 INFO:teuthology.orchestra.run.smithi019.stdout: libradosstriper1-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:28.308 INFO:teuthology.orchestra.run.smithi019.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-04T15:42:28.308 INFO:teuthology.orchestra.run.smithi019.stdout: librgw2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:28.308 INFO:teuthology.orchestra.run.smithi019.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-04T15:42:28.309 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-04T15:42:28.309 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-04T15:42:28.309 INFO:teuthology.orchestra.run.smithi019.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-04T15:42:28.309 INFO:teuthology.orchestra.run.smithi019.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-04T15:42:28.309 INFO:teuthology.orchestra.run.smithi019.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-04T15:42:28.310 INFO:teuthology.orchestra.run.smithi019.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-04T15:42:28.310 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-04T15:42:28.310 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-argparse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:28.310 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-common-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:28.310 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cephfs-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:28.311 INFO:teuthology.orchestra.run.smithi019.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-04T15:42:28.311 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-04T15:42:28.311 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-04T15:42:28.311 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-04T15:42:28.311 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-04T15:42:28.311 INFO:teuthology.orchestra.run.smithi019.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-04T15:42:28.312 INFO:teuthology.orchestra.run.smithi019.stdout: python3-google-auth-1:2.23.3-1.el9.noarch 2023-11-04T15:42:28.312 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-04T15:42:28.312 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-04T15:42:28.312 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-04T15:42:28.312 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-04T15:42:28.313 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-04T15:42:28.313 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-04T15:42:28.313 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-04T15:42:28.313 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-04T15:42:28.313 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-04T15:42:28.314 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-04T15:42:28.314 INFO:teuthology.orchestra.run.smithi019.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-04T15:42:28.314 INFO:teuthology.orchestra.run.smithi019.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-04T15:42:28.314 INFO:teuthology.orchestra.run.smithi019.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-04T15:42:28.314 INFO:teuthology.orchestra.run.smithi019.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-04T15:42:28.315 INFO:teuthology.orchestra.run.smithi019.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-04T15:42:28.315 INFO:teuthology.orchestra.run.smithi019.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-04T15:42:28.315 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-04T15:42:28.315 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-04T15:42:28.315 INFO:teuthology.orchestra.run.smithi019.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-04T15:42:28.316 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-04T15:42:28.316 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ply-3.11-14.el9.noarch 2023-11-04T15:42:28.316 INFO:teuthology.orchestra.run.smithi019.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-04T15:42:28.316 INFO:teuthology.orchestra.run.smithi019.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-04T15:42:28.316 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-04T15:42:28.317 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-04T15:42:28.317 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-04T15:42:28.317 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-04T15:42:28.317 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-04T15:42:28.317 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rados-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:28.318 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:28.318 INFO:teuthology.orchestra.run.smithi019.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-04T15:42:28.318 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-04T15:42:28.318 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rgw-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:28.318 INFO:teuthology.orchestra.run.smithi019.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-04T15:42:28.318 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-04T15:42:28.319 INFO:teuthology.orchestra.run.smithi019.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-04T15:42:28.319 INFO:teuthology.orchestra.run.smithi019.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-04T15:42:28.319 INFO:teuthology.orchestra.run.smithi019.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-04T15:42:28.319 INFO:teuthology.orchestra.run.smithi019.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-04T15:42:28.319 INFO:teuthology.orchestra.run.smithi019.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-04T15:42:28.320 INFO:teuthology.orchestra.run.smithi019.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-04T15:42:28.320 INFO:teuthology.orchestra.run.smithi019.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-04T15:42:28.320 INFO:teuthology.orchestra.run.smithi019.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-04T15:42:28.320 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-mirror-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:28.320 INFO:teuthology.orchestra.run.smithi019.stdout: re2-1:20211101-3.el9.x86_64 2023-11-04T15:42:28.321 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:28.321 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:42:28.902 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/1 2023-11-04T15:42:28.938 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/1 2023-11-04T15:42:28.965 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:42:28.966 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:42:28.966 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2023-11-04T15:42:28.966 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:42:28.966 INFO:teuthology.orchestra.run.smithi019.stdout:Removing: 2023-11-04T15:42:28.966 INFO:teuthology.orchestra.run.smithi019.stdout: cephadm noarch 2:18.2.0-1181.gf7e9f9af.el9 @ceph-noarch 213 k 2023-11-04T15:42:28.967 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:28.967 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2023-11-04T15:42:28.967 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:42:28.967 INFO:teuthology.orchestra.run.smithi019.stdout:Remove 1 Package 2023-11-04T15:42:28.967 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:28.968 INFO:teuthology.orchestra.run.smithi019.stdout:Freed space: 213 k 2023-11-04T15:42:28.968 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2023-11-04T15:42:28.969 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2023-11-04T15:42:28.969 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2023-11-04T15:42:28.970 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2023-11-04T15:42:28.970 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2023-11-04T15:42:29.021 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2023-11-04T15:42:29.021 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/1 2023-11-04T15:42:29.148 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/1 2023-11-04T15:42:29.149 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:29.149 INFO:teuthology.orchestra.run.smithi096.stdout:Removed: 2023-11-04T15:42:29.149 INFO:teuthology.orchestra.run.smithi096.stdout: cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:42:29.149 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:29.149 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:42:29.190 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/1 2023-11-04T15:42:29.190 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:29.191 INFO:teuthology.orchestra.run.smithi130.stdout:Removed: 2023-11-04T15:42:29.191 INFO:teuthology.orchestra.run.smithi130.stdout: cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:42:29.191 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:29.191 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:42:29.647 INFO:teuthology.orchestra.run.smithi096.stdout:No match for argument: ceph-immutable-object-cache 2023-11-04T15:42:29.647 INFO:teuthology.orchestra.run.smithi096.stderr:No packages marked for removal. 2023-11-04T15:42:29.652 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:42:29.653 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2023-11-04T15:42:29.653 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:42:29.698 INFO:teuthology.orchestra.run.smithi130.stdout:No match for argument: ceph-immutable-object-cache 2023-11-04T15:42:29.699 INFO:teuthology.orchestra.run.smithi130.stderr:No packages marked for removal. 2023-11-04T15:42:29.703 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:42:29.705 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2023-11-04T15:42:29.705 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:42:29.839 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/1 2023-11-04T15:42:30.035 INFO:teuthology.orchestra.run.smithi096.stdout:No match for argument: ceph-mgr 2023-11-04T15:42:30.036 INFO:teuthology.orchestra.run.smithi096.stderr:No packages marked for removal. 2023-11-04T15:42:30.041 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:42:30.042 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2023-11-04T15:42:30.042 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:42:30.085 INFO:teuthology.orchestra.run.smithi130.stdout:No match for argument: ceph-mgr 2023-11-04T15:42:30.086 INFO:teuthology.orchestra.run.smithi130.stderr:No packages marked for removal. 2023-11-04T15:42:30.090 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 1/1 2023-11-04T15:42:30.091 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:30.091 INFO:teuthology.orchestra.run.smithi019.stdout:Removed: 2023-11-04T15:42:30.091 INFO:teuthology.orchestra.run.smithi019.stdout: cephadm-2:18.2.0-1181.gf7e9f9af.el9.noarch 2023-11-04T15:42:30.091 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:30.092 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:42:30.092 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:42:30.092 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2023-11-04T15:42:30.093 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:42:30.440 INFO:teuthology.orchestra.run.smithi096.stdout:No match for argument: ceph-mgr-dashboard 2023-11-04T15:42:30.440 INFO:teuthology.orchestra.run.smithi096.stderr:No packages marked for removal. 2023-11-04T15:42:30.445 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:42:30.446 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2023-11-04T15:42:30.446 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:42:30.478 INFO:teuthology.orchestra.run.smithi130.stdout:No match for argument: ceph-mgr-dashboard 2023-11-04T15:42:30.479 INFO:teuthology.orchestra.run.smithi130.stderr:No packages marked for removal. 2023-11-04T15:42:30.484 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:42:30.485 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2023-11-04T15:42:30.485 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:42:30.621 INFO:teuthology.orchestra.run.smithi019.stdout:No match for argument: ceph-immutable-object-cache 2023-11-04T15:42:30.621 INFO:teuthology.orchestra.run.smithi019.stderr:No packages marked for removal. 2023-11-04T15:42:30.626 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:42:30.627 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do. 2023-11-04T15:42:30.628 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:42:30.810 INFO:teuthology.orchestra.run.smithi096.stdout:No match for argument: ceph-mgr-diskprediction-local 2023-11-04T15:42:30.810 INFO:teuthology.orchestra.run.smithi096.stderr:No packages marked for removal. 2023-11-04T15:42:30.815 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:42:30.816 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2023-11-04T15:42:30.817 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:42:30.848 INFO:teuthology.orchestra.run.smithi130.stdout:No match for argument: ceph-mgr-diskprediction-local 2023-11-04T15:42:30.849 INFO:teuthology.orchestra.run.smithi130.stderr:No packages marked for removal. 2023-11-04T15:42:30.853 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:42:30.855 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2023-11-04T15:42:30.855 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:42:31.020 INFO:teuthology.orchestra.run.smithi019.stdout:No match for argument: ceph-mgr 2023-11-04T15:42:31.021 INFO:teuthology.orchestra.run.smithi019.stderr:No packages marked for removal. 2023-11-04T15:42:31.026 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:42:31.027 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do. 2023-11-04T15:42:31.028 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:42:31.181 INFO:teuthology.orchestra.run.smithi096.stdout:No match for argument: ceph-mgr-rook 2023-11-04T15:42:31.181 INFO:teuthology.orchestra.run.smithi096.stderr:No packages marked for removal. 2023-11-04T15:42:31.186 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:42:31.187 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2023-11-04T15:42:31.188 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:42:31.219 INFO:teuthology.orchestra.run.smithi130.stdout:No match for argument: ceph-mgr-rook 2023-11-04T15:42:31.220 INFO:teuthology.orchestra.run.smithi130.stderr:No packages marked for removal. 2023-11-04T15:42:31.224 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:42:31.226 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2023-11-04T15:42:31.226 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:42:31.415 INFO:teuthology.orchestra.run.smithi019.stdout:No match for argument: ceph-mgr-dashboard 2023-11-04T15:42:31.416 INFO:teuthology.orchestra.run.smithi019.stderr:No packages marked for removal. 2023-11-04T15:42:31.421 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:42:31.422 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do. 2023-11-04T15:42:31.422 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:42:31.553 INFO:teuthology.orchestra.run.smithi096.stdout:No match for argument: ceph-mgr-cephadm 2023-11-04T15:42:31.554 INFO:teuthology.orchestra.run.smithi096.stderr:No packages marked for removal. 2023-11-04T15:42:31.559 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:42:31.560 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2023-11-04T15:42:31.560 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:42:31.593 INFO:teuthology.orchestra.run.smithi130.stdout:No match for argument: ceph-mgr-cephadm 2023-11-04T15:42:31.593 INFO:teuthology.orchestra.run.smithi130.stderr:No packages marked for removal. 2023-11-04T15:42:31.598 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:42:31.600 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2023-11-04T15:42:31.600 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:42:31.811 INFO:teuthology.orchestra.run.smithi019.stdout:No match for argument: ceph-mgr-diskprediction-local 2023-11-04T15:42:31.811 INFO:teuthology.orchestra.run.smithi019.stderr:No packages marked for removal. 2023-11-04T15:42:31.816 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:42:31.817 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do. 2023-11-04T15:42:31.818 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:42:31.964 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:42:31.965 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:42:31.965 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2023-11-04T15:42:31.966 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:42:31.966 INFO:teuthology.orchestra.run.smithi096.stdout:Removing: 2023-11-04T15:42:31.966 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-fuse x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 2.5 M 2023-11-04T15:42:31.966 INFO:teuthology.orchestra.run.smithi096.stdout:Removing unused dependencies: 2023-11-04T15:42:31.966 INFO:teuthology.orchestra.run.smithi096.stdout: fuse x86_64 2.9.9-15.el9 @CentOS-BaseOS 215 k 2023-11-04T15:42:31.967 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:31.967 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2023-11-04T15:42:31.967 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:42:31.967 INFO:teuthology.orchestra.run.smithi096.stdout:Remove 2 Packages 2023-11-04T15:42:31.967 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:31.968 INFO:teuthology.orchestra.run.smithi096.stdout:Freed space: 2.7 M 2023-11-04T15:42:31.968 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2023-11-04T15:42:31.968 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2023-11-04T15:42:31.969 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2023-11-04T15:42:31.998 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:42:31.999 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:42:31.999 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2023-11-04T15:42:31.999 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:42:32.000 INFO:teuthology.orchestra.run.smithi130.stdout:Removing: 2023-11-04T15:42:32.000 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-fuse x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 2.5 M 2023-11-04T15:42:32.000 INFO:teuthology.orchestra.run.smithi130.stdout:Removing unused dependencies: 2023-11-04T15:42:32.000 INFO:teuthology.orchestra.run.smithi130.stdout: fuse x86_64 2.9.9-15.el9 @CentOS-BaseOS 215 k 2023-11-04T15:42:32.000 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:32.001 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-11-04T15:42:32.001 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:42:32.001 INFO:teuthology.orchestra.run.smithi130.stdout:Remove 2 Packages 2023-11-04T15:42:32.001 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:32.001 INFO:teuthology.orchestra.run.smithi130.stdout:Freed space: 2.7 M 2023-11-04T15:42:32.002 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-11-04T15:42:32.002 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2023-11-04T15:42:32.003 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2023-11-04T15:42:32.003 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-11-04T15:42:32.003 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-11-04T15:42:32.034 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-11-04T15:42:32.035 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-11-04T15:42:32.094 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2023-11-04T15:42:32.135 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-11-04T15:42:32.166 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : ceph-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/2 2023-11-04T15:42:32.197 INFO:teuthology.orchestra.run.smithi019.stdout:No match for argument: ceph-mgr-rook 2023-11-04T15:42:32.197 INFO:teuthology.orchestra.run.smithi019.stderr:No packages marked for removal. 2023-11-04T15:42:32.202 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:42:32.203 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do. 2023-11-04T15:42:32.203 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:42:32.220 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : fuse-2.9.9-15.el9.x86_64 2/2 2023-11-04T15:42:32.224 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : ceph-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/2 2023-11-04T15:42:32.279 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : fuse-2.9.9-15.el9.x86_64 2/2 2023-11-04T15:42:32.582 INFO:teuthology.orchestra.run.smithi019.stdout:No match for argument: ceph-mgr-cephadm 2023-11-04T15:42:32.583 INFO:teuthology.orchestra.run.smithi019.stderr:No packages marked for removal. 2023-11-04T15:42:32.586 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: fuse-2.9.9-15.el9.x86_64 2/2 2023-11-04T15:42:32.586 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/2 2023-11-04T15:42:32.588 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:42:32.589 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do. 2023-11-04T15:42:32.589 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:42:32.666 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: fuse-2.9.9-15.el9.x86_64 2/2 2023-11-04T15:42:32.667 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/2 2023-11-04T15:42:32.849 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2023-11-04T15:42:32.849 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:32.849 INFO:teuthology.orchestra.run.smithi096.stdout:Removed: 2023-11-04T15:42:32.850 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2023-11-04T15:42:32.850 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:32.850 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:42:32.950 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2023-11-04T15:42:32.950 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:32.950 INFO:teuthology.orchestra.run.smithi130.stdout:Removed: 2023-11-04T15:42:32.950 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2023-11-04T15:42:32.951 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:32.951 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:42:33.012 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:42:33.013 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:42:33.013 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2023-11-04T15:42:33.013 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:42:33.013 INFO:teuthology.orchestra.run.smithi019.stdout:Removing: 2023-11-04T15:42:33.013 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-fuse x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 2.5 M 2023-11-04T15:42:33.014 INFO:teuthology.orchestra.run.smithi019.stdout:Removing unused dependencies: 2023-11-04T15:42:33.014 INFO:teuthology.orchestra.run.smithi019.stdout: fuse x86_64 2.9.9-15.el9 @CentOS-BaseOS 215 k 2023-11-04T15:42:33.014 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:33.014 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2023-11-04T15:42:33.015 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:42:33.015 INFO:teuthology.orchestra.run.smithi019.stdout:Remove 2 Packages 2023-11-04T15:42:33.015 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:33.015 INFO:teuthology.orchestra.run.smithi019.stdout:Freed space: 2.7 M 2023-11-04T15:42:33.015 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2023-11-04T15:42:33.016 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2023-11-04T15:42:33.016 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2023-11-04T15:42:33.051 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2023-11-04T15:42:33.052 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2023-11-04T15:42:33.148 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2023-11-04T15:42:33.228 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : ceph-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/2 2023-11-04T15:42:33.284 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : fuse-2.9.9-15.el9.x86_64 2/2 2023-11-04T15:42:33.404 INFO:teuthology.orchestra.run.smithi096.stdout:No match for argument: ceph-volume 2023-11-04T15:42:33.404 INFO:teuthology.orchestra.run.smithi096.stderr:No packages marked for removal. 2023-11-04T15:42:33.409 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:42:33.410 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2023-11-04T15:42:33.410 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:42:33.482 INFO:teuthology.orchestra.run.smithi130.stdout:No match for argument: ceph-volume 2023-11-04T15:42:33.483 INFO:teuthology.orchestra.run.smithi130.stderr:No packages marked for removal. 2023-11-04T15:42:33.487 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:42:33.488 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2023-11-04T15:42:33.489 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:42:33.637 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: fuse-2.9.9-15.el9.x86_64 2/2 2023-11-04T15:42:33.637 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/2 2023-11-04T15:42:33.822 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:42:33.823 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:42:33.824 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repo Size 2023-11-04T15:42:33.824 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:42:33.824 INFO:teuthology.orchestra.run.smithi096.stdout:Removing: 2023-11-04T15:42:33.824 INFO:teuthology.orchestra.run.smithi096.stdout: librados-devel x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 456 k 2023-11-04T15:42:33.825 INFO:teuthology.orchestra.run.smithi096.stdout:Removing dependent packages: 2023-11-04T15:42:33.825 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs-devel x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 139 k 2023-11-04T15:42:33.825 INFO:teuthology.orchestra.run.smithi096.stdout:Removing unused dependencies: 2023-11-04T15:42:33.825 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs2 x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 1.9 M 2023-11-04T15:42:33.825 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:33.826 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2023-11-04T15:42:33.826 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:42:33.826 INFO:teuthology.orchestra.run.smithi096.stdout:Remove 3 Packages 2023-11-04T15:42:33.826 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:33.827 INFO:teuthology.orchestra.run.smithi096.stdout:Freed space: 2.4 M 2023-11-04T15:42:33.827 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2023-11-04T15:42:33.829 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2023-11-04T15:42:33.829 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2023-11-04T15:42:33.857 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2023-11-04T15:42:33.857 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2023-11-04T15:42:33.899 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2023-11-04T15:42:33.900 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:33.900 INFO:teuthology.orchestra.run.smithi019.stdout:Removed: 2023-11-04T15:42:33.900 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2023-11-04T15:42:33.900 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:33.901 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:42:33.911 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:42:33.912 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:42:33.912 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repo Size 2023-11-04T15:42:33.912 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:42:33.912 INFO:teuthology.orchestra.run.smithi130.stdout:Removing: 2023-11-04T15:42:33.913 INFO:teuthology.orchestra.run.smithi130.stdout: librados-devel x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 456 k 2023-11-04T15:42:33.913 INFO:teuthology.orchestra.run.smithi130.stdout:Removing dependent packages: 2023-11-04T15:42:33.913 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs-devel x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 139 k 2023-11-04T15:42:33.913 INFO:teuthology.orchestra.run.smithi130.stdout:Removing unused dependencies: 2023-11-04T15:42:33.913 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs2 x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 1.9 M 2023-11-04T15:42:33.914 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:33.914 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-11-04T15:42:33.914 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:42:33.914 INFO:teuthology.orchestra.run.smithi130.stdout:Remove 3 Packages 2023-11-04T15:42:33.915 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:33.915 INFO:teuthology.orchestra.run.smithi130.stdout:Freed space: 2.4 M 2023-11-04T15:42:33.915 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-11-04T15:42:33.916 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-11-04T15:42:33.916 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-11-04T15:42:33.945 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-11-04T15:42:33.945 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-11-04T15:42:33.966 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2023-11-04T15:42:34.019 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : libcephfs-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/3 2023-11-04T15:42:34.019 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : libcephfs2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/3 2023-11-04T15:42:34.055 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-11-04T15:42:34.111 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : libcephfs-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/3 2023-11-04T15:42:34.111 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : libcephfs2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/3 2023-11-04T15:42:34.112 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libcephfs2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/3 2023-11-04T15:42:34.166 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : librados-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 3/3 2023-11-04T15:42:34.195 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libcephfs2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/3 2023-11-04T15:42:34.259 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : librados-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 3/3 2023-11-04T15:42:34.479 INFO:teuthology.orchestra.run.smithi019.stdout:No match for argument: ceph-volume 2023-11-04T15:42:34.480 INFO:teuthology.orchestra.run.smithi019.stderr:No packages marked for removal. 2023-11-04T15:42:34.485 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:42:34.486 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do. 2023-11-04T15:42:34.487 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:42:34.531 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librados-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 3/3 2023-11-04T15:42:34.531 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libcephfs-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/3 2023-11-04T15:42:34.531 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libcephfs2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/3 2023-11-04T15:42:34.656 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librados-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 3/3 2023-11-04T15:42:34.656 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephfs-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/3 2023-11-04T15:42:34.656 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephfs2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/3 2023-11-04T15:42:34.781 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librados-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 3/3 2023-11-04T15:42:34.781 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:34.782 INFO:teuthology.orchestra.run.smithi096.stdout:Removed: 2023-11-04T15:42:34.782 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:34.782 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:34.782 INFO:teuthology.orchestra.run.smithi096.stdout: librados-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:34.783 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:34.783 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:42:34.920 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:42:34.921 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:42:34.921 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repo Size 2023-11-04T15:42:34.921 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:42:34.922 INFO:teuthology.orchestra.run.smithi019.stdout:Removing: 2023-11-04T15:42:34.922 INFO:teuthology.orchestra.run.smithi019.stdout: librados-devel x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 456 k 2023-11-04T15:42:34.922 INFO:teuthology.orchestra.run.smithi019.stdout:Removing dependent packages: 2023-11-04T15:42:34.922 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs-devel x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 139 k 2023-11-04T15:42:34.923 INFO:teuthology.orchestra.run.smithi019.stdout:Removing unused dependencies: 2023-11-04T15:42:34.923 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs2 x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 1.9 M 2023-11-04T15:42:34.923 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:34.923 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2023-11-04T15:42:34.923 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:42:34.924 INFO:teuthology.orchestra.run.smithi019.stdout:Remove 3 Packages 2023-11-04T15:42:34.924 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:34.924 INFO:teuthology.orchestra.run.smithi019.stdout:Freed space: 2.4 M 2023-11-04T15:42:34.924 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2023-11-04T15:42:34.925 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2023-11-04T15:42:34.925 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2023-11-04T15:42:34.948 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 3/3 2023-11-04T15:42:34.949 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:34.949 INFO:teuthology.orchestra.run.smithi130.stdout:Removed: 2023-11-04T15:42:34.949 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:34.949 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:34.949 INFO:teuthology.orchestra.run.smithi130.stdout: librados-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:34.950 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:34.950 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:42:34.956 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2023-11-04T15:42:34.956 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2023-11-04T15:42:35.060 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2023-11-04T15:42:35.123 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : libcephfs-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/3 2023-11-04T15:42:35.123 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : libcephfs2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/3 2023-11-04T15:42:35.208 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libcephfs2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/3 2023-11-04T15:42:35.264 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : librados-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 3/3 2023-11-04T15:42:35.349 INFO:teuthology.orchestra.run.smithi096.stdout:No match for argument: libcephfs2 2023-11-04T15:42:35.350 INFO:teuthology.orchestra.run.smithi096.stderr:No packages marked for removal. 2023-11-04T15:42:35.354 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:42:35.356 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2023-11-04T15:42:35.356 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:42:35.521 INFO:teuthology.orchestra.run.smithi130.stdout:No match for argument: libcephfs2 2023-11-04T15:42:35.522 INFO:teuthology.orchestra.run.smithi130.stderr:No packages marked for removal. 2023-11-04T15:42:35.527 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:42:35.528 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2023-11-04T15:42:35.528 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:42:35.628 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librados-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 3/3 2023-11-04T15:42:35.628 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephfs-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/3 2023-11-04T15:42:35.628 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephfs2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/3 2023-11-04T15:42:35.739 INFO:teuthology.orchestra.run.smithi096.stdout:No match for argument: libcephfs-devel 2023-11-04T15:42:35.740 INFO:teuthology.orchestra.run.smithi096.stderr:No packages marked for removal. 2023-11-04T15:42:35.745 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:42:35.746 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2023-11-04T15:42:35.746 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:42:35.888 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 3/3 2023-11-04T15:42:35.888 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:35.888 INFO:teuthology.orchestra.run.smithi019.stdout:Removed: 2023-11-04T15:42:35.889 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:35.889 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:35.889 INFO:teuthology.orchestra.run.smithi019.stdout: librados-devel-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:35.889 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:35.890 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:42:35.918 INFO:teuthology.orchestra.run.smithi130.stdout:No match for argument: libcephfs-devel 2023-11-04T15:42:35.919 INFO:teuthology.orchestra.run.smithi130.stderr:No packages marked for removal. 2023-11-04T15:42:35.923 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:42:35.924 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2023-11-04T15:42:35.926 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:42:36.158 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:42:36.160 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:42:36.160 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2023-11-04T15:42:36.161 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:42:36.161 INFO:teuthology.orchestra.run.smithi096.stdout:Removing: 2023-11-04T15:42:36.161 INFO:teuthology.orchestra.run.smithi096.stdout: librados2 x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 12 M 2023-11-04T15:42:36.161 INFO:teuthology.orchestra.run.smithi096.stdout:Removing dependent packages: 2023-11-04T15:42:36.161 INFO:teuthology.orchestra.run.smithi096.stdout: qemu-kvm-block-rbd x86_64 17:8.1.0-3.el9 @CentOS-AppStream 41 k 2023-11-04T15:42:36.161 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-fuse x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 231 k 2023-11-04T15:42:36.162 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-nbd x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 494 k 2023-11-04T15:42:36.162 INFO:teuthology.orchestra.run.smithi096.stdout:Removing unused dependencies: 2023-11-04T15:42:36.162 INFO:teuthology.orchestra.run.smithi096.stdout: libpmemobj x86_64 1.12.1-1.el9 @CentOS-AppStream 383 k 2023-11-04T15:42:36.162 INFO:teuthology.orchestra.run.smithi096.stdout: librbd1 x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 12 M 2023-11-04T15:42:36.162 INFO:teuthology.orchestra.run.smithi096.stdout: lttng-ust x86_64 2.12.0-6.el9 @CentOS-AppStream 1.0 M 2023-11-04T15:42:36.163 INFO:teuthology.orchestra.run.smithi096.stdout: thrift x86_64 0.15.0-2.el9 @epel 4.8 M 2023-11-04T15:42:36.163 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:36.163 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2023-11-04T15:42:36.163 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-11-04T15:42:36.163 INFO:teuthology.orchestra.run.smithi096.stdout:Remove 8 Packages 2023-11-04T15:42:36.164 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:36.164 INFO:teuthology.orchestra.run.smithi096.stdout:Freed space: 31 M 2023-11-04T15:42:36.164 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2023-11-04T15:42:36.165 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2023-11-04T15:42:36.165 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2023-11-04T15:42:36.200 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2023-11-04T15:42:36.201 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2023-11-04T15:42:36.325 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:42:36.327 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:42:36.327 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2023-11-04T15:42:36.327 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:42:36.327 INFO:teuthology.orchestra.run.smithi130.stdout:Removing: 2023-11-04T15:42:36.327 INFO:teuthology.orchestra.run.smithi130.stdout: librados2 x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 12 M 2023-11-04T15:42:36.328 INFO:teuthology.orchestra.run.smithi130.stdout:Removing dependent packages: 2023-11-04T15:42:36.328 INFO:teuthology.orchestra.run.smithi130.stdout: qemu-kvm-block-rbd x86_64 17:8.1.0-3.el9 @CentOS-AppStream 41 k 2023-11-04T15:42:36.328 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-fuse x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 231 k 2023-11-04T15:42:36.328 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-nbd x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 494 k 2023-11-04T15:42:36.328 INFO:teuthology.orchestra.run.smithi130.stdout:Removing unused dependencies: 2023-11-04T15:42:36.328 INFO:teuthology.orchestra.run.smithi130.stdout: libpmemobj x86_64 1.12.1-1.el9 @CentOS-AppStream 383 k 2023-11-04T15:42:36.329 INFO:teuthology.orchestra.run.smithi130.stdout: librbd1 x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 12 M 2023-11-04T15:42:36.329 INFO:teuthology.orchestra.run.smithi130.stdout: lttng-ust x86_64 2.12.0-6.el9 @CentOS-AppStream 1.0 M 2023-11-04T15:42:36.329 INFO:teuthology.orchestra.run.smithi130.stdout: thrift x86_64 0.15.0-2.el9 @epel 4.8 M 2023-11-04T15:42:36.329 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:36.329 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-11-04T15:42:36.330 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-11-04T15:42:36.330 INFO:teuthology.orchestra.run.smithi130.stdout:Remove 8 Packages 2023-11-04T15:42:36.330 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:36.330 INFO:teuthology.orchestra.run.smithi130.stdout:Freed space: 31 M 2023-11-04T15:42:36.330 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-11-04T15:42:36.331 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-11-04T15:42:36.331 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-11-04T15:42:36.356 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2023-11-04T15:42:36.366 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-11-04T15:42:36.367 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-11-04T15:42:36.414 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : rbd-nbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/8 2023-11-04T15:42:36.414 INFO:teuthology.orchestra.run.smithi019.stdout:No match for argument: libcephfs2 2023-11-04T15:42:36.415 INFO:teuthology.orchestra.run.smithi019.stderr:No packages marked for removal. 2023-11-04T15:42:36.420 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:42:36.421 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do. 2023-11-04T15:42:36.421 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:42:36.447 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : rbd-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/8 2023-11-04T15:42:36.474 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : qemu-kvm-block-rbd-17:8.1.0-3.el9.x86_64 3/8 2023-11-04T15:42:36.475 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : librbd1-2:18.2.0-1181.gf7e9f9af.el9.x86_64 4/8 2023-11-04T15:42:36.520 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-11-04T15:42:36.559 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librbd1-2:18.2.0-1181.gf7e9f9af.el9.x86_64 4/8 2023-11-04T15:42:36.560 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : librados2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 5/8 2023-11-04T15:42:36.560 INFO:teuthology.orchestra.run.smithi096.stdout:warning: file /etc/ceph: remove failed: No such file or directory 2023-11-04T15:42:36.560 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:36.607 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : rbd-nbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/8 2023-11-04T15:42:36.640 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : rbd-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/8 2023-11-04T15:42:36.644 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librados2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 5/8 2023-11-04T15:42:36.668 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : qemu-kvm-block-rbd-17:8.1.0-3.el9.x86_64 3/8 2023-11-04T15:42:36.668 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : librbd1-2:18.2.0-1181.gf7e9f9af.el9.x86_64 4/8 2023-11-04T15:42:36.678 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : lttng-ust-2.12.0-6.el9.x86_64 6/8 2023-11-04T15:42:36.702 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : thrift-0.15.0-2.el9.x86_64 7/8 2023-11-04T15:42:36.757 INFO:teuthology.orchestra.run.smithi096.stdout: Erasing : libpmemobj-1.12.1-1.el9.x86_64 8/8 2023-11-04T15:42:36.761 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librbd1-2:18.2.0-1181.gf7e9f9af.el9.x86_64 4/8 2023-11-04T15:42:36.761 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : librados2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 5/8 2023-11-04T15:42:36.762 INFO:teuthology.orchestra.run.smithi130.stdout:warning: file /etc/ceph: remove failed: No such file or directory 2023-11-04T15:42:36.762 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:36.820 INFO:teuthology.orchestra.run.smithi019.stdout:No match for argument: libcephfs-devel 2023-11-04T15:42:36.820 INFO:teuthology.orchestra.run.smithi019.stderr:No packages marked for removal. 2023-11-04T15:42:36.825 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:42:36.826 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do. 2023-11-04T15:42:36.827 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:42:36.846 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librados2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 5/8 2023-11-04T15:42:36.871 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : lttng-ust-2.12.0-6.el9.x86_64 6/8 2023-11-04T15:42:36.905 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : thrift-0.15.0-2.el9.x86_64 7/8 2023-11-04T15:42:36.960 INFO:teuthology.orchestra.run.smithi130.stdout: Erasing : libpmemobj-1.12.1-1.el9.x86_64 8/8 2023-11-04T15:42:37.211 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libpmemobj-1.12.1-1.el9.x86_64 8/8 2023-11-04T15:42:37.212 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 1/8 2023-11-04T15:42:37.212 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librados2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/8 2023-11-04T15:42:37.212 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librbd1-2:18.2.0-1181.gf7e9f9af.el9.x86_64 3/8 2023-11-04T15:42:37.213 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 4/8 2023-11-04T15:42:37.213 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : qemu-kvm-block-rbd-17:8.1.0-3.el9.x86_64 5/8 2023-11-04T15:42:37.213 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : rbd-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 6/8 2023-11-04T15:42:37.213 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : rbd-nbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 7/8 2023-11-04T15:42:37.256 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:42:37.259 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:42:37.259 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2023-11-04T15:42:37.259 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:42:37.259 INFO:teuthology.orchestra.run.smithi019.stdout:Removing: 2023-11-04T15:42:37.259 INFO:teuthology.orchestra.run.smithi019.stdout: librados2 x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 12 M 2023-11-04T15:42:37.260 INFO:teuthology.orchestra.run.smithi019.stdout:Removing dependent packages: 2023-11-04T15:42:37.260 INFO:teuthology.orchestra.run.smithi019.stdout: qemu-kvm-block-rbd x86_64 17:8.1.0-3.el9 @CentOS-AppStream 41 k 2023-11-04T15:42:37.260 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-fuse x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 231 k 2023-11-04T15:42:37.260 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-nbd x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 494 k 2023-11-04T15:42:37.260 INFO:teuthology.orchestra.run.smithi019.stdout:Removing unused dependencies: 2023-11-04T15:42:37.260 INFO:teuthology.orchestra.run.smithi019.stdout: libpmemobj x86_64 1.12.1-1.el9 @CentOS-AppStream 383 k 2023-11-04T15:42:37.261 INFO:teuthology.orchestra.run.smithi019.stdout: librbd1 x86_64 2:18.2.0-1181.gf7e9f9af.el9 @ceph 12 M 2023-11-04T15:42:37.261 INFO:teuthology.orchestra.run.smithi019.stdout: lttng-ust x86_64 2.12.0-6.el9 @CentOS-AppStream 1.0 M 2023-11-04T15:42:37.261 INFO:teuthology.orchestra.run.smithi019.stdout: thrift x86_64 0.15.0-2.el9 @epel 4.8 M 2023-11-04T15:42:37.261 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:37.261 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2023-11-04T15:42:37.261 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-11-04T15:42:37.262 INFO:teuthology.orchestra.run.smithi019.stdout:Remove 8 Packages 2023-11-04T15:42:37.262 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:37.262 INFO:teuthology.orchestra.run.smithi019.stdout:Freed space: 31 M 2023-11-04T15:42:37.262 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2023-11-04T15:42:37.263 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2023-11-04T15:42:37.264 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2023-11-04T15:42:37.302 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2023-11-04T15:42:37.303 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2023-11-04T15:42:37.477 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libpmemobj-1.12.1-1.el9.x86_64 8/8 2023-11-04T15:42:37.477 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 1/8 2023-11-04T15:42:37.477 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/8 2023-11-04T15:42:37.478 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librbd1-2:18.2.0-1181.gf7e9f9af.el9.x86_64 3/8 2023-11-04T15:42:37.478 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 4/8 2023-11-04T15:42:37.478 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : qemu-kvm-block-rbd-17:8.1.0-3.el9.x86_64 5/8 2023-11-04T15:42:37.478 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 6/8 2023-11-04T15:42:37.478 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-nbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 7/8 2023-11-04T15:42:37.479 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2023-11-04T15:42:37.531 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 8/8 2023-11-04T15:42:37.531 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:37.532 INFO:teuthology.orchestra.run.smithi096.stdout:Removed: 2023-11-04T15:42:37.532 INFO:teuthology.orchestra.run.smithi096.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-04T15:42:37.532 INFO:teuthology.orchestra.run.smithi096.stdout: librados2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:37.532 INFO:teuthology.orchestra.run.smithi096.stdout: librbd1-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:37.532 INFO:teuthology.orchestra.run.smithi096.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-04T15:42:37.533 INFO:teuthology.orchestra.run.smithi096.stdout: qemu-kvm-block-rbd-17:8.1.0-3.el9.x86_64 2023-11-04T15:42:37.533 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:37.533 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-nbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:37.533 INFO:teuthology.orchestra.run.smithi096.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-04T15:42:37.533 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-11-04T15:42:37.533 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:42:37.554 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : rbd-nbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 1/8 2023-11-04T15:42:37.579 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : rbd-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/8 2023-11-04T15:42:37.607 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : qemu-kvm-block-rbd-17:8.1.0-3.el9.x86_64 3/8 2023-11-04T15:42:37.607 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : librbd1-2:18.2.0-1181.gf7e9f9af.el9.x86_64 4/8 2023-11-04T15:42:37.692 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librbd1-2:18.2.0-1181.gf7e9f9af.el9.x86_64 4/8 2023-11-04T15:42:37.693 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : librados2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 5/8 2023-11-04T15:42:37.693 INFO:teuthology.orchestra.run.smithi019.stdout:warning: file /etc/ceph: remove failed: No such file or directory 2023-11-04T15:42:37.693 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:37.777 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librados2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 5/8 2023-11-04T15:42:37.788 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 8/8 2023-11-04T15:42:37.788 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:37.789 INFO:teuthology.orchestra.run.smithi130.stdout:Removed: 2023-11-04T15:42:37.789 INFO:teuthology.orchestra.run.smithi130.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-04T15:42:37.789 INFO:teuthology.orchestra.run.smithi130.stdout: librados2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:37.789 INFO:teuthology.orchestra.run.smithi130.stdout: librbd1-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:37.789 INFO:teuthology.orchestra.run.smithi130.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-04T15:42:37.790 INFO:teuthology.orchestra.run.smithi130.stdout: qemu-kvm-block-rbd-17:8.1.0-3.el9.x86_64 2023-11-04T15:42:37.790 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:37.790 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-nbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:37.790 INFO:teuthology.orchestra.run.smithi130.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-04T15:42:37.791 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-11-04T15:42:37.791 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:42:37.810 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : lttng-ust-2.12.0-6.el9.x86_64 6/8 2023-11-04T15:42:37.844 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : thrift-0.15.0-2.el9.x86_64 7/8 2023-11-04T15:42:37.900 INFO:teuthology.orchestra.run.smithi019.stdout: Erasing : libpmemobj-1.12.1-1.el9.x86_64 8/8 2023-11-04T15:42:38.165 INFO:teuthology.orchestra.run.smithi096.stdout:No match for argument: librbd1 2023-11-04T15:42:38.165 INFO:teuthology.orchestra.run.smithi096.stderr:No packages marked for removal. 2023-11-04T15:42:38.170 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:42:38.171 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2023-11-04T15:42:38.171 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:42:38.373 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libpmemobj-1.12.1-1.el9.x86_64 8/8 2023-11-04T15:42:38.373 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 1/8 2023-11-04T15:42:38.374 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2/8 2023-11-04T15:42:38.374 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librbd1-2:18.2.0-1181.gf7e9f9af.el9.x86_64 3/8 2023-11-04T15:42:38.374 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 4/8 2023-11-04T15:42:38.374 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : qemu-kvm-block-rbd-17:8.1.0-3.el9.x86_64 5/8 2023-11-04T15:42:38.374 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 6/8 2023-11-04T15:42:38.375 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-nbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 7/8 2023-11-04T15:42:38.442 INFO:teuthology.orchestra.run.smithi130.stdout:No match for argument: librbd1 2023-11-04T15:42:38.443 INFO:teuthology.orchestra.run.smithi130.stderr:No packages marked for removal. 2023-11-04T15:42:38.448 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:42:38.449 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2023-11-04T15:42:38.449 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:42:38.548 INFO:teuthology.orchestra.run.smithi096.stdout:No match for argument: python3-rados 2023-11-04T15:42:38.549 INFO:teuthology.orchestra.run.smithi096.stderr:No packages marked for removal. 2023-11-04T15:42:38.554 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:42:38.555 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2023-11-04T15:42:38.555 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:42:38.682 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 8/8 2023-11-04T15:42:38.682 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:38.683 INFO:teuthology.orchestra.run.smithi019.stdout:Removed: 2023-11-04T15:42:38.683 INFO:teuthology.orchestra.run.smithi019.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-04T15:42:38.683 INFO:teuthology.orchestra.run.smithi019.stdout: librados2-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:38.683 INFO:teuthology.orchestra.run.smithi019.stdout: librbd1-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:38.683 INFO:teuthology.orchestra.run.smithi019.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-04T15:42:38.684 INFO:teuthology.orchestra.run.smithi019.stdout: qemu-kvm-block-rbd-17:8.1.0-3.el9.x86_64 2023-11-04T15:42:38.684 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-fuse-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:38.684 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-nbd-2:18.2.0-1181.gf7e9f9af.el9.x86_64 2023-11-04T15:42:38.684 INFO:teuthology.orchestra.run.smithi019.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-04T15:42:38.684 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-11-04T15:42:38.684 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:42:38.843 INFO:teuthology.orchestra.run.smithi130.stdout:No match for argument: python3-rados 2023-11-04T15:42:38.844 INFO:teuthology.orchestra.run.smithi130.stderr:No packages marked for removal. 2023-11-04T15:42:38.849 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:42:38.850 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2023-11-04T15:42:38.850 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:42:38.933 INFO:teuthology.orchestra.run.smithi096.stdout:No match for argument: python3-rgw 2023-11-04T15:42:38.933 INFO:teuthology.orchestra.run.smithi096.stderr:No packages marked for removal. 2023-11-04T15:42:38.938 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:42:38.939 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2023-11-04T15:42:38.939 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:42:39.234 INFO:teuthology.orchestra.run.smithi130.stdout:No match for argument: python3-rgw 2023-11-04T15:42:39.235 INFO:teuthology.orchestra.run.smithi130.stderr:No packages marked for removal. 2023-11-04T15:42:39.239 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:42:39.241 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2023-11-04T15:42:39.241 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:42:39.302 INFO:teuthology.orchestra.run.smithi096.stdout:No match for argument: python3-cephfs 2023-11-04T15:42:39.302 INFO:teuthology.orchestra.run.smithi096.stderr:No packages marked for removal. 2023-11-04T15:42:39.307 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:42:39.308 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2023-11-04T15:42:39.309 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:42:39.371 INFO:teuthology.orchestra.run.smithi019.stdout:No match for argument: librbd1 2023-11-04T15:42:39.372 INFO:teuthology.orchestra.run.smithi019.stderr:No packages marked for removal. 2023-11-04T15:42:39.377 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:42:39.379 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do. 2023-11-04T15:42:39.379 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:42:39.606 INFO:teuthology.orchestra.run.smithi130.stdout:No match for argument: python3-cephfs 2023-11-04T15:42:39.607 INFO:teuthology.orchestra.run.smithi130.stderr:No packages marked for removal. 2023-11-04T15:42:39.612 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:42:39.613 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2023-11-04T15:42:39.613 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:42:39.672 INFO:teuthology.orchestra.run.smithi096.stdout:No match for argument: python3-rbd 2023-11-04T15:42:39.673 INFO:teuthology.orchestra.run.smithi096.stderr:No packages marked for removal. 2023-11-04T15:42:39.678 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:42:39.679 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2023-11-04T15:42:39.679 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:42:39.778 INFO:teuthology.orchestra.run.smithi019.stdout:No match for argument: python3-rados 2023-11-04T15:42:39.778 INFO:teuthology.orchestra.run.smithi019.stderr:No packages marked for removal. 2023-11-04T15:42:39.783 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:42:39.784 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do. 2023-11-04T15:42:39.785 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:42:39.977 INFO:teuthology.orchestra.run.smithi130.stdout:No match for argument: python3-rbd 2023-11-04T15:42:39.978 INFO:teuthology.orchestra.run.smithi130.stderr:No packages marked for removal. 2023-11-04T15:42:39.982 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:42:39.984 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2023-11-04T15:42:39.984 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:42:40.044 INFO:teuthology.orchestra.run.smithi096.stdout:No match for argument: rbd-fuse 2023-11-04T15:42:40.044 INFO:teuthology.orchestra.run.smithi096.stderr:No packages marked for removal. 2023-11-04T15:42:40.049 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:42:40.050 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2023-11-04T15:42:40.050 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:42:40.176 INFO:teuthology.orchestra.run.smithi019.stdout:No match for argument: python3-rgw 2023-11-04T15:42:40.177 INFO:teuthology.orchestra.run.smithi019.stderr:No packages marked for removal. 2023-11-04T15:42:40.182 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:42:40.183 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do. 2023-11-04T15:42:40.183 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:42:40.354 INFO:teuthology.orchestra.run.smithi130.stdout:No match for argument: rbd-fuse 2023-11-04T15:42:40.354 INFO:teuthology.orchestra.run.smithi130.stderr:No packages marked for removal. 2023-11-04T15:42:40.359 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:42:40.360 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2023-11-04T15:42:40.360 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:42:40.417 INFO:teuthology.orchestra.run.smithi096.stdout:No match for argument: rbd-mirror 2023-11-04T15:42:40.417 INFO:teuthology.orchestra.run.smithi096.stderr:No packages marked for removal. 2023-11-04T15:42:40.422 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:42:40.424 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2023-11-04T15:42:40.424 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:42:40.566 INFO:teuthology.orchestra.run.smithi019.stdout:No match for argument: python3-cephfs 2023-11-04T15:42:40.567 INFO:teuthology.orchestra.run.smithi019.stderr:No packages marked for removal. 2023-11-04T15:42:40.572 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:42:40.573 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do. 2023-11-04T15:42:40.574 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:42:40.724 INFO:teuthology.orchestra.run.smithi130.stdout:No match for argument: rbd-mirror 2023-11-04T15:42:40.725 INFO:teuthology.orchestra.run.smithi130.stderr:No packages marked for removal. 2023-11-04T15:42:40.730 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:42:40.731 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2023-11-04T15:42:40.731 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:42:40.786 INFO:teuthology.orchestra.run.smithi096.stdout:No match for argument: rbd-nbd 2023-11-04T15:42:40.786 INFO:teuthology.orchestra.run.smithi096.stderr:No packages marked for removal. 2023-11-04T15:42:40.791 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-11-04T15:42:40.792 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2023-11-04T15:42:40.792 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-11-04T15:42:40.853 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum clean all 2023-11-04T15:42:40.954 INFO:teuthology.orchestra.run.smithi019.stdout:No match for argument: python3-rbd 2023-11-04T15:42:40.955 INFO:teuthology.orchestra.run.smithi019.stderr:No packages marked for removal. 2023-11-04T15:42:40.960 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:42:40.961 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do. 2023-11-04T15:42:40.962 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:42:41.043 INFO:teuthology.orchestra.run.smithi096.stdout:73 files removed 2023-11-04T15:42:41.071 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f /etc/yum.repos.d/ceph.repo 2023-11-04T15:42:41.097 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum clean expire-cache 2023-11-04T15:42:41.098 INFO:teuthology.orchestra.run.smithi130.stdout:No match for argument: rbd-nbd 2023-11-04T15:42:41.098 INFO:teuthology.orchestra.run.smithi130.stderr:No packages marked for removal. 2023-11-04T15:42:41.103 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-11-04T15:42:41.104 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2023-11-04T15:42:41.104 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-11-04T15:42:41.171 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum clean all 2023-11-04T15:42:41.307 INFO:teuthology.orchestra.run.smithi096.stdout:Cache was expired 2023-11-04T15:42:41.307 INFO:teuthology.orchestra.run.smithi096.stdout:0 files removed 2023-11-04T15:42:41.333 DEBUG:teuthology.parallel:result is None 2023-11-04T15:42:41.349 INFO:teuthology.orchestra.run.smithi019.stdout:No match for argument: rbd-fuse 2023-11-04T15:42:41.350 INFO:teuthology.orchestra.run.smithi019.stderr:No packages marked for removal. 2023-11-04T15:42:41.355 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:42:41.356 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do. 2023-11-04T15:42:41.357 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:42:41.359 INFO:teuthology.orchestra.run.smithi130.stdout:73 files removed 2023-11-04T15:42:41.387 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f /etc/yum.repos.d/ceph.repo 2023-11-04T15:42:41.414 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum clean expire-cache 2023-11-04T15:42:41.623 INFO:teuthology.orchestra.run.smithi130.stdout:Cache was expired 2023-11-04T15:42:41.624 INFO:teuthology.orchestra.run.smithi130.stdout:0 files removed 2023-11-04T15:42:41.650 DEBUG:teuthology.parallel:result is None 2023-11-04T15:42:41.737 INFO:teuthology.orchestra.run.smithi019.stdout:No match for argument: rbd-mirror 2023-11-04T15:42:41.737 INFO:teuthology.orchestra.run.smithi019.stderr:No packages marked for removal. 2023-11-04T15:42:41.743 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:42:41.744 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do. 2023-11-04T15:42:41.744 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:42:42.130 INFO:teuthology.orchestra.run.smithi019.stdout:No match for argument: rbd-nbd 2023-11-04T15:42:42.130 INFO:teuthology.orchestra.run.smithi019.stderr:No packages marked for removal. 2023-11-04T15:42:42.135 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-11-04T15:42:42.137 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do. 2023-11-04T15:42:42.137 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-11-04T15:42:42.194 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum clean all 2023-11-04T15:42:42.397 INFO:teuthology.orchestra.run.smithi019.stdout:73 files removed 2023-11-04T15:42:42.424 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f /etc/yum.repos.d/ceph.repo 2023-11-04T15:42:42.455 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum clean expire-cache 2023-11-04T15:42:42.676 INFO:teuthology.orchestra.run.smithi019.stdout:Cache was expired 2023-11-04T15:42:42.676 INFO:teuthology.orchestra.run.smithi019.stdout:0 files removed 2023-11-04T15:42:42.703 DEBUG:teuthology.parallel:result is None 2023-11-04T15:42:42.704 INFO:teuthology.task.install:Removing ceph sources lists on ubuntu@smithi019.front.sepia.ceph.com 2023-11-04T15:42:42.704 INFO:teuthology.task.install:Removing ceph sources lists on ubuntu@smithi096.front.sepia.ceph.com 2023-11-04T15:42:42.704 INFO:teuthology.task.install:Removing ceph sources lists on ubuntu@smithi130.front.sepia.ceph.com 2023-11-04T15:42:42.705 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f /etc/yum.repos.d/ceph.repo 2023-11-04T15:42:42.705 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f /etc/yum.repos.d/ceph.repo 2023-11-04T15:42:42.706 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f /etc/yum.repos.d/ceph.repo 2023-11-04T15:42:42.737 DEBUG:teuthology.orchestra.run.smithi019:> sudo mv -f /etc/yum/pluginconf.d/priorities.conf.orig /etc/yum/pluginconf.d/priorities.conf 2023-11-04T15:42:42.738 DEBUG:teuthology.orchestra.run.smithi096:> sudo mv -f /etc/yum/pluginconf.d/priorities.conf.orig /etc/yum/pluginconf.d/priorities.conf 2023-11-04T15:42:42.739 DEBUG:teuthology.orchestra.run.smithi130:> sudo mv -f /etc/yum/pluginconf.d/priorities.conf.orig /etc/yum/pluginconf.d/priorities.conf 2023-11-04T15:42:42.807 DEBUG:teuthology.parallel:result is None 2023-11-04T15:42:42.809 DEBUG:teuthology.parallel:result is None 2023-11-04T15:42:42.810 DEBUG:teuthology.parallel:result is None 2023-11-04T15:42:42.811 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-04T15:42:42.822 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-04T15:42:42.822 DEBUG:teuthology.orchestra.run.smithi019:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-04T15:42:42.850 DEBUG:teuthology.orchestra.run.smithi096:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-04T15:42:42.853 DEBUG:teuthology.orchestra.run.smithi130:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-04T15:42:42.862 INFO:teuthology.orchestra.run.smithi019.stderr:bash: line 1: ntpq: command not found 2023-11-04T15:42:42.866 INFO:teuthology.orchestra.run.smithi096.stderr:bash: line 1: ntpq: command not found 2023-11-04T15:42:42.867 INFO:teuthology.orchestra.run.smithi019.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-04T15:42:42.867 INFO:teuthology.orchestra.run.smithi019.stdout:=============================================================================== 2023-11-04T15:42:42.867 INFO:teuthology.orchestra.run.smithi019.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 47 +573us[ +573us] +/- 86ms 2023-11-04T15:42:42.867 INFO:teuthology.orchestra.run.smithi019.stdout:^* hv02.front.sepia.ceph.com 3 6 377 47 -811us[ -933us] +/- 50ms 2023-11-04T15:42:42.867 INFO:teuthology.orchestra.run.smithi019.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 45 +701us[ +701us] +/- 75ms 2023-11-04T15:42:42.868 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T15:42:42.868 INFO:teuthology.orchestra.run.smithi130.stderr:bash: line 1: ntpq: command not found 2023-11-04T15:42:42.870 INFO:teuthology.orchestra.run.smithi096.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-04T15:42:42.870 INFO:teuthology.orchestra.run.smithi096.stdout:=============================================================================== 2023-11-04T15:42:42.871 INFO:teuthology.orchestra.run.smithi096.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 47 +400us[ +400us] +/- 85ms 2023-11-04T15:42:42.871 INFO:teuthology.orchestra.run.smithi096.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 46 -983us[ -983us] +/- 50ms 2023-11-04T15:42:42.871 INFO:teuthology.orchestra.run.smithi096.stdout:^* hv03.front.sepia.ceph.com 3 7 377 109 +488us[ +514us] +/- 74ms 2023-11-04T15:42:42.871 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T15:42:42.873 INFO:teuthology.orchestra.run.smithi130.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-04T15:42:42.873 INFO:teuthology.orchestra.run.smithi130.stdout:=============================================================================== 2023-11-04T15:42:42.873 INFO:teuthology.orchestra.run.smithi130.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 46 +562us[ +432us] +/- 85ms 2023-11-04T15:42:42.873 INFO:teuthology.orchestra.run.smithi130.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 46 -807us[ -937us] +/- 50ms 2023-11-04T15:42:42.874 INFO:teuthology.orchestra.run.smithi130.stdout:^* hv03.front.sepia.ceph.com 3 6 377 45 +676us[ +547us] +/- 75ms 2023-11-04T15:42:42.874 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-11-04T15:42:42.874 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-04T15:42:42.886 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-04T15:42:42.887 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-04T15:42:42.901 DEBUG:teuthology.orchestra.run.smithi019:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-04T15:42:43.010 DEBUG:teuthology.orchestra.run.smithi096:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-04T15:42:43.108 DEBUG:teuthology.orchestra.run.smithi130:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-04T15:42:43.205 DEBUG:teuthology.orchestra.run.smithi019:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-04T15:42:43.241 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T15:42:43.242 DEBUG:teuthology.orchestra.run.smithi096:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-04T15:42:43.277 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T15:42:43.278 DEBUG:teuthology.orchestra.run.smithi130:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-04T15:42:43.310 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T15:42:43.311 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-04T15:42:43.321 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-04T15:42:43.335 INFO:teuthology.task.internal:Duration was 1421.148407 seconds 2023-11-04T15:42:43.336 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-04T15:42:43.350 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-04T15:42:43.351 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-04T15:42:43.353 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-04T15:42:43.355 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-04T15:42:43.398 INFO:teuthology.orchestra.run.smithi096.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-04T15:42:43.399 INFO:teuthology.orchestra.run.smithi130.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-04T15:42:43.401 INFO:teuthology.orchestra.run.smithi019.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-04T15:42:43.915 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-04T15:42:43.915 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi019.front.sepia.ceph.com 2023-11-04T15:42:43.916 DEBUG:teuthology.orchestra.run.smithi019:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-04T15:42:43.937 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi096.front.sepia.ceph.com 2023-11-04T15:42:43.938 DEBUG:teuthology.orchestra.run.smithi096:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-04T15:42:43.965 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi130.front.sepia.ceph.com 2023-11-04T15:42:43.965 DEBUG:teuthology.orchestra.run.smithi130:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-04T15:42:43.987 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-04T15:42:43.988 DEBUG:teuthology.orchestra.run.smithi019:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-04T15:42:43.990 DEBUG:teuthology.orchestra.run.smithi096:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-04T15:42:44.008 DEBUG:teuthology.orchestra.run.smithi130:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-04T15:42:44.056 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-04T15:42:44.056 DEBUG:teuthology.orchestra.run.smithi019:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-04T15:42:44.063 DEBUG:teuthology.orchestra.run.smithi096:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-04T15:42:44.078 DEBUG:teuthology.orchestra.run.smithi130:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-04T15:42:44.193 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-04T15:42:44.203 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-04T15:42:44.204 DEBUG:teuthology.orchestra.run.smithi019:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-04T15:42:44.234 DEBUG:teuthology.orchestra.run.smithi096:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-04T15:42:44.260 DEBUG:teuthology.orchestra.run.smithi130:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-04T15:42:44.286 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-04T15:42:44.299 DEBUG:teuthology.orchestra.run.smithi019:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-04T15:42:44.301 DEBUG:teuthology.orchestra.run.smithi096:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-04T15:42:44.304 DEBUG:teuthology.orchestra.run.smithi130:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-04T15:42:44.326 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern = core 2023-11-04T15:42:44.328 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern = core 2023-11-04T15:42:44.351 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern = core 2023-11-04T15:42:44.367 DEBUG:teuthology.orchestra.run.smithi019:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-04T15:42:44.406 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T15:42:44.407 DEBUG:teuthology.orchestra.run.smithi096:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-04T15:42:44.421 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T15:42:44.422 DEBUG:teuthology.orchestra.run.smithi130:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-04T15:42:44.436 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T15:42:44.436 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-04T15:42:44.446 INFO:teuthology.task.internal:Transferring archived files... 2023-11-04T15:42:44.447 DEBUG:teuthology.misc:Transferring archived files from smithi019:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-11-04_14:52:48-smoke-reef-release-distro-default-smithi/7447748/remote/smithi019 2023-11-04T15:42:44.447 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-04T15:42:44.488 DEBUG:teuthology.misc:Transferring archived files from smithi096:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-11-04_14:52:48-smoke-reef-release-distro-default-smithi/7447748/remote/smithi096 2023-11-04T15:42:44.488 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-04T15:42:44.524 DEBUG:teuthology.misc:Transferring archived files from smithi130:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-11-04_14:52:48-smoke-reef-release-distro-default-smithi/7447748/remote/smithi130 2023-11-04T15:42:44.524 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-04T15:42:44.559 INFO:teuthology.task.internal:Removing archive directory... 2023-11-04T15:42:44.559 DEBUG:teuthology.orchestra.run.smithi019:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-04T15:42:44.562 DEBUG:teuthology.orchestra.run.smithi096:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-04T15:42:44.564 DEBUG:teuthology.orchestra.run.smithi130:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-04T15:42:44.608 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-04T15:42:44.619 INFO:teuthology.task.internal:Not uploading archives. 2023-11-04T15:42:44.620 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-04T15:42:44.681 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-04T15:42:44.681 DEBUG:teuthology.orchestra.run.smithi019:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-04T15:42:44.684 DEBUG:teuthology.orchestra.run.smithi096:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-04T15:42:44.686 DEBUG:teuthology.orchestra.run.smithi130:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-04T15:42:44.696 INFO:teuthology.orchestra.run.smithi019.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 4 15:42 /home/ubuntu/cephtest 2023-11-04T15:42:44.698 INFO:teuthology.orchestra.run.smithi096.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 4 15:42 /home/ubuntu/cephtest 2023-11-04T15:42:44.700 INFO:teuthology.orchestra.run.smithi130.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 4 15:42 /home/ubuntu/cephtest 2023-11-04T15:42:44.701 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-04T15:42:44.713 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-04T15:42:44.737 INFO:teuthology.nuke:Checking targets against current locks 2023-11-04T15:42:44.766 DEBUG:teuthology.nuke:shortname: smithi019 2023-11-04T15:42:44.767 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-04T15:42:44.789 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi019.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-04_14:52:48-smoke-reef-release-distro-default-smithi/7447748', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 15:10:17.739057', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDUF6GhI9UdAVsAuoE7taXLXG9X55/PpxG0EzdDfjrGV973BZVbJQjP7zdZwIRFQ1Kc60DvJydDHIr7yoMRXOxY='} 2023-11-04T15:42:44.793 DEBUG:teuthology.nuke:shortname: smithi096 2023-11-04T15:42:44.793 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-04T15:42:44.815 DEBUG:teuthology.nuke:shortname: smithi130 2023-11-04T15:42:44.815 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-04T15:42:44.819 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi096.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-04_14:52:48-smoke-reef-release-distro-default-smithi/7447748', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 15:10:17.736686', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK5l3tDH2VVqynCSWKBpotIfAusQCpStCcRal/vwmwL8eKhohkIs8Xg0Ebt25Q8nPiv3D8BGGaNX6ki/mdyWg+s='} 2023-11-04T15:42:44.844 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi130.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-04_14:52:48-smoke-reef-release-distro-default-smithi/7447748', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 15:10:17.734917', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBUw1R0UBohkkCAXVi0fUzIBoX9wBq68kEPkBOfBr2PKB2ER0yAJSAO7f2znVl7GMLRro6CEtxtEJ3rgN7i2RLg='} 2023-11-04T15:42:44.851 INFO:teuthology.orchestra.console.smithi019:Power off 2023-11-04T15:42:44.851 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-04T15:42:44.877 DEBUG:teuthology.orchestra.console.smithi019:power off output: Chassis Power Control: Down/Off 2023-11-04T15:42:44.878 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T15:42:44.892 INFO:teuthology.orchestra.console.smithi096:Power off 2023-11-04T15:42:44.893 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-04T15:42:44.904 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on 2023-11-04T15:42:44.915 DEBUG:teuthology.orchestra.console.smithi096:power off output: Chassis Power Control: Down/Off 2023-11-04T15:42:44.916 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T15:42:44.931 INFO:teuthology.orchestra.console.smithi130:Power off 2023-11-04T15:42:44.932 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-04T15:42:44.941 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is on 2023-11-04T15:42:44.955 DEBUG:teuthology.orchestra.console.smithi130:power off output: Chassis Power Control: Down/Off 2023-11-04T15:42:44.956 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T15:42:44.976 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on 2023-11-04T15:42:48.905 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T15:42:48.942 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T15:42:48.978 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T15:42:49.016 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on 2023-11-04T15:42:49.051 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is on 2023-11-04T15:42:49.088 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on 2023-11-04T15:42:53.018 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T15:42:53.053 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T15:42:53.089 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T15:42:53.128 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off 2023-11-04T15:42:53.161 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off 2023-11-04T15:42:53.198 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is off 2023-11-04T15:42:53.230 INFO:teuthology.orchestra.console.smithi019:Power off completed 2023-11-04T15:42:53.262 INFO:teuthology.orchestra.console.smithi096:Power off completed 2023-11-04T15:42:53.299 INFO:teuthology.orchestra.console.smithi130:Power off completed 2023-11-04T15:42:53.403 INFO:teuthology.run:Summary data: description: smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap s3tests-branch supported-random-distro$/{centos_latest} tasks/{0-install test/libcephfs_interface_tests}} duration: 1421.1484072208405 failure_reason: '"2023-11-04T15:27:31.620957+0000 mon.a (mon.0) 84 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-11-04T15:42:53.404 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T15:42:53.482 INFO:teuthology.run:FAIL